So since IUP does not know about your dialog, you have to disable
it yourself before showing the IUP dialogs. Simply do:
EnableWindow(hWnd,FALSE);
IupPopup(...
EnableWindow(hWnd,TRUE);
Unfortunately "EnableWindow" is winapi function, so you should write your own dll or ask the plugin's...