This still occured in the new Version 15.0.0.2050 (64 bit). But after going through the preferences I found an option, that triggers the behavior. If you set User Interface > Options > Autosave desktop to "off", PL/SQL Developer is displayed in the taskbar as expected after start. If you set it to "on", the behavior is faulty again.
