If anyone is experiencing similar problems to what I described above:

Bar Solutions released a new version of the Reconnect Plugin.
This new version *does* also reconnect the browser window, so problem solved!
It also has some more reconnect types.

Thanks Patrick for solving this issue I had!

Check it out:
Bar Solutions Plugins