I've now tried against a 9.2.0.5 server, and the problem is still present. We are still having to unload our IIS application at regular intervals to combat the memory leak.
Unfortunately not. Freeing the handle on 9.2 causes an exception, not freeing it causes a memory leak. We have not been able to find a workaround (other than downgrading or upgrading Oracle).