Thanks Theod - That option was actually set to "disabled", but it only seems to work if you explicitly save the file:
"Before PL/SQL Developer saves a file, the original file will be saved to a backup file before overwriting it. "
I did notice that I had the "Recovery" option on the same tab...