The incident in which Lord Palmerston entered the supposedly wrong room in an attempt to commit adultery happened at Windsor Castle, not Osborne House. It did not involve the Duchess of Monmouth, who did not exist; it was an attempt to assault a lady in waiting, Susan Brand, who successfully screamed for help.
Queen Victoria did not have a near-drowning incident when swimming, nor did she say she was not a fish.