HG Wells wears an Order of the Eastern Star ring.
The helicopter that Artie and Myka ride to Yellowstone is labeled "IRS". The Warehouse's cover story for the people of Univlle is that they are IRS agents storing all tax returns for the US.
Pete's reference to the resurrection of Mickey Rourke is probably in reference to his boxing career. He boxed between 1964 and 1971, retired on advice of his physician due to a concussion in his last fight then came back to boxing in 1991 which resulted in such severe injuries that he had to have facial reconstructive surgery afterwards.
The music track while Myka is leaving is "Vanderlyle Crybaby Geeks" by The National.
Pete's first guess as to the origin of the artifact causing Kelly to attack him is Lorena Bobbitt. Lorena (Gallo) Bobbitt famously used a kitchen knife to slice the penis off of her abusive husband in her home on the night of June 23, 1993. The trials (her for assault, him for rape) and surrounding media circus sparked a nationwide discussion about abuse, rape within marriage (and whether such a thing was rape and legally punishable), and taking the law into one's own hands for revenge or justice that resulted in, among other things, laws in various states criminalizing what came to be known as "marital rape." Both were acquitted in their respective trials (although he wouldn't be under the laws later passed). His penis was surgically reattached and then later enlarged, and he starred in two pornographic films centering on his celebrity gained from the media attention; she started a foundation for domestic abuse victims and their children. The press at the time depicted Mrs. Bobbitt as a deranged, man-hating woman who attacked her husband for unknowable reasons and later made up abuse accusations to justify her assault and that depiction has unfortunately persisted, thus Pete's guess that his girlfriend attacking him with a knife was related to that unfortunate incident.