I once had to divert back to Newark airport after flying for nearly 3 hours since my destination St. Johns and all possible alternates went below approach minimums several hours earlier than forecast. This can happen when they're all coastal fog magnets. It was the best plan dispatch could come up with, it being an International flight late at night. So the FO went to the back to use the lav and the sole flight attendant came to the cockpit to babysit me for signs of insanity, as was the rule. The FO was a political type and he chatted for a long time with the angry folks in back, unbeknownst to me. This being a 3 crew airplane having no phone in the lav, I suspected I couldn't call him to ask him why his shit was taking so long. I also couldn't send the FA to the back since her being with me was the rule. She couldn't see very much through the peep hole either because it was dark in the cabin. I started thinking about what kind of PAs I could make to either get the FOs attention or get him help. Well finally I called the back anyway, expecting no one to answer, yet the FO picked up. I asked him if everything was okay and he said it was, just that since not much was going on and people had questions he was taking the time to answer them. Not his job but whatever. What's a few more minutes? We were still an hour from Bangor, our fuel stop, and there's not much going on over Prince Edward Island at midnight. We got back to Newark and a lot of the folks stayed at the same hotel as us. The next morning we tried the flight again, this time with better weather and heat from the sun to keep the fog away. In the hotel lobby I had several different groups of folks ask us what me and the flight attendant were doing up there in the cockpit the whole time. A bunch of old women kept looking at me and laughing and smiling and whispering. Apparently it was common knowledge that the flight attendant and I had joined the mile high club while the FO was back there covering for her. Is this what you people think?