On the face of it, given a choice at a party, I would probably tend to try and talk to as many female attendees as I could, if they were sufficiently interesting - and they tend not to be very interested in military history. I save those conversations for the internet.
Come to think of it, though, most males have little interest in military history these days either, so it's not something that comes up and nothing I really enjoy talking to uninitiates about. I spent the last party I went to - a friend's birthday party at a pub downtown IIRC - talking to some of his coworkers, mostly about the upcoming civic election, my trip to Europe, their travel experiences, home improvement projects, the football game that was on the television, and various small talk topics which are now lost to memory, probably embarrassing stories about the birthday boy which would have been the common link we all shared. I'm almost positive the Waffen SS never came up.