It actually is very easy to get mistaken for a girl on the phone. Working in a call center you wouldn't believe the amount of times I get a customer one of my co-workers was just talking to and the customer opens with "Hi, I was just speaking with one of your female co-workers," and I look at the case and he was just talking to one of my male co-workers.
Yeah...come to think of it, I've had that happen to me too from working in a call center.
I've also had a customer call in that I couldn't exactly tell from the voice or the name and it turns out to be a guy.