Was it unreasonable for me to ask for that?
Not at all. If you can't take phone calls during the day, for whatever reason, so be it.
Is his response out of line?
A little, by insinuating you aren't serious about wanting a new job because of when you can be called. Which is a rather poor argument.
But really, they're just saying they are unable to help you if you if you can't take calls during the day; that's perfectly fine. Same as above; if they can't take phone calls outside of office hours, so be it.
I would just take it as a "We're not a good match" and thank them for their time, given that your schedules don't seem to work together.