Are you expected to work in the company's time zone or its just a different office from where the interview is scheduled? If your final work timing are going to align to their timezone, then you should definitely say yes.
If not , then consider the position you are applying for and the situation.Is there a reason no one local can take your interview? Can you offer an alternate time? Assuming a 12 hour difference as highlighted by you, would you be comfortable attending an interview late at night, say between 9 pm to 11 pm?
You could reply by saying- I was wondering if it would be possible to schedule something before 11 am your time. If its not, I will make it at 5 pm.
Usually companies are accommodating and will try to schedule as per your preferences. If they cannot, they will suggest this is the only slot and you should make it.