Just tell them the truth.
I think the only thing you did wrong (maybe) was not following up the next day saying that you never received an email about a time to come in on the day of the interview. You knew what day it was and so I believe you had time to try to reach out to them beforehand.
It is rather unfortunate that you did not get the email, that isn't your fault. It's possible that she typed in the wrong email address (since you mentioned there was a potential language barrier).
Here's what I would say (or something like it):
Good morning/afternoon [person you who talked to]:
I had not received any email confirmation regarding when I should come in to have the interview with you all. I was not able to receive any phone calls either. Please let me know if there is any way to reschedule this interview. I apologize for any inconvenience.
Sincerely,
Your Name
EDIT: Based on your edit, you could say, "I am not able to answer the phone during the workday, as I mentioned in my cover letter."
They don't have to know why you weren't able to answer your phone but following up with them could tell them that you're still interested and perhaps there was a good reason why you weren't able to answer the phone. But they might raise their eyebrow a little and wonder why you didn't reach out to them the before the interview.
However, if you are not interested at all, and it sounds like you aren't, then I would email back and say the same thing I mentioned above except you can say that you have decided to focus your career elsewhere instead of rescheduling an interview.
It's up to you to decide if you want work at this other company.