My working place has quite the same configuration, when I asked people on my first week, boss told me everyone do his own thing.
If I want a coffee and my desk mate wants one too, I should just take one for me and let him do is own coffee.
That's actually how we work, and that's fine for everyone.
Of course, if someone is next to me when I serve myself, I ask him something like "Which one do I put in ?" (talking about little coffe capsules)
Or asking him "Do you go out ?" (a smart way to ask him if he will take a pause)
We have an espresso machine, this point may be important. If we had a huge "percolator", I would say something like "I made coffee" just to let them know they can serve themselves.
The problem is that if you begin to make coffee for everyone one time, then two, then three... It will quickly become a habit and they may even criticize you the day you won't do it.
When my boss takes a pause, he invites us to follow him like he is speaking to himself "Little cigarette pause..." "Coffee then go..." and if we want to follow him then when do, if we don't we just continue to work.
You shouldn't feel responsible for everyone, even if it's the "etiquette" of your country. But, of course, it depends on relations you have with all your mates and your boss.
Of course that may be a great conversation topic for your next tea-pause, there won't be anything better than your mates advices. Just them and you know really how that's work in your compagny.
EDIT: Funny fact : The second after I posted this, boss came to ask me which type of coffee capsules I want to re-order... :D