I think occasionally it is not a problem but if it becomes a part of job then it is and I understand that software development is a field where quiet environment and least disturbance are necessity as they help in focusing. But if it becomes daily thing then you guys can arrange it like this. Your boss should divide the teams of 2-3 people each and each team should be assigned the job of manual labour each day of the work week so that everybody gets equal amount of work and I believe your boss and other superiors should also get their fair share. Sometime back this same problem happened in my workplace but they finally had to hire a separate guy for these jobs.