I think the best person to take a call on this, after appropriate discussion, is you.
First of all review your country's employment/ethical policy on this issue. Maybe the law of the land does not permit it in the first place. Take appropriate legal advice if you have to.
Talk to your manager. Tell him that you have unused leave and that you plan on taking it if it is OK with him and the team. Give him the pattern of holiday choices you are willing to take. In his role, he will walk you through the company policies regarding this issue since some companies have reservations against people taking paid time off once they have put in their papers.
Talk to the team if they are OK with your plan about the vacation days. If you really value the relations with the team then this would be a important step so that you do not burn any bridges.
If the manager and the team are OK, then you have your answer. The advantage with this approach is: you get the legality of it sorted, you get your manager's consent and hence know your vacation is not offending the management as well as not souring your relationship with the team. An win-win for all.