Have another talk with your manager and talk things through.
If you've competenced yourself out of your current role and there aren't any internal openings for you to grow (without making someone else redundant), then it seems as though it's appropriate for you to leave and seek fresh challenges elsewhere.
If you're open and honest with your manager, and he supports you, then you shouldn't feel guilty about researching and looking for other jobs while you're at your desk.