I don't think you're being impatient - it does sound like you need to change something.
Your phrasing ("My passion for it has slowly drained") seems to indicate that you were originally passionate about it. What changed? Is it maybe just the role you're currently in rather than the career path? Thus changing jobs (or even just talking to your current employer to change your current responsibilities) might give you back your passion.
Take some time
It might simply be that you're overworked and need some time off. Consider taking a nice long holiday, and make sure to have absolutely no contact with work during this holiday, if at all possible.
Some careers just don't pay enough for most. If money is a problem, you'll need to figure something out - change careers (and possibly focus on what got you into this career in the first place as a hobby), get a second job, do some contract work, or something else.
The other possibility is that you're just producing mediocre work (by your own admission) (and/or your company isn't willing / able to pay market-related salaries) and resultantly aren't getting paid as much. Check what other employees in your area are getting (using Glassdoor, for example) to see if you are in a similar range, and then consider asking for a raise, look for a higher paying job, or perhaps even moving to a different area where you are in greater demand, if this is an option. Even if you change jobs and end up getting a similar salary, you may be satisfied in your job, producing great work and end up advancing quickly and getting the desired salary.
But money certainly isn't everything. Saying you don't "freedom" in terms of money doesn't sound a whole lot like "I can't afford to support my family" (although the latter might be true). Living on a tight budget in an okay job can be a lot better than working yourself to death in a job you hate to live comfortably (although not planning for a rainy day could be a problem if it ever rains). Consider planning and recording all your expenses and check that you're not spending money on luxuries in favour of necessities, not wasting money on unnecessary things, and actually putting some money away for a rainy day. Try to hold off on / limit luxuries while you have any sort of debt (including a house or car that's not paid off). Consider getting a (temporary) financial advisor, but be very careful of having that just be another expense as opposed to something that's actually saving you money - it can even just be a good friend that's good with their money helping you out free of charge. I'm not sure about the scope of the Personal Finance site, but you may be able to ask some specific questions there to help you along your path.
Job satisfaction doesn't equal happiness.
You should consider that things outside of work might be the problem.
Do you exercise regularly and spend sufficient time with friends and family?
Have you considered that you might be depressed and require professional help / medication?
Can you find time to do something you love outside of work (perhaps even consider reducing your hours to achieve this)?
Switching careers isn't exactly an impossible (or particularly difficult) task.
If you can't get job satisfaction and/or the salary you need from your current career, changing careers should be a serious option. Don't think you should stay in your current career just because you've been doing it the longest and don't concern yourself too much with the possibility that you might have to start off at the bottom in some other career (but make sure you can afford it) - if it's something you're passionate about and good at, you should be able to advance quickly.
Look for things you're passionate about, you're really good at or a high-paying career (if money's particularly important to you).
Just for completeness - yes, you can be rich and/or happy with a career that you're not passionate about. You can be good at something and not be passionate about it. You can be happy despite spending a few hours a day doing something you're not passionate about. If we're talking about something you hate, that might be a bit of a different story.