Chances are most companies will not dig too far past your recent work experience and highest qualification.
However, as a hiring manager, I actually value developers that have arrived in the field from outside computer science - my general experience (there are exceptions) has been that a pure computer science education produces a bit of a fish-bowl outlook to development and a bit of disconnect to how software actually needs to work in the real world. Then again, I'm not looking for algorithm or backend developers.
Depending on the kind of role you are going for and at what organisation, you might want to wave that bachelor's degree to show that you have some "real-world" education - particular as a large amount of software development is out there to provide business applications.
As always - you should be tailoring your resume and cover letter to each specific job application. Sure, this adds time and effort to every application - but I think you'll get a better response to the applications if you spend the extra 10-15 minutes to make sure you address the specific role you are applying for.
One additional thought after reviewing the question: if you only state a Master's degree in Computer Science on your resume, an employer might assume you took a 4 or 5 year direct course. This would be quite different to a 1 or 2 year post-grad course following a 3 or 4 year Bachelor's, so I'd be careful about possible misrepresentation.