Your boss sounds like a senior dev or team lead acting as a CTO; in most hierarchies that puts him at least two levels above his pay grade. It sounds to me that if you have a CTO who is focusing on the small details and is being overwhelmed by them, he needs to grow into his position a little, and adjust the "zoom level" on his corporate magnifying glass, to focus on the people, the teams and the big picture, not the minutiae.
The first thing I would do as the CTO is identify the functional teams within his hierarchy. Those 16 devs and 8 QA are probably more like 2 groups of 8 devs and 4 BA/QA. I would identify what they're working on and who's working on it, name these as teams, and appoint someone to be "team lead". If there are two or more "teams" working on the same overall "project", consider a "project manager" whose job it is to oversee the day-to-day of both teams. This is a judgement call and can be quite political, especially picking someone over someone else of equal or greater perceived qualifications (experience, education, seniority, skills). So it probably won't be an easy call, but that's why he's the CTO; he gets to make the tough calls.
With that sorted, the CTO's job is to manage the teams through the team leads. At its most basic, the job of every worker's supervisor, from the senior dev to the CTO of the company, is to make the decision that extends beyond the scope of the worker's own control, thus removing the hindrance to their work. A junior coder pretty much can't make a decision in his work that affects anyone beyond himself; a senior dev can affect the path of the junior coders he supervises. A senior dev can't make decisions affecting the entire team; a team lead can. A team lead can't make decisions that affect other teams; a project manager can. A project manager can't make decisions that impact the entire business; a CTO can. Here's the rub; a CTO shouldn't be making the decisions that affect only one senior dev and his juniors. That's the team lead's job. It's when the team lead and/or the project manager can't solve the problem that they bring it to the CTO.