I'm a dev with two years experience who was just recently (think two weeks) denied a promotion. I currently work in enterprise software.
At this company, promotions work through applying, interviewing, and then a number of people outside your team and department decide whether you would be a good choice for the promotion. That board consists of both technicals and non-technicals. They collect references from others on your team as well.
I had a couple of meetings to review with relevant people about where I might have failed.
My boss's boss (a non-technical) doesn't understand why I was denied. He found it strange given my relatively high profile in the company. He is arguably my strongest advocate in the company. He gave me my first promotion from contract to permanent after 4 months (my company will often keep people on contract for years) and he got that extra position approved by mentioning me to the CTO.
My technical boss doesn't think I'm actually that sharp a developer (no reason given), but rather just better at conversing with the product owner about what is required, which reduces the time I spend on my work. I am also more organized than others in his view, boosting my productivity further (I have a whiteboard with my prioritized to-do list at my desk).
Senior dev (think 2nd in command) prefers to work with me on projects because I am more disciplined about my approach to development than others.
My non-technical boss (I am theoretically co-managed, which is its own messy story) barely knows my name as he is either out talking to clients or never leaves his office, so I can't get any useful feedback from him.
A co-worker who I don't get along with took the denial (he knows as promotions are generally in waves, so everyone kinda knows who got one and who didn't) to call me a bullshitter.
Firstly, this is a huge shot to my confidence as everything I do in my life is development. I often jet off to a hackathon after work and then come back for the Monday morning after a night in a hotel. I have open source contributions, albeit to smaller projects. I have a number of guest pieces on software development on various blogs.
More importantly (my goal for this question), I now need to figure out how to get an objective assessment of what I am good at and from that, figure out how to move forward (I am probably going to leave my current company either way, but need to write a strategy guide for it). How can one objectively assess oneself when faced with contradictory external information?
My initial response was to send out a bunch of resumes to get a market assessment of myself. No trouble getting replies, including from Amazon.