The Workplace Stack Exchange is a question and answer site for members of the workforce navigating the professional setting. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

It is the first time that I am doing HR, and we are looking for a developer. The selection process is three rounds: technical phone interview, programming task (0.5 - 1 hr challenge), and then finally an interview with upper management and me.

The problem that I am having is that when I give some candidates (mostly fresh grads with 1 or 2 technical internships already under their belt) the programming task, they not only do not complete it in the given time frame (a week), but I don't hear from them again unless I follow up.

I'm thinking about ditching the programming task, but I really think it can help establish who really knows the languages listed on their resume.

How can I improve our hiring process?

UPDATE SINCE THIS QUESTION HAS BEEN POSTED

For the most part a lot of candidates are put off by the programming tests, which is very frustrating since I need to go through A LOT of candidates to find one that is willing to do it. With that said, I have found some willing to do them, and generally have found that:

a) It shows that they have a good attitude towards the company and role if they are prepared to go the extra mile to complete it.

b) They have programming ability. Sure they may have cheated but if they have attempted it, again, a good attitude for us is much more important since they will be much more easily manageable.

I have since hired a graduate developer, who attempted and completed the exercise successfully. He also completed all the additional 'bonus points' on the task. It is too early to say how good he is at his role, since he has only recently started.

On some occasions I do avoid giving the exercise to developers if they already have a strong portfolio working for good brands, and a track record. Since to get into the large brands he would have to do their own entrance tests.

share|improve this question
74  
If somebody doesn't have the wherewithal to complete a task for an interview, I wouldn't expect them to complete tasks as an employee. It would be different if you got feedback saying that the task is too difficult for the provided time frame, but I take it they are not giving feedback at all. What country are you in/taking candidates from? Either way I don't believe removing a test to employment is a valid path forward in this case, sounds like you are chasing the wrong candidates. – Ron Beyer Feb 2 at 14:49
166  
Speaking from my own experience as an entry-level dev, the demand is so high that I can skip any interview process with a online programming test and easily end up with a good offer (note: not technical interview with programming questions, which you should do, I'm referring to a 2-4h test done during my own time after which I may or may not ever hear back) Suffice to say demand for actually experienced people is probably even higher. Why jump through your hoops when they get recruiter emails every week, if not every day? – Cat'r'pillar Feb 2 at 15:34
97  
I avoid interviews with programming tasks, unless the job is above average. I see no need in losing a few hours to a company I'm interviewing for, considering that I can get plenty of interviews without tests. – GustavoMP Feb 2 at 18:11
12  
Trust me, you want to be scaring away candidates who cannot program. You may want to revise its content and/or your approach for presenting it (for instance, maybe invite them for an onsite interview, pair them with a programmer, and have them sit in a room for an hour with a workstation and pair-program the exercise). But getting rid of it entirely is a very bad idea. – aroth Feb 4 at 4:18
10  
Personally, I see not having candidates code as part of their interview as a red flag. If potential future colleagues got into the workplace without showing any technical skill and I'm going to help maintain their code, that could be bad times. Additionally, this is one of the points on the Joel Test. – FreeAsInBeer Feb 4 at 5:01

20 Answers 20

You need a programming test. But it should be 5-10 minutes. 30 minutes tops. There is no 2 hour test that will tell you exactly how good a programer is. You won't be able to tell if they continually write maintainable code, or if they always comment properly, or if they come up with unreadable messes of 'clever' solutions to problems, etc. In 2 hours, the only thing you'll accomplish is find out who is outright lying about knowing a language/programming.

Except you should be able to spot outright frauds in far less time than 2 hours. 5 minutes writing FizzBuzz and 2-3 quick questions about language specific features will tell you if they are absolutely worthless. And that's about the best you can do in a job interview.

Let me tell you what I would think if I received a 2 hour exam for the privilege of conducting an interview:

"Either these people think this has value which means they have no clue what they are doing, OR, they know this is a waste of time, but for some reason (probably blindly following HR's red tape), they are willing to waste the candidates time before the candidate is even hired. Imagine what they'll think they can get away with once they are paying me.

Either way, I don't want to work there."



There's another thing that could be driving away candidates: The length of your interview process. You have people doing a phone interview. Then a take home test that they have a week to finish. Then you go over the tests. Then you set up a face interview with management. Then (I assume) you do a couple of face interviews. Then you get back yo the guy who you want to hire. What does that take? 2 weeks? Longer?

In that time I've already gotten 3 offers. I accepted one and I start next week. You think I'm going to go do your 2 hour test?

share|improve this answer
13  
But it should be 5-10 minutes. 30 minutes tops. - It does not have to be this short, but having them do it on-site before they leave would increase the completion rate. It doesn't matter if its a 2 hour challenge if you have them do it in house they wont get home and decide its not worth the effort. But in general I agree a quick fizz buzz type challenge is likely to yield similar results to a more in-depth test with less effort required to evaluate the results. And if it takes 3-4 weeks to get through a hiring process I have already started somewhere else. – Chad Feb 3 at 21:37
19  
No, you don't need any programming tests. What you need is trial period. – Agent_L Feb 4 at 10:52
33  
@Agent_L An employee making $40,000 costs (on average) $16,000 to replace. An employee who makes $80,000 costs $120,000 to replace. That's an insane amount to pay for a trial period to weed out half your candidates when you could give a 5 min test for free instead. Seriously, why on earth would you hire someone and start paying them for several weeks/months just to find out they lied on their resume? Why do that when you can spend 5 min and not pay them a penny to find out the same thing? – Shane Feb 4 at 22:00
12  
@Agent_L: Costs of a failed hire are far higher than the wages mis-spent. They include the need to re-do the hire, for example, and all the admin associated with adding a person to your staff. I do not know where Shane's figures came from, but they don't seem unreasonable. Probably that 16,000 is on top of the salary given to the bad hire. As you are proposing alternative solutions, presumably you have been a hiring manager, or work in some capacity related to hiring? – Neil Slater Feb 5 at 19:15
15  
It's worth adding that these same principles applies to all tests, not just programming tests. All "Homework" tests discriminate against busy and in-demand people, and tend to test the wrong things (domain knowledge that can be learned on the job, not aptitudes that can't). I had the exact same thing in a team who recruited graphic designers using a multi-hour "design X in our brand style" homework task, which I replaced with a kind of in-interview fizz-buzz for creative thinking. – user568458 Feb 8 at 9:58

Let me begin by saying hiring employees in general is a pathetically inexact science, and you will get various results no matter what you try. Having said that, I felt I should share my thoughts on this.

I think programming exercises are a bust, mainly because you will get people who are desperate and have way too much time on their hands completing it. If they have a full time job, you'd have to ask how much time/mental energy they are taking from their current employer to work for someone who isn't even paying them. Do you want them doing things like that to you?

In addition, if they are good, they are most likely interviewing with many employers. Guess which ones they will prioritize? The ones who don't ask to complete projects before they even get on the phone with an engineering manager.

There is also the problem of plagiarism. Sure, they will be found out in the in-person interview, but by then you've already wasted the time of (presumably) highly-paid people at the company interviewing this person.

My current company did it well, and this is the route I would go down in your position. Give them a small task which should only take maybe 90-120 minutes to do, and tell them to justify in the comments why they chose that way of solving the problem. This is something that can be done in one night, and will give you insight to their thinking.

I can tell you right now that if I get a project that takes 8+ hours to do, I tell them thank you but I'm not interested. I have a good job and a life. If a manager sees that as an issue, that tells me they wouldn't care about my work/life balance on the job (especially if they don't care before I have it). No company except maybe Google, Apple, or Facebook could get away with that.

share|improve this answer
9  
Disagree with others here and +1, wish I could plus more, because of "I think programming exercises are a bust". You kinda go back on it by suggesting a programming challenge, but still. I agree with you, they are ridiculous and don't work at all because I've worked beside many people who apparently passed these tests but are incompetent. In fact many people I've worked beside didn't do their actual work, but sat there studying interview type questions so they could apply to other programming jobs on the job. This process needs to die. – Technik Empire Feb 3 at 15:52
8  
Google and Facebook both have highly optimized recruiting procedures, and neither uses at-home tests as part of said procedures. – stannius Feb 3 at 19:00
6  
This must have been written before the asker clarified the length of the test, because it's a terrible answer now. – DCShannon Feb 3 at 21:24
2  
@stannius That is not true. Facebook does have an at home project as part of their interview process. I have taken it – Tyrsius Feb 4 at 4:56
10  
"give them a small task which should only take maybe 90-120 minutes" This seems worse by your own description than a programming task that takes 30 - 60 minutes, which is what they're currently tasked with. – TylerH Feb 4 at 7:05

In my experience, take-home projects don't weed out bad coders, and likely make good coders find a job where they don't have to jump through a hoop to talk to the hiring manager.

Think about it this way. A good coder can easily get phone and in-person interviews. Every extra hoop they have to jump through will mean they'll take the easier route and interview (and get hired) by someone else who will pay just as much. If you make people jump through hoops, make sure they see it's worth their while from the get-go.

A bad developer can take as long as they want. You won't see them take 4x as long; you'll just see the completed test. You also won't see them go to Google or their buddy for help with an if statement.

My last company did this, and the vast majority of people we brought in for an in-person interview failed Fizz buzz (around 65%). I think this happened because we inadvertently weeded out good, busy people that didn't need another company's interview, and at the same time, dangling an easy interview in front of bad coders.

What I think we should have done instead

Instead of giving people a take-home assignment that took 15-20 minutes to grade, we should have done a 15-20 minute Skype interview where we asked questions like Fizz buzz. This would have taken the same amount of time, but I would likely have weeded out the bad programmers before a two-hour in-person interview.

FYI -> Here is a very detailed article about Fizz-buzz and general interviewing practices.

share|improve this answer
3  
I was once asked to complete a programming task on hackerearth.com and was asked to enter personal info to register myself. It was an immediate turn-off. Moreover, the programming task itself was not a reliable indicator of capability. I agree that such take-home assignments are not really worth it. – Nav Feb 3 at 23:53
1  
The one and only time I've ever done a take home programming task, the hiring manager hounded me because I didn't have 1 day turn-around. After that I decided if I got a take-home assignment again, to say I wasn't interested in the job. – sevensevens Feb 4 at 16:09
1  
@TechnikEmpire you have numbers that are both divisible by 3 and 5. So you get both Fizz and Buzz being outputted in one iteration. The order which one of the two comes first is dependent how you order you divisors eg.. 3 first or 5 first. Something that I saw in your code example you've done exactly the same thing. – Chad Feb 8 at 12:56
1  
@TechnikEmpire Really enjoyed reading your code, interesting to see how far C++ has come. – Chad Feb 8 at 13:27
1  
@Chad Nice. that's alien to me because I've never used printf in my life. lol – Technik Empire Feb 8 at 13:30

A contrasting view, from someone in the trenches on both sides of this question. I suspect this answer will attract down-votes, but it's a highly informed opinion, developed over several decades in this business. Because I like doing so, I still write code every day for a living and as a hobby in my "copious free time", but I've also been the final decision maker on hiring a couple dozen programmers, and have helped to interview and advised on the hiring of a fairly large number more.

Lawrence is right: hiring is woefully inexact. But we're getting better at it over time. More than face-to-face chats, more than trivia questions, short on-site programming challenges are an increasingly essential part of that: not only for skill, but for attitude.

Note that I said "short". We give candidates a laptop set up with a properly installed Eclipse (our chosen IDE) when they come in for the interview. Properly set up means they have access to the jdk source, but it has no internet, and they're asked to not use cell phones during the test. They get an hour to solve anywhere from zero to five problems, starting from "FizzBuzz", and going up in complexity to something on the order of a simple multi-threaded producer/multiple-consumer system.

Nobody's ever solved all five in an hour, and I don't expect anyone ever will (I can write solutions for five in comfortably under an hour, but of course I've seen the problems and solved them all previously, so I'm not a fair test).

Incidentally, we've had ostensibly experienced programmers fail to get FizzBuzz right. Let me say that again: we've had a handful of candidates fail to complete FizzBuzz correctly. Usually by not following directions, but reading the spec is an essential part of being a developer.

We have them write code while here on premises rather than giving them homework for several reasons, partly the risk of cheating, and partly to give each candidate an equal opportunity to work the problems. We also rotate problems in and out of the challenge set, and we discuss solutions with candidates afterwards.

I feel extremely strongly on this issue. I've never seen a candidate refuse a position or drop out of the interview process because of our programming test. But that may be influenced by the fact that we tell the recruiters who serve us that the process includes on-site programming. So we might just not see the candidates who think being asked to write an hour's worth of code is "unpaid work". If so, good riddance. If they think an hour's coding is more like "work" than an hour of answering trivia questions, or that their answers to test problems can produce anything useful, I don't need their attitude.

We did once have one candidate complain about the test, because he thought he was too senior to have to prove himself (that's not speculation - he said so). And he did well on the challenges, and he had all the experience we wanted. But he was a terrible employee: he also apparently thought he was too senior to take direction or learn, and ultimately we had to let him go.

One of the things I've decided over the years we've been doing this is that any company which doesn't test is less likely to get me as an employee. Like their answers to questions like what they use for source control etc., whether a company tests tells me a lot about how good they are at the business of software development.

So, what should you do? You should do what works for your organization, but my advice is to continue the tests, but do them onsite, as part of the interview. Tell them in advance that that's part of the process, and do it happen before they meet with upper management (but you should meet them first to help set them at ease). And really: skip the interview with upper management if they fail. Don't worry about popularity with candidates or posters on the internet. The cost of a bad hire is way worse than the cost of delaying until you make a good hire.

share|improve this answer
45  
I don't expect downvotes. You're perfectly in line with the other answers, arguing in favor of shorter on site tests and against long at home tests. The one thing I personally disagree with is the "no internet" clause. For a developer the internet is one of the basic tools of their trade - taking it away shows you how well they do without internet, which is irrelevant to 99% of development jobs. – Peter Feb 2 at 22:13
9  
@Peter It may even be better to allow Internet access and just see where they go. Do they go to StackOverflow to check something? Do they come here to complain? (Of course, such monitoring should be explicitly stated to the programmer and require their consent to continue to avoid controversy.) – JAB Feb 2 at 22:23
8  
Honestly your answer doesn't contradict the other answers/general sentiment at all. IMO there is a (huge) difference between "do this task on your own time to have a shot at this position" (OP current process) and "let's assess your ability and fit for the company together" (what you're suggesting). – Cat'r'pillar Feb 2 at 22:54
7  
At my current employer, we do something similar to this, and this is closest to the answer I would have written. One thing I would add (perhaps you could add as an option or note for OP?): We allow internet access and do the tests as "pair coding" exercise with team members that the person would be working with. The coding partner helps explain the goals, and is there to answer questions, help things along if necessary - i.e. much like how they would work together in practice. Not only do we get to assess technical skills, but also get a good sense of how the candidate works with others. – Neil Slater Feb 3 at 9:14
6  
Agreed with @Peter. If I were interviewing with you, the "no Internet" thing would make me think you value memorizing an API more than understanding the concepts, which would make me think twice before accepting a job an offer from your company. Otherwise, I generally agree with the answer and the last sentence is especially true. – reirab Feb 3 at 16:31

If it's for a senior position, a senior developer with people skills will be able to tell within less than 10 minutes if the senior developer on the other end of the phone is any good, or is just making up stuff. We won't know how good exactly, but we'll know as much if not more than any at-home coding test tells us.

If it's for a junior position, we don't expect much in terms of technical expertise, instead we're looking for enthusiasm, willingness to learn, and talent. Forget about spotting the level of technical expertise of a junior in a phone interview - unlike a senior developer, there are too many things they are allowed to be oblivious to. So while we can use an at-home coding task to weed out some juniors, the results are not really all that important - if we hire them we need to train them anyway.

In both cases the candidates are probably sending their CVs to multiple companies, unless you got a big brand name and they really want to work for you. Having to work on an at-home coding test for a couple hours makes you stand out in a bad way. It also makes it easy to cheat, meaning you can't trust the test and later have to re-test their coding ability on site.


Just give them 10 minutes to solve a FizzBuzz variation on site during the first round of interviews, or if you get swamped with good CVs and need another filter, do it over Skype before the first real round of interviews.

You absolutely want to know more about the coding abilities of your candidates once you're at the point where you're considering giving them the job. I like to spend 30 minutes to have them do pair programming for a bit, or doing a code review on actual real code that is currently being worked on. Then have them do the same with someone else. Not an exercise based on real code, but actual real work - the stuff they are supposed to do if we hire them.

Don't worry about the test being different for each hire - the goal of the hiring process isn't to find the person who scores best in a couple of measurable and repeatable tests. The real goal is to hire a single person who will do the job well.


Addition: From a comment I gathered this is about a very senior position. Good senior people know what they're worth, they know that their time is valuable. A 2 hour at-home coding test shows them you're not valuing their time. Always remember: every interview goes both ways.

share|improve this answer
14  
You are fooling yourself if you think someone can tell within 10 minutes if the person on the other end of the phone is any good. – Dunk Feb 2 at 21:46
7  
Enthusiasm and willingness to learn? What about existing knowledge or ability to learn? – djechlin Feb 2 at 21:54
13  
As an aside, teaching an advanced math class, I've definitely met willing but not able. – djechlin Feb 2 at 22:07
10  
@Dunk I disagree. It would take me 10 minutes to decided if they where "ANY good". But it would take a lot longer to see if they were "good enough". The point of having interviewing "rounds" is to progressively weed out candidates. What the OP has done is create the equivalent of a "quest of worthiness". – Aron Feb 3 at 2:06
5  
+1000 for the "10 minutes on the phone with a senior developer" part. If you want to know whether a developer knows his stuff, hook them up with another developer whose opinion you trust and they'll sort it out faster than any test. Short, in-person tests are okay if you insist (but far from necessary) but the much more reliable method for weeding out bad candidates is by a peer actually interacting with them. – thanby Feb 3 at 21:10

Here is another point that I don't see covered in the existing answers (which I think cover the topic well in general). I would take a close and serious look at how long it actually takes people to complete. I have had four job interviews during which I had a programming exercise to complete, each of which was done differently (and each had its own advantages and disadvantages). Two of the four (numbers 3 and 4 below) took much longer than they said it should, and both of which I ended up giving up on because of the difficultly level involved. I've described them below and ranked them from best to worst from my perspective.

  1. During the technical interview, they sat me down at a computer that had a pared down version of their code base and had me solve three relatively short problems related to it (find and fix a bug that they had purposefully added, add a new field to an info table, etc.). They gave me exactly an hour to do it, and after an hour they went over my solution as well as how I approached the problems. This gave them more insight into me as a programmer, while respecting my time by keeping it short and to the point.
  2. During the technical interview they had me work through a problem they had encountered during development on a whiteboard while being able to bounce ideas off of them. This was the shortest option, while still giving them a chance to see how I work through problems and how much I can actually do the necessary job.
  3. During the technical interview (for a junior Ruby on Rails Web Development position) they tasked me with building a web application from scratch that would navigate to a website, fill out multiple forms as they were presented, scrape data from the resulting page, and present that to the user. They said this should be a quick exercise, and it may have been for a senior level web developer, but having had only a year of professional experience at that point, I spent four hours trying to get it all to work before giving up and going home (all of the interviewers had left hours before I did because it was an afternoon interview, they said I should just save the finished program when I was done). This is a ridiculous assignment for the listed position, gave them no idea of my coding abilities, and seemed to me like they were just trying to get free work from the deal. Needless to say I didn't even want the job by the time I left that day.
  4. Before even having a technical interview, they gave me an assignment to create a web application that would take advantage of an API their company used to "do something interesting". This was exactly as broad as it sounds. This required me to do the following before even attempting to create the application: create a developer account for the API, download the API development kit, create a publicly accessible web application (with another developer account), learn the API, and create a data repository to access with the API. This of course took many hours just to get started, and shortly after getting started on the web application itself, I got a different job interview and shortly thereafter a job offer, so I discontinued work on the assignment. This is a crazy thing to have as part of an interview process because who wants to put all of that time and effort into developing a program just to have a small chance of moving on in the interview process?

So to more directly answer your question, should you have a programming exercise? Yes, but make sure it is tailored to test what you actually care about, and not require a ton of extraneous work for the interviewee. Do you want to know about their algorithmic thinking? Give them an algorithm problem. Do you want to know about their coding style? Give them a coding problem. Do you want to know about their development process? Discuss their process with them as they work through a problem.

share|improve this answer
    
interviewers gave up and went home?! FFS, you did not want to work there anyway. I'd have left 2 minutes after they did. – gbjbaanb Feb 8 at 10:01
    
They didn't so much give up as just go home from work. Once they gave me the assignment they just left me to my own devices to finish the problem, and because it was an afternoon interview and I was working on the problem for a solid four hours, they ended up going home. A couple of the employees were still there by the time I left, and I realized it was time to throw in the towel when those guys ordered dinner into the office – Kevin Wells Feb 8 at 18:23

Let me start off with:

  • I've been given tests to complete at home that ranged from 15 minutes to 10 hours.
  • I've been given online tests to run through.
  • I've been tasked with writing out the answer to FizzBuzz and other fashionable internet tests on whiteboards.
  • I've been asked about the square vs round manhole covers.

In short, I've dealt with pretty much all the different ways developers like to handle interviews. To be quite honest - I seriously doubt the vast majority of people interviewing me even understood what the potential outcomes of each of those tests were and ultimately just hired people on whether or not they "liked" them.

Before you even put up a job listing you should sit down and go through exactly what it is you are trying to hire and "developer" isn't an answer, at least, it's not a proper one. A good answer to this would be something like "mortgage domain expert".

Finding someone that can write a bit of code or search google for how to apply a particular pattern is trivial compared with finding someone that's been in the business you are in and can leverage that knowledge. In other words, if I was hiring for a mortgage documentation company, I'd take someone that could talk about the difference between 15 year fixed and and ARM loan over someone that could write a bubble sort algorithm in 2 minutes. The reason is that "normal" business people make all sorts of odd demands and domain experts can more easily get to the heart of what's needed whereas someone that knows nothing will happily add things that are useless or make the app really bad.

Getting back to the questions, only ask go / no go questions.

Is it critical that the person can tell you the difference between a virtual and abstract method? Might be, usually isn't. I'd wager a good portion of developers barely even know when to use those keywords but they aren't your superstars, they are the rank and file who use can't code without the visual designers.

Is it critical to spot when a query is open for sql injection? For a Sr position - absolutely; for a Jr. position no. This is something that is easily trainable and handled via code review. Hence the reason you want the sr. to know it inside and out - so they can train the juniors.

Is it critical that they know the exact maximum value of an Int32 data type? Not normally - that level of trivial knowledge is what google is for; but maybe your requirement is for coding on memory constrained devices - in that case: absolutely.

I interview and hire developers. I don't send home tests - it's too easy to have a friend help. I don't use online testing sites - given how the scoring has to be automated it's trivial to game. I don't ask candidates to write out the answer to fizzbuzz - just about everyone has seen that test and should know the answer by heart; everyone else entered the field in the last year and are jr.'s anyway. I also don't ask trivia questions - being able to recite the answer usually just means you've heard the question before.

What I do to interview people:

  • I ask them to describe a prior project or two. All I care about at this point is to make them comfortable and to get them talking. This is a go/no go because if I can't understand what they are saying then I can't work with them.

  • I ask them a few specific questions in the tech I need them to use. If it's SQL server, I'll ask about updating on a join. If it's HTML, I'll hand them a 10 line html file with a couple css classes and ask them what the output is. These are trivial questions to people with experience in those areas and quickly weeds out pretenders.

  • If I'm looking for a Sr. dev then I'll ask domain knowledge questions. Not edge case things but rather core principals. If I need you to lead a project on an accounting back end then you better have a grasp of basic accounting principals.

  • If I'm looking for a Jr. dev then I'll ask about pet projects. all I want to know is the type of tech used. This should clue you into what they really want to do. In other words a C# developer isn't likely to be doing pet projects in php. I honestly don't expect too much from a jr dev except to be trainable. If they are actively working on a pet project then I can train them. If they are the type that needs people to tell them what to do there are far larger companies these guys can work at.

I don't make these questions up on the fly, the potential answers are considered ahead of time and fit a go/no go pattern. If a question doesn't fit that then it's not relevant. I also ask every candidate the same ones unless I'm 100% convinced I'm not hiring them at which point I'll stop the interview.

If for some reason you still insist on sending home a test - make sure that the skills required to successfully complete that test in a reasonable amount of time are actually skills you care about.

I had one company give me a take home test that involved writing a custom cryptographic service provider. I completed the test because it was somewhat interesting; they hired me. At no point in my time there did I do anything even remotely related to security, cryptography or even math based beyond adding a few numbers. I wonder how many people they drove off with that test?

share|improve this answer
    
Thanks for your response, good answer. We have a similar approach minus the take home test. – bobo2000 Feb 8 at 15:33

Coming from the standpoint of a person seeking a job, I generally avoid places that take over 1 hour to code. One time I went to this place that required a nearly 3 days worth java coding project. I did it all and the guy was even impressed with it but they told me they hired someone else after the second interview stage. So after that, if I come to a company I would ignore/pass any project that requires more than a couple of hours to complete. My time is just as valuable as theirs and I rather not waste it on things that won't get me anywhere.

With that said, if your coding exercise is too long, maybe people aren't willing to put the time in. I would attempt to reduce it such that it takes an hour at most but at the same time demonstrates an understanding of coding and maybe putting a deadline on it like, "Please complete by COB tomorrow" or something. They can still "copy-and-paste" something online but make it hard by being specific rather than something you read online.

share|improve this answer
    
A strong resume, references and being able to perform on a short test, may be all you need. Stick to your guns and good luck with the job search. – JeffO Feb 2 at 18:28
10  
Amazon reached out to me a few years ago, asked me to take a 3-hour test with 3 different puzzles to figure out AND code. I stubbed out all 3 but only finished one to my satisfaction. It was kinda fun but the lack of any kind of feedback was very disappointing. A year later I had another coding interview with them but this time a member of the team came up with a puzzle and we coded it together. I didn't get the job but I learned as much in that 90 minutes of paired programming as I did in half a semester of traditional schooling. – HireThisMarine Feb 2 at 18:33
9  
The only time I had a "take-home" programming problem, the company never responded after I submitted my solution. I touched base with them after a week and the manager said he got it, but hadn't had time to look it over yet. They never called back, and neither did I. – TMN Feb 2 at 18:43
    
"the guy was even impressed with it but they told me they hired someone else" But not impressed enough to hire you? Did they tell you why? – Dave is Not That Guy Feb 2 at 21:19
1  
So even though they later found you to be a fine coder, they knew before you left the initial interview that you were in the no-hire column. How could you have done the coding test differently to make up for that and advance to the next round? Hardly seems fair to you. – Dave is Not That Guy Feb 3 at 23:51

I used to be a firm believer in coding tests and whiteboard coding, but I've started to realize that they're pretty much useless, because

What are you testing, anyway?

A whiteboard test, or short programming test gives you some insight into the individual, but really not that much. Unless you plan on having someone spend their time writing code on a whiteboard or FizzBuzz style code.

What do you want?

You want someone who is:

  • passionate
  • willing to learn
  • able to solve problems*
  • resonably technical
  • going to help your team improve

*Note, most developers solve their problems by knowing what terms to search for in Google.

The last thing that you want to hire is someone who is not a good fit for your team because they will drag it down.

How Can You Test For These?

  • Ask them about a project that they enjoyed. If they seem reluctant to talk about it, try expressing gentle disbelief, e.g. "You can't do X, can you?" If it's something they're passionate about, they will correct you. This will also help you learn if they're technical or not.
  • Ask them about things that they've learned recently. Or what they learned from the project they worked enjoyed.
  • Ask them about the last time (or a time) where they were missing some knowledge. How did they get the information they needed? Did they go to a teammate? Did they search the internet?
  • Ask them if there's anything they would want to see improved on their current/last team. Did they need better commit messages? More code reviews? More testing? More automation?
  • Ask them what technology excites them, and why.

If you have someone who is comptent technically in on this conversation it will be the easiest thing in the world to tell if this person will be the worst. An example: we had a kid come in and interview - he said that on a scale of 1-10, his Java skills were like a 7-8. I don't think he even knew that Java was compiled to a jar file which was later compiled to machine language by the JVM. I'd rank myself maybe a 2 or a 3 and I know that.

He was actually asked the same question by our CTO in an interview the previous day, and our CTO called him on it and explained that there was no way he was a 7-8.

Our CTO also asked him about his favorite project, which had to do with hand-held scanners. But he couldn't explain anything about how they worked, or the fact that they used polling to prevent busy-waits. He couldn't explain a single technical thing.

That guy didn't get hired.

Figure out the kind of attributes you're looking for, and then figure out how to test for those

But I really need to see how she codes!

Okay, that's fine - but unless she's going to be coding in a silo, the best thing to do will be hire her as a contractor for a small, well-defined project. Maybe you're adding the capability to download some files from an FTP and then dump them in your database. Something simple, that doesn't require much/any domain knowledge.

Have your candidates work with an existing employee or two, and pay them for their time. You'll get to see exactly how they work, and how well they work with the team. Do they communicate well? Do they get frustrated easily? Are they persistent?

There are things that you can do to hire better employees... but a programming competition probably isn't one of them.

share|improve this answer
5  
You raise some good points, but a drawback of "the best thing to do will be hire her as a contractor for a small, well-defined project" is that most candidates will prefer a full time offer rather than contract-to-hire. If they have multiple offers, they will take the more "secure" option. – RQDQ Feb 3 at 12:28
    
@RQDQ agreed. I think it's the least effective means of interviewing... but it's the most effective form of interviewing with code. – Wayne Werner Feb 3 at 12:49
2  
The old "try before you buy". Though the whole industry is going that way, and my next position will likely be a 3-6 month contract to hire, I am saddened by the fear enshrined in it. When did we stop doing our homework and when did we become afraid to fire anyone? – Joshua Drake Feb 3 at 17:23
1  
@JoshuaDrake unemployment, that's when ;) – Wayne Werner Feb 3 at 19:31

As others have noted, some developers may be put off by a 1-2 hour programming exercise to apply for a job. What may work better is having a white-boarding session, where the candidate solves a problem on a white board during the interview. This allows you the opportunity to have an in-person interview while also making sure they have technical chops.

These problems should not be extremely difficult, or designed to trip up a developer. A classic example is FizzBuzz. This allows you to see how they think, and also know that they can at least program and don't need to google how to do a loop.

share|improve this answer
3  
Does anyone really fail FizzBuzz? – Patricia Shanahan Feb 2 at 19:23
14  
@PatriciaShanahan: Yes, all the time, you'd be surprised at the range of quality. A side effect of developers being in demand, is many people want to take a shot at being hired as one, even if they are not quite ready or good enough, they may convince themselves that they could learn on the job. A decent short technical test really does help prevent accidentally hiring someone who can talk the talk but not deliver in practice, and that situation is common enough that you need some kind of interview technique to filter them. – Neil Slater Feb 2 at 19:33
2  
FizzBuzz usefulness discussed in Programmers SE: programmers.stackexchange.com/questions/15623/fizzbuzz-really – Neil Slater Feb 2 at 19:43
6  
@NeilSlater - FizzBuzz was great when it first came out. It was still a good discriminator five years ago when that discussion took place. It's not so great now. One thing that the US education has excelled in is teaching kids how to overachieve on a standardized test. FizzBuzz (along with anything like it) has now fallen to the status of a standardized test. – David Hammen Feb 3 at 4:27
5  
@DavidHammen: Interesting. However, you could just redefine "FizzBuzz test" to mean "any simple coding challenge similar to FizzBuzz". Coming up with a similar problem should not be hard. – sleske Feb 3 at 14:03

DO NOT GET RID OF THE CODING TEST!!!!

If you want to be a programmer you have to write code that does something. Answering trivia questions is not that important. Chatting about past experiences is good, but it is in no way a substitute for being able to code.

Do what it takes to attract people to want to take the test and get this job. Make it shorter or pay them. Bring them in on a weekend so everyone has time to observe this person in action.

This is really contingent on having people who can interpret the results of the tests/observations. You may want to hire a third party to do this screening if you don't know how to do it. Just getting the answer right, is only half the battle. Developers need Googling skills, but there is much more to it. If one programmer can do the test faster, that is a plus.

Depending on your project, you may prefer fluency in a language, so the dev can start working efficiently right away. On the other hand, you could suffer in the long run when you opted for the less skilled programmer who is going to get stuck with a key feature of your app or they build such a poor structure, it's difficult to alter and maintain. You may have been better off with a good programmer who is willing to adapt and learn the language needed. There are many devs who will absolutely run away from certain stacks, frameworks, languages, tools and operating systems.

Developers are critical positions that are very expensive to fill. I understand your concern over chasing too many good ones away, but you only need one. Don't skimp.

share|improve this answer
3  
That is exactly the reason why we have introduced it, there are too many cowboy developers out there who have a zillion languages on their CV but when it comes down to it cannot code. It is also the highest paid position in the company, so we can't afford to take the risk with a bad hire...it has on the flip side saved our ass a few times, a couple of guys who I suspected were weak candidates on the phone following a technical interview, withdrew their job app at the last minute once I introduced the coding test in the second round. It has crossed my mind to just do the tech phone interview. – bobo2000 Feb 2 at 17:32
10  
@bobo2000 There's something I don't understand: in other comments you say that you have mostly fresh graduates as applicants, but here you say that you're looking to fill the highest paid position in the company. Something does not really add up. Can you explain how these 2 facts fit together ? – Radu Murzea Feb 2 at 19:26
4  
A coding test is one thing. A coding test that takes 8+ hours to do is another thing completely. – NotVonKaiser Feb 2 at 19:47
21  
@bobo2000 "I give some candidates (mostly fresh grads) the programming task" + "It is also the highest paid position in the company" = something isn't adding up here. – Esoteric Screen Name Feb 2 at 20:37
6  
The sense I'm getting is that the "fresh" grads are no longer falling for the promise of romance & riches from the thinly financed startup. Good for them! I did that twice last bubble, and neither of those dumps are still around. – Dave is Not That Guy Feb 2 at 21:41

One thing no-one appears to have mentioned; even if the test is not your issue, you should be looking for other ways of attracting talent.

If you are hunting for good people based on their existing published work, you don't need to run the test on them.

If you're just being sent people via recruiters and filtering, you are vulnerable to the fact that your needs and the recruiters' needs do not perfectly synergize. They want to place someone with you. You want a top level engineer. If they can find a top level engineer that's awesome because you'll come back to them, but if they can't (and top level engineers tend to have stuff going on that leaves little time for interviewing), they'll settle for just placing a moderate engineer with a nice suit. The loss to them is a bit of long-term rep, but that's minor compared to missing their targets. If this is provably not true in your instance, hang on to that recruiter and never let them go(*), recruiters who are prioritizing a long-term relationship over targets are precious diamonds in an ocean of coaldust.

What you want to be doing is finding provably interesting candidates. Hunt through StackOverflow and GitHub for top engineers (I hear StackOverflow has a tool to help with this), check for technically interesting companies that produced good software but who screwed up their financials or monetization, and just laid off 10 top level engineers. Spend time working at universities assisting with final year projects. Identify good potential candidates and befriend them, preferably in person, alternatively via remote; even if they have offers, good engineers hang out with good engineers. Also, they can tell you how they feel about your hiring process.

Does this sound like a lot of work? It should. One of the reasons that hiring seems so "hard" is because you're trying to do it as efficiently as possible. The more time, brainpower and resources you divert to it, the easier it is. Whether those resources would be better spent on shipping product is the eternal management question. But if you're spending a lot of time on "crap programmer filtration", that's burning money. At least the steps outlined above have inherent value beyond the hiring process.

(*): Hell, hire them.

share|improve this answer
    
Yep, that is currently my approach. You would be surprise at the amount of developers who do not have publicly available 'git repos', – bobo2000 Feb 3 at 10:34
3  
Good point. However, there's a risk in relying on published code - not everyone codes in their spare time (different hobbies, family obligations etc.). While many people assume that "codes in spare time" correlates with technical ability, to me it is not clear that this is true. I know good developers who do different things outside work. – sleske Feb 3 at 14:11
    
@sleske that is true, I code in my spare time (CS Major/ex developer) and I never publish my code in public repositories. But that is probably part of the problem, a candidate could easily go to a job interview and lie about their skill set using buzz words. – bobo2000 Feb 3 at 14:22
1  
@sleske I agree, which is why "check git repos" is a small statement in a much larger paragraph (and I've actually deleted it now). If you're looking at a professional developer who doesn't publish their work, then look at the company that they worked for. Is it a good company? Does it do good work? Why did they leave it? What aspect did they work on? There's lots of associated data you can use that's more useful than your tests; and if they don't have that data, then you can use the tests. But if they do, use it instead of the tests. – deworde Feb 3 at 16:37
1  
@grasshopper See, I can see it from a "what are you like to actually be around" perspective, but they shouldn't be asking you if you know what a boolean is. – deworde Feb 6 at 21:04

In my opinion, the problem you have here is not necessarily the programming test. First you have the telephone technical interview and then a work from home test before a face to face interview. It sounds like you are keeping your candidates at a distance and leaving it to the last minute before meeting them. At what point do you expect candidates to decide that they want to work for you ?

I assume your recruitment advertisement is similar to most and so focuses on location, salary and a (wish) list of skills. Candidates don't really know what they would be working on, anything about the environment or people they would have to interact with. You haven't sold the job to them yet here you are asking them to prove their technical capabilities twice before they get to ask a single question about the work.

I suggest you try changing the format of the technical phone interview to be a 30-45 minute chat about the job including plenty of opportunities for questions from the candidates, then 15 minutes of technical questions as a screen so you still get a chance to pick the better applicants without making it too onerous.

I would also consider moving the programming challenge to be done onsite prior to interviews. It would seem more achieveable to the candidates, give them an incentive to stay on track with the process and you would get the benefit of observing the true time spent on the challenge (I think you might be surprised).

share|improve this answer
    
Thanks for this, what should I do if the candidate is not in the same country so can't come onsite to do the task? I am interviewing a candidate tomorrow who is in Hong Kong, we are in the UK. After the face to face to interview we expect to the candidates to decide whether they want to work for us. – bobo2000 Feb 3 at 17:37
1  
You have to adjust the interview according to circumstances. Still, you have to sell the job to the candidate and not just throw tests at them. Furthermore, the whole process is an exercise in building confidence between the two of you. You want your candidate to know exactly what they're getting themselves into; if an international move is required then you might want to spend a little more time getting to know more about each other. – koan Feb 3 at 20:31
    
Use screen-sharing if someone is not able to visit in person. – user70848 Feb 5 at 23:44
    
@user70848 The point of the programming challenge is to make sure the candidate can handle a programming task. Screen sharing is a horrible way to do that because you would have to spend an hour watching the candidate and they would undoubtedly feel more self conscious than if they were doing it for real. If on the other hand the job requires pair programming then this would be a good way to do it remotely. – koan Feb 7 at 16:16
    
@koan That is true, but if you're located half a world away from someone, literally, it's a much cheaper and simpler solution to help both parties make a decision on whether to invest more time and energy. It's not like you can't have another programming task, if and when you again meet in person. – user70848 Feb 9 at 4:35

I don't like take-home tests as part of interviews, for many of the reasons people have already mentioned - extends the hiring process, devalues applicant's time, may not get a call back anyway, etc.

My main issue is that it's unrealistic to how the team actually works and makes the interview process one-sided. An applicant wants if this place is a good fit for them, including the culture, how the team approaches and solves problems. You primarily are also looking for fit, including how they work and if they have the right skill set. A take home test doesn't provide an applicant an opportunity to evaluate the soft qualities of a workplace, and employers don't get to learn how the applicant approached the problem.

A better solution might be to give the applicant a more open-ended problem that can be solved in any type of creative way. You could even restrict it to X language. Rather than email it in, invite them back to present it to yourself and upper management. It gives them autonomy and incentive to do well, because it promises another interview and shows you care to know what they think.

If you must use a test to screen which candidates make it to interview with upper management, I would include the test in the interview so you can discuss their thought process together.

share|improve this answer

Do you want to hire programmers who can't program?

I'm going to venture that you do not.

Hiring programmers who can't actually solve problems and write code is a good way to ruin a tech company. And you're not going to be effective at weeding out the programmers who can't actually program (and there are a lot of those out there) if your hiring process doesn't include some sort of programming test.

Are you willing to lower your standards because everyone's trying to hire programmers?

Maybe you are, but I don't think you should be. As has been noted in the comments and answers, there are candidates out there who aren't going to bother doing programming exercises as part of an interview process because they just don't need to in order to get a job.

But are those really the people you want to hire anyways? The ones who follow the path of least resistance, do whatever is most beneficial to them in the short term, and don't really care enough about your company to complete a simple programming exercise? Those don't seem like positive attributes, and they don't provide much confidence in terms of being able to retain those candidates long-term (which is also important for a tech company, as learning curves tend to be steep and the cost of replacing existing staff is very high).

So let those other businesses have the programmers who can't even be bothered. You don't want to hire them anyways. Unlike them, you have a plan. One that's not based on the "a programmer is a programmer" fallacy. Your focus should be on quality and sustainability, not bodycount.

Is scaring off candidates a problem?

Generally no, as long as they're being scared off for a good reason. You don't want to hire people who aren't up to scratch. And some of the people who say they "can't be bothered" due to high demand might actually be using that as an excuse to cover up a "not really that good at programming so would need all week to complete a 1 hour exercise" situation.

It's good to scare away those candidates. You want to hire the capable, motivated candidates. As long as you're not scaring those ones away too, you're good.

Every candidate you don't scare off is one you have to try and evaluate. And that can be hard to do if you're not giving your technical candidates any technical exercises to use for evaluation.

How can I improve our hiring process?

Check the content of your programming exercise. Is it reasonable and appropriate for an interviewing context?

You don't want something that's going to take days (or even hours) to complete. What you want is something simple to weed out the people who just can't program, ideally with enough room for nuance that the people who can program really well can differentiate themselves. Keep in mind what you're trying to accomplish (weeding out unskilled and non-serious candidates), and ensure your content is tailored to that goal. Don't go overboard.

If you've already got some technical staff, you can use them to sanity-check (and/or help design) your exercise.

And also consider how you administer the exercise. If you just give them some documentation and say "here, do this over the next week and e-mail it to me", that's probably only going to be minimally effective.

Better might be if you can run the exercise through a web portal, which candidates can check in and start the exercise, and once they start a timer starts counting down from 1 hour. Then they either submit something within that hour, or not. That's less open-ended, better retains the candidate's focus, and provides a clear deadline/timebox both so that 1) you're not left waiting around all week for a result that's never going to come, and 2) unqualified candidates don't throw away a week of their time trying to complete your programming exercise. They get 1 hour, they either solve the problem or they do not, and you know the outcome immediately.

And even better would be to bring them in for an onsite interview. Introduce them to a member of your development team. Shut them in a room together with a workstation. Have your developer start with some general/soft interview questions, and then they can pair-program with the candidate to solve the programming exercise. This will tell you not just whether or not the candidate can code, but also how well they work with your team. Your developer should also be able to glean a lot of additional information that you just won't get by looking at a bunch of code that a candidate wrote and then e-mailed to you.

Bottom line

No, you don't want to get rid of your programming exercise. But you may want to review it for appropriate content, make sure it doesn't take too long to solve, and also look at how you're fitting it into your overarching interview process.

A self-directed take-home exercise probably isn't the best approach. But the solution to that isn't to scrap the exercise entirely. Not unless you're okay with hiring crap programmers, at any rate.

Better to scare away a lot of bad candidates and a handful of good than to open up the floodgates and hire a few bad ones.

share|improve this answer

I really think it can help establish who really knows the languages listed on their resume.

If that's really your goal, I would consider a different approach. As other answers indicated, YES, you should always have a coding question, but coding questions rarely get into details of the language. Some questions I've seen that are useful for testing this:

  1. Compare and contrast Java and C (or whatever two languages are relevant, are on the candidate's resume, etc.)
  2. What features do you think should be added to the language? (Or better yet, what do you think about this particular proposed/recent change to the language?)

Engineers who've seen a thing or two know how to answer these questions pretty easily, and in only a few minutes.

share|improve this answer
    
..or write fizz buzz. – djechlin Feb 2 at 21:56
3  
BTW I can pass both these questions in many languages I can't write a hello world in. – djechlin Feb 2 at 21:57
    
I've found them useful. It is extremely hard to "pass" them if you can't say something intelligent about how approaches are different between languages, how memory allocation is different, how concurrency primitives are different etc., and as great as the FizzBuzz question it doesn't lend itself well to discussing the same. – James Kingsbery Feb 2 at 22:17
4  
@James Agreed. And even if they can't write a hello world in Java, if they can compare and contrast Java with various other languages they are probably more useful than someone who can write a hello world, but cannot compare and contrast Java with other languages. – Peter Feb 2 at 22:32

IMHO there is almost 0% chance that a fresh college graduate would be able to do a tough programming code at an entry level. If your coding test takes one week time to complete then you should clearly mention in your requirement that you people are looking for programmers with at least 2+ years of experience because I think that much experience should be required for completing a code work which requires one week to complete. And I think if you are looking for fresh graduates then design your test accordingly and you can find lot of idea on the internet or else you can ask senior programmers working for you to design a suitable test for fresh graduates.

share|improve this answer
    
I wouldn't personally expect a senior developer to write a suitable test, unless they had some experience on what works or not during an interview. It is very easy to become focused on what you know yourself as being easy and obvious, and hard to correct for that, which will needlessly fail candidates who don't know precisely what the test writer does. I think this situation is one reason by tests like FizzBuzz became popular - they seem(ed) to work at the right level of shared knowledge to filter candidates correctly. – Neil Slater Feb 3 at 10:15
    
@Neil Slater:- It could be possible that a senior programmer would not know how to design a test for an entry level programming candidate. But it is not that difficult to know what to expect from an entry level candidate. And when my previous company wanted to hire a new programmer I knew what to ask/expect from a new programmer and I did accordingly and we hired a good candidate. Also at many places where I have been interviewed for programming job I was interviewed by programming seniors of that company. So that is why I suggested that and it is a very common practice. – Rolen Koh Feb 3 at 10:47
2  
Actually takes 30 minutes if you know web development. I give them 1 week since I interview many candidates mid week, and it gives them time to do the test over a time frame that suits their schedule; personal commitments, work, studies etc. I would personally prefer candidates to do the test quicker because it saves me time waiting on them. I am thinking about ditching this and just doing fizzbuzz to make my life easier. – bobo2000 Feb 3 at 11:56

What is your business problem?

Disregarding all the arguments for or against particular tests, it all comes down to a tradeoff - more filters will scare off some good candidates, less filters will let through poor candidates that you might have to replace soon after hiring.

It all comes down to looking at your business situation instead of general practices.

Do you currently have a problem where you lack qualified candidates and are unable to hire as quickly as you need to meet your business goals? You need to ditch this initial programming task.

Do you currently have a problem where you are not satisfied with the quality of your recent hires? Then you need to implement more filters like this.

Do you have both of these problems, and both are equally painful? Congratulations, you have found the right balance for this tradeoff.

share|improve this answer

I think that you have phrased your question a little bit wrong, but the way you've phrased it reflects a common misconception about hiring programmers. Are the candidates being "scared off" by the programming task, or are they filtering your company out of their own consideration because of the task?

An anecdote to demonstrate my point: while job hunting not long ago, I saw a position for a company which seemed average. The way they described their programming process made it sound quite good, but there were very few details, so I was skeptical. Maybe they were a good place to work, maybe not. But I figured I'd see about getting to a phone screen so I could figure out the details and see if they were as good as they seemed.

I clicked on the job posting, and was immediately asked to write a cover letter. Ugh. I think every candidate hates cover letters. I didn't know this company or use their products, so what could I say about them? I googled them, read through their website and product offerings, figured out where I was likely to fit into their org chart if hired, and came up with a few paragraphs "selling" myself.

Next I provided my resume and access to my LinkedIn - but immediately afterward they asked me to fill out my relevant work experience with dates and descriptions. This info is both on my LinkedIn and my resume, it was ridiculous to have to provide the same information 3 times. I closed the browser tab. 5 minutes later I was applying to another company that offered some really cool benefits which the first did not. I could actually apply to another company with better benefits faster than I could jump through the hoops the first company wanted from me.

You need to be sure that your candidates are invested in your company in particular before presenting them with any hoops to jump through, or else they won't jump. Do you do this?

Examples of quality benefits I commonly see tech companies offering:

  1. Remote working.
  2. Free computers/monitors as a signing bonus.
  3. Company contributes to respected open-source projects.
  4. Reimbursement for professional training and/or conferences.
  5. Catered lunches.
  6. Flexible hours.
  7. Opportunity to work with new or unfamiliar technologies.
  8. "Startup culture" - aka lack of politics/bureaucracy.
  9. Company Equity.
  10. Name recognition: your company or your product is well-known. Candidates like to mention where they work and hear people respond with "Oh, neat! I like their products."
  11. Charitable or revolutionary company goals/vision. People like to write code that makes people's lives better.
  12. Above-average pay. Money covers a multitude of organizational sins.
  13. Annual company retreats to cool places.

This list isn't comprehensive, but if your company doesn't offer one or more things like the items on that list, then any obstacle in your hiring process could send a candidate looking for one that does.

So let's say that, for whatever reason, you don't or can't offer incentives like the above for your candidates to convince them to spend writing code for you for free. Then what can you do? I have two alternatives most candidates will prefer over busywork programming tasks:

Alternative #1 - Pay them an hourly rate to do your programming task as though they were a contractor. This encourages them to take it seriously both for professional reasons and because... they're getting paid. This costs you money, but so does any form of recruiting. If you're really good you can even find a way for them to diagnose and fix an actual bug in your code, in which case you're getting something useful for your money.

Alternative #2 - They have probably already written code for free which they will show you if you just ask. Most programmers have code on Github, Bitbucket, Q&A websites like Stack Overflow, or could provide you with some code they have not already published.

Why make them write code they don't care about when you could let them share a passion project with you instead? It's guaranteed to be less boring than reading yet another solution to the same generic problem for the 100th time. And since the code is already written it saves both you and your candidate time. Plus you'll get a look at what sort of code they enjoy writing, which gives insight into their personality and how well they will fit with your company culture.

share|improve this answer
    
re: above-average pay: In my hiring experience, you pay the best, you attract all kinds of freeloaders who think they can blag the role and are only interested in the money (you see this in C-level type all the time :-) ). Never attract people with just the money. – gbjbaanb Feb 8 at 10:12

I'd send them to an online quiz where you can filter out people who have no clue. At least you'd have a sense whether they know what they're talking about.

Early in my career headhunters told me "you're up against people who read the box and put an application on their resume." I assume this may still happen to the young and naive, but once you get trashed in a few interviews you learn this is bad advice...

share|improve this answer

protected by Jane S Feb 2 at 22:53

Thank you for your interest in this question. Because it has attracted low-quality or spam answers that had to be removed, posting an answer now requires 10 reputation on this site (the association bonus does not count).

Would you like to answer one of these unanswered questions instead?

Not the answer you're looking for? Browse other questions tagged or ask your own question.