We've been using it for DevOps roles which are not highly specialised in any particular technologies and require ability to solve problems at a general level.
The test is intentionally designed to filter out candidates who cannot meet or do not want to meet the technical requirements.
The point is to have a conversation about a project that the candidate understands well and is passionate about rather than asking them a bunch of questions that we already know the answers to.
Before the interview we review the code base and try to understand what it’s doing by the documentation provided in the readme. During the interview we get the candidate to demo the project and any questions that came up in our code review we ask at the stage of execution in the project demo. The interview lasts for 2 hours and we’ve had several rounds of candidates put through this process.
Both we as interviewers and the feedback from candidates has been very positive. The interview ends up being a day-to-day normal experience within the team and this really helps us to gauge the team fit. I think this helps to hire people that compliment and expand our skill set rather than hire people who are basically ourselves.
The test is intentionally designed to filter out candidates who cannot meet or do not want to meet the technical requirements.