Instead of these interviews, consider this approach: Ask the applicant to provide links to their own open projects and/or to merged PRs they submitted to others open projects. Over each submitted relevant link, run a script that computes: `log(stars) * git_diff_length`. For one's own projects, git_diff_length is relative to an empty repo. If a link is not relevant to the position, do not consider it. For each applicant, use the sum of the top-scoring three links. This is assuming that the stars are not fake which is something you have to evaluate by seeing if the starring users have unique repos of their own or not.
Comments
Instead of these interviews, consider this approach: Ask the applicant to provide links to their own open projects and/or to merged PRs they submitted to others open projects. Over each submitted relevant link, run a script that computes: `log(stars) * git_diff_length`. For one's own projects, git_diff_length is relative to an empty repo. If a link is not relevant to the position, do not consider it. For each applicant, use the sum of the top-scoring three links. This is assuming that the stars are not fake which is something you have to evaluate by seeing if the starring users have unique repos of their own or not.