This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior Software Engineer - REMOTE. This role focuses on evaluating the performance of AI coding agents in various real-world scenarios. You will primarily assess their outputs, considering aspects like engineering judgment and quality of responses. Unlike traditional engineering roles, the emphasis here is on understanding and critiquing how well these models emulate great engineering thought processes. Your insights will directly impact the development of these advanced tools, ensuring they align more closely with experienced engineers' expectations.
Accountabilities
- Evaluate AI-generated coding interactions end-to-end
- Judge the usefulness and correctness of outputs
- Assess quality of explanations and reasoning
- Differentiate levels of response quality
- Provide constructive feedback on outputs
- Help define excellence in interaction with coding tools
Requirements
- Staff / Principal-level engineer or equivalent experience
- Strong background in TypeScript / JavaScript or Python
- Experience with OpenAI Codex and Claude Code
- Familiarity with modern AI-assisted development workflows
- Ability to evaluate code without deep line-by-line review
- Comfortable giving direct feedback on technical outputs
- High standards for good engineering practices
Benefits
- Competitive hourly pay based on location
- Flexible working hours (10–20 hrs/week)
- Remote work environment
- Potential for contract extension
- Opportunities for ongoing training and development
Why Apply Through Jobgether?
We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.
We appreciate your interest and wish you the best!
Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.
#LI-CL1
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.