# Software Engineer > Raydar · San Francisco, United States · Full-time · Posted 2026-10-12 **Salary:** USD 140,000–185,000 **Workplace:** on_site ## Description About the company Our client is a software company. The role Raydar is recruiting for this role on behalf of our client. Own the testing and reporting of newly released machine learning models, running them through a suite of task-based assessments and analyzing the results. Work closely with research and communications colleagues and external partners, and keep the supporting evaluation infrastructure running. The pace follows release cycles, with intense sprints followed by quieter periods. What you'll do \- Run new model releases through an established set of assessments and publish the results. \- Collaborate with external model developers on measuring performance. \- Analyze common failure patterns and recurring weaknesses in model outputs. \- Share notable findings with the communications team for public release. \- Add new models and maintain the integrations in an internal model library. \- Maintain and improve the infrastructure used to run both agentic and non-agentic assessments. \- Partner with researchers on designing new assessments. ## Requirements What we're looking for \- Early-career engineer with experience at a company known for a high engineering bar. \- Degree in computer science or a related field from a top 30 university. \- Strong Python skills for backend engineering. \- Solid hands-on coding ability, including coding without AI assistance. \- Ability to work autonomously and take on tasks independently. \- Willingness to sprint intensely, including shipping results within 12 to 48 hours of a release and working late when needed. \- Genuine enthusiasm for large language models and working closely with the teams that build them. Bonus points \- Machine learning or AI research experience. \- Startup or founder experience, including early-stage or forward-deployed engineering roles. \- Previous benchmarking or evaluation work. ## Benefits Compensation and benefits \- Base salary: USD 140,000 to 185,000 per year \- Equity \- Health and dental coverage \- Unlimited paid time off \- Relocation support Location and work model \- San Francisco, CA, United States \- On-site, 5 days per week in office \- Full-time ## Apply [Apply at Raydar](https://apply.workable.com/raydar/j/A26C5BA99F/apply) --- Powered by [Workable](https://www.workable.com)