# Systems Software Engineer

> Raydar · San Francisco, United States · Full-time · Posted 2026-10-06

**Salary:** USD 200,000–300,000

**Workplace:** on_site

## Description

About the company

Our client is a technology company.

The role

Raydar is recruiting for this role on behalf of our client. Work on low-level performance and infrastructure engineering for a production machine learning serving platform. You will tune software for speed and efficiency, run large compute clusters, and speak directly with customers as part of a small, high-ownership team.

What you'll do

\- Deliver fast support for newly released open-source models, tuned for low latency and high throughput.

\- Improve the model serving stack with techniques such as request batching, caching, decoding strategies and quantization.

\- Write and tune low-level GPU kernels across several hardware vendors.

\- Design, deploy and operate compute clusters built from mixed hardware.

\- Run production inference across a varied fleet, with attention to reliability, observability and cost efficiency at scale.

\- Talk with customers and help set the direction of your own work with a high degree of autonomy.

## Requirements

What we're looking for

\- Deep understanding of how computers work, including architecture, memory hierarchy and operating system internals, beyond application-level coding.

\- Backend, infrastructure or systems experience at a well-regarded technology company or an early-stage startup.

\- Real enthusiasm for using AI agents and coding tools to improve your own workflow.

\- A computer science degree from a strong undergraduate program.

\- Clear communication and emotional intelligence, as roughly 10 to 20 percent of the role is customer-facing.

\- Comfort working on-site five days a week.

Bonus points

\- Experience deploying or operating infrastructure at scale, such as clusters or large GPU fleets.

\- Experience with machine learning inference optimization.

\- Familiarity with GPU programming.

\- Academic background in low-level systems topics.

\- New graduates with strong internships are welcome.

## Benefits

Compensation and benefits

\- Base salary: USD 200,000 to 300,000 per year

\- Equity

\- Health, dental and vision coverage

\- Meals provided

\- Unlimited paid time off

\- Parental leave

Location and work model

\- San Francisco, CA, United States

\- On-site, 5 days per week in office

\- Full-time

## Apply

[Apply at Raydar](https://apply.workable.com/raydar/j/4F86EA5514/apply)

---
Powered by [Workable](https://www.workable.com)
