Inferact
Member of Technical Staff, Cloud Orchestration (Remote)
- Location
- US
- Arrangement
- Remote
- Employment type
- Full-time
- Level
- Staff
- Posted
- 25 August 2026 (about a month ago)
Checked about a month agoApplications go to the employer, never to RoleSprint
About this role
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
ABOUT THE ROLE
We're looking for an cloud orchestration engineer to build the operational backbone that keeps vLLM running reliably at massive scale. You'll design the systems for cluster management, deployment automation, and production monitoring that enable teams worldwide to serve AI models without friction. You'll ensure that vLLM deployments are observable, debuggable, and recoverable, turning operational complexity into infrastructure that just works.
SKILLS AND QUALIFICATIONS
Minimum qualifications:
- Bachelor's degree or equivalent experience in computer science, engineering, or similar.
- Strong experience with Kubernetes and container orchestration at scale.
- Experience designing and implementing custom Kubernetes operators.
- Proficiency in Python/Rust/Go and infrastructure-as-code tools (Terraform, Helm, etc).
- Experience managing GPU clusters and debugging hardware issues.
- Ability to work across cloud platforms (AWS, GCP, Azure) and on-premise infrastructure.
Preferred qualifications:
- Experience with ML-specific orchestration tools (Ray, Slurm).
- Knowledge of GPU scheduling, multi-tenancy, and resource optimization.
- Familiarity with vLLM deployment patterns and configuration.
- Track record of improving operational reliability for ML systems.
Bonus points if you have:
- Experience deploying inference systems on large-scale GPU (1,000+) clusters.
LOGISTICS
- Location: Fully remote, worldwide. We're timezone-flexible but expect regular overlap with Pacific Time for critical syncs.
- Compensation: We offer competitive compensations (salary + equity) compared to the local market conditions.
- Visa sponsorship: We sponsor visas on a case-by-case basis.
- Benefits: Inferact offers competitive benefits appropriate to your location, including health coverage where applicable.
Eligible remote locations
- US
Related jobs
Ready to make a decision?
This role is either worth your time or it isn’t.
Analyze the posting against your experience, see the gaps clearly, and build the right materials only if the opportunity makes sense.
Nothing is submitted automatically. You choose what happens next.
About this listing
Published on Ashby under the board identifier Inferact, which is the name the employer’s own job board carries. RoleSprint has not verified the company’s registered or trading name, so it is shown exactly as published rather than tidied up.
RoleSprint is not the employer and not a recruiter. Applications are made on the employer’s own site and never reach us; what RoleSprint does is help you decide whether a role is worth your time and prepare for it if it is.
Published 25 August 2026, last checked about a month ago. A posting stops being advertised here 90 days after the employer published it, and one the employer takes down is marked closed rather than quietly removed.