Software Engineer, Inference
Company revealed to Pro
- Location
- Remote (United States)
- Pay
- $195K to $345K a year
- Employment
- Full-time
Employer posted Oct 8 · Added to VDJ Oct 9 · Last checked today
AI company. This company doesn't make vertical drama. We list the role because the skills carry straight over to vertical work.
About the role
A new role you can do remotely. Pro members see the company and apply now. It opens to everyone on November 7.
Skills and tools
Pythonscheduling
What they're looking for
- Strong Python and system-architecture skills.
- Experience deploying models with PyTorch, Hugging Face, vLLM, SGLang, TensorRT-LLM, or similar.
- Experience with queues, scheduling, traffic control, and fleet management at scale.
- Experience with Linux, Docker, and Kubernetes, and with orchestration, deployment, and scheduling.
- Familiarity with Redis and S3-compatible storage.
Nice to have
- Modern networking stacks including RDMA (RoCE, InfiniBand, NVLink).
- High-performance large-scale ML systems (100+ GPUs).
- CUDA, and FFmpeg or multimedia processing.
We found this on the studio's own hiring page.
Pro members see the company and the apply link, and apply first. It opens to everyone after 30 days.
Get Pro for $10 a weekSign up free to open 3 fresh jobs a week, company and apply link included.
Fresh role: Pro members see the company and apply for the first 30 days. More Tech & business jobs →