Performance Engineer, On-Device Inference at Sarvam

SarvamBengaluru
Checked by our scam filter
Apply on Sarvam’s site

Who can apply

The employer hasn’t stated batch, branch or CGPA requirements for this role. Upload your résumé to see how well you match.

About this role

About Sarvam

Sarvam is building the bedrock of Sovereign AI for India. The company is developing India’s full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India’s leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC.

About the Role

Take Sarvam models from research-handoff state to production-ready artifacts on at least two of our target chipsets (Intel xPU, ARM xPU, Apple xPU, Nvidia / AMD GPUs). You'll own 1 - 2 (model, chipset) pairs end-to-end and partner with the consuming app team during integration.

What You’ll Do

Quantize, validate accuracy, benchmark, and document. Author the deployment workbook for each pair you own.

Embed part-time with consuming teams during integration; debug perf and accuracy issues alongside them.

Maintain and extend the team's benchmark harness.

What We're Looking For

3+ years on ML systems.

Solid PyTorch + ONNX export experience including the gotchas (dynamic shapes, control flow, custom ops).

Quantization in production on at least one real model.

Comfort with at least two of: ONNX Runtime, TensorRT, CoreML, OpenVINO, QNN, LiteRT.

Profiling fluency on at least one platform.

Bonus Points

Custom op authoring in any runtime.

Why Sarvam?

Sarvam is a fast-moving, high talent-density team building full-stack AI for India, working on problems that push the frontiers of AI with real population-scale impact.

Work alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar

High ownership and high impact, from day one

Everything we do is AI-first, from the way we build and ship to the way we think about problems

You can work on problems that could change how an entire country learns, works, and communicates

If you want to work on problems at the frontier of AI in India, Sarvam is the place to be.

Questions freshers ask

Is this role open to freshers?

Sarvam hasn't stated an experience requirement for this role. Umbrix only lists roles that are fresher-eligible or leave experience unstated, so it's worth applying and letting the employer decide.

Does applying cost anything?

No. Applying is free, and it always should be. Umbrix runs every listing through a scam filter before publishing it, and any posting that asks for a registration fee, a security deposit or a training charge is rejected outright. If this employer asks you for money at any stage, that is a scam — stop and report it.

Where does this listing come from?

This posting was collected from Sarvam's own careers listing or a licensed job feed, checked by our scam filter, and re-verified on each ingest run. The Apply button sends you to the original posting — Umbrix never sits between you and the employer.

Is this job still open?

Umbrix re-checks every listing against its source on a schedule and closes any posting that disappears. This it & software role was still live at the last check. If the employer's page says otherwise, it closed since then.

Similar it & software roles in Bengaluru