Designs and builds scalable machine learning and large language model inference platforms across AWS and Azure. Responsibilities include production inference pipelines, Kubernetes deployments, vLLM and REST services, event-driven architectures, CI/CD, model lifecycle management, GPU optimization, and engineering best practices. The role partners with data science, cloud, platform, and leadership teams to deliver reliable, cost-effective ML systems.
Requisition Number: 2392529
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.
We are looking for an ML Engineer responsible for designing and building scalable ML/LLM inference platforms across AWS and Azure.
Primary Responsibilities:
Required Qualifications:
At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone - of every race, gender, sexuality, age, location and income - deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.
We are looking for an ML Engineer responsible for designing and building scalable ML/LLM inference platforms across AWS and Azure.
Primary Responsibilities:
- Build and maintain production ML/LLM inference pipelines
- Deploy and manage ML workloads on Kubernetes, EKS, and AKS
- Build scalable inference services using vLLM and REST APIs
- Design event-driven and asynchronous architectures using queues and messaging services
- Develop CI/CD pipelines for ML models and inference services
- Manage model versioning, deployment, promotion, rollback, and release workflows
- Optimize inference for GPU utilization, latency, throughput, reliability, and cost
- Review peer code, architecture, and technical designs and drive engineering best practices
- Work closely with Data Scientists, Platform/Cloud teams, and leadership on architecture and delivery decisions
- Comply with all applicable Company policies, procedures, and business directives, changes including those relating to work location, team assignments, work schedules, and flexible work arrangements
Required Qualifications:
- Skills:
- Python, ML/LLM Inference, AWS, Azure, Kubernetes, EKS/AKS, Docker, vLLM, REST APIs, CI/CD, Event-Driven Architecture, GPU workloads, and MLOps
At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone - of every race, gender, sexuality, age, location and income - deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.
Optum Hyderabad, Telangana, IND Office
Hyderabad, India, India
Similar Jobs at Optum
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Develop and maintain full-stack applications using Angular, Java, SQL, REST APIs, microservices, Kafka, CI/CD, Docker, and Kubernetes. Build secure, scalable event-driven services, automate deployments, resolve production issues, and support features through production. Collaborate across teams, follow security and code-quality practices, and continuously adopt new technologies, including AI-related tools.
Top Skills:
AngularApache KafkaCi/CdDevOpsDockerGitJavaKubernetesMicroservicesRestful ServicesSQL
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Process enrollment and eligibility information for US healthcare plans, applying concepts such as deductibles, coinsurance, copays, out-of-pocket limits, coordination of benefits, and alternate benefits. The role requires accurate data handling, issue identification and correction, email communication, quality focus, and participation in special projects. Candidates must be graduates, possess Microsoft Word and Excel skills, communicate effectively in English, and be open to night shifts.
Top Skills:
ExcelMicrosoft Word
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Leads Salesforce software development, translating business requirements into scalable technical designs and implementing Apex, LWC, integrations, automation, security, and declarative configurations. Manages deployments and CI/CD across environments, conducts code reviews and testing, documents solutions, supports technical discussions, mentors developers, and contributes to planning and estimation. Requires extensive Salesforce and software development experience, including technical leadership, LWC, integrations, security models, and Salesforce clouds.
Top Skills:
ApexApproval ProcessesAuraAuth ProvidersBoomiBulk ApiCi/CdConnected AppsCopadoData CloudEinsteinFlow BuilderGearsetGitJenkinsLightning Web Components (Lwc)MulesoftNamed CredentialsOauth 2.0Platform EventsRest ApiSalesforceSfdxSoap ApiSsoVisualforce
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.

