Optum Logo

Optum

Senior Data Engineer-Data Bricks, Airflow, Snowflake, AI

Posted One Month Ago
Be an Early Applicant
In-Office
Hyderabad, Telangana, IND
Senior level
In-Office
Hyderabad, Telangana, IND
Senior level
Design and maintain scalable Databricks data pipelines, orchestrate workflows with Airflow, and build optimized Snowflake ELT solutions. Develop Python-based APIs and data services deployed on Azure, applying cloud security, scalability, monitoring, and cost-optimization practices. Implement data quality and observability controls, collaborate with analytics and platform teams, participate in architecture and code reviews, and resolve complex production issues across data infrastructure.
The summary above was generated by AI
Requisition Number: 2376265
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.
Primary Responsibilities:
  • Design, develop, and maintain scalable data pipelines using Databricks (Spark / PySpark)
  • Orchestrate and monitor workflows using Apache Airflow for batch and incremental processing
  • Build and optimize ELT pipelines in Snowflake, ensuring performance, reliability, and cost efficiency
  • Develop production-quality Python code for data processing, transformations, and integrations
  • Design, build, and host APIs and data services using modern Python frameworks
  • Deploy and manage APIs using Azure-native services (Azure Functions, App Services, API Management)
  • Apply Azure cloud best practices for security, scalability, monitoring, resiliency, and cost optimization
  • Implement data quality checks, logging, alerting, and observability for production pipelines
  • Collaborate with analytics, product, and platform teams to enable downstream data consumption
  • Participate in architecture design, code reviews, and technical decision-making
  • Troubleshoot and resolve complex production issues across data pipelines and cloud infrastructure
  • Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Required Qualifications:
  • B.Tech. / MCA / Graduation
  • 4+ years of total experience
  • Solid hands-on experience with Databricks (Spark / PySpark) in production environments
  • Experience building and hosting REST APIs / data services using Python frameworks
  • Solid experience with Microsoft Azure, including cloud-native architecture and best practices
  • Solid working experience with Snowflake, including data modeling and performance tuning
  • Solid understanding of data warehousing, ELT patterns, and modern cloud data architecture
  • Proven expertise with Apache Airflow for workflow orchestration and dependency management
  • Proven advanced Python programming skills for data engineering and API development
  • Demonstrated ability to independently own, design, and deliver end-to-end data engineering solutions

Preferred Qualification:
  • Experience with CI/CD pipelines, Git-based version control, and deployment automation
  • Good Knowledge of SQL, Pyspark, Snowflake cloud tech stacks, python, exposure in code management, AI usage to add efficiency

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.

Optum Hyderabad, Telangana, IND Office

Hyderabad, India, India

Similar Jobs at Optum

Yesterday
In-Office
Hyderabad, Telangana, IND
Senior level
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Leads a team responsible for designing, building, and maintaining scalable data pipelines, architectures, warehouses, lakes, and streaming platforms. Oversees end-to-end analytics data product delivery, data security, governance, quality, optimization, and production support. Partners with business and engineering stakeholders to enable BI, advanced analytics, and machine learning. Mentors data engineers and drives technical standards and continuous improvement.
Top Skills: Apache AirflowApache KafkaSparkAws RedshiftAzureCi/CdDatabricksEltETLGitJavaLinuxPythonScalaShell ScriptingSnowflakeSQL
Yesterday
In-Office
Hyderabad, Telangana, IND
Mid level
Mid level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Build and maintain ETL processes, data pipelines, automated analytics solutions, dashboards, and visualizations. Analyze healthcare, provider, and claims data using Python and SQL to identify trends and operational improvements. Collaborate with engineering, business, and data governance teams to define requirements, ensure data quality, and apply responsible analytical practices across cloud and big data environments.
Top Skills: AWSAzureDatabricksETLGCPPower BIPythonRelational DatabasesSQLTableau
Yesterday
In-Office
Hyderabad, Telangana, IND
Entry level
Entry level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Build and operate cloud-native ETL pipelines using Azure, Databricks, Python, PySpark, and Spark SQL. Modernize on-premises ETL workloads to cloud platforms, optimize large-scale batch and incremental processing, implement data validation and monitoring, and support data warehousing, governance, documentation, and cross-functional delivery.
Top Skills: Apache AirflowSparkAWSAzureDatabricksDatastageGCPPysparkPythonSnowflakeSpark SqlSQL

What you need to know about the Hyderabad Tech Scene

Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account