Designs and delivers enterprise-scale Azure lakehouse platforms, data products, ETL/ELT and streaming pipelines using Databricks, Spark, Delta Lake, and related Azure services. Leads and mentors data engineers, establishes engineering standards, drives Agile delivery, and collaborates with technical and business stakeholders. Implements CI/CD, security, governance, monitoring, data quality, lineage, observability, performance tuning, and cost optimization for production data platforms.
Description and Requirements
We're Hiring: Senior Azure Data Engineer / Data Engineering Lead
Role: Senior Azure Data Engineer / Data Engineering Lead | Experience: 8+ Years | Level: Senior Individual Contributor
About the Role
We are looking for a senior Azure Data Engineering professional who can design, build, and lead delivery of enterprise-scale cloud data platforms. The ideal candidate will bring strong hands-on engineering depth across Azure, Databricks, Spark, Data Lakehouse, and modern data pipelines, while also guiding engineers, collaborating with business stakeholders, and driving high-quality delivery in an Agile and DevOps environment.
What You'll Lead and Deliver
• Modern Data Platform & Lakehouse Engineering:
§ Architect and deliver scalable data lakehouse solutions using Azure Data Lake Storage, Azure Databricks, Delta Lake, Unity Catalog, and Medallion architecture.
§ Design curated data products, data marts, and analytics-ready datasets for business analysts, data scientists, and enterprise reporting teams.
§ Apply strong data modeling practices, partitioning strategies, schema evolution, performance tuning, and cost optimization.
• Data Pipelines, ETL/ELT & Streaming:
§ Build reliable batch and near-real-time pipelines using Azure Databricks, Apache Spark, PySpark, SQL, Azure Data Factory, Synapse, and related Azure services.
§ Implement ingestion frameworks for structured, semi-structured, and unstructured data from multiple enterprise sources.
§ Ensure data quality, lineage, validation, observability, error handling, and reusable pipeline patterns.
• Engineering Leadership:
§ Lead and mentor a team of data engineers, set engineering standards, review designs, and guide implementation decisions.
§ Collaborate with architects, product owners, business stakeholders, data scientists, security, platform, and operations teams.
§ Drive Agile delivery, estimation, sprint planning, technical roadmaps, and continuous improvement across the team.
• DevOps, Security & Governance:
§ Implement CI/CD for data workloads using Azure DevOps or GitHub Actions, including automated testing, deployment, and release governance.
§ Apply secure engineering practices using Microsoft Entra ID, role-based access control, secrets management, and data governance controls.
§ Promote monitoring, alerting, operational readiness, and SRE-aligned practices for production data platforms.
Candidate Profile
• Education: Bachelor's degree in Computer Science, Engineering, Information Technology, Data Engineering, or equivalent practical experience.
• Experience:
§ 8+ years of experience in data engineering, data platform engineering, ETL/ELT, BI, analytics, or cloud data application development.
§ 4+ years of hands-on experience designing and delivering cloud-based data platforms on Microsoft Azure.
§ 2+ years of strong experience with Azure Databricks, Apache Spark, PySpark, Spark SQL, Delta Lake, and Lakehouse architecture.
§ Proven experience leading engineers, reviewing architecture/design, owning delivery outcomes, and driving technical excellence.
• Core Azure Skills:
§ Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Azure SQL, Dedicated SQL Pool, Cosmos DB, Logic Apps, Azure Monitor, and Application Insights.
§ Experience with Microsoft Entra ID, access control, secure connectivity, key management, and enterprise data governance.
• Azure Databricks Skills:
§ Hands-on expertise in Databricks workspaces, notebooks, jobs/workflows, clusters/serverless compute, Delta tables, Auto Loader, Delta Live Tables or Lakeflow-style declarative pipelines.
§ Strong understanding of Unity Catalog, catalog/schema/table governance, data lineage, access controls, data quality, and lakehouse security practices.
§ Experience optimizing Spark jobs, Delta Lake performance, partitioning, Z-ordering/clustering strategies, workload monitoring, and cost-efficient compute usage.
Skills & Competencies
• Technical Skills:
§ Python, PySpark, SQL, Spark SQL, data modeling, ETL/ELT design, orchestration, data quality, metadata management, and performance tuning.
§ Modern lakehouse patterns including Bronze/Silver/Gold layers, Delta Lake, schema evolution, slowly changing dimensions, and reusable ingestion frameworks.
§ CI/CD, Git, Azure DevOps, automated testing, environment configuration, release pipelines, SonarQube, and secure coding practices.
§ Monitoring and observability using Azure Monitor, Application Insights, logs, alerts, pipeline health checks, and operational dashboards.
• Leadership & Collaboration:
§ Ability to lead engineers, mentor junior team members, influence design decisions, and promote engineering best practices.
§ Strong communication skills with the ability to work across global, multi-cultural teams and translate business needs into scalable technical solutions.
§ Comfortable working in a fast-paced Agile environment with ownership mindset, delivery focus, and continuous improvement culture.
• Certifications Preferred / Add-ons:
§ Microsoft Certified: Azure Data Engineer Associate.
§ Microsoft Certified: Azure Databricks Data Engineer Associate.
§ Databricks Certified Data Engineer Associate or Professional.
§ Azure Solutions Architect, Azure Developer, or relevant cloud/data engineering certifications are a plus.
Why Join Us?
Be part of MetLife's technology transformation journey and help build modern, secure, scalable, and governed data platforms that create meaningful business impact. If you are passionate about Azure, Databricks, data engineering, and leading teams to deliver high-quality solutions, we would love to connect.
About MetLife
Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World's 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.
As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.
Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us!
#BI-Hybrid
We're Hiring: Senior Azure Data Engineer / Data Engineering Lead
Role: Senior Azure Data Engineer / Data Engineering Lead | Experience: 8+ Years | Level: Senior Individual Contributor
About the Role
We are looking for a senior Azure Data Engineering professional who can design, build, and lead delivery of enterprise-scale cloud data platforms. The ideal candidate will bring strong hands-on engineering depth across Azure, Databricks, Spark, Data Lakehouse, and modern data pipelines, while also guiding engineers, collaborating with business stakeholders, and driving high-quality delivery in an Agile and DevOps environment.
What You'll Lead and Deliver
• Modern Data Platform & Lakehouse Engineering:
§ Architect and deliver scalable data lakehouse solutions using Azure Data Lake Storage, Azure Databricks, Delta Lake, Unity Catalog, and Medallion architecture.
§ Design curated data products, data marts, and analytics-ready datasets for business analysts, data scientists, and enterprise reporting teams.
§ Apply strong data modeling practices, partitioning strategies, schema evolution, performance tuning, and cost optimization.
• Data Pipelines, ETL/ELT & Streaming:
§ Build reliable batch and near-real-time pipelines using Azure Databricks, Apache Spark, PySpark, SQL, Azure Data Factory, Synapse, and related Azure services.
§ Implement ingestion frameworks for structured, semi-structured, and unstructured data from multiple enterprise sources.
§ Ensure data quality, lineage, validation, observability, error handling, and reusable pipeline patterns.
• Engineering Leadership:
§ Lead and mentor a team of data engineers, set engineering standards, review designs, and guide implementation decisions.
§ Collaborate with architects, product owners, business stakeholders, data scientists, security, platform, and operations teams.
§ Drive Agile delivery, estimation, sprint planning, technical roadmaps, and continuous improvement across the team.
• DevOps, Security & Governance:
§ Implement CI/CD for data workloads using Azure DevOps or GitHub Actions, including automated testing, deployment, and release governance.
§ Apply secure engineering practices using Microsoft Entra ID, role-based access control, secrets management, and data governance controls.
§ Promote monitoring, alerting, operational readiness, and SRE-aligned practices for production data platforms.
Candidate Profile
• Education: Bachelor's degree in Computer Science, Engineering, Information Technology, Data Engineering, or equivalent practical experience.
• Experience:
§ 8+ years of experience in data engineering, data platform engineering, ETL/ELT, BI, analytics, or cloud data application development.
§ 4+ years of hands-on experience designing and delivering cloud-based data platforms on Microsoft Azure.
§ 2+ years of strong experience with Azure Databricks, Apache Spark, PySpark, Spark SQL, Delta Lake, and Lakehouse architecture.
§ Proven experience leading engineers, reviewing architecture/design, owning delivery outcomes, and driving technical excellence.
• Core Azure Skills:
§ Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Azure SQL, Dedicated SQL Pool, Cosmos DB, Logic Apps, Azure Monitor, and Application Insights.
§ Experience with Microsoft Entra ID, access control, secure connectivity, key management, and enterprise data governance.
• Azure Databricks Skills:
§ Hands-on expertise in Databricks workspaces, notebooks, jobs/workflows, clusters/serverless compute, Delta tables, Auto Loader, Delta Live Tables or Lakeflow-style declarative pipelines.
§ Strong understanding of Unity Catalog, catalog/schema/table governance, data lineage, access controls, data quality, and lakehouse security practices.
§ Experience optimizing Spark jobs, Delta Lake performance, partitioning, Z-ordering/clustering strategies, workload monitoring, and cost-efficient compute usage.
Skills & Competencies
• Technical Skills:
§ Python, PySpark, SQL, Spark SQL, data modeling, ETL/ELT design, orchestration, data quality, metadata management, and performance tuning.
§ Modern lakehouse patterns including Bronze/Silver/Gold layers, Delta Lake, schema evolution, slowly changing dimensions, and reusable ingestion frameworks.
§ CI/CD, Git, Azure DevOps, automated testing, environment configuration, release pipelines, SonarQube, and secure coding practices.
§ Monitoring and observability using Azure Monitor, Application Insights, logs, alerts, pipeline health checks, and operational dashboards.
• Leadership & Collaboration:
§ Ability to lead engineers, mentor junior team members, influence design decisions, and promote engineering best practices.
§ Strong communication skills with the ability to work across global, multi-cultural teams and translate business needs into scalable technical solutions.
§ Comfortable working in a fast-paced Agile environment with ownership mindset, delivery focus, and continuous improvement culture.
• Certifications Preferred / Add-ons:
§ Microsoft Certified: Azure Data Engineer Associate.
§ Microsoft Certified: Azure Databricks Data Engineer Associate.
§ Databricks Certified Data Engineer Associate or Professional.
§ Azure Solutions Architect, Azure Developer, or relevant cloud/data engineering certifications are a plus.
Why Join Us?
Be part of MetLife's technology transformation journey and help build modern, secure, scalable, and governed data platforms that create meaningful business impact. If you are passionate about Azure, Databricks, data engineering, and leading teams to deliver high-quality solutions, we would love to connect.
About MetLife
Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World's 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.
As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.
Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us!
#BI-Hybrid
MetLife Hyderabad, Telangana, IND Office
MetLife Hyderabad, IN Office
11th, 12th & 13th Floor, Prestige Sky Tech, Poppalagunda Village, Gandipet Mandal, Hyderabad, Telangana, India, 500032
Similar Jobs at MetLife
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Lead and operationalize data governance: develop standards, policies, metadata, glossaries and lineage (Collibra); manage CDEs; resolve governance issues; define metrics and SLAs; coach and lead analysts; collaborate with Business, Technology, Operations and D&A teams.
Top Skills:
CollibraGen AiSQL
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Lead design and execution of data governance policies, metadata management, lineage, and stewardship. Develop standards, tools, and training; manage governance platforms (e.g., Collibra); identify Critical Data Elements; monitor metrics and SLAs; resolve governance issues; collaborate across Business, Technology, and D&A teams; and provide people leadership to coach and develop data governance talent.
Top Skills:
CollibraGen AiSQL
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Oversee soft services, facility maintenance, vendors, procurement, inventory, invoicing, contracts, and preventive maintenance. Manage AMCs for HVAC, electrical, elevators, fire safety, and plumbing systems. Prepare MIS reports, coordinate repairs and compliance activities, manage stakeholder expectations, and supervise, train, and engage facilities staff and service providers while maintaining service quality, safety, and budget adherence.
Top Skills:
Electrical SystemsElevatorsFire Safety SystemsHvacInventory Management SystemsMis ReportingPlumbingPreventive Maintenance
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
