Leads enterprise data engineering strategy and designs scalable cloud and hybrid data architectures. Responsibilities include building high-volume ETL/ELT pipelines, modernizing data platforms, implementing governance and security, supporting streaming analytics and machine learning workloads, and establishing DataOps practices. The role provides technical leadership and mentorship, partners with data science and product teams, translates business requirements into technical solutions, and develops REST APIs and Azure PaaS solutions.
Job Title: Data Engineer - Lead
Experience Required: 8+ Years
Location: Hyderabad/Ahmedabad
Employment Type: Full-time
Position Overview
We are seeking an experienced Data Engineer with over 8 years of experience in designing, developing, and optimizing enterprise-scale data solutions. The ideal candidate will lead our data engineering strategy, architect cloud-based data platforms, and mentor engineering teams to deliver scalable and reliable data systems that power business intelligence, AI, and analytics.
Roles & Responsibilities
· Design and implement modern data architectures across cloud and hybrid environments.
- Develop and optimize data pipelines and ETL/ELT processes for high-volume, high-velocity data.
- Lead data platform modernization initiatives using cutting-edge tools and frameworks.
- Define and enforce data governance, security, and compliance standards.
- Partner with Data Science, BI, and Product teams to ensure data availability, accuracy, and performance.
- Provide technical leadership and mentorship to data engineers and developers.
- Implement DevOps/Data Ops practices for automated testing, deployment, and monitoring.
- Continuously evaluate and introduce innovative data technologies that enhance efficiency and scalability.
- Translate business requirements into robust and scalable technical data solutions.
- Support real-time and streaming data architectures for analytics and ML workloads.
- Designing and developing REST APIs / Azure App Services and implementing Azure PaaS solutions.
Required Skills & Qualifications
- Bachelor’s or master’s in computer science, Engineering, or related field.
- 8+ years in Data Engineering or Data Architecture roles.
- Expertise in Python, SQL, Spark, Kafka, and Airflow.
- Proven experience with cloud platforms (AWS, Azure, or GCP).
- Hands-on experience with Snowflake, Databricks, or Delta Lake.
- Strong understanding of data modelling, governance, and lineage tools.
- Excellent problem-solving, leadership, and communication skills.
Good to Have Skills:
· C#, .NET Core, Azure PaaS, Problem-Solving, REST API Development, EF Core, Leadership, Agile Practices.
· Blazor UI, Azure IPaaS (Azure Integration Services), Design Patterns, and Cloud Security best practices.
Similar Jobs
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Develop advanced avionics features for Honeywell’s ANTHEM cockpit platform. Responsibilities include defining system architecture, capturing and validating requirements, integration and functional testing, troubleshooting interfaces, supporting SRR/PDR/CDR reviews, and coordinating with globally distributed teams. The role requires avionics certification knowledge, display-system development experience, systems safety analysis, ARP4754A expertise, and proficiency with Agile tools including DOORS NG and JIRA.
Top Skills:
AgileArp4754AAtlassian JiraAvionics HardwareAvionics SoftwareAvionics SystemsEpic/ApexIbm Rational Doors Ng
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Leads multiple aerospace datalink product development teams in Bangalore, overseeing avionics system and software design, program execution, budgets, quality, delivery, and customer support. Drives Agile transformation, cost and cycle-time reduction, digital engineering initiatives, innovation, common avionics products, strategic planning, talent development, and performance culture. Requires deep avionics expertise, aerospace software development experience, knowledge of DO-178B/C and ARP4754A, and substantial people and technical leadership.
Top Skills:
AgileAIArp4754AAutomationAvionicsDigital ThreadDigital TwinHoneywell Operating SystemLean Product DevelopmentModel-Based Systems Engineering (Mbse)Rtca Do-178B/C
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Provides technical leadership for embedded platform software and avionics certification. Develops BSPs, boot software, platform abstraction layers, device drivers, middleware, requirements, architecture, and DO-178C certification documentation. Leads certification activities, solves complex technical issues, collaborates with stakeholders, supports talent development, and drives software quality and continuous improvement. Requires extensive real-time embedded software experience in C, C++, assembly, bare-metal environments, multicore systems, and Deos RTOS.
Top Skills:
Arinc 429ArmAssemblyBare-MetalBoard Support PackagesCC++Deos RtosDevice DriversDo-178CEthernetMiddlewareMulticore SystemsNetwork Communication StacksPowerpcRs-232Rs-422X86
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
