Lead data engineering teams to optimize cloud-based data systems. Manage data quality and collaborate with cross-functional teams while overseeing team performance.
About the RoleWe are hiring a Senior Manager to lead data engineering and infrastructure optimization efforts focused on retail warehousing systems, cloud platforms (Azure/GCP), and business analytics. This role blends deep technical knowledge with strong people leadership, platform strategy, and an understanding of reporting needs across operations.What You'll Do
- Lead data engineering teams responsible for building and maintaining cloud-based data pipelines and infrastructure
- Drive infrastructure performance and cost optimization using Azure and/or GCP platforms
- Manage data quality, access controls, and cataloging using tools like Unity Catalog or similar
- Collaborate with warehouse, supply chain, and BI teams to deliver reliable data for analytics and reporting
- Oversee annual performance management, career development, and mentoring for team members
- Ensure platform stability, scalability, and observability for 24x7 operations
- Support modernization of legacy systems into cloud-native stack
- Align closely with product managers and analysts to prioritize data product delivery
- Contribute to finops practices, cloud usage tracking, and spend optimization
- 4–7 years of experience in Data Engineering or related roles, with overall 12+years experience
- Hands-on experience with cloud-based platforms:
- Azure: Databricks, PySpark, Data Lake, ADF
- Or equivalent GCP stack: BigQuery, Dataflow, Composer, etc.
- Proficiency in Python, Linux scripting, and building scalable data pipelines.
- Familiarity with relational/non-relational databases, data streams, and file stores.
- Experience with version control and CI/CD tools (GitHub, Jenkins).
- Graduate degree in Computer Science or equivalent.
Good-to-Have Skills
- Experience with BI/reporting tools (Power BI, MicroStrategy).
- Familiarity with enterprise integration patterns and data governance.
- Exposure to DevOps practices, monitoring, and observability.
- Strong collaboration and communication skills in cross-functional teams.
Top Skills
Adf
Azure
BigQuery
Composer
Data Lake
Databricks
Dataflow
GCP
Git
Jenkins
Linux
Microstrategy
Power BI
Pyspark
Python
Similar Jobs
Cloud • Information Technology • Security • Software
The Security Engineer will respond to security incidents, manage alerts, conduct forensics, and collaborate with stakeholders to enhance security practices across JumpCloud's services.
Top Skills:
AWSDatadogElkEndpoint ProtectionGCPGoLinuxmacOSNetwork Telemetry DataPythonShellSIEMSnowflakeSumologicWindows
Financial Services
Responsible for managing data quality and governance practices, enhancing instrument reference data, and collaborating with various business lines to meet operational needs.
Top Skills:
Advanced Ms ExcelBloombergEuroclearIceRefinitivSQL
Financial Services
As a Senior Product Associate, leverage user research and metrics analysis to enhance product development in Business Banking, collaborating across teams to optimize offerings.
Top Skills:
Data Analytics
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
