Lead modernization of a large-scale AWS data platform: design, build, and optimize scalable ETL/ELT pipelines, migrate Airflow/EMR to AWS-native services (Glue, MWAA), implement data lake/warehouse solutions, enforce data governance/lineage/metadata, build data quality and monitoring frameworks, automate deployments with IaC, and support BI (QuickSight) and Power BI migration, UAT, and production support.
About us:
Working at Tech Holding isn't just a job, it's an opportunity to be a part of something bigger. We are a full-service consulting firm that was founded on the premise of delivering predictable outcomes and high-quality solutions to our clients. Our founders and team members have industry experience and have held senior positions in a wide variety of companies – from emerging startups to large Fortune 50 firms – and we have taken our combined experiences and developed a unique approach that is supported by the principles of deep expertise, integrity, transparency, and dependability.
About the Role
We are looking for a Senior AWS Data Engineer to join our team and lead the modernization of a large-scale cloud data platform. You will be responsible for designing, building, and optimizing scalable data pipelines, modernizing ETL/ELT workloads, implementing data governance, and enabling analytics and reporting solutions on AWS.
The ideal candidate has deep expertise in AWS data services, data engineering, pipeline orchestration, and data warehouse modernization, with a passion for building reliable, secure, and scalable data platforms.
Location: Remote
Experience Required: 5+ Years
Employment Type: Contract
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows on AWS.
- Modernize legacy data platforms by migrating Apache Airflow/MWAA workloads to AWS-native orchestration services.
- Migrate and optimize Amazon EMR workloads to AWS Glue.
- Design and implement scalable data lake and data warehouse solutions using AWS services.
- Develop robust data models, semantic layers, and standardized KPI definitions to support business analytics.
- Build and maintain data quality, validation, anomaly detection, and monitoring frameworks.
- Implement metadata management, data lineage, and data governance best practices.
- Develop automated deployment pipelines and infrastructure using Infrastructure as Code (IaC).
- Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
- Collaborate with business stakeholders to understand reporting requirements and translate them into scalable data solutions.
- Support QuickSight semantic datasets, dashboard optimization, and Power BI migration initiatives.
- Participate in UAT, production deployments, knowledge transfer, and post-production support.
Required Skills & Qualifications
• 5+ years of experience in Data Engineering.
• Strong programming skills in Python and SQL.
• Hands-on experience with Apache Spark / PySpark.
• Extensive experience with AWS data services including:
- AWS Glue
- Amazon S3
- Amazon Redshift
- Amazon Athena
- AWS Lambda
- AWS Step Functions
- Amazon EventBridge
- AWS IAM
• Experience designing and implementing ETL/ELT pipelines.
• Strong knowledge of data modeling, data warehousing, and data lake architecture.
• Experience with Apache Airflow or Amazon MWAA.
• Strong understanding of Data Governance, Metadata Management, Business Glossary, and Data Lineage.
• Experience implementing Data Quality, Audit Logging, and Data Reconciliation frameworks.
• Experience with Amazon QuickSight, semantic datasets, and BI reporting.
• Experience with Git, CI/CD, and Infrastructure as Code (Terraform or CloudFormation).
• Excellent analytical, troubleshooting, and communication skills.
Preferred Qualifications
• Strong knowledge of data modeling, data warehousing, and data lake architecture.
• Experience with Apache Airflow or Amazon MWAA.
• Strong understanding of Data Governance, Metadata Management, Business Glossary, and Data Lineage.
• Experience implementing Data Quality, Audit Logging, and Data Reconciliation frameworks.
• Experience with Amazon QuickSight, semantic datasets, and BI reporting.
• Experience with Git, CI/CD, and Infrastructure as Code (Terraform or CloudFormation).
• Excellent analytical, troubleshooting, and communication skills.
Preferred Qualifications
- Experience with Power BI migration projects.
- Experience working with Healthcare or Life Sciences data platforms.
- Knowledge of Lake Formation, AWS Glue Data Catalog, and AWS security best practices.
- Familiarity with ML-ready data pipelines and feature engineering.
- AWS Certification (Data Engineer, Solutions Architect, or Developer) is a plus.
Tech Holding is proud to be an Equal Opportunity Employer and is committed to fostering a diverse and inclusive workplace. We welcome applicants from all backgrounds and experiences, and we consider qualified applicants without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, disability, veteran status, or any other legally protected characteristic. If you require accommodation in the application process, please contact our HR
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead a global engineering organization (50+ engineers) to define strategy, set OKRs, and deliver platform and enterprise-level initiatives. Partner with product, design, and cross-functional stakeholders to translate strategy into funded execution, grow technical leaders, and coordinate dependencies across teams.
Top Skills:
Agile
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Contribute to a development team from day one, design and code features, work across full product lifecycle, report to senior engineers, apply data structures and algorithms, and gain practical software engineering experience.
Top Skills:
CC++JavaPython
Blockchain • Software • Cryptocurrency • Web3
Design, build, test, and deploy smart contracts and decentralized applications. Maintain blockchain integrations and backend services, optimize for security and gas efficiency, contribute to architecture and technical strategy, conduct code reviews, mentor junior engineers, and collaborate with product, frontend, and security teams.
Top Skills:
AnchorAvalancheBnb ChainCi/CdCloud InfrastructureDaosDatabasesDefiEthereumEthers.JsFoundryGitGoHardhatNftsNode.jsPolygonPythonRustSmart ContractsSolanaSolidityTruffleTypescriptWallet IntegrationsWeb3.Js
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
