Build and optimize batch and real-time ETL/ELT pipelines using Python, PySpark, SQL, Snowflake, Databricks, and cloud platforms. Develop transformation and orchestration layers, implement data quality monitoring and alerting, optimize performance and cloud costs, and collaborate with architects, analysts, and data scientists. The role also requires data warehousing, dimensional modeling, CI/CD, version control, and documentation practices.
About Techdome
Techdome Solutions Pvt. Ltd. is a technology consultancy and product engineering company founded in 2020 and headquartered in Indore. We design, build and run AI-powered, cloud-native platforms across data engineering, machine learning, cloud, automation, CRM and enterprise platforms. Our own products include JustInterview.ai and Catalyst ERP, and we serve clients from startups to large enterprises worldwide.
Why join us: work on global client programs and our own products, a fast-growing team, ownership from day one, and recognition as Madhya Pradesh Best Employer Brand 2026.
Job Details
Experience: 5–12 years
Notice Period: Immediate joiners only
Locations: Hyderabad, Indore, Noida, Delhi, Mumbai
Employment Type: Full-time, permanent
Work Mode: Work from office
Education: B.E./B.Tech/MCA or equivalent in Computer Science, IT or a related field
How to Apply: Share your updated CV with current CTC, expected CTC and notice period / last working day.
We are looking for an experienced Data Engineer to build and maintain reliable, scalable data pipelines and platforms that power analytics and AI for our clients.
Key Responsibilities:
- Design, build and optimise batch and real-time data pipelines (ETL/ELT) from multiple sources.
- Develop data solutions on Snowflake, Databricks and cloud platforms (Azure, AWS or GCP).
- Write efficient, production-grade code in Python, PySpark and SQL.
- Build transformation layers using dbt, ADF, Matillion, Glue or Airflow.
- Implement data quality checks, monitoring, alerting and pipeline orchestration.
- Tune query and pipeline performance and manage cloud compute costs.
- Work with architects, analysts and data scientists to deliver clean, well-modelled data.
- Follow CI/CD, version control and documentation best practices.
Required Skills:
- 5+ years of hands-on data engineering experience.
- Strong SQL and Python; hands-on Spark/PySpark.
- Production experience with Snowflake and/or Databricks.
- Experience with at least one cloud platform: Azure (ADF, ADLS, Synapse), AWS (S3, Glue, Redshift, EMR) or GCP (BigQuery, Dataflow).
- Orchestration with Airflow, ADF or similar.
- Good understanding of data warehousing and dimensional modelling.
Good to Have:
- Streaming with Kafka, Spark Structured Streaming or Kinesis.
- dbt, Delta Lake / Iceberg, CDC tools.
- Docker, Terraform, Git-based CI/CD.
- Cloud or Snowflake/Databricks certifications.
Similar Jobs
Other
Maintain Python-based web scraping configurations, monitor errors and data blockages, coordinate scraping requirements with stakeholders, and report on scraping activities. Build and optimize pipelines for data lake ingestion and transformation using ETL, data modeling, cloud, database, and infrastructure tools. Collaborate with data scientists and analysts while ensuring data security, compliance, testing, and maintainability.
Top Skills:
AirflowAzureData LakesData WarehousingDbtETLGitNoSQLPythonSQLTerraform
Information Technology
Build and maintain governed finance data products on Microsoft Fabric and Databricks. Responsibilities include developing PySpark and Python ingestion pipelines, implementing incremental loading and CDC, optimizing Delta Lake tables, managing Azure Data Factory pipelines and Analysis Services cubes, designing Power BI semantic models, and ensuring version control, testing, monitoring, governance, and data contract compliance. The role also involves stakeholder collaboration, mentoring junior engineers, and applying enterprise data architecture standards.
Top Skills:
Adls Gen2SparkAzure Analysis ServicesAzure Data FactoryCi/CdDatabricksDelta LakeMicrosoft FabricMicrosoft PurviewPower BIPysparkPythonSQL ServerT-Sql
Blockchain • Fintech • Financial Services • Cryptocurrency • Quantitative Trading
Build and support large-scale, real-time kdb+ analytics platforms processing billions of daily messages. Develop kdb Insights or KDB-X modules, packages, pipelines, performant q queries, and functions for trading desks. Create SRE tools to detect performance bottlenecks across q, Python, and Java processes running continuously in AWS. Support ingestion stability, Kubernetes deployments, PyKX data processing, and cloud-native analytics infrastructure.
Top Skills:
AWSDatabricksDatadogJavaKdb InsightsKdb+Kdb-XKubernetesPykxPythonQ
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
