Design, build, and maintain scalable data infrastructure for digital and physical operations. Responsibilities include architecting data lakes and lakehouses, developing ETL and ELT pipelines, using Airflow and Spark, creating data models in Snowflake or Databricks, coding in Python, SQL, and Scala, and monitoring data platforms for reliability, security, and performance.
Summary
We are seeking a skilled Data Engineer to spearhead our Phygital Drive initiative within the IT Services sector. This pivotal role focuses on designing, building, and maintaining robust data infrastructure that bridges digital and physical operational needs. The successful candidate will be instrumental in architecting scalable data solutions, ensuring seamless data flow, and enabling advanced analytics to drive strategic business decisions across our organization.
Responsibilities
- Architect and implement scalable data lake and lakehouse solutions utilizing platforms such as AWS, Azure, or GCP.
- Develop, optimize, and manage complex ETL and ELT processes to ensure high-quality data ingestion and transformation.
- Design and construct efficient data pipelines using tools like Apache Airflow and frameworks including Apache Spark or PySpark.
- Collaborate with cross-functional teams to define data requirements and deliver high-performance data models in Snowflake or Databricks.
- Write clean, efficient, and maintainable code in Python, SQL, or Scala to support various data engineering tasks.
- Monitor and troubleshoot data infrastructure to guarantee reliability, security, and optimal performance of data assets.
Requirements
Requirements:
- Possess a work experience level between 2 to 8 years in data engineering or related technical fields.
- Demonstrate proficiency with major cloud data platforms including AWS, Azure, or Google Cloud Platform (GCP).
- Show hands-on expertise with orchestration tools like Apache Airflow and big data processing engines such as Apache Spark.
- Have a strong command of data warehousing and lakehouse technologies, specifically Snowflake or Databricks.
- Be proficient in coding languages essential for data manipulation, including Python, SQL, and Scala.
- Exhibit a solid understanding of Data Lake architecture principles and experience in developing end-to-end data pipelines.
Similar Jobs
Fintech • Mobile • Payments • Software • Financial Services
Conduct customer and business onboarding through CDD and EDD reviews, assess identity documents, ownership structures, source of wealth, adverse media, and transaction activity. Maintain accurate KYC records, perform risk assessments, identify money laundering and fraud indicators, escalate risks, and file Suspicious Activity Reports when required. Communicate with customers, meet strict KPIs, provide process feedback, and work flexibly across shifts.
Fintech • Mobile • Payments • Software • Financial Services
Recruiter responsible for end-to-end hiring for Wise’s Servicing Operations teams in Hyderabad. The role manages candidate experiences, partners with hiring managers and sourcers, builds talent networks, uses recruiting data and dashboards to optimize processes, and supports talent initiatives such as referrals, talent mapping, and salary benchmarking.
.jpeg)
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Build and architect enterprise-scale agentic AI and multi-agent systems using Claude, MCP, AWS AgentCore, RAG, and GraphRAG. Design hybrid-cloud architectures across AWS, GCP, Kubernetes, and on-premises platforms; develop engineering-data ETL pipelines; and lead PoCs, technology standards, cross-functional collaboration, and mentoring across engineering, manufacturing, product, validation, and data teams.
Top Skills:
A2AAgentic Ai FrameworksAmazon NeptuneAWSAws AgentcoreClaudeClaude CodeETLGCPGenerative AiGraphragKubernetesMcpNeo4JOn-Premises PlatformsOntologiesPythonSemantic ModelingTaxonomiesVector DatabasesVector Rag
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
