Design, build, and maintain scalable Azure-based data pipelines and systems (Databricks, Data Lake, Synapse, ADF). Collaborate with cross-functional teams, ensure data quality and integrity, optimize performance, monitor and troubleshoot systems, and stay current with industry trends to improve solutions.
## Company Overview
Delphic Global is a forward-thinking company dedicated to innovation and excellence in the global market. We pride ourselves on our dynamic work environment and our commitment to fostering talent and growth.
## Job Title
Data Engineer
## Location
India
## Experience Required
6-8 years
## Key Responsibilities
* Design, develop, and maintain scalable data pipelines and systems.
* Collaborate with cross-functional teams to understand data requirements and deliver solutions.
* Implement data solutions using Azure technologies such as Azure Databricks, Data Lake, Synapse, and Azure Data Factory (ADF).
* Optimize and improve existing data systems for better performance and scalability.
* Ensure data quality and integrity through rigorous testing and validation.
* Monitor and troubleshoot data systems to ensure reliability and performance.
* Stay updated with the latest industry trends and technologies to drive continuous improvement.
## Required Skills
* Proven experience in data engineering with a focus on Azure technologies.
* Strong expertise in Azure Databricks, Data Lake, Synapse, and Azure Data Factory (ADF).
* Proficiency in Python and Apache Spark for data processing and analysis.
* Solid understanding of SQL for data manipulation and querying.
* Experience in building and optimizing data pipelines and architectures.
* Ability to work collaboratively in a team environment and communicate effectively.
## Why Join Us?
At Delphic Global, we offer a vibrant work culture that encourages innovation and personal growth. Join us to be part of a team that values diversity, creativity, and collaboration.
Similar Jobs
Fintech • Financial Services
Design, build, and maintain scalable Azure-based data pipelines and warehouses using ADF, Databricks, Synapse. Optimize performance, ensure security and governance, collaborate with analysts/scientists, automate CI/CD, monitor health, and document architectures and best practices.
Top Skills:
Arm TemplatesAzure Ai & Machine LearningAzure Blob StorageAzure Data FactoryAzure Data LakeAzure DatabricksAzure DevopsAzure MonitorAzure Sql DatabaseAzure Synapse AnalyticsCosmos DbDataopsGitJavaLog AnalyticsPower BIPysparkPythonScalaSparkSQLSQL ServerT-SqlTerraform
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Principal Data Engineer will lead the data engineering team, architecting solutions and driving complex data projects to enhance operational data quality and support business decisions.
Top Skills:
AirflowAthenaAWSEmrFlinkHiveKafkaRedshiftSparkSQL
Artificial Intelligence • Big Data • Cloud • Generative AI
Lead design and delivery of AWS Data Lakehouse solutions using Medallion architecture. Architect and automate cloud infrastructure, optimize Redshift/Glue performance and costs, enforce data governance and quality, implement CDC/ETL pipelines, and liaise with Data Science/BI and business stakeholders. Mentor engineers and drive technical roadmap and migrations.
Top Skills:
Amazon AthenaAmazon RedshiftAmazon S3Apache AirflowAws DmsAws GlueAws Glue Data QualityAws Glue DatabrewAws Lake FormationAws Step FunctionsDbtDockerGithub ActionsIamMicrosoft FabricOpenlineageParquetPower BIPower Bi EmbeddedPysparkPythonRedshift ServerlessSnowflakeSQLTerraform
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
