InOrg Global Logo

InOrg Global

Data Engineer

Reposted 20 Minutes Ago
India
Mid level
India
Mid level
The Data Engineer will design, build, and maintain scalable data pipelines using Databricks, integrating data into systems and ensuring data quality and performance while collaborating with stakeholders.
The summary above was generated by AI

Job Summary:

We're seeking an experienced Data Engineer/ Sr Data Engineer / Lead Data Engineer

With expertise in data engineering across major data platforms. The ideal candidate will have a

strong background in Python, SQL, ETL, and data modeling, with experience in tools like

Teradata, Informatica, Hadoop, Spark, PySpark, ADF, Snowflake, and Big Data. Cloud

knowledge (AWS, Azure, or GCP) is a plus. The role requires a willingness to transition and

upskill into Databricks & AI/ML projects.

Key Responsibilities:

● Design, develop, and maintain large-scale data systems

● Develop and implement ETL processes using various tools and technologies

● Collaborate with cross-functional teams to design and implement data models

● Work with big data tools like Hadoop, Spark, PySpark, and Kafka

● Develop scalable and efficient data pipelines

● Troubleshoot data-related issues and optimize data systems

● Transition and upskill into Databricks & AI/ML projects

Requirements:

● Relevant  years of experience in data engineering

● Strong proficiency in Python, SQL, ETL, and data modeling

● Experience with one or more of the following:

○ Teradata

○ Informatica

○ Hadoop

○ Spark

○ PySpark

○ ADF

○ Snowflake

○ Big Data

○ Scala

○ Kafka

● Cloud knowledge (AWS, Azure, or GCP) is a plus

● Willingness to learn and adapt to new technologies, specifically Databricks & AI/ML

Nice to Have:

● Experience with Databricks

● Knowledge of AI/ML concepts and tools

● Certification in relevant technologies

What We Offer:

● Competitive salary and benefits

● Opportunity to work on cutting-edge projects

● Collaborative and dynamic work environment

● Professional growth and development opportunities

● Remote work opportunities & flexible hours

Top Skills

Airflow
Spark
AWS
Azure
Databricks
Databricks Rest Api
Databricks Sql
Datadogs
Delta Lake
GCP
Git
Mlflow
Prometheus
Python
Rest Apis
Scala

Similar Jobs

3 Days Ago
In-Office
Pune, Maharashtra, IND
Mid level
Mid level
Healthtech • Logistics • Pharmaceutical
Designs and develops data management solutions and pipelines using cloud/on-prem tools (Azure, Databricks, Synapse). Performs data profiling, modeling, analytics, automates data quality improvements, and collaborates with stakeholders to translate business needs into data solutions.
Top Skills: Ms Azure,Databricks,Azure Synapse,Adf,Logic Apps,Ms Sql,Ssis,Ssrs,Power Bi,Tableau,Qlik Sense,Sql,R,Python,Databricks
3 Days Ago
In-Office
Pune, Maharashtra, IND
Mid level
Mid level
Healthtech • Logistics • Pharmaceutical
Designs, builds, and deploys BI solutions and data engineering pipelines using Databricks/Azure, Spark SQL and Python. Creates dashboards and reports in Power BI, conducts data profiling, testing, and troubleshooting, collaborates with stakeholders to translate business requirements into data models and analytic solutions.
Top Skills: Spark Sql,Power Bi,Azure,Databricks,Python,Dax,Row-Level Security,Power Bi Deployment Pipelines,Databricks Notebooks,Sql,R,Tableau,Alteryx,Qliksense,Microsoft Office,Sas,Spss
3 Days Ago
In-Office
Pune, Maharashtra, IND
Mid level
Mid level
Healthtech • Logistics • Pharmaceutical
Designs, integrates, and prepares large-scale healthcare datasets for analysis; develops algorithms, automated pipelines, and analytics-ready data; ensures data quality and governance; collaborates with clients and teams to deliver analytical solutions and validate findings.
Top Skills: AlteryxMicrosoft Office SuitePower BIPythonQliksenseRSASSpssSQLTableau

What you need to know about the Hyderabad Tech Scene

Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account