Strategic Minds Business Services Logo

Strategic Minds Business Services

Senior Data Engineer

Reposted 9 Days Ago
In-Office
Hyderabad, Telangana, IND
Senior level
In-Office
Hyderabad, Telangana, IND
Senior level
Designs and maintains scalable data pipelines using AWS, Spark, Kafka, Airflow, and related technologies. Collaborates with product, data science, and business teams; develops reporting dashboards; documents data flows and runbooks; optimizes workflows; troubleshoots data processing issues; and supports Agile delivery and CI/CD practices.
The summary above was generated by AI

Hiring For Senior Data Engineer

Job Title: Senior Data Engineer
Experience: 6+ Years
Work Location: Pune / Noida / Bangalore / Hyderabad / Chennai / Gurgaon /Bangalore/Mumbai
Work Mode: Hybrid
Key Responsibilities:
• Design, develop, and maintain scalable and reliable data pipelines using modern data platforms.
• Collaborate with cross-functional teams including product owners, data scientists, and business stakeholders.
• Develop and support reporting dashboards using tools like Tableau, Power BI, QlikSense, SAS VA, MicroStrategy, and Hex.
• Contribute to comprehensive technical documentation including data flows, mappings, and runbooks.
• Optimize data processing workflows and support troubleshooting activities.

• Participate in Agile sprints and support CI/CD practices using DevOps tools.

Mandatory Skills:
• Cloud Technologies: AWS – EC2, EMR, S3, Redshift, EKS, Glue
• Programming & Scripting: Python, PySpark, Shell scripting, SQL
• Big Data Frameworks: Apache Spark, Apache Kafka
• OS/Platforms: Linux

• Databases: PostgreSQL, Relational and NoSQL
• Containerization & DevOps: Docker, Kubernetes, Terraform, CI/CD pipelines • Experience working with Apache Airflow for workflow orchestration.
• Additional proficiency in Scala, Java, or R is a plus.

Similar Jobs

7 Days Ago
In-Office
Senior level
Senior level
Fintech • Financial Services
Design and build the data foundation for generative AI products in Markets Technology. Develop scalable Python pipelines and low-latency serving layers for billions of records, while ensuring data quality, lineage, security, observability, reliability, and performance. Contribute hands-on code, architecture, testing, CI/CD, data modeling, and operational practices while collaborating with AI, software, architecture, product, and financial markets stakeholders.
Top Skills: Apache AirflowApache ParquetSparkCi/CdDagsterDaskDevinGithub CopilotKubernetesNumpyOpenshiftPandasPolarsPostgresPrefectPyarrowPythonSQLSqlalchemy
13 Days Ago
Easy Apply
Remote or Hybrid
India
Easy Apply
Senior level
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
Leads cybersecurity data-source onboarding and integration for Zscaler’s security platform. Builds and automates Python/API-based data transformations, maps and normalizes security data, manages pipeline lifecycle activities, troubleshoots data quality, and identifies security gaps. Partners with cybersecurity SMEs and cross-functional teams to create implementation plans, communicate technical findings, and provide product improvement feedback. The role requires expertise in security platforms, diverse security-tool integrations, data modeling, SQL, and Python.
Top Skills: Ai/MlAPIsCloud LogsCmdbCnappCspmEdrPythonSIEMSQLUnified Vulnerability Management
12 Days Ago
In-Office or Remote
Bhālewādi, Wardha, Mahārāshtra, IND
Senior level
Senior level
Software
Build and optimize scalable real-time and batch ETL/ELT pipelines for manufacturing analytics using Azure Databricks, PySpark, and distributed computing. Design cloud data lakes, lakehouses, and warehouses; process IoT, MES, SCADA, LIMS, and ERP data; implement CI/CD, DevOps, Docker, and Kubernetes practices; monitor pipeline reliability; and provide clean data for AI/ML models. The role also involves data preprocessing, cloud optimization, troubleshooting, and collaboration with automation, engineering, and data science teams.
Top Skills: SparkAWSAzureAzure DatabricksCassandraCi/CdDevOpsDockerGCPInfluxdbKubernetesMedallion ArchitectureMlopsMongoDBPostgresPysparkPythonSQL Server

What you need to know about the Hyderabad Tech Scene

Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account