Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead data engineering architecture and execution for large-scale, low-latency analytics. Own technical direction, ensure operational data quality, design streaming and batch pipelines, mentor engineers, coordinate cross-functional teams, and deliver scalable solutions using Spark, Airflow, and AWS or equivalent data platforms.
Top Skills:
AirflowAthenaColumn StoresDatabricksDatabricks ApisEmrFlinkHiveKafkaKappa ArchitectureLambda ArchitectureMaster Data Management (Mdm)Microservices ArchitectureRedshiftSparkSQLStreaming Pipelines
Artificial Intelligence • HR Tech • Professional Services • Software
Design and maintain scalable Snowflake data warehouses and ETL/ELT pipelines. Lead Oracle-to-Snowflake migrations, including assessment, mapping, transformation, validation, and reconciliation. Develop data models and advanced SQL workflows, optimize Snowflake performance, troubleshoot pipeline and data quality issues, and support secure, governed, monitored cloud data platforms. Collaborate with architects, analysts, application teams, and business stakeholders on enterprise data modernization.
Top Skills:
AgileAWSAzureCi/CdDevOpsDynamic TablesEltETLGCPGitInformaticaMatillionOraclePythonSnowflakeSnowpipeSQLStreamsTalendTasksTime Travel
HR Tech • Information Technology • Professional Services
Design, implement, and optimize graph data solutions for a supplier chain project. Responsibilities include graph modeling with LPG and RDF, Neo4j database development and query optimization, GCP data processing using BigQuery, GCS, and Dataproc, and integrating graph data with visualization tools. The role also involves schema and data design, SQL-based relational database work, performance tuning, and potentially ETL/ELT, streaming, API, and distributed systems development.
Top Skills:
Api DevelopmentBigQueryCypherDataprocDistributed SystemsEtl/EltGcp Data FusionGoogle Cloud Platform (Gcp)Google Cloud Storage (Gcs)KafkaKinesisLabeled Property Graphs (Lpg)Neo DashNeo4JNeo4J AuraPower BIPysparkResource Description Framework (Rdf)SparksqlSQLTableau
The Data Engineer will design and maintain data pipelines, build data warehouses, and ensure data quality while collaborating with data scientists and engineers.
Job Summary:
We are looking for a talented and experienced Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining our data pipelines and infrastructure. You will work closely with our data scientists and analysts to ensure that our data is accessible, reliable, and secure.
Responsibilities:
- Design, develop, and maintain scalable data pipelines.
- Build and manage data warehouses and data lakes.
- Implement data quality and data governance best practices.
- Work with data scientists and analysts to support their research and development projects.
- Collaborate with other engineers to build and maintain our data infrastructure.
Qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field
- 3-5 years of experience in Data Warehousing and Data Integration projects, with exposure to ETL processes, data pipelines, and data quality management.
- practical experience working within large scale data environments and demonstrate strong analytical and problem-solving capabilities.
- Hands-on experience in SAS, including development and optimization of SAS programs.
- Strong programming skills in Python, Java, or Scala
- Experience with big data technologies such as Hadoop, Spark, and Kafka
- Experience with cloud computing platforms such as AWS, Azure, or Google Cloud Platform
- Experience with database systems such as SQL, PostgreSQL and Cassandra
- Experience with data warehousing and ETL (extract, transform, load) processes
- Excellent problem-solving and analytical skills
- Strong communication and teamwork skills
Bonus Points:
- Experience with SAS, Kubernetes, or Docker
- Experience with machine learning and artificial intelligence
- Experience with cloud-native development
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
