Designs and maintains data warehouses, metadata frameworks, dimensional models, and ETL pipelines using SnapLogic or Informatica, Python, dbt, Snowflake, and SQL. Optimizes data systems, supports reporting and dashboards, and implements data governance practices. Collaborates with cross-functional teams to ensure data quality, integrity, security, and compliance while exploring Generative AI applications in data engineering.
About the Role:
As a Data Engineer, you will work with developers, staff, and end-users to provide advanced technical support, maintenance, and logistical support to production and test systems. This job is part of the Database Engineering job function. They are responsible for the upkeep of databases across several company platforms and computing environments.
What You’ll Do:
- Design, develop, and maintain robust data warehouse solutions to support business intelligence and analytics needs.
- Design, implement and manage metadata frameworks to ensure data consistency and quality.
- Develop and maintain reference data and dimensional data models to support various business processes.
- Design and implement ETL (Extract, Transform, Load) processes using tools like SnapLogic or Informatica to integrate data from multiple sources.
- Utilize Python for data manipulation, automation, and integration tasks.
- Optimize the performance of data systems and processes.
- Implement transformations in DBT (Data Build Tool) to streamline data workflows.
- Collaborate with cross-functional teams to develop and maintain reporting tools and dashboards.
- Implement data governance practices to ensure data integrity, security, and compliance.
- Stay updated with the latest advancements in Generative AI and explore opportunities to integrate AI solutions into data engineering processes.
What You’ll Need:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 5 to 8 years of experience in working with data platforms
- Strong knowledge of data warehouse concepts, metadata frameworks, reference data, and dimensional data modeling.
- Proficiency in ETL processes and tools like SnapLogic or Informatica.
- Advanced skills in Python programming, DBT and Snowflake.
- Advanced SQL knowledge.
- Experience with reporting tools such as Tableau, Power BI, or similar.
- Understanding of data governance principles and best practices.
- Knowledge of Generative AI and its applications is a plus.
- Experience with DBT (Data Build Tool) for data transformations.
- Ability to optimize the performance of data systems and processes.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
Prudent Technologies and Consulting Hyderabad, Telangana, IND Office
Gowra Fountain Head, 8th Floor, Suite #801, Survey No: 83(P), 84(P), Madhapur, , Hyderabad, Telangana , India, 500081
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Designs and develops large-scale ETL/ELT pipelines and data integration solutions using Azure Databricks, Spark, SQL, and cloud platforms. Builds data pipelines supporting machine learning, analytics, business intelligence, and data products; integrates diverse data sources and formats; optimizes data reliability, quality, and performance; develops AI-enabled automations; contributes to architecture and standards; and mentors other data engineers.
Top Skills:
SparkArtifactoryAzureAzure DatabricksAzure FunctionsAzure Service BusGitGithub ActionsGraphQLLakebaseLlmsPysparkPythonRedisRestSnowflakeSonarqubeSpark SqlSQLTerraform
Healthtech • Software
Leads the design and delivery of a cloud-native healthcare data platform. Responsibilities include building batch and near-real-time pipelines, implementing lakehouse architecture with Apache Iceberg, establishing data quality and observability frameworks, optimizing storage and query performance, and driving technical standards. The role also involves architecture reviews, code reviews, mentoring engineers, cross-functional collaboration, and information-security policy implementation.
Top Skills:
Amazon AthenaAmazon S3Amazon SagemakerApache AirflowApache HudiApache IcebergApache KafkaSparkAtlanAWSAws GlueAws Lake FormationAws MskAws Step FunctionsDbtDelta LakeIamPysparkPythonSQL
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Architects and builds scalable distributed data-platform systems, ingestion solutions, foundational libraries, and backend infrastructure. The role delivers high-performance Java services, operates Kubernetes-based platforms, applies fault-tolerance and high-availability strategies, and troubleshoots complex production issues. It also provides technical leadership, drives engineering best practices, evaluates emerging technologies, and integrates data lakes with analytics, query, and machine-learning platforms.
Top Skills:
Apache FlinkApache IcebergApache KafkaSparkAvroData LakesDevOpsJavaJvmKubernetesMySQLOracleOrcParquetPostgres
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
