Designs and maintains scalable Snowflake ETL/ELT pipelines, SnapLogic integrations, and dbt transformation models. Responsibilities include dimensional and medallion architecture, performance and cost optimization, data quality, governance, CI/CD, documentation, and responsible use of AI-assisted development tools. Partners with analytics teams, mentors junior engineers, and helps establish reusable AI workflows and engineering standards.
ABOUT THE ROLE
Data Engineering team is looking for a Senior Data Engineer who combines strong data engineering fundamentals with a genuine curiosity for using AI tools to work smarter, not just harder. You will design and build scalable data pipelines and models on Snowflake, orchestrate integrations through SnapLogic, and use dbt to bring rigor and testability to our transformation layer — while also actively exploring how AI copilots and agentic tools can speed up development, debugging, documentation, and data quality work.
This is not an “AI engineer” role — it is a data engineering role for someone who is already fluent with tools like Cortex, GitHub Copilot, Claude, or ChatGPT in their daily workflow and sees them as a natural extension of good engineering practice, not a gimmick.
WHAT YOU'LL DO
- Design, build, and maintain robust ETL/ELT pipelines feeding a Snowflake-based data platform
- Build and manage integrations using SnapLogic to connect source systems, APIs, and downstream consumers
- Develop and maintain data models and transformations in dbt, including tests, documentation, and CI/CD-based deployment
- Design dimensional and/or medallion-style (Bronze/Silver/Gold) data architectures that balance performance, cost, and usability
- Use AI-assisted tools to accelerate development — generating boilerplate code, drafting SQL/dbt models, writing documentation, debugging pipeline failures, and summarising data quality issues
- Partner with data quality, governance, and analytics teams to ensure data is well-modelled, well-documented, and trustworthy
- Optimise Snowflake warehouse performance and cost (query tuning, clustering, resource monitors)
- Write clean, tested, version-controlled code and contribute to CI/CD pipelines
- Mentor junior engineers, including on how to use AI tools responsibly and effectively (e.g., reviewing AI-generated code, not blindly trusting output)
- Contribute to internal standards for prompt patterns, reusable AI workflows, or tooling that make the whole team faster
CORE SKILLS
- Snowflake — strong hands-on experience with data modelling, performance tuning, security/access, and cost management
- SnapLogic — building and maintaining integration pipelines and connecting heterogeneous source systems
- dbt — writing modular, tested transformations; managing dependencies, macros, and documentation
- Data Modelling — dimensional modelling, medallion/layered architectures, normalisation vs. denormalisation trade-offs
- Strong SQL and at least one scripting language (Python preferred)
- Familiarity with orchestration tools (Airflow, ADF, or similar)
- Working knowledge of git-based CI/CD workflows
AI-AUGMENTED WORKING STYLE (WHAT WE'RE LOOKING FOR)
- Regularly uses AI coding assistants (Copilot, Claude Code, Cursor, ChatGPT, etc.) as part of the daily workflow — not just for one-off snippets
- Comfortable prompting AI tools for tasks like generating dbt models, writing test cases, summarising data quality issues, or drafting documentation
- Applies good judgement about when AI output needs review vs. can be trusted — treats AI as a fast first draft, not a final answer
- Curious about applying AI to structural problems: pipeline debugging, anomaly detection, metadata generation, code review support
- Comfortable working in an environment where AI-usage practices are still evolving, and contributes ideas to shape them
NICE TO HAVE
- Experience with data quality tooling (SODA, Collibra, or similar)
- Exposure to cloud platforms (Azure, AWS, or GCP)
- Experience in a regulated or enterprise-scale data environment
- Prior experience mentoring or leading a small pod of engineers
EXPERIENCE
- 8+ years in data engineering, with at least 4+ years focused on Snowflake and modern ELT tooling (dbt)
- Track record of delivering production-grade pipelines at scale
Prudent Technologies and Consulting Hyderabad, Telangana, IND Office
Gowra Fountain Head, 8th Floor, Suite #801, Survey No: 83(P), 84(P), Madhapur, , Hyderabad, Telangana , India, 500081
Similar Jobs
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Architects and builds scalable distributed data-platform systems, ingestion solutions, foundational libraries, and backend infrastructure. The role delivers high-performance Java services, operates Kubernetes-based platforms, applies fault-tolerance and high-availability strategies, and troubleshoots complex production issues. It also provides technical leadership, drives engineering best practices, evaluates emerging technologies, and integrates data lakes with analytics, query, and machine-learning platforms.
Top Skills:
Apache FlinkApache IcebergApache KafkaSparkAvroData LakesDevOpsJavaJvmKubernetesMySQLOracleOrcParquetPostgres
Fintech • Food • Payments • Software
Own and operate qlub’s production data platform across ingestion, dbt modeling, BigQuery, Airflow, ClickHouse, GCP infrastructure, data quality, and CI/CD. Build reliable pipelines, optimize performance and cost, troubleshoot production issues, establish engineering standards, and mentor data engineers. Explore practical applications of LLMs and agents for data discovery, monitoring, and troubleshooting while maintaining secure, maintainable systems.
Top Skills:
AirbyteApache AirflowApache FlinkAws Ec2Aws RdsAws S3BashCi/CdClickhouseCloud RunCronDatastreamDbtDebeziumDockerFivetranGitGoogle BigqueryGoogle Cloud Platform (Gcp)Google Cloud StorageGreat ExpectationsIamKafkaKubernetesLinuxLlm ApisMonte CarloPostgresPower BIPythonRagSodaSQLSshTableauTerraform
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Develop secure, scalable ETL and data pipelines using DMExpress and modern cloud and big-data technologies. Drive automation across data ingestion, movement, and access workflows; enforce software development and ETL engineering standards; troubleshoot production incidents; and improve processes. The role requires collaboration across distributed teams, independent execution, analytical debugging, root-cause analysis, technology evaluation, and proof-of-concept development.
Top Skills:
Apache AirflowSparkBig DataCloud TechnologiesData PipelinesData WarehousingDatabricksDmexpressETL
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
