Designs and executes ETL testing strategies, performs data reconciliation and integrity assessments, optimizes SQL queries, validates data across PostgreSQL, MSSQL, and Snowflake, and develops automated data quality testing suites to ensure reliable data pipelines and reporting.
Summary
We are seeking a highly skilled Data Quality Engineer to join our IT Services team. In this pivotal role, you will be responsible for ensuring the accuracy, consistency, and reliability of our data assets across complex environments. Your expertise will drive confidence in our reporting and analytics by implementing robust validation frameworks and maintaining strict data integrity standards. This position is critical for supporting data-driven decision-making and optimizing our overall data infrastructure.
Responsibilities
- Design and execute comprehensive testing strategies for ETL processes to verify data transformation accuracy.
- Perform intricate data reconciliation activities to identify and resolve discrepancies between source and target systems.
- Conduct rigorous quality assurance checks to uphold data integrity across all operational databases.
- Optimize complex SQL queries to enhance performance and efficiency within data pipelines.
- Validate data structures and processes within PostgreSQL, Microsoft SQL Server (MSSQL), and Snowflake environments.
- Develop and maintain automated data quality testing suites to monitor system health proactively.
Requirements
Requirements:
- Minimum of 6 years of professional experience in data engineering or quality assurance within the IT Services sector.
- Proven expertise in ETL testing, data validation methodologies, and reconciliation techniques.
- Strong proficiency in SQL query optimization and advanced database management.
- Hands-on experience with major data platforms including PostgreSQL, Microsoft SQL Server (MSSQL), and Snowflake.
- Demonstrated ability to perform data integrity assessments and implement quality control measures.
- Familiarity with data quality testing frameworks and tools.
Similar Jobs
Cloud • Analytics • Consulting
Designs and executes data quality testing for end-to-end ETL/ELT pipelines. Responsibilities include source-to-target validation, reconciliation, business rule verification, SQL and Python automation, Databricks and Delta Lake testing, CI/CD integration, failure analysis, and data integrity validation. The role also evaluates emerging AI and RAG pipelines and collaborates with data engineering teams to resolve discrepancies.
Top Skills:
Ai AgentsApache AirflowAWSAzureAzure DevopsDatabricksDeequDelta LakeEtl/EltGCPGenerative AiGitGreat ExpectationsJenkinsKafkaLlmsPysparkPytestPythonRagSnowflakeSodaSpark SqlSQLUnity Catalog
Artificial Intelligence • Information Technology • Software • Consulting
Ensure enterprise data quality, accuracy, integrity, and reliability across source systems, data warehouses, Medallion Architecture layers, Snowflake, and Power BI. Perform source-to-target validation, ETL/ELT testing, reconciliation, profiling, governance validation, lineage checks, and report testing. Develop automated data-quality frameworks and reusable test suites using SQL, Python, PySpark, and Soda, integrating them into Azure DevOps or GitHub Actions CI/CD pipelines.
Top Skills:
Azure Blob StorageAzure DevopsBigQueryGithub ActionsGoogle Analytics 4Microsoft Sql ServerPostgresPower BIPysparkPythonSnowflakeSodaSQL
Fintech • Mobile • Payments • Software • Financial Services
Conduct customer and business onboarding through CDD and EDD reviews, assess identity documents, ownership structures, source of wealth, adverse media, and transaction activity. Maintain accurate KYC records, perform risk assessments, identify money laundering and fraud indicators, escalate risks, and file Suspicious Activity Reports when required. Communicate with customers, meet strict KPIs, provide process feedback, and work flexibly across shifts.
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
