Build and operate cloud-native Azure data pipelines from source ingestion through Bronze-Silver-Gold transformation layers. Develop Fabric Dataflow Gen2 pipelines, Delta Tables, Synapse SQL evaluation logic, and event-driven integrations using Azure Event Hub and Event Grid. Perform data quality validation, schema reconciliation, lineage verification, and parallel-run testing across multiple domains. Extend configuration-driven frameworks and support sprint-based delivery across concurrent workstreams.
About the Role
We are looking for a Data Engineer to build, extend, and operate cloud-native data pipelines as part of a large-scale Azure data platform. This role covers end-to-end pipeline development - from source system ingestion through Bronze–Silver–Gold transformation layers — along with configuration-based framework extensions, evaluation engine integration, and data quality gate management across multiple data domains.
Key Responsibilities
- Design and build end-to-end data ingestion pipelines for multiple enterprise source systems using Fabric Dataflow Gen2 and Event Hub connectors
- Implement Bronze–Silver–Gold Delta Table data layering following established schema and field mapping conventions
- Write and maintain SQL evaluation logic in Synapse Analytics for automated control assessment across multiple data domains
- Perform data quality validation, schema reconciliation, and lineage verification across all pipeline stages
- Support parallel-run validation activities ensuring data consistency between automated outputs and source reports
Required Skills & Experience
- 3+ years of experience in data engineering, ETL/ELT development, and cloud data pipeline delivery
- Strong hands-on experience with Microsoft Fabric (Dataflow Gen2, Lakehouse, Delta Tables) and Azure Synapse Analytics
- Proficiency in SQL for complex data transformation, evaluation logic, and cross-domain queries
- Experience building event-driven pipelines using Azure Event Hub and Event Grid
- Familiarity with config-driven or metadata-driven data pipeline frameworks
- Experience with Microsoft Purview for data lineage registration and catalog management is advantageous
- Ability to work in sprint-based delivery environments with multiple concurrent workstreams
- Strong attention to detail and ability to validate complex data flows end-to-end across multiple systems
Anblicks Hyderabad, Telangana, IND Office
Raidurg Panmakhta, Serilingampally Mandal, Ranga Reddy, , Hyderabad, Telangana , India, 500081
Anblicks Hyderabad, Telangana, IND Office
Hyderabad, Hyderabad, India
Similar Jobs
Cloud • Analytics • Consulting
Develop and optimize SQL-based data pipelines, build staging, ODS, and warehouse layers, create file ingestion and outbound workflows, validate and reconcile data, implement incremental processing and change data capture, tune performance, and support hybrid legacy-to-cloud data warehouse migrations.
Top Skills:
Azure Data FactoryAzure SynapseChange Data CaptureCsvData WarehousingFlat FilesSftpSQLT-Sql
Cloud • Analytics • Consulting
Design, build, maintain, and troubleshoot scalable data pipelines, ETL/ELT workflows, data warehouses, lakehouse structures, and Azure-based data solutions. Develop optimized T-SQL logic, support ADF, SSIS, and Microsoft Fabric pipelines, validate data quality, resolve integration issues, document data flows, and assist with deployments, testing, production operations, and enterprise data modernization.
Top Skills:
AzureAzure Data Factory (Adf)Azure Data Lake Storage (Adls)Ci/CdDatabricksFabric PipelinesGitMicrosoft FabricOraclePl/SqlSalesforceSQL ServerSsisT-Sql
Cloud • Analytics • Consulting
Develop and configure ServiceNow Service Catalog items, Flow Designer automation, security decision tables, and integrations with Azure Active Directory and Microsoft Intune. Write and execute unit tests, support user acceptance testing, resolve defects, validate Moveworks conversational intents and notifications, and contribute to deployment checklists, test reports, and administrator documentation in a collaborative sprint-based environment.
Top Skills:
Azure Active DirectoryFlow DesignerIntegration HubItsmMicrosoft IntuneMoveworksRest ApiService CatalogServicenow
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
