Datavail Logo

Datavail

Azure Data Engineer - CTR

Posted 3 Days Ago
Be an Early Applicant
Hybrid
Hyderabad, Telangana, IND
Expert/Leader
Hybrid
Hyderabad, Telangana, IND
Expert/Leader
Designs, develops, and supports enterprise ETL/ELT pipelines, data warehouses, and integrations using SQL Server, SSIS, and Azure Data Factory. Responsibilities include modernizing legacy SSIS workloads, optimizing SQL performance, integrating APIs and SFTP, ensuring data quality, troubleshooting production issues, implementing CI/CD, and supporting hybrid cloud environments. The role also contributes to architecture decisions and may incorporate AI-enabled data engineering, anomaly detection, and intelligent automation.
The summary above was generated by AI

Title: Azure Data Engineer

Location: India ( Remote )

Education: Bachelor’s Degree

Experience Level: 10+

 

We are looking for experienced Data Engineers who can provide overlap with North America business hours. The ideal coverage is until approximately 3:00 PM–4:00 PM Eastern Time (ET). Resources may also work staggered shifts to ensure broader support coverage and operational continuity.

 

We are seeking a highly skilled, hands-on Senior Data Engineer with strong expertise in SQL Server, Azure Data Factory (ADF), ETL development, and Data Warehousing. This role is focused on designing, developing, troubleshooting, and modernizing enterprise-scale data integration solutions. The ideal candidate is a true Data Engineer, not primarily a BI or reporting developer. They should be capable of independently analyzing existing data pipelines, resolving production issues, building scalable data solutions, and driving the modernization of legacy SSIS-based workloads to Azure-based data platforms.

 

Required Qualifications:

Technical Skills

 

  • 8+ years of experience in Data Engineering, ETL Development, or Data Warehousing.

  • Strong expertise in Microsoft SQL Server and advanced T-SQL development.

  • Strong hands-on experience with Azure Data Factory (ADF).

  • Extensive experience designing and building ETL/ELT pipelines.

  • Strong experience with SSIS development, troubleshooting, migration, and modernization.

  • Solid understanding of Data Warehouse concepts and dimensional modeling, including:

  • Fact & Dimension models

  • Star Schema

  • Snowflake Schema

  • Experience processing large-volume data and performing SQL performance tuning.

  • Experience integrating with REST APIs and external data providers.

  • Experience with SFTP and file-based integrations.

  • Strong knowledge of data validation, reconciliation, and quality controls.

  • Proven production support and troubleshooting skills.

  • Experience using Git, source control practices, CI/CD, and deployment automation.

  • Experience working across on-premises, hybrid, and cloud data platforms.

 

 

Preferred AI / GenAI Experience:

 

  • Candidates with exposure to AI-enabled data engineering solutions will be highly valued.

  • Experience incorporating AI/GenAI capabilities into data engineering solutions.

  • Experience with Azure OpenAI Service or OpenAI API integrations.

  • Python-based AI automation and intelligent workflow development.

  • AI-assisted data quality monitoring, anomaly detection, and operational troubleshooting.

  • Understanding of:

  • Retrieval-Augmented Generation (RAG)

  • Embeddings

  • Vector Databases

 

Additional Preferred Skills:

 

  • Python

  • PySpark

  • Databricks

  • Snowflake

  • Azure Synapse Analytics

  • Microsoft Fabric

  • MongoDB / NoSQL databases

  • PowerShell scripting

  • Data Lake and Lakehouse architectures

 

Desired Candidate Profile

The successful candidate will:

 

  • Be highly hands-on and technically strong in data engineering.

  • Demonstrate the ability to work independently with minimal supervision.

  • Quickly understand and troubleshoot complex legacy and modern data platforms.

  • Possess strong analytical and problem-solving skills.

  • Have experience supporting mission-critical production environments.

  • Be comfortable driving modernization initiatives and recommending best practices.

  • Communicate effectively with both technical and business stakeholders.

  • Take ownership of deliverables and operational outcomes.

 

Nice-to-Have Industry Experience:

 

  • Enterprise Data Warehousing

  • Financial Services

  • Healthcare

  • Retail & Consumer Data Platforms

  • SaaS and Cloud-Native Data Environments

 

Key Responsibilities:

 

  • Design, develop, and maintain scalable ETL/ELT solutions and data pipelines.

  • Support and enhance enterprise data warehouse solutions.

  • Analyze existing SSIS packages and lead modernization efforts toward Azure Data Factory and modern cloud-based architectures.

  • Build and optimize data ingestion, transformation, and integration processes.

  • Perform advanced SQL development, query optimization, and performance tuning for large-volume datasets.

  • Develop integrations with REST APIs, third-party systems, and file-based interfaces.

  • Support SFTP-based and batch data exchange processes.

  • Troubleshoot production issues, perform root-cause analysis, and implement preventive solutions.

  • Ensure data quality through reconciliation, validation, monitoring, and exception handling.

  • Collaborate with business and technical stakeholders to gather requirements and build data solutions.

  • Implement CI/CD pipelines and source control best practices for data engineering solutions.

  • Support hybrid environments involving on-premises and cloud-based systems.

  • Participate in architecture discussions and recommend modernization strategies.

 

 

 

 

About UsDatavail is a leading provider of data management, application development, analytics, and cloud services, with more than 1,000 professionals helping clients build and manage applications and data via a world-class tech-enabled delivery platform and software solutions across all leading technologies. For more than 17 years, Datavail has worked with thousands of companies spanning different industries and sizes, and is an AWS Advanced Tier Consulting Partner, a Microsoft Solutions Partner for Data & AI and Digital & App Innovation (Azure), an Oracle Partner, and a MySQL Partner. About the Team
Datavail’s Data Management Services: 
Datavail’s Data Management and Analytics practice is made up of experts who provide a variety of data services including initial consulting and development, designing and building complete data systems, as well as ongoing support and management of database, data warehouse, data lake, data integration, and virtualization and reporting environments. Datavail’s team is comprised of not just excellent BI & analytics consultants, but great people as well. Datavail’s data intelligence consultants are experienced, knowledgeable and certified in the best in breed BI and analytics software applications and technologies. We ascertain your business objectives, goals and requirements, assess your environment, and recommend the tools which best fit your unique situation. Our proven methodology can help your project succeed, regardless of stage. With the combination of a proven delivery model and top-notch experience ensures that Datavail will remain the Data Management experts on demand you desire. Datavail’s flexible and client focused services always add value to your organization.

Similar Jobs

20 Minutes Ago
Remote or Hybrid
India
Senior level
Senior level
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Develop advanced avionics features for Honeywell’s ANTHEM cockpit platform. Responsibilities include defining system architecture, capturing and validating requirements, integration and functional testing, troubleshooting interfaces, supporting SRR/PDR/CDR reviews, and coordinating with globally distributed teams. The role requires avionics certification knowledge, display-system development experience, systems safety analysis, ARP4754A expertise, and proficiency with Agile tools including DOORS NG and JIRA.
Top Skills: AgileArp4754AAtlassian JiraAvionics HardwareAvionics SoftwareAvionics SystemsEpic/ApexIbm Rational Doors Ng
4 Hours Ago
Remote or Hybrid
India
Senior level
Senior level
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Leads multiple aerospace datalink product development teams in Bangalore, overseeing avionics system and software design, program execution, budgets, quality, delivery, and customer support. Drives Agile transformation, cost and cycle-time reduction, digital engineering initiatives, innovation, common avionics products, strategic planning, talent development, and performance culture. Requires deep avionics expertise, aerospace software development experience, knowledge of DO-178B/C and ARP4754A, and substantial people and technical leadership.
Top Skills: AgileAIArp4754AAutomationAvionicsDigital ThreadDigital TwinHoneywell Operating SystemLean Product DevelopmentModel-Based Systems Engineering (Mbse)Rtca Do-178B/C
Yesterday
Hybrid
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Leads the architecture and delivery of secure, scalable enterprise infrastructure across on-premises, hybrid-cloud, and cloud environments. Partners with engineering, security, network, and product teams to drive platform modernization, automation, Infrastructure-as-Code, resiliency, performance, and operational excellence. Develops architecture standards, roadmaps, and documentation while ensuring availability, compliance, disaster recovery, and security requirements for mission-critical platforms.
Top Skills: AnsibleApi GatewaysAWSAzureBitbucketCi/CdGitGoogle Cloud PlatformInfrastructure-As-CodeJenkinsLoad BalancingMicrosoft VisioTerraformVMwareWeb Application FirewallZero Trust

What you need to know about the Hyderabad Tech Scene

Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account