Designs, builds, and maintains Azure-based data solutions and ETL pipelines using Azure Data Factory and Databricks. Manages SQL and MySQL databases, develops data models, optimizes queries, supports data governance and quality, and documents architectures and pipelines. Collaborates with data scientists, analysts, and business stakeholders to deliver reliable data for analysis and reporting. The role also involves security compliance and may include real-time processing, multi-cloud technologies, and machine learning concepts.
Job Title: Senior Azure Data Engineer
Location: Hyderabad
Job Type: Full-Time
Job Summary: As an Azure Data Engineer, you will design, build, and maintain data solutions on Microsoft Azure, leveraging your expertise in SQL and MySQL to ensure high-quality data availability for analysis and reporting. You will collaborate closely with cross-functional teams to meet data needs and enhance decision-making capabilities.
Key Responsibilities:
Data Pipeline Development: Design and implement ETL processes using Azure Data Factory and Azure Databricks, ensuring data integration from various sources.
Database Management: Develop and maintain relational databases using SQL and MySQL, ensuring optimal performance and reliability.
Data Modelling: Create and maintain data models to support analytical needs, ensuring data is structured for efficient querying and reporting.
Query Optimization: Write and optimize complex SQL queries for data retrieval and reporting, improving performance and efficiency.
Collaboration: Work with data scientists, analysts, and business stakeholders to understand data requirements and ensure data quality.
Security and Compliance: Implement data governance practices and ensure compliance with data protection regulations.
Documentation: Create and maintain comprehensive documentation for data pipelines, databases, and architectural designs.
Qualifications:
Bachelor’s degree
4+ years of experience in data engineering or related roles.
Strong proficiency in Microsoft Azure services, particularly Azure Data Factory, Azure Databricks, Azure SQL Database.
Familiarity with AWS services will be advantageous in our multi-cloud environment.
Extensive experience with SQL and MySQL, including database design, optimization, and data manipulation.
Familiarity with programming languages such as Python or spark for data processing and analysis.
Understanding of data warehousing concepts and big data technologies (e.g., Hadoop, Spark) is a plus.
Experience with data governance and data quality best practices.
Excellent problem-solving skills and attention to detail.
Strong communication skills and ability to work collaboratively in a team environment.
Preferred Qualifications:
Microsoft Azure Data Engineer certification.
Experience with real-time data processing and stream analytics.
Knowledge of machine learning concepts and tools.
Similar Jobs
Information Technology
Designs, develops, monitors, and maintains large-scale batch and real-time data pipelines using Microsoft Fabric and Azure services. Responsibilities include ETL/ELT development, data modeling, database optimization, ingestion of terabytes of data, governance, lineage, security, and integration with analytics and production systems. The role also involves stakeholder collaboration, client interactions, mentoring peers, and providing technical guidance across structured, unstructured, and streaming data environments.
Top Skills:
Amazon RedshiftApache AirflowApache KafkaSparkAzure Cosmos DbAzure SynapseCassandraCi/CdData ActivatorDatabricksEventstreamFabric Dataflows Gen2Fabric LakehouseFabric NotebooksFabric PipelinesFabric ShortcutsFabric WarehouseGoogle BigqueryGraphdbKql DatabaseAzureMicrosoft FabricMongoDBMySQLOnelakePostgresPower BIPysparkPythonReal-Time HubSemantic ModelsSnowflakeSpark SqlSQLSQL Server
Events • Food • Travel • Hospitality • Hotels & Resorts
Conduct hotel security patrols, identify and address safety risks, assist with incident investigations, maintain accurate security reports, respond to emergencies, and provide professional guest assistance. The role requires prior security officer experience, knowledge of surveillance and emergency procedures, strong communication skills, calm performance under pressure, English proficiency, flexible availability, and preferably security certifications such as first aid or CPR.
Top Skills:
Emergency ProceduresSurveillance Systems
Events • Food • Travel • Hospitality • Hotels & Resorts
Prepares menu items and complex recipes under kitchen standards, manages guest orders, oversees station execution, inspects plates, maintains sanitation and food safety, performs inventory checks, and requisitions supplies. The role requires at least one year of cooking experience in a five-star hotel or high-standard restaurant, cuisine knowledge, teamwork, communication, and the ability to work calmly in a demanding kitchen environment.
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
