Design, develop, and modernize enterprise-scale Azure data platforms. Lead solution architecture, refactor and optimize PySpark/Databricks pipelines, implement ETL/ELT and lakehouse/warehousing solutions, ensure performance, data quality, governance, and mentor junior engineers.
Enable Data seeking an experienced Azure Data Architect with strong hands-on engineering expertise to design, develop, optimize, and modernize enterprise-scale data platforms. The role combines solution architecture, technical leadership, and individual contributor responsibilities, requiring deep expertise in Azure data services, data engineering best practices, and large-scale data processing using PySpark, Python, SQL, and Azure Databricks.
The ideal candidate will be responsible for analyzing existing data products and pipelines, identifying improvement opportunities, leading refactoring and redesign initiatives, and implementing scalable, reliable, and high-performance data solutions on Azure.
Responsibilities- Architecture & Solution Design
- Overall 15+ years of experience with 10+ years of experience in Data Engineering and Analytics solutions.
- Design end-to-end data architectures on Microsoft Azure.
- Define data ingestion, transformation, storage, governance, and consumption strategies.
- Create scalable, secure, and cost-effective data solutions aligned with business objectives.
- Establish architectural standards, design patterns, and best practices for data engineering teams.
- Collaborate with business stakeholders, product owners, and technical teams to translate requirements into technical solutions.
- Design, develop, and modernize enterprise data platforms on Azure. Analyze, refactor, and redesign existing data pipelines and products while building new scalable data solutions.
- Act as a hands-on individual contributor with technical leadership responsibilities, including mentoring junior developers and driving best practices.
- Strong hands-on experience in PySpark, Python, and SQL
- Expertise in Azure Databricks and Azure data ecosystem
- Experience designing and implementing scalable data architectures
- Ability to analyze, optimize, refactor, and redesign existing data pipelines
- Develop and maintain ETL/ELT solutions and data products
- Performance tuning, troubleshooting, and data quality implementation
- Mentor and guide junior developers and conduct code reviews
- Collaborate with cross-functional teams to deliver end-to-end data solutions
Required Experience
Requirements
- Azure Data Lake, Azure Data Factory, Azure Synapse
- Data warehousing, lakehouse architecture, and cloud migration
- CI/CD, Git, and Agile development practices
- Role Type: Senior Individual Contributor with Technical Leadership responsibilities.
Similar Jobs
Automotive • eCommerce • Retail • Sales
Leads a team of data engineers and owns the architecture, implementation, governance, security, and optimization of a GCP Data Lakehouse platform. Responsibilities include designing Spark and Delta Lake pipelines, managing Unity Catalog, improving SQL and ETL performance, enabling analytics and machine learning use cases, implementing CI/CD with GitLab and Jenkins, and communicating technical strategies to stakeholders.
Top Skills:
Apache AirflowApache KafkaSparkConfluenceDelta LakeEmbedding ModelsGCPGcp Cloud StorageGcp Data LakeGcp Pub/SubGitGitlabJenkinsJIRALlmsLooker StudioMlflowPostgresPower BIPysparkPythonRagScalaSQLTerraformUnity CatalogVector Databases
Big Data • Cloud • Software • Database
Lead and manage a regional Builder Relations team in APAC, driving developer and customer engagement through schema design reviews, live enablement sessions, content creation, and collaboration with Sales and Marketing. Mentor team members, measure business impact, and scale developer enablement programs while advocating MongoDB adoption and AI-native solutions.
Top Skills:
AIAWSDocument DatabasesGCPAzureMongoDBMongodb Atlas
.png)
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Design and implement a unified orchestration layer coordinating vendor and internal LLMs and human agents. Build production-grade Python services, drive ML projects from design to delivery, ensure secure, scalable AI-enabled customer experiences, and collaborate across teams to meet security, compliance, and performance standards.
Top Skills:
Aws BedrockDeep LearningGoogle AdkLanggraphLangsmithLlmsPythonVertex Ai
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
