Designs and leads enterprise data and analytics architectures on Databricks, including Lakehouse, Medallion, Unity Catalog, governance, lineage, schemas, integration patterns, and security considerations. Produces reference architectures and technical designs, guides engineering teams, and manages stakeholder communication. Preferred experience includes process mining, object-centric modeling, Celonis, federated queries, Microsoft Fabric, Power BI semantic models, dashboard architecture, and engineering analytics.
Required Skills & Experience (Must Have)
- 12+ years of overall IT experience, with significant experience in enterprise data architecture, data engineering architecture or analytics platform architecture.
- Strong experience designing and implementing enterprise data and analytics architectures on Databricks.
- Strong understanding and practical experience with:
- Databricks Lakehouse architecture.
- Medallion Architecture (Bronze, Silver and Gold) or equivalent data-layering patterns.
- Databricks Unity Catalog.
- Data governance, metadata management and data lineage.
- Experience defining canonical data schemas, data models and source-system onboarding patterns.
- Strong understanding of enterprise data integration and experience designing integration patterns across:
- Git platforms.
- Azure DevOps.
- CI/CD pipelines and engineering toolchains.
- Ability to define architectural boundaries between data platform transformations and downstream analytics/reporting tools.
- Experience producing enterprise reference architectures, solution architecture documents and technical design recommendations.
- Experience preparing architecture documentation and technical inputs for security architecture reviews.
- Strong understanding of enterprise data governance, access control, data security and integration considerations.
- Proven ability to provide technical leadership and architectural guidance to engineering teams without requiring direct people-management responsibilities.
- Strong communication and stakeholder management skills.
- Experience with process mining or object-centric data modelling.
- Hands-on experience with Celonis or Bloomfilter.
- Understanding of zero-copy or federated query patterns between a lakehouse and an analytics platform.
- Awareness of Microsoft Fabric and its integration with enterprise lakehouse architectures.
- Experience designing Power BI semantic models and enterprise analytics consumption layers.
- Experience with persona-based or tiered dashboard architecture for different stakeholder groups.
- Previous experience in developer productivity analytics, engineering intelligence or software engineering analytics.
- Understanding of engineering metrics and data from Git, Azure DevOps, CI/CD and related development platforms.
Similar Jobs
Information Technology
Designs application data architecture, storage, integration, and scalable Databricks ETL/ELT pipelines. Builds secure Delta Live Tables and Unity Catalog implementations, manages data ingestion, governance, masking, sharing, dashboards, and cloud integrations. Develops Python and PySpark transformation logic, optimizes performance and costs, supports GenAI datasets, and deploys pipelines through CI/CD. Requires 7.5 years of Databricks experience and 15 years of full-time education.
Top Skills:
Apache AirflowSparkAuto LoaderAWSAzureDatabricksDatabricks Asset BundlesDatabricks Vector SearchDbtDelta LakeDelta Live TablesDelta SharingFeature StoreFivetranGCPGitGitlabHadoopHiveInformaticaJdbcKafkaLookerMatillionMlflowOdbcPhotonPower BIPysparkPythonSQLTableauTalendUnity Catalog
Healthtech
Provides technical leadership for enterprise data and analytics architecture across multiple programs. Defines scalable, secure solution architectures, reference patterns, data models, integration blueprints, and implementation standards. Leads proofs of concept, technology evaluations, architecture and code reviews, and technical quality assessments. Partners with engineering, product, governance, security, and business teams to address complex platform challenges, guide delivery roadmaps, and embed privacy and compliance. Mentors technical teams and communicates architectural decisions to senior stakeholders.
Top Skills:
Azure Data ServicesChange Data Capture (Cdc)Ci/CdData ModelingData WarehousingDatabricks LakehouseDaxDelta LakeDelta Live TablesDevOpsEtl/EltGraphQLInfrastructure As CodeJdeKafkaLakehouseMaster Data Management (Mdm)OraclePower BIPythonRestSap S/4HanaSFDCSQLUnity Catalog
Healthtech • Other • Robotics • Biotech • Manufacturing
Provides technical leadership for enterprise data and analytics architecture across multiple programs. Defines scalable cloud data platforms, integration patterns, governance standards, data models, and reusable architectures. Leads proof-of-concepts, technology evaluations, architecture and code reviews, and technical quality assessments. Partners with engineering, product, security, governance, and business teams to translate strategy into implementation roadmaps while resolving complex performance, reliability, and integration challenges. Mentors technical teams and communicates architecture decisions to senior stakeholders.
Top Skills:
Azure Data ServicesCdcCi/CdData GovernanceData WarehousingDatabricks LakehouseDaxDelta LakeDelta Live TablesDevOpsDimensional ModelingDistributed Data ProcessingEtl/EltGraphQLInfrastructure-As-CodeJdeKafkaLakehouseMaster Data ManagementMedallion ArchitectureMetadata ManagementOraclePower BIPythonReal-Time StreamingRestSap S/4HanaSFDCSQLStar-Schema DesignUnity Catalog
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
