Design and implement scalable, secure Databricks-based data platforms; lead architecture, pipeline development (ELT/ETL), performance tuning, data quality, lineage, governance, and integrations; coordinate cross-functional teams; define best practices, CI/CD, and mentor junior staff.
Position:DBX - Solutions ArchitectJob Description:
What you'll be doing:
- Lead the design and implementation of scalable, secure, and high-performing data solutions using Azure Databricks, Delta Lake, and Delta Live Tables.
- Own the complete architecture process, including requirements gathering, solution design, documentation, technical reviews and implement advanced data solutions on the Databricks platform.
- Define best practices for cloud data architecture, data modeling, ELT/ETL pipelines, workspace setup, cluster management, repos, and job orchestration.
- Coordinate and communicate with onshore and offshore teams, including end-users, data engineers, reporting specialists, and business analysts.
- Ensure solution compliance with data privacy, security, and governance standards.
- Conduct performance tuning and optimization of Databricks clusters.
- Ensure data quality, lineage, and observability across all pipelines.
- Monitor and troubleshoot data pipelines to ensure data quality and reliability.
- Lead the integration of Databricks with other data platforms and tools.
- Create processes and workflows to support data solutions documents, and lead solution reviews and audits for quality
- Stay updated with industry best practices, Databricks and Azure developments, and introduce improvements to the technical stack.
What we're looking for:
- At least 10 years of experience in enterprise data architecture, including design and implementation of large-scale data platforms and 5+ years of relevant data engineering experience on Databricks.
- Strong expertise in: Databricks (Workspace, Clusters, Jobs, Repos, Delta Live Tables)
- Deep hands-on expertise with Azure Databricks, PySpark, Delta Lake, Unity catalog, MLflow, DBT, and associated Azure data services (Data Lake, SQL, Synapse, ADF).
- Proven experience migrating from legacy data warehouse and reporting systems to modern cloud platforms.
- Experience in data modeling, data warehousing (OLTP, OLAP), security, governance, DevOps, and MLOps.
- Hands-on with CI/CD, version control (Git), and DevOps practices for data engineering
- Excellent communication, collaboration, problem-solving and analytical skills with the ability to collaborate effectively with cross-functional teams and influence decision-making at all levels of the organization.
- Architect-level certifications in Databricks and DBT are preferred.
- Ability to mentor and coach junior architects, engineers, and BI/reporting developers.
About Arrow:
Arrow Electronics, Inc. (NYSE: ARW), an award-winning Fortune 148 and one of Fortune Magazine’s Most Admired Companies. Arrow guides innovation forward for over 220,000 leading technology manufacturers and service providers. With 2025 sales of USD $30.9 billion, Arrow develops technology solutions that improve business and daily life. Our broad portfolio that spans the entire technology landscape helps customers create, make and manage forward-thinking products that make the benefits of technology accessible to as many people as possible. Learn more at www.arrow.com.
Our strategic direction of guiding innovation forward is expressed as Five Years Out, a way of thinking about the tangible future to bridge the gap between what's possible and the practical technologies to make it happen. Learn more at https://www.fiveyearsout.com/.
Arrow Electronics, Inc. Hyderabad, Telangana, IND Office
Hyderabad, Telangana, India, 500003
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The role involves managing finance change, regulatory reporting, project management, and software testing, requiring extensive experience in financial services and team leadership.
Top Skills:
Automation Testing ToolsExcelSQL
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Manage projects in the transaction banking sector with an emphasis on compliance and retail payments, using Agile methodologies and strong stakeholder management.
Top Skills:
ConfluenceIso20022JIRA
.png){kind=logo}
Artificial Intelligence • Edtech • Mobile • Natural Language Processing • Productivity • Software
The IT Systems Engineer II will design, automate, and manage scalable IT infrastructure while collaborating across teams to ensure operational excellence in cloud and on-prem environments.
Top Skills:
AnsibleAWSBashCloudFormationGCPGithub ActionsGitlabGrafanaJenkinsPowershellPrometheusPythonTerraform
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
