Designs, builds, and maintains scalable ETL pipelines connecting Salesforce with Snowflake and other data systems. The role manages Salesforce APIs and bulk data loading, writes and optimizes SQL and Python for data transformation, conducts Git-based code reviews, and monitors pipeline performance, availability, and data integrity.
Summary
We are seeking an experienced Data Engineer to join our IT Services division. In this pivotal role, you will design, build, and maintain robust data pipelines that facilitate seamless information flow across our Salesforce ecosystem and data warehouse. You will be instrumental in ensuring data integrity, optimizing ETL processes, and enabling data-driven decision-making through the implementation of scalable architectures using Snowflake, Python, and SQL. This position offers the opportunity to work with cutting-edge technologies while driving efficiency in our data loading and transformation workflows.
Responsibilities
- Architect and develop efficient ETL solutions for bulk data loading operations, specifically tailored for Salesforce environments.
- Integrate and manage Salesforce APIs to ensure accurate and timely data synchronization between external systems and the CRM.
- Utilize specialized Salesforce data loading tools to handle large-scale data migration and maintenance tasks.
- Write, review, and optimize complex SQL queries and Python scripts to support data processing and analysis needs.
- Collaborate with development teams to conduct code reviews, ensuring adherence to best practices and version control standards using Git.
- Monitor and troubleshoot data pipelines to maintain high availability and performance within the Snowflake platform.
- Implement secure and scalable data loading strategies to support business growth and operational requirements.
Requirements
Requirements:
- Possess 6 to 8 years of professional experience in data engineering, with a strong focus on IT Services.
- Demonstrate deep proficiency with Salesforce APIs and dedicated data loading utilities.
- Show proven expertise in designing and executing ETL processes and bulk data loading strategies.
- Be highly skilled in SQL and Python for data manipulation, transformation, and automation.
- Have hands-on experience working with Snowflake as a primary data warehouse solution.
- Exhibit strong competency in version control systems, specifically Git, including the ability to perform thorough code reviews.
- Hold a competitive salary expectation within the range of ₹12-14 LPA.
Similar Jobs
Information Technology
Design, develop, and maintain scalable data solutions, pipelines, and ETL processes using Databricks, Azure Databricks, PySpark, and Python. Ensure data quality, integration, migration, and workflow performance across systems. Lead data architecture implementation, translate stakeholder requirements into technical solutions, make team decisions, collaborate across multiple teams, and mentor junior engineers. Continuously improve data processes for efficiency, reliability, and scalability.
Top Skills:
Databricks Unified Data Analytics PlatformMicrosoft Azure DatabricksPysparkPython
Information Technology
Design, develop, and maintain data solutions, pipelines, and ETL processes using Databricks. Ensure data quality through validation, cleansing, and monitoring; support data migration across systems; troubleshoot complex engineering issues; collaborate across teams; and mentor junior staff.
Top Skills:
Databricks Unified Data Analytics PlatformETL
Information Technology
Design, develop, and maintain scalable data solutions, pipelines, and ETL processes using Databricks, Azure Databricks, PySpark, and Python. Ensure data quality, integration, migration, and workflow performance across systems. Lead data architecture initiatives, collaborate with stakeholders, make technical decisions, mentor junior engineers, manage teams, and continuously improve data processes for reliability and scalability.
Top Skills:
Cloud-Based Data PlatformsData PipelinesDatabricks Unified Data Analytics PlatformDistributed ComputingETLMicrosoft Azure DatabricksPysparkPython
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
