MLOps- Sr Software Engineer

Posted 3 Days Ago
Be an Early Applicant
Hyderabad, Telangana
5-7 Years Experience
eCommerce • Fashion
The Role
Design, optimize, and maintain scalable data pipelines using PySpark, Python, Databricks, and Delta Lake. Implement MLOps practices for efficient deployment and monitoring of machine learning models. Develop strategies for detecting and mitigating data drift. Utilize Vector DB for data querying and management. Manage a Feature Store for sharing feature data for ML models. Collaborate with teams to deliver impactful data solutions.
Summary Generated by Built In

About the RoleSenior Data Engineer with expertise in designing and implementing scalable data solutions, including robust data pipelines. Strong proficiency in ETL processes, MLOps practices for efficient model deployment, and utilizing technologies such as Databricks, DataLake, Vector DB, and Feature Store are essential.What You'll Do

  • Design, optimize, and maintain scalable data pipelines using PySpark (Apache Spark), Python, Databricks, and Delta Lake. 

  • Implement MLOps practices for efficient deployment and monitoring of machine learning models. 

  • Should be able to Develop strategies and tools for detecting and mitigating data drift. 

  • Utilize Vector DB for effective data querying and management. 

  • Establish and manage a Feature Store to centralize and share feature data for machine learning models. 

  • Ensure data integrity and quality throughout all stages of the pipeline. 

  • Collaborate with teams and stakeholders to deliver impactful data solutions. 

  • Demonstrate proficiency in Python programming, PySpark (Apache Spark), data architecture, ETL processes, and cloud platforms (AWS, Azure, GCP). 

Soft Skills:

  • Collaborate effectively with cross-functional teams and stakeholders to deliver impactful data solutions. 

  • Demonstrate strong communication skills to articulate complex technical concepts to non-technical stakeholders. 

  • Exhibit problem-solving skills to address data-related challenges and optimize processes. 

 

Who You Are

  • 5-8 yrs of experience in designing and implementing effective data solutions.

  • 5+yrs experience into Databricks, Delta Lake, PySpark (Apache Spark), MLOps, Data Drift Detection, Vector DB and Feature Store .

  • Efficient in Model deployment

  • Hands-on experience in Databricks, Pyspark, Delta Lake, MLOps.

  • Graduation in any degree

Top Skills

Pyspark
Python
The Company
Bristol
11,000 Employees
On-site Workplace
Year Founded: 1969

What We Do

In 1969, Don and Doris Fisher opened the first Gap store on Ocean Avenue in San Francisco. They wanted to make it easier to find a great pair of jeans, and they did. Their denim and records store was a hit, and it grew to become one of the world’s most iconic brands.

Today we’re represented in more than 1400 stores in over 40 countries, and online. We have headquarters in New York, London, Shanghai, Tokyo, and, of course, San Francisco.

Our unique aesthetic is optimistic cool, elevated American style. Our clothes are crafted with care, with focused attention to thoughtful design. We believe in staying true to our heritage while creating what’s next.

Don and Doris Fisher always wanted to “do more than sell clothes.” They wanted to support the people who ran their company, to be active in their communities, and to have a positive impact on the world. Their vision helped transform retail, and we’re still following their lead.

We stand for freedom and possibility for all; we champion diverse ideas that transcend generations, geographies and genders.

Jobs at Similar Companies

Alliant Credit Union Logo Alliant Credit Union

Data Analyst - Hybrid

Fintech • Financial Services
Hybrid
Chicago, IL, USA
843 Employees
Easy Apply
Remote
United States
985 Employees
Hybrid
Chicago, IL, USA
843 Employees

AffiniPay Logo AffiniPay

Sales Operations Manager

Fintech • Legal Tech • Payments • Sales • Software
Remote
United States
519 Employees

Similar Companies Hiring

Crunchyroll Thumbnail
News + Entertainment • Mobile • Gaming • eCommerce • Digital Media
San Francisco, CA
1200 Employees
Opendoor Thumbnail
Software • Real Estate • PropTech • Fintech • eCommerce
San Francisco, CA
1600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account