VST Global Logo

VST Global

Data Engineer

Reposted 8 Days Ago
In-Office
Hyderabad, Telangana, IND
Mid level
In-Office
Hyderabad, Telangana, IND
Mid level
As a Data Engineer, you will design and maintain systems for processing large datasets, develop data pipelines, ensure data integrity, and optimize workflows for analytics and machine learning.
The summary above was generated by AI

As a Data Engineer you will have the opportunity to design, build, and maintain systems for collecting, storing, and processing large datasets. You will develop data pipelines, ensure data integrity, and optimize data workflows for analytics or machine learning. With your proficiency in programming languages like Python or Java and tools such as SQL, PySpark, and cloud platforms, you will collaborate with teams to enable efficient data access and support decision-making processes. Strong problem-solving and communication skills are essential for this role.

Responsibilities:
  • Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.
  • Collaborate with product and technology teams to design and validate the capabilities of the data platform
  • Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability
  • Provide technical support and usage guidance to the users of our platform’s services.
  • Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.


Requirements
  • Experience building and optimizing data pipelines in a distributed environment
  • Experience supporting and working with cross-functional teams
  • Proficiency working in Linux environment
  • 4+ years of advanced working knowledge of SQL, Python, and PySpark
  • 2+ years of experience with using a broad range of AWS technologies
  • Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline
  • Experience with platform monitoring and alerts tools


Benefits

Working at VentureSoft means being part of a team driven by success and care. We believe in helping each other achieve their aspirations. We prioritize your growth through exceptional mentorship opportunities, continuous learning programs, and a well-defined career path. Our flat and agile structure ensures that your voice is heard, your ideas are valued, and your contributions drive success for our clients and partners. At VentureSoft, you’re not just an employee—you’re part of a community that supports your aspirations and celebrates your achievements.

  • Flexible Work Schedule/Telecommuting
  • Vacation / Paid Time Off
  • Employee Discounts and Rewards
  • Finding Balance
  • Health Insurance / Wellness Program

We offer the best employee benefits and perks, and we have created a culture of appreciation within our organization. It’s a philosophy that’s not necessarily new—the idea that employees who are treated better perform better—but it’s starting to gain momentum in the professional world. At Venturesoft, we think that offering major benefits like flexible work schedules, generous PTO, and unique perks like a vacation reimbursement program (or a tuition reimbursement program), full cost for any IT certifications can do wonders for morale and productivity.



Similar Jobs

2 Days Ago
Hybrid
Hyderabad, Telangana, IND
Junior
Junior
Information Technology
Design, build, and optimize ETL/ELT data pipelines using Microsoft Fabric and Azure Data Factory. Implement and maintain data warehousing solutions, write and tune complex SQL queries, manage Azure resources, ensure data governance and pipeline reliability, and collaborate with stakeholders for analytics needs.
Top Skills: Azure Data FactoryAzure Event HubsAzure PortalAzure Sql DatabaseAzure StorageAzure SynapseMicrosoft FabricPower BIPythonSparkSQLStream Analytics
6 Days Ago
Remote or Hybrid
India
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design, build, and maintain cloud-native data pipelines and ETL/ELT workflows for high-volume trade lifecycle data. Integrate DTCC sources (RTTM, Settlement Web) into a Unified Trade Record, process ISO 15022 messages, manage trade exception databases, optimize SQL Server performance, and ensure data quality, lineage, governance, and observability while collaborating with business stakeholders.
Top Skills: AWSDockerDtcc RttmDtcc Settlement WebEksEltETLFixFxmlIbm MqIndexingIso 15022KafkaKubernetesRdsRest ApiS3SQLSQL ServerStored ProceduresUnified Trade Record (Utr)
Yesterday
Hybrid
Hyderabad, Telangana, IND
Senior level
Senior level
Information Technology
Lead architecture and delivery of cloud-scale data pipelines, ETL/ELT, and modern data warehousing using Microsoft Fabric, ADF, PySpark, and advanced SQL. Oversee platform operations in Azure, enforce governance/security, mentor engineers, drive performance tuning, resiliency, and reusable frameworks to support analytics-ready datasets and stakeholder requirements.
Top Skills: Azure Data Factory (Adf)Azure Data ServicesAzure PortalAzure Sql DatabaseAzure StorageAzure SynapseMicrosoft FabricPysparkPythonSQL

What you need to know about the Hyderabad Tech Scene

Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account