Develop and maintain scalable PySpark data pipelines and ETL processes, write optimized SQL for extraction and transformation, manage large structured and unstructured datasets, ensure data quality, resolve performance bottlenecks, and collaborate with cross-functional teams. The role also involves code reviews and applying data engineering best practices. AWS, Airflow, Hadoop, and modern data lake platform experience are preferred.
Experience- 4-9years
Location- Hyderabad
PySpark Developer – ETL & SQL
We're looking for a PySpark Developer who enjoys working with data at scale and has a strong foundation in PySpark, ETL development, and SQL. If you're passionate about building efficient data pipelines, transforming large datasets into meaningful insights, and solving complex data challenges, we'd love to connect with you.
Requirements
What You'll Do
- Develop and maintain robust data pipelines using PySpark.
- Design and build scalable ETL processes to support business and analytics needs.
- Write optimized SQL queries for data extraction, transformation, validation, and reporting.
- Work with large volumes of structured and unstructured data.
- Ensure data quality, accuracy, and consistency across various data sources.
- Identify and resolve performance bottlenecks in existing data workflows.
- Collaborate with cross-functional teams to understand requirements and deliver reliable data solutions.
- Participate in code reviews and contribute to data engineering best practices.
What We're Looking For
- 4–8 years of experience in Data Engineering or related roles.
- Strong hands-on experience with PySpark and large-scale data processing.
- Solid expertise in designing and developing ETL pipelines.
- Advanced SQL skills, including query optimization and performance tuning.
- Good understanding of data warehousing and data modeling concepts.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
Nice to Have
- Experience with AWS.
- Exposure to Airflow or other workflow orchestration tools.
- Familiarity with Hadoop ecosystem technologies.
- Experience working with modern data lake or cloud data platforms.
Benefits
- Comprehensive Medical Coverage:Health insurance of INR 5.0 Lakhs for you and your family (up to 6 members), ensuring complete peace of mind.
- Robust Protection Plans:Group Personal Accident Insurance and Group Term Life Insurance to safeguard you and your loved ones.
- Retirement Benefits:PF and Gratuity provided as per standard government regulations.
- Flexible Work Options:Enjoy hybrid work arrangements & flexible working hours
- Generous Leave Policy:21 days of annual leave, in addition to 10 company-declared holidays.
- Employee Well-being Spaces:Access to a dedicated break-out area with round-the-clock refreshments for relaxation and rejuvenation
Similar Jobs
Big Data • Cloud • Software • Database
Lead and manage a regional Builder Relations team in APAC, driving developer and customer engagement through schema design reviews, live enablement sessions, content creation, and collaboration with Sales and Marketing. Mentor team members, measure business impact, and scale developer enablement programs while advocating MongoDB adoption and AI-native solutions.
Top Skills:
AIAWSDocument DatabasesGCPAzureMongoDBMongodb Atlas
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, train, and deploy production-grade ML and deep learning models on large healthcare datasets. Apply classical and advanced techniques, AutoML, synthetic data, and healthcare standards. Collaborate with data engineering, lead model governance, monitor performance, and communicate results to technical and non-technical stakeholders.
Top Skills:
ConfluenceCptDatarobotFhirGretel.AiH2O.AiHl7Hugging Face TransformersIcdKerasLoincNdcPythonPyTorchRSnomedSQLSyntheaTensorFlowVertex Ai (Google Cloud Automl)Xgboost
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, develop, and maintain scalable, secure full-stack web applications using React/Angular front ends and Java/Python/Node.js backends. Build RESTful APIs and microservices, work across cloud platforms (Azure/AWS/GCP), support CI/CD and containerization, participate in architecture and code reviews, troubleshoot production issues, and mentor junior engineers.
Top Skills:
AngularAWSAzureCi/CdDockerGitGoogle Cloud PlatformJavaJavaScriptKubernetesMicroservicesNode.jsPythonReactRest ApisSpring BootSQLTypescript
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
