The Senior Big Data Engineer will develop data solutions using Big Data technologies, including PySpark, and manage large datasets while ensuring best practices in engineering.
Company Description
👋🏼We're Nagarro.
We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (18000+ experts across 38 countries, to be exact). Our work culture is dynamic and non-hierarchical. We're looking for great new colleagues. That's where you come in!
Job Description
REQUIREMENTS:
- Total experience 3+ years.
- Excellent knowledge and experience in Big data engineer.
- Strong hands-on experience with PySpark and Apache Spark development.
- Proficiency in Python for data processing and automation.
- Expertise in SQL for querying, transformation, and performance tuning.
- Hands-on experience with Databricks or similar cloud-based big data platforms.
- Proven ability to work with large datasets in distributed computing environments.
- Solid understanding of data engineering best practices, including version control, CI/CD, and testing.
- Knowledge of data modeling, ETL frameworks, and workflow orchestration tools (e.g., Airflow, Azure Data Factory).
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Familiarity with Delta Lake, Lakehouse architecture, or data warehousing concepts.
- Excellent problem-solving and communication skills.
RESPONSIBILITIES:
- Writing and reviewing great quality code
- Understanding functional requirements thoroughly and analyzing the client’s needs in the context of the project
- Envisioning the overall solution for defined functional and non-functional requirements, and being able to define technologies, patterns and frameworks to realize it
- Determining and implementing design methodologies and tool sets
- Enabling application development by coordinating requirements, schedules, and activities.
- Being able to lead/support UAT and production roll outs
- Creating, understanding and validating WBS and estimated effort for given module/task, and being able to justify it
- Addressing issues promptly, responding positively to setbacks and challenges with a mindset of continuous improvement
- Giving constructive feedback to the team members and setting clear expectations.
- Helping the team in troubleshooting and resolving of complex bugs
- Coming up with solutions to any issue that is raised during code/design review and being able to justify the decision taken
- Carrying out POCs to make sure that suggested design/technologies meet the requirements.
Qualifications
Bachelor’s or master’s degree in computer science, Information Technology, or a related field.
Top Skills
Airflow
Spark
AWS
Azure
Azure Data Factory
Databricks
GCP
Pyspark
Python
SQL
Nagarro Hyderabad, Telangana, IND Office
Workafella Business Centre, 12th floor, Western Aqua, Hi-Tech City, Whitefields, Kondapur, Hyderabad, Telangana, India, 500081
Similar Jobs
Artificial Intelligence • Hardware • Information Technology • Machine Learning • Semiconductor
The Big Data Operations Engineer is responsible for developing ETL processes, utilizing big data frameworks, and collaborating with data scientists to optimize data analytics and machine learning systems.
Top Skills:
Apache Ni-FiHadoopHbaseHdfsHivePythonScalaSparkSQL
Big Data • Marketing Tech • Analytics
The Senior Big Data Engineer will work on data engineering tasks, focusing on SQL and ETL processes, data visualization, and data warehouse migration. Responsibilities include data modeling, collaborating with teams, and driving technological innovation within the organization.
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
In this role, you'll develop scalable code, collaborate with product owners, implement user-friendly software, and mentor peers.
Top Skills:
AIAngularJavaJavaScriptReactUnix ToolsVue
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
