Develop, enhance, and support ETL/data pipelines using Sparkola, PySpark and SQL. Build and manage batch and ad-hoc pipelines via Sparkola Job Server, use Cloudera Machine Learning for development, validate datasets for downstream analytics (QlikSense/Superset), engage stakeholders to translate requirements, support production issues, and follow JIRA-driven delivery and governance controls.
Business Function
Consumer Banking Group enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group CBG, we manage the majority of the Bank's operational processes and inspire to delight our business partners through our multiple banking delivery channels
Key Accountabilities
- Develop, enhance, and support data extraction, transformation, and validation processes using Sparkola, PySpark, and SQL.
- Build and manage batch and ad‑hoc data pipelines through Sparkola Job Server, ensuring stability, performance, and timely delivery.
- Use Cloudera Machine Learning (CML) environments for development, testing, and execution of Spark workloads as per DBS standards.
- Ensure datasets are accurate, traceable, and fit for consumption by downstream analytics and reporting platforms such as QlikSense and Superset.
Business & Stakeholder Engagement
- Engage with business users and analysts to understand functional requirements and translate them into technical logic and data models.
- Support production issues and data clarifications as required.
Delivery Governance & Controls
- Manage deliverables using JIRA, adhering to timelines, priorities, and change control processes.
- Ensure solutions comply with DBS risk, security, and data governance standards, including internal data controls.
Required Skills for this rile (JD):
Technical Competencies
- Strong hands‑on experience with:
- Sparkola
- PySpark
- SQL (complex queries, joins, performance tuning)
- Working knowledge of:
- CML (Cloudera Machine Learning)
- Sparkola Job Server
- QlikSense and/or Superset
- Strong proficiency in MS Excel for data validation, analysis, and reconciliation.
Functional & Behavioral Competencies
- Experience working in agile delivery models with strong exposure to JIRA boards.
- Excellent communication and collaboration skills, with the ability to bridge business and technology discussions.
- Strong analytical thinking, attention to detail, and problem‑solving capability.
- Proactive, dependable team player with a learning mindset and resilience in a fast‑paced environment.
Preferred (Good to Have)
- Experience in banking or financial services, especially in regulated data environments.
- Exposure to data governance, audit, lineage, and controls.
Location:
Hyderabad - DTI Skyview SEZJob:
AnalyticsSchedule:
RegularEmployee Status:
Full timeSimilar Jobs
Big Data • Cloud • Software • Database
Lead and manage a regional Builder Relations team in APAC, driving developer and customer engagement through schema design reviews, live enablement sessions, content creation, and collaboration with Sales and Marketing. Mentor team members, measure business impact, and scale developer enablement programs while advocating MongoDB adoption and AI-native solutions.
Top Skills:
AIAWSDocument DatabasesGCPAzureMongoDBMongodb Atlas
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, train, and deploy production-grade ML and deep learning models on large healthcare datasets. Apply classical and advanced techniques, AutoML, synthetic data, and healthcare standards. Collaborate with data engineering, lead model governance, monitor performance, and communicate results to technical and non-technical stakeholders.
Top Skills:
ConfluenceCptDatarobotFhirGretel.AiH2O.AiHl7Hugging Face TransformersIcdKerasLoincNdcPythonPyTorchRSnomedSQLSyntheaTensorFlowVertex Ai (Google Cloud Automl)Xgboost
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, develop, and maintain scalable, secure full-stack web applications using React/Angular front ends and Java/Python/Node.js backends. Build RESTful APIs and microservices, work across cloud platforms (Azure/AWS/GCP), support CI/CD and containerization, participate in architecture and code reviews, troubleshoot production issues, and mentor junior engineers.
Top Skills:
AngularAWSAzureCi/CdDockerGitGoogle Cloud PlatformJavaJavaScriptKubernetesMicroservicesNode.jsPythonReactRest ApisSpring BootSQLTypescript
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
