Build and maintain GCP-based data pipelines and infrastructure to support generative AI/NLP model training, ensure data privacy and security, integrate backend with web and mobile apps, collaborate with AI and DevOps teams, and implement monitoring and optimization for production performance.
Job Summary
- We are seeking a Data Engineer to help build and integrate a Generative AI-powered conversational assistant, into our website and mobile app. This role is crucial in handling data pipelines, model training, and infrastructure setup to deliver a seamless, privacy-compliant experience for users seeking personalized health insights. The Data Engineer will work closely with our AI and software development teams to design scalable data solutions within Google Cloud Platform (GCP) to support this next-generation AI service.
- Data Integration & Pipeline Development: Design and implement data pipelines to support training and finetuning of knowledge base and user data, ensuring data quality, scalability, and efficiency.
- Data Processing & Transformation: Develop data transformation processes to prepare data for Natural Language Processing (NLP) models, facilitating personalized and accurate health recommendations.
- Privacy & Security Compliance: Ensure all data handling practices comply with privacy and security standards, focusing on user data protection within AI model training and deployment.
- Infrastructure Setup & Management: Build and maintain foundational cloud infrastructure on GCP to host, deploy, and scale securely and efficiently across platforms.
- Collaboration with AI & DevOps Teams: Partner with AI/ML and DevOps teams to finetune, test, and optimize NLP models for production, focusing on deployment performance and user experience.
- Website & Mobile Integration Support: Work alongside frontend developers to ensure smooth data flow and integration between the backend, website and mobile app.
- Monitoring & Optimization: Implement monitoring, logging, and automated alerts to ensure data pipelines, model interactions, and infrastructure meet performance and reliability requirements.
- Education: Bachelor’s or Master’s in Computer Science, Data Engineering, or a related field.
- Experience:
- 3+ years in data engineering, preferably within Generative AI or NLP-focused projects.
- Hands-on experience with Google Cloud Platform (GCP), including BigQuery, Dataflow, and Cloud Storage.
- Proven ability in data pipeline design and data transformations for AI model training.
- Skills:
- Strong programming skills in Python and familiarity with SQL.
- Experience with DevOps tools (e.g., Kubernetes, Docker) and CI/CD pipelines in GCP.
- Proficient in data management practices, data privacy, and security protocols.
- Familiarity with AI/ML workflows, specifically NLP model training and finetuning.
- Nice to Have:
- Experience working with Contentful, or React Native integrations.
- Knowledge of MLOps practices to support continuous model training and deployment.
Photon Hyderabad, Telangana, IND Office
DLF Cyber City 6th Floor, Block 3 Gachibowli , Hyderabad, India, 500032
Photon Hyderabad, Telangana, IND Office
Hyderabad, India
Similar Jobs
.png)
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Lead architecture and delivery of Control Center platform capabilities, evolving it into an AI-agent-ready operations platform. Design MCP registries, AI orchestration, access automation, guardrails, and HITL workflows. Mentor engineers, drive cross-team roadmaps, own backend services reliability, SLOs, observability, incident response, and collaborate with Security and Product to deliver secure, compliant internal tooling.
Top Skills:
AWSBuildkiteCircleCIGo (Golang)GraphQLGrpcHitlKafkaKubernetesLlm OrchestrationMcpMcp ServersMemcachedMqNoSQLPythonRagRedisSQLTerraform
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Design and own architecture for IT tooling automations across n8n, Airflow, Temporal, and Jira; lead high-impact automation projects end-to-end; establish standards, reusable frameworks, and documentation; collaborate with Security, Corporate Engineering, and IAM to resolve blockers and scale the platform.
Top Skills:
AirflowCi/CdGenerative AiGitGoogle WorkspaceJIRAJira AutomationN8NOktaSlack ApiTemporalWorkato
Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Build end-to-end full-stack AI features on a Ruby on Rails backend and React frontend, design and run experiments (A/B tests and AI evaluations), implement AI infrastructure for reliable LLM inference, and iterate quickly to scale production-ready LLM-powered products.
Top Skills:
Ai AgentsLlmsMySQLPostgresReactRetrieval-Augmented Generation (Rag)Ruby On Rails
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
