Own and build production AI/LLM applications end-to-end: architect RAG and agentic systems, implement function/tool calling, optimise inference costs, run evaluation frameworks, deploy on Kubernetes, and integrate with third-party platforms while collaborating with product teams to improve quality, latency, and cost.
Role Summary
We are looking for a Senior FullStack Engineer, AI to own and evolve Delta Exchange's suite of AI-powered products. You will work across multiple production AI applications: conversational support agents, RAG-powered search, code-generation copilots, and trading-strategy assistants. This is a hands-on role where you architect solutions around our existing stack, build retrieval pipelines, improve frontends with product sense, optimise inference costs, and run evaluations, collaborating closely with the product team.
Key Responsibilities
- Design, build, and maintain production AI applications end-to-end: backend, frontend, and inference services.
- Architect RAG systems using vector databases, embedding models, and chunking strategies optimised for accuracy and latency.
- Build agentic workflows with tool/function calling, multi-step reasoning, and structured output parsing, with accuracy and control as priority.
- Write and iterate on system prompts, few-shot examples, and prompt chains to maximise output quality.
- Implement function calling, tool-use patterns, and structured JSON/XML output handling using frontier and lightweight models from providers like Anthropic and OpenAI.
- Drive cost optimisation: model selection, caching, token budgeting, and request batching at scale.
- Build and maintain evaluation frameworks to measure accuracy, relevance, hallucination rates, and regression across prompt and model changes. Experience with observability tools (Sentry, Opik, etc.) is a must.
- Work with message queues (RabbitMQ), caching layers (Redis), and relational databases (PostgreSQL) powering AI service backends.
- Deploy and manage AI services on Kubernetes with CI/CD pipelines on AWS/GCP.
- Integrate AI capabilities with third-party platforms (Telegram bots, chat widgets, etc.).
- Contribute to architectural decisions: model selection, hosting (cloud APIs vs. self-hosted), and build-vs-buy trade-offs.
Required Skills & Experience
- 5+ years shipping production software systems.
- 2 years building AI/LLM-powered applications end-to-end with real users and volume. Not prototypes.
- Strong experience with RAG architectures: vector databases, embedding models, chunking/indexing strategies, and retrieval evaluation.
- Deep understanding of LLM capabilities and limitations: prompt engineering, function/tool calling, structured outputs, context window management, and multi-turn conversations.
- Experience with LLM provider APIs and abstraction layers (OpenAI, Anthropic, LiteLLM, OpenRouter, or similar).
- Proficiency in Python (Flask/FastAPI) and/or Node.js/TypeScript (Next.js, Vercel AI SDK). Golang experience is a plus.
- Hands-on experience building evals, tracking quality metrics, and debugging non-deterministic outputs in production.
- Familiarity with cost optimisation: model routing, caching, token usage monitoring, and prompt compression.
- Solid fundamentals in data structures, algorithms, and system design.
- Experience with containerised deployments (Docker, Kubernetes) and cloud platforms (AWS/GCP). Practical understanding of k8s concepts and trade-offs is a must.
Nice to Have
- Experience with agentic frameworks (Vercel AI SDK, LangChain, Mastra, etc.). Even better if you have built Gen AI apps using raw HTTP calls to provider APIs and designed efficient conversation persistence to a database.
- Background in fine-tuning or training open-source models. Huge plus if you can demonstrate matching proprietary model quality (Sonnet 4.6, Haiku 4.5, etc.) with fine-tuned alternatives.
- Knowledge of cryptocurrency, derivatives trading, or financial systems. Helps understand how AI can improve product UX.
- Open-source contributions or personal projects with real traction. Even a tool you built to solve your own problem counts.
- Your day is spent mostly in AI coding harnesses (Claude Code, Codex, Droid, etc.), MCP servers, custom skills, and similar tooling. We use AI to build AI, and candidates already living this workflow will ramp up fast.
- Proven ability to debug production AI systems: diagnosing tool call failures, optimising function calling patterns, refining prompts and tool descriptions under real traffic.
- Extreme ownership and bias towards action. You treat production AI systems as your own, proactively improving quality, latency, and cost without waiting to be asked. You deliver your best work especially when no one is watching.
Similar Jobs
Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
Build and deploy AI-powered customer solutions across discovery, prototyping, and production. Responsibilities include designing secure multi-tenant and hybrid architectures, integrating identity and access management, encryption, networking, data engineering, CI/CD, observability, and production support. The role partners directly with enterprise customers, executive sponsors, and cross-functional teams to solve ambiguous problems, demonstrate prototypes, and standardize successful solutions. Regular domestic and occasional international travel is required.
Top Skills:
Api GatewaysAWSCi/CdDockerDuckdbFastmcpJavaKafkaKubernetesLangchainLanggraphMcpMtlsPgvectorPostgresPrivatelinkPythonRagTypescriptVpc Peering
Professional Services • Social Impact • Analytics • Consulting
Design and build production software and embedded machine learning systems for public-sector clients. Responsibilities include backend and API architecture, data pipelines, model development and evaluation, production reliability, security and privacy, cloud and constrained infrastructure decisions, offline-first systems, client collaboration, technical scoping, handover, and mentoring. The role remains hands-on, requiring weekly software development and regular model training while setting engineering standards for the organization.
Top Skills:
APIsAuthenticationAuthorizationComputer VisionContainersContinuous IntegrationEncryptionForecastingGpusLanguage ModelsMachine LearningPythonPyTorchRelational DatabasesRetrievalScikit-LearnSQLTensorFlow
Professional Services • Social Impact • Analytics • Consulting
Build and operate production software and embedded AI models for public-sector platforms. Responsibilities include designing APIs and data models, preparing messy institutional data, training and evaluating models, deploying and monitoring services, supporting offline-first systems, writing tests, reviewing code, protecting personal data, and documenting solutions. The role also involves mentoring and reviewing junior engineers, handling production issues, and traveling regularly to client sites.
Top Skills:
APIsContainersContinuous IntegrationData ModelingDeep Learning FrameworksEncryptionPandasPythonScikit-LearnSQLVersion Control
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
