Lead Backend Developer (Python and AI)
We are looking for a Lead Backend Developer with Python and AI expertise to drive the design and delivery of robust AI-powered API services and agentic workflows, while providing technical leadership across the team.
This role focuses on language model interaction with internal systems, vector databases, and external tools via orchestration frameworks, treating LLMs as components in a secure, scalable distributed system. You will define technical direction, own API contracts and service reliability end-to-end, ensure AI edge cases fail gracefully, and integrate LLMs using rigorous systems engineering with built-in evaluation, observability, fallback handling, and cost awareness. As a lead, you will also mentor engineers, shape architecture across pods, and champion engineering excellence.
Responsibilities
- Lead the design and implementation of backend API services and LLM orchestration layers
- Define and evolve reliable, reusable orchestration frameworks and logic for downstream developer consumption
- Architect and oversee complex RAG pipelines, including document ingestion, chunking, embedding, and retrieval optimization
- Drive the development and integration of agent tools using LangChain, LangGraph, and potentially MCP (Model Context Protocol)
- Set the standard for integrating LLMs with rigorous systems engineering, embedding evaluation, observability, fallback handling, and cost awareness
- Establish and enforce practices for security, privacy, enterprise-grade observability, and test coverage across all backend workflows
- Own API contracts and service reliability end-to-end, ensuring AI edge cases fail gracefully
- Lead architecture decisions and define engineering standards within and across pods
- Mentor and coach backend engineers, conduct code reviews, and foster a culture of technical excellence
- Collaborate closely with frontend engineers, data engineers, infrastructure teams, product managers, and stakeholders to align technical strategy with business goals
Requirements
- Extensive backend engineering experience, with a proven track record in microservices and distributed systems
- 5+ years of experience in Python for high-performance backend services and cloud-native APIs
- At least 1 year of relevant leadership experience
- Deep expertise in AWS
- Strong hands-on experience with Docker and ECS/EKS
- Proven experience designing RESTful APIs and building production systems with LangChain
- Solid knowledge of secure coding practices and strong auth/authz fundamentals
- Demonstrated experience leading engineering teams, mentoring developers, and driving architectural decisions
- Excellent written and verbal communication skills in English (B2+ level)
Nice to have
- Production experience with AI SDKs (OpenAI, Anthropic/Claude, AWS Bedrock, or equivalent)
- Practical experience with vector databases (Amazon Kendra, OpenSearch), embedding strategies, and retrieval systems
- Familiarity with LlamaIndex, LangGraph, or agent interoperability patterns (MCP)
- Background in AI evaluation tooling or real-time APM (LangSmith, Langfuse, Arize)
- Experience with React and TypeScript
- Deep understanding of identity/security domains (IAM, CIAM), plus experience deploying to EKS environments at scale
- Flexibility to use secondary languages such as Java, Node.js, or Go
- Experience influencing engineering strategy at the organizational level
