Chief Software Engineer - MCP Server

We are seeking a Chief Software Engineer to lead a secure, scalable AI Gateway for governed LLM and agentic workflows in multi-tenant SAAS. You will shape MCP server frameworks, routing, governance, observability, and Kubernetes delivery while partnering across product teams.

Responsibilities

• Build the AI Gateway platform across MCP, agents, LLM routing, governance, and observability
• Translate business and product requirements into crisp problem statements, architecture designs, and scalable technical solutions
• Design extensible frameworks for MCP server capabilities and integrations, along with agent orchestration and reusable agent skills
• Architect gateway features including semantic caching for LLM responses, rate limiting, quotas, traffic governance, and guardrails and validation layers for safe LLM/MCP usage
• Define and review authentication and authorization models, including multiple OIDC-based flows, identity propagation, and token-based access control for MCP and LLM traffic
• Create prototypes and reference implementations to validate architectural choices and guide engineering teams
• Collaborate with multiple product teams integrating with the AI Gateway by providing architecture guidance, best practices, and integration patterns
• Review designs and code to deliver actionable feedback that improves quality, performance, scalability, and security
• Define and review CI/CD best practices using modern GitHub-based pipelines
• Architect and review Kubernetes-based deployment models to ensure scalability, resiliency, and production readiness

Requirements

• Proven track record with 7+ years of software engineering experience, including significant responsibility in a principal engineer role
• Demonstrated experience designing and shipping large-scale distributed systems or platform products
• High proficiency in Golang and Python for production-grade services
• Hands-on familiarity with AI centric development, emphasizing quality gates and architecture patterns that enforce agentic behavior for producing quality code
• Deep understanding of AI gateways, AI/LLM platforms, or middleware systems, including routing, governance, and scalability
• Solid background with microservices and service-oriented architectures for multi-tenant SAAS environments
• Practical skills using PostgreSQL for transactional data and Redis for caching and distributed coordination
• Strong expertise in authentication and authorization systems, especially OAuth-based approaches
• Proven ability to independently drive problem definition, architecture, prototype, and execution guidance
• Experience designing platforms and frameworks consumed by multiple product teams

Nice to have

• Experience with MCP (Model Context Protocol), agentic platforms, or AI orchestration frameworks
• Knowledge of working with EDA software
• Prior work on LLM gateways, API gateways, or AI middleware platforms
• Experience building generic developer frameworks or SDKs adopted across teams
• Familiarity with guardrails, semantic caching, prompt/response optimization, and LLM cost control techniques
• Experience operating high-throughput, low-latency systems in Kubernetes environments
• Strong written and verbal communication skills for cross-team architectural alignment