Senior AI Engineer

Join EPAM Malaysia as a Senior AI Engineer and lead the charge in creating cutting-edge AI solutions that solve complex, real-world problems. You’ll design and deploy scalable ML pipelines using ML frameworks and data platforms while harnessing the power of cloud platforms. Collaborate with cross-functional teams to transform business challenges into innovative data-driven solutions, leveraging your expertise in Python, SQL and MLOps frameworks.

Responsibilities

• Design and implement end-to-end AI systems including inference pipelines, agent workflows and tool-calling architectures
• Build and manage context orchestration for LLMs, covering system prompts, memory, retrieval and structured inputs
• Engineer latency-aware and cost-efficient fallback strategies across models and providers
• Develop backend services for prompt routing, response handling and tool execution using Python or Node.js
• Implement observability for AI systems including logging, metrics, tracing and quality monitoring
• Maintain CI/CD pipelines for safe, repeatable deployments of AI services
• Integrate and deploy AI-powered software solutions into scalable enterprise environments, translating business requirements into robust system designs
• Collaborate with cross-functional teams, ensure compliance with data protection and AI governance and document architectures and implementation decisions

Requirements

• Solid software engineering experience with hands-on work with AI/ML or LLM systems, and a Bachelor’s or Master’s degree in Computer Science, Data Science or a related field
• Proficient in Python, with experience in SQL or NoSQL databases, REST APIs and backend integration
• Demonstrated expertise in LLM-based solution development, prompt engineering, NLP, semantic models and agent-style architectures
• Skilled in fine-tuning and evaluating LLMs, building automated AI pipelines for training, testing, deployment and monitoring
• Experience with the Spark or Apache ecosystem, scalable data and AI architectures and cloud computing platforms
• Proficient in containerization technologies such as Docker and Kubernetes with experience in GPU orchestration and cost optimization
• Familiarity with CI/CD pipelines, DevOps tooling and enterprise-scale architectures
• Strong analytical thinker and communicator, results-driven, customer-focused and actively following new AI advancements and industry best practices

Nice to have

• Experience integrating with LLM APIs from providers like OpenAI, Claude, or comparable platforms
• Direct involvement in building or maintaining Retrieval-Augmented Generation (RAG) systems, including work with vector databases and embedding pipelines
• Familiarity with model safety measures, implementation of AI guardrails or responsible AI best practices