Senior LLM/RAG Engineer (Legacy Modernization)
The LLM/RAG Engineer will play a pivotal role in a high-profile modernization project, transitioning a legacy RPG/IBM i-based Dealer Management System (DMS) into a modern, cloud-native Java architecture.
In this Proof of Concept (POC) phase, you will specialize in CodeRAG (Retrieval-Augmented Generation for code) and Abstract Syntax Tree (AST) techniques. Your primary objective is to automate the parsing, transformation, and migration of legacy business logic into modern microservices. You will work at the intersection of Generative AI and legacy system modernization, ensuring that automated code generation remains accurate, performant, and aligned with architectural specifications.
Essential functions
- Code Transformation & Analysis: Utilize AST techniques to parse legacy RPG code and transform it into structured formats suitable for automated migration.
- RAG Implementation: Design and maintain RAG pipelines using AWS Bedrock and Vector Databases to provide LLMs with high-fidelity context from legacy documentation and code analysis.
- Data Preprocessing: Clean, structure, and enrich metadata from legacy systems, potentially involving the creation of knowledge graphs or embeddings to improve LLM accuracy.
- Iterative Validation: Perform rigorous validation and correction of AI-generated code assets to ensure they meet modern Java standards and functional parity with the legacy system.
- Legacy Integration: Collaborate with specialized code analysis tools (such as PKS eXplain) to extract business logic and code flows from IBM i environments.
- Collaboration & Documentation: Work closely with cross-functional teams in India and Germany, documenting complex business logic and ensuring tight feedback loops during the POC.
- Quality Assurance: Adhere to strict architectural specifications and collaborate on testing strategies to validate the migrated solution.
Qualifications
- Total Work Experience: Minimum of 4–8 years of experience in software engineering, with a significant focus on AI/ML or Backend development.
- AI & LLM Expertise: Proven experience working with advanced LLMs (e.g., Claude 3.5/3.7/4) and building RAG pipelines.
- Technical Proficiency: * Languages: Strong proficiency in Python.
- Cloud: Hands-on experience with AWS Bedrock.
- Databases: Experience with Vector Databases such as Milvus or Pinecone.
- Code Transformation Skills: Deep understanding of Abstract Syntax Trees (AST) and experience in parsing or transforming code programmatically.
- Modernization Knowledge: Familiarity with code migration processes, microservices architecture, and cloud-native design patterns.
- Tools & Version Control: Expert-level knowledge of Git for managing generated code and collaborative development.
- Soft Skills: A proactive nature with strong communication skills, essential for navigating the ambiguity of a POC environment and working with distributed global teams.
We offer
- Opportunity to work on bleeding-edge projects
- Work with a highly motivated and dedicated team
- Competitive salary
- Flexible schedule
- Benefits package - medical insurance, sports
- Corporate social events
- Professional development opportunities
- Well-equipped office
About us
Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.