Senior Data Software Engineer with ML and RAG, AI Data Platform
About the Position
We are looking for a Data Software Engineer with a strong focus on machine learning and modern data architectures to join a long term AI driven platform initiative. You will work on building scalable data pipelines and intelligent services powered by large language models and advanced data retrieval techniques. This role includes opportunities for both strong middle and senior specialists. Standard Working Hours: Standard India shift from 10:00 AM to 7:00 PM IST. This schedule ensures a 3 hour overlap with AEST for ANZ collaboration and a 5 hour overlap with GMT for UK collaboration.
About the Project
This project focuses on designing and building a cloud based platform that enables intelligent data processing and knowledge discovery. The solution integrates vector search, knowledge graphs, and retrieval augmented generation to deliver advanced AI capabilities across multiple business use cases.
About the Team
You will work in a distributed engineering team that includes data engineers, backend developers, and ML engineers. The team follows a collaborative approach with regular knowledge sharing and close interaction with stakeholders across time zones.
Responsibilities
- Develop and maintain scalable ETL pipelines for structured and unstructured data
- Design and implement serverless microservices using cloud native patterns
- Build and optimize data solutions using vector databases and knowledge graphs
- Collaborate with ML engineers to integrate large language model capabilities into production systems
- Implement retrieval augmented generation pipelines for advanced AI use cases
- Work with Azure AI Services to deliver reliable and scalable solutions
- Ensure code quality through testing, code reviews, and adherence to engineering standards
- Collaborate with distributed teams and participate in technical discussions across time zones
Requirements
- Experience in Python development for backend or data engineering tasks
- Hands on experience with ETL pipeline design and implementation
- Familiarity with Azure infrastructure and cloud native services
- Understanding of microservices architecture and serverless computing
- Experience working with vector databases and data indexing solutions
- Knowledge of retrieval augmented generation and knowledge graph concepts
- Experience integrating or working with large language models
- Practical experience with prompt engineering
- English proficiency sufficient for daily communication in an international team
Nice to Have
- Experience with Azure AI Services in production environments
- Exposure to distributed system design and scalability patterns
- Knowledge of data governance and data quality practices
- Experience working in globally distributed teams
Technologies
Python, Azure infrastructure, Azure AI Services, ETL pipelines, serverless microservices, vector databases, knowledge graphs, retrieval augmented generation architecture, large language models, prompt engineering
