Agentic AI Architect

We are looking for an Agentic AI Architect to join our team. As an Agentic AI Architect specializing in Microsoft 365 Copilot and knowledge platforms, you will play a critical role in designing, configuring, and building the AI agent, search, and persona-based experience of the organization's governance knowledge platform. You will collaborate closely with the program lead, governance document authors, the enablement and training team, and engineering teams to deliver a Copilot-based agent that understands a large, connected governance document estate. Your work will span agent configuration, RAG implementation, content architecture, dependency visualization, and document lifecycle workflows, with a strong emphasis on accuracy, citation integrity, and platform-agnostic design

Responsibilities

• Partner with the program lead, governance document authors, and engineering teams to clarify platform requirements and expectations around agent behavior
• Analyze governance documentation, requirements, and technical specifications to produce clear, accurate, and well-cited agent configurations
• Design, configure, and maintain Copilot agents that address both functional and persona-based dimensions of the platform
• Implement thorough RAG strategies to verify answer accuracy, citation reliability, and the security of grounded responses
• Build and maintain content architecture, metadata, and taxonomy, applying appropriate chunking and tagging to support AI consumption
• Plan, carry out, and evaluate search relevance tuning and agent quality assessments to measure accuracy, adoption, and user feedback
• Identify, document, and report agent quality issues, supplying detailed evidence, logs, and remediation recommendations
• Collaborate closely with product, engineering, and governance stakeholders to anticipate and support upcoming platform changes
• Build and maintain reusable agent configurations, runbooks, and documentation, prioritizing efficiency, portability, and quality gates
• Maintain active communication with stakeholders to clarify requirements, review designs, and confirm implementations
• Keep configuration artifacts, prompts, and runbooks organized and traceable, ensuring alignment with governance and audit standards
• Proactively flag risks, escalate critical issues, and recommend mitigation strategies to support high-quality, compliant deployments
• Take an active role in Agile ceremonies, including stand-ups, sprint planning, retrospectives, and backlog grooming
• Design, implement, and maintain declarative and custom agents within Microsoft Copilot Studio and Microsoft 365 Copilot, grounded on SharePoint libraries, Agile QMS copies, and partner SharePoint sites
• Write and refine agent instructions, topics, actions, and knowledge sources so responses remain accurate, properly cited, and consistent across different audiences
• Configure persona-specific agents and behaviors tailored to commercial, functional, engineering, customer, and auditor audiences
• Build retrieval-augmented generation (RAG) patterns for scenarios where Copilot alone falls short, leveraging Azure AI Search, Azure OpenAI/Azure AI Foundry, or Microsoft Graph connectors
• Enable on-demand generation of PowerPoint, Word, Excel, and PDF outputs from platform content using approved brand templates
• Apply Microsoft Purview sensitivity labels, permissions, and data loss prevention controls to ensure the agent surfaces only content each user is authorized to access

Requirements

• A minimum of 5 years of relevant experience
• At least 2 years in Senior, Lead, Manager, or Owner-level roles
• Proven track record managing engagements for teams of 5 or more full-time employees
• Strong experience in software, platform, and data solution development, including delivering AI/LLM solutions to production
• Hands-on experience with Azure AI and Machine Learning services
• Background in database development to support structured and unstructured data needs
• Practical experience in Generative AI application development
• Proficiency with Microsoft Copilot Studio for building and configuring AI agents
• Strong working knowledge of Microsoft SharePoint for content and document management
• Experience developing RAG (Retrieval-Augmented Generation) applications
• Proficiency in Agile delivery methods and effective communication across distributed, multi-vendor stakeholder groups
• Professional proficiency in English (B2) and a proactive, accountable approach to problem-solving

Nice to have

• Experience with AWS Bedrock and Amazon Kendra for AI and search-related capabilities
• Familiarity with Amazon Web Services for general cloud infrastructure support
• Experience with Azure AI Search and Azure OpenAI Service for building intelligent search and generative AI solutions
• Knowledge of Data Loss Prevention (DLP) practices to protect sensitive information
• Background in data modeling to support structured information architecture
• Familiarity with GxP compliance standards, particularly within regulated industries
• Experience within the Healthcare industry or similar regulated environments
• Knowledge of knowledge graphs for representing and connecting structured information
• Experience with LangChain for building LLM-powered applications
• Familiarity with Microsoft 365 Copilot for enterprise productivity and AI integration
• Working knowledge of Microsoft Azure for cloud infrastructure and services
• Experience with Microsoft Entra ID for identity and access management
• Familiarity with Microsoft Fabric for data integration and analytics
• Experience using the Microsoft Graph API and Microsoft Graph Data Connect for accessing Microsoft 365 data
• Knowledge of the Microsoft Power Platform, including Power Automate, for building automated workflows
• Familiarity with Microsoft Purview for governance, compliance, and data protection
• Skilled in prompt engineering to design and refine effective AI model interactions
• Experience with ReactJS for building interactive user interfaces
• Familiarity with the SharePoint Framework (SPFx) for custom SharePoint development
• Proficiency in TypeScript for front-end and application development
• Relevant certification, which would be considered a valuable addition to your qualifications