Building Custom MCP Tools for Azure AI Foundry Agents (with Cosmos DB GraphRAG)

Dec 01, 20254,006 views20:04

This video walks through the process of building a custom MCP (Model Component Provider) tool for use with Azure AI Foundry Agents, specifically focusing on integrating a Python-based server that exposes GraphRAG tools via HTTP. You'll learn how to design and implement this server as an Azure Function, deploy it, and connect it to an Azure AI Foundry Agent to enable querying of a Cosmos DB Gremlin graph without requiring knowledge of the underlying data source.

Open in YouTube

Description

In this video we build a complete flow for using custom MCP tools with an Azure AI Foundry Agent. We’ll start by designing and implementing a Python-based MCP server that exposes GraphRAG tools over HTTP, then deploy it as an Azure Function and wire it into an Azure AI Foundry Agent so the agent can query a Cosmos DB Gremlin graph without knowing anything about the underlying data source. What we cover • How the MCP server is designed and how it hosts custom tools • The HTTP endpoints behind the server: • A typical MCP request/response flow between an agent and the server • How the MCP tools encapsulate all the GraphRAG / Cosmos DB Gremlin logic • Creating an Azure AI Foundry Agent, attaching the MCP server as a tool, and testing end-to-end By the end, you’ll see how to: • Wrap your own Python logic as MCP tools • Host those tools in a lightweight cloud service (Azure Functions) • Let Azure AI Foundry agents call into your GraphRAG backend via MCP instead of bespoke REST endpoints Code & related resources • ✅ GitHub repo (MCP server + sample tools): https://github.com/robkerr/robkerrai-demo-code/tree/main/create-mcp-server-ai-foundry • ▶️ Related video – GraphRAG with Neo4j in a Docker stack: https://youtu.be/qqhvzq24WqE If you’re already using RAG and want a cleaner, more standard way for agents to call your tools and data sources, this walk-through should give you a concrete pattern to reuse. Chapters 0:00 Introduction 0:38 MCP Architecture 1:43 What's MCP? 2:49 Implementation Plan 5:03 MCP Flow 6:13 Code Walk-Through 13:49 Create AI Foundry Agent 20:03 Test AI Foundry Agent