Building Custom MCP Tools for Azure AI Foundry Agents (with Cosmos DB GraphRAG)

Dec 01, 20254,383 views20:04

In this video, we'll build a complete flow for using custom MCP tools with an Azure AI Foundry Agent. We'll start by designing and implementing a Python-based MCP server that exposes GraphRAG tools over HTTP, then deploy it as an Azure Function and wire it into an Azure AI Foundry Agent so the agent can query a Cosmos DB Gremlin graph without knowing anything about the underlying data source. We'll walk through how the MCP server is designed and hosted, look at the HTTP request and response flow between an agent and the server, and see how to create an Azure AI Foundry Agent, attach the MCP server as a tool, and test everything end-to-end. By the end, you'll see how to wrap your own Python logic as MCP tools, host them in a lightweight cloud service, and let Azure AI Foundry agents call into your GraphRAG backend via MCP instead of bespoke REST endpoints.

Open in YouTube

Description

In this video we build a complete flow for using custom MCP tools with an Azure AI Foundry Agent. We’ll start by designing and implementing a Python-based MCP server that exposes GraphRAG tools over HTTP, then deploy it as an Azure Function and wire it into an Azure AI Foundry Agent so the agent can query a Cosmos DB Gremlin graph without knowing anything about the underlying data source. What we cover • How the MCP server is designed and how it hosts custom tools • The HTTP endpoints behind the server: • A typical MCP request/response flow between an agent and the server • How the MCP tools encapsulate all the GraphRAG / Cosmos DB Gremlin logic • Creating an Azure AI Foundry Agent, attaching the MCP server as a tool, and testing end-to-end By the end, you’ll see how to: • Wrap your own Python logic as MCP tools • Host those tools in a lightweight cloud service (Azure Functions) • Let Azure AI Foundry agents call into your GraphRAG backend via MCP instead of bespoke REST endpoints Code & related resources • ✅ GitHub repo (MCP server + sample tools): https://github.com/robkerr/robkerrai-demo-code/tree/main/create-mcp-server-ai-foundry • ▶️ Related video – GraphRAG with Neo4j in a Docker stack: https://youtu.be/qqhvzq24WqE If you’re already using RAG and want a cleaner, more standard way for agents to call your tools and data sources, this walk-through should give you a concrete pattern to reuse. Chapters 0:00 Introduction 0:38 MCP Architecture 1:43 What's MCP? 2:49 Implementation Plan 5:03 MCP Flow 6:13 Code Walk-Through 13:49 Create AI Foundry Agent 20:03 Test AI Foundry Agent