Building Custom MCP Tools for Azure AI Foundry Agents (with Cosmos DB GraphRAG)
This video walks through the process of building a custom MCP (Model Composition Protocol) tool for use with an Azure AI Foundry Agent, focusing on integrating Python-based tools with Cosmos DB Gremlin. You'll learn how to design and implement an HTTP server that exposes GraphRAG tools, deploy it as an Azure Function, and connect it to an AI Foundry Agent, enabling seamless querying of a graph database without requiring knowledge of the underlying data structure.
Description
In this video we build a complete flow for using custom MCP tools with an Azure AI Foundry Agent.
We’ll start by designing and implementing a Python-based MCP server that exposes GraphRAG tools over HTTP, then deploy it as an Azure Function and wire it into an Azure AI Foundry Agent so the agent can query a Cosmos DB Gremlin graph without knowing anything about the underlying data source.
What we cover
• How the MCP server is designed and how it hosts custom tools
• The HTTP endpoints behind the server:
• A typical MCP request/response flow between an agent and the server
• How the MCP tools encapsulate all the GraphRAG / Cosmos DB Gremlin logic
• Creating an Azure AI Foundry Agent, attaching the MCP server as a tool, and testing end-to-end
By the end, you’ll see how to:
• Wrap your own Python logic as MCP tools
• Host those tools in a lightweight cloud service (Azure Functions)
• Let Azure AI Foundry agents call into your GraphRAG backend via MCP instead of bespoke REST endpoints
Code & related resources
• ✅ GitHub repo (MCP server + sample tools): https://github.com/robkerr/robkerrai-demo-code/tree/main/create-mcp-server-ai-foundry
• ▶️ Related video – GraphRAG with Neo4j in a Docker stack: https://youtu.be/qqhvzq24WqE
If you’re already using RAG and want a cleaner, more standard way for agents to call your tools and data sources, this walk-through should give you a concrete pattern to reuse.
Chapters
0:00 Introduction
0:38 MCP Architecture
1:43 What's MCP?
2:49 Implementation Plan
5:03 MCP Flow
6:13 Code Walk-Through
13:49 Create AI Foundry Agent
20:03 Test AI Foundry Agent