Deploying and Consuming Large Language Models from the Azure ML Model Catalog
In this video, we'll explore Azure Machine Learning's Model Catalog and walk through how to pick a pre-trained model from top providers. We'll guide you through the steps of deploying it on Azure's computing services and accessing it via a REST API.
Description
Explore Azure Machine Learning's selection of pre-trained models from leading sources like OpenAI, Microsoft, and Hugging Face. In this video I'll guide you through the process of choosing, deploying a model on Azure's computing services, and accessing it through a REST API.
This video is a video demo of this blog post content:
https://robkerr.ai/deploy-azure-model-catalog-endpoint
0:00 Create Resource Group
1:04 Create Workspace
2:23 Model Catalog
3:05 Deploy Endpoint
4:32 Test Endpoint
7:46 Summary