Deploying and Consuming Large Language Models from the Azure ML Model Catalog

Feb 16, 2024942 views8:16

In this video, we'll explore Azure Machine Learning's Model Catalog and walk through how to pick a pre-trained model from top providers. We'll guide you through the steps of deploying it on Azure's computing services and accessing it via a REST API.

Open in YouTube

Description

Explore Azure Machine Learning's selection of pre-trained models from leading sources like OpenAI, Microsoft, and Hugging Face. In this video I'll guide you through the process of choosing, deploying a model on Azure's computing services, and accessing it through a REST API. This video is a video demo of this blog post content: https://robkerr.ai/deploy-azure-model-catalog-endpoint 0:00 Create Resource Group 1:04 Create Workspace 2:23 Model Catalog 3:05 Deploy Endpoint 4:32 Test Endpoint 7:46 Summary