Deploying and Consuming Large Language Models from the Azure ML Model Catalog

Name: Deploying and Consuming Large Language Models from the Azure ML Model Catalog
Uploaded: 2024-02-16T18:40:29
Duration: 8 min 16 s
Description: This video walks through the process of selecting pre-trained models from Azure ML's Model Catalog and deploying them on Azure's computing services, culminating in accessing these models via a REST API. Viewers will learn how to create a resource group, set up a workspace, and test an endpoint.

Feb 16, 2024937 views8:16

Azure AI Foundry

This video walks through the process of selecting pre-trained models from Azure ML's Model Catalog and deploying them on Azure's computing services, culminating in accessing these models via a REST API. Viewers will learn how to create a resource group, set up a workspace, and test an endpoint.

Open in YouTube

Description

Explore Azure Machine Learning's selection of pre-trained models from leading sources like OpenAI, Microsoft, and Hugging Face. In this video I'll guide you through the process of choosing, deploying a model on Azure's computing services, and accessing it through a REST API. This video is a video demo of this blog post content: https://robkerr.ai/deploy-azure-model-catalog-endpoint 0:00 Create Resource Group 1:04 Create Workspace 2:23 Model Catalog 3:05 Deploy Endpoint 4:32 Test Endpoint 7:46 Summary