BigQuery → Fabric Mirroring Made Easy (Automation Script Included)

Jun 24, 202668 views6:26

This video walks through the process of setting up Microsoft Fabric database mirroring from Google BigQuery, including an automated script for configuring the GCP side. You'll learn how to create a mirrored database in Fabric, set up near real-time replication, and validate the data synchronization between BigQuery and Fabric.

Open in YouTube

Description

In this video, I walk through how to set up Microsoft Fabric database mirroring from Google BigQuery—end-to-end. Link to Repo with scripts: https://github.com/robkerr/fabric-data-integration-scripts/tree/main/bigquery_mirroring We start by preparing BigQuery using a fully automated script that handles: Service account creation Minimal IAM permissions GCS staging bucket setup Enabling change history on tables From there, we move into Fabric to: ✅ Create the BigQuery connection ✅ Set up a mirrored database ✅ Start replication ✅ Monitor sync status at the table level Along the way, I’ll explain how Fabric mirroring works under the hood: ✅ Near real-time replication (no full reloads) ✅ Incremental sync of inserts, updates, and deletes ✅ Conversion to Delta tables in OneLake ✅ Immediate usability with SQL, Power BI, and AI scenarios At the end, we validate everything by querying the mirrored data in Fabric and confirming it matches the source in BigQuery. What you’ll learn: ✅ How Fabric mirroring works with BigQuery ✅ How to automate the entire GCP-side setup ✅ How to configure and validate a mirrored database in Fabric ✅ How to avoid building ETL pipelines entirely 🔗 The automation script used in this video is available in the linked GitHub repo. https://github.com/robkerr/fabric-data-integration-scripts If you’re working with BigQuery and looking to bring your data into Fabric without pipelines, this is a clean, production-ready approach. Chapters: 0:00 Introduction 0:26 Fabric Mirroring 0:56 BigQuery Mirroring 2:09 BigQuery Source Data 2:37 GCP Setup Script 3:31 Fabric Connection 4:00 Create Mirror Database 4:43 Test Mirror Data 5:44 Summary