Run the CETAS command on Managed Instance that will export the table data to One Lake.Create external data source that points to One Lake, database scoped credential that uses Managed instance identity for authentication to One Lake storage, and Parquet file format for exporting data.Find a path in the Lakehouse where we will store the data and enable Azure SQL Managed Instance to write to that location.Enable data export functionality on Azure SQL Managed Instance using PowerShell (if it is not already enabled).We will use the CETAS T-SQL command to export table data from Managed Instance to One Lake and then the Spark script to transform data and convert it to Delta format. You can choose either one as the destination for your export process, depending on your needs. /Files where you store the files that need Spark processing before you convert them to Delta and use them in the reports./Tables where you store the files in Delta format that are ready for analytics (gold layer).In this blog post, I will show how to export data from Managed Instance and store it directly in the One Lake that is linked to the Lakehouse.Įvery Lakehouse artifact has its own part of One Lake, separated into two locations: That’s why Fabric offers Lakehouse, an artifact that combines Spark, Fabric One Lake, the built-in unified storage layer for your data, and Warehouse endpoint for analytics. But sometimes you may want to do some data engineering with Spark before you analyze the data. In the previous blog post, I explained how to export data from your Azure SQL Managed Instance to Fabric Warehouse, where you can run analytics queries on it. However, if your data is in other databases, such as Azure SQL Managed Instance, you would need to find a way to copy data into Fabric to analyze it. Both options are optimized for fast query performance and easy integration with Power BI.
With Microsoft Fabric, you can store your data in Fabric Lakehouses or Warehouses.
Microsoft Fabric is a solution that combines the best Lakehouse and Warehouse technologies to provide a scalable, secure, and cost-effective platform for data analytics. If you want to perform advanced analytics on your data and create stunning reports in Power BI, you should consider using Microsoft Fabric.
0 kommentar(er)
