英文:
Migrate Azure Synapse to GCP Bigquery
问题
我对Azure云没有经验,最近我们收到了一个业务需求,需要将数据从Azure Synapse迁移到Bigquery。是否有任何教程可以指导如何做这个操作?你能否指导我到正确的方向?
英文:
I have no experience on Azure cloud, and we have recently received a business requirement where data needs to be migrated from Azure synapse to Bigquery. Is there any tutorial that sheds light on how to do this? Can you please point me to the right direction?
答案1
得分: 1
很抱歉,Azure数据工厂和Synapse管道不支持将BigQuery用作目标。因此,您需要编写自己的自定义逻辑来移动数据。
以下博客解释了如何通过Databricks将数据从ADLS移动到BigQuery:
https://www.linkedin.com/pulse/reading-from-azure-datalake-writing-google-bigquery-via-deepak-rajak
因此,您可以将数据从Synapse移动到ADLS,然后使用此逻辑将数据移动到目标位置。
或者,您可以修改以直接访问Synapse作为数据源。
英文:
Unfortunately Azure Data factory and Synapse pipelines do not support big query as a sink.
So you would have to write your own custom logic to move the data.
The below blog explains to move from ADLS to Big query via databricks:
https://www.linkedin.com/pulse/reading-from-azure-datalake-writing-google-bigquery-via-deepak-rajak
So you can move the data into ADLS from synapse and then use this logic to move into destination.
Else you can modify to directly access Synapse as source.
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库,让每个人都能够通过互相帮助和分享经验来进步。
评论