迁移 Azure Synapse 到 GCP BigQuery

huangapple go评论74阅读模式
英文:

Migrate Azure Synapse to GCP Bigquery

问题

我对Azure云没有经验,最近我们收到了一个业务需求,需要将数据从Azure Synapse迁移到Bigquery。是否有任何教程可以指导如何做这个操作?你能否指导我到正确的方向?

英文:

I have no experience on Azure cloud, and we have recently received a business requirement where data needs to be migrated from Azure synapse to Bigquery. Is there any tutorial that sheds light on how to do this? Can you please point me to the right direction?

答案1

得分: 1

很抱歉,Azure数据工厂和Synapse管道不支持将BigQuery用作目标。因此,您需要编写自己的自定义逻辑来移动数据。

以下博客解释了如何通过Databricks将数据从ADLS移动到BigQuery:

https://www.linkedin.com/pulse/reading-from-azure-datalake-writing-google-bigquery-via-deepak-rajak

因此,您可以将数据从Synapse移动到ADLS,然后使用此逻辑将数据移动到目标位置。

或者,您可以修改以直接访问Synapse作为数据源。

英文:

Unfortunately Azure Data factory and Synapse pipelines do not support big query as a sink.
So you would have to write your own custom logic to move the data.

The below blog explains to move from ADLS to Big query via databricks:

https://www.linkedin.com/pulse/reading-from-azure-datalake-writing-google-bigquery-via-deepak-rajak

So you can move the data into ADLS from synapse and then use this logic to move into destination.

Else you can modify to directly access Synapse as source.

huangapple
  • 本文由 发表于 2023年7月27日 20:13:20
  • 转载请务必保留本文链接:https://go.coder-hub.com/76779626.html
匿名

发表评论

匿名网友

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

确定