英文:
Transferring data from folder to folder from Azure Blob Storage to Google Cloud Storage using Google Cloud Storage Transfer Service
问题
我有多个存储在Azure Blob Storage账户中不同文件夹中的文件夹，并已将这些文件夹中的所有文件移动到Google Cloud的一个同名文件夹中的Cloud Storage存储桶中。我在Azure中有大约10个不同的存储文件夹。我现在想要定期安排每天重复的传输作业，从这些Azure Blob文件夹中传输数据，但我想知道是否有一种方法可以安排只一个作业来将数据从这10个文件夹移动到GCS，还是我需要安排10个不同的作业来从Azure中的每个文件夹移动文件到GCS中的相应文件夹。提前感谢！
致敬，
Bertan
英文:
I have a number of different folders stored in different folders in a Blob Storage account on Azure, and have moved all the files in these folders to a equivalently named folder in a Cloud Storage bucket on Google Cloud. I have around 10 different storage folders in Azure. I would now like to schedule daily recurring transfer jobs from these Azure Blob folders, but wonder if there is a way to schedule only one job to move the data from these 10 folders to GCS, or if I am in need to schedule 10 different jobs to move files from each folder on Azure to the corresponding folder in GCS. Thank you in advance!
Regards,
Bertan
答案1
得分: 1
基于这份关于调度传输的文档：
> 您可以安排传输作业定期运行，最频繁每小时一次。存储传输服务以您指定的频率运行增量传输，将数据复制到云存储，并在Google Cloud控制台中记录传输的结果，无需人工干预。
存储传输服务作业支持以下间隔周期：
- 小时
- 天
- 周
您还可以选择立即开始传输或稍后开始传输。
如果您想创建新的传输，请参考这个链接使用调度选项创建传输，如果您已经有现有的传输服务，可以参考管理传输来编辑传输计划。
您可以查看以下链接以获取关于数据传输的附加指南：
这里有一个示例计划：
| 场景 | 如何配置您的计划 |
|---|---|
| 每天午夜无限制复制数据 | 每天运行 |
| 开始于 | |
| 开始日期/时间—今晚午夜 | |
| 结束日期—无 | |
| 每小时复制数据，立即开始 | 使用自定义频率运行 |
| 立即开始 | |
| 结束日期—无 | |
| 自定义频率：每—1小时重复一次 | |
| 在2周后的每周二下午3点开始，截止日期为2030年4月3日 | 每周运行 |
| 开始于 | |
| 开始日期/时间—2周后的周二下午3:00 | |
| 结束日期—2030年4月3日 |
截图：
希望这对您有所帮助。
英文:
Based on this documentation on scheduling transfers:
> You can schedule your transfer jobs to run periodically, as frequently as every hour. Storage Transfer Service runs an incremental transfer at the frequency you specify, copying data to Cloud Storage, and recording the results of the transfer in the Google Cloud Console without human intervention.
Storage Transfer Service jobs support the following interval periods:
- Hours
- Days
- Weeks
You can also choose to start the transfer immediately or at a later time.
You may follow this link on creating a transfer with scheduling options if you want to create a new transfer or manage transfers if you already have an existing transfer service so that you can edit the transfer schedule.
You can check these links for additional guides on transferring data:
Here's an example schedules:
| Scenario | How to configure your schedule |
|---|---|
| Copy data every night at midnight, forever | Run every day |
| Starting on | |
| Start date/time—tonight at midnight | |
| End date—None | |
| Copy data every hour, starting now | Run with custom frequency |
| Starting now | |
| End date—None | |
| Custom frequency: Repeat every—1, Hours | |
| Copy data every Tuesday at 3PM, starting in 2 weeks and stopping on April 3, 2030. | Run every week |
| Starting on | |
| Start date/time—Tuesday 3:00PM, 2 weeks from now | |
| End date—April 3, 2030 |
Screenshot:
Hope this helps.
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库，让每个人都能够通过互相帮助和分享经验来进步。
评论