无法通过Azure数据工厂导出Office 365 SharePoint数据集。

huangapple go评论82阅读模式
英文:

Can't export Office 365 share point datasets through azure data factory

问题

我正在构建一个Azure Marketplace提供的服务,该服务部署并设置一个Azure数据工厂和一个用作接收端的存储账户。数据工厂中包含一个具有多个copy data活动的管道。所有这些活动都会从Office 365导出数据,例如BasicDataSet_v0.User_v1BasicDataSet_v0.SharePointPermissions_v1,并将其存储到一个存储账户中。

我已经将这个市场提供的服务设置为预览模式,并在一个测试租户上安装了它,大约一周前我在这里启用了全组织范围的Data Connect。因此,所有数据集应该都可以使用,因为可能需要最多48小时才能访问它们。

在运行管道时,除了SharePoint数据集之外,所有其他数据集都被成功导出,而失败的活动出现了以下错误:
> 在目标SharePointSites上的操作失败:ErrorCode=UserErrorOffice365DataLoaderError,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Office365数据加载执行失败。 office365LoadErrorType: PermanentError。您的数据集请求失败。 请联系dataconnect@microsoft.com以获得进一步支持。 更多信息,请参阅我们的文档:https://aka.ms/mgdcdocs。Source=Microsoft.DataTransfer.ClientLibrary,'

在我开发应用程序的租户中安装市场提供的服务时,所有数据集都被成功导出。因此,我猜测我可能错误地启用了Data Connect,尽管这似乎不太可能,因为它只是一个复选框,或者在遵循了data connect教程后我可能遗漏了其他一些内容。

我想也许是作为托管应用程序导出Office 365数据的限制,因此我将资源从托管资源组移动到了一个常规资源组中,这样应该可以消除该变量。但是没有成功。

通过Data Factory导出来自Office 365的数据需要所有相关资源(例如接收端和用于身份验证的服务主体)位于同一个租户下,因此我确保了这一点。

您这些人中是否有人在使用Azure数据工厂导出Office 365 SharePoint数据集时遇到过这个问题?任何帮助都将不胜感激。

这是失败活动的图像。
无法通过Azure数据工厂导出Office 365 SharePoint数据集。

英文:

I am building an azure marketplace offering that deploys and sets up an azure data factory and a storage account that is used as a sink.
The data factory has a pipeline with several copy data activities. All of them export data from Office 365 such as BasicDataSet_v0.User_v1 and BasicDataSet_v0.SharePointPermissions_v1 into a storage account.

I have the marketplace offer in preview mode and have installed it on a test tenant where I enabled Data Connect organization wide about a week ago. So, all data sets should be available since it can take up to 48 hours for them to be accesibile.

Upon running the pipeline, all but the SharePoint data sets are being exported where the failing activities fail with:
> Operation on target SharePointSites failed: ErrorCode=UserErrorOffice365DataLoaderError,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Office365 data loading failed to execute. office365LoadErrorType: PermanentError. Your dataset request failed. Please reach out to dataconnect@microsoft.com for further support. For more information please review our documentation at https://aka.ms/mgdcdocs.,Source=Microsoft.DataTransfer.ClientLibrary,'

Installing the marketplace offering on the tenant where I develop the app, all the data sets are being exported successfully. So, I am guessing that I've either enabled data connect wrongly, which seems like a stretch since is just a checkbox, or there is something else I have missed while following the data connect tutorial.

I thought that there might be a limitation with it being a managed app exporting Office 365 data, so I moved the resources from the managed resource group to a regular resource group where that variable should be eliminated. No luck.
Exporting data from Office 365 through Data Factory needs all the resources involved such as the sink and the service principal used for authentication to be under the same tenant, so I made sure that's the case.

Have any of you fellow humans encountered this issue while exporting Office 365 SharePoint data sets using Azure Data Factory? Any help would be highly appreciated.

Here's an image of the failing activities.
无法通过Azure数据工厂导出Office 365 SharePoint数据集。

答案1

得分: 0

我已经联系了Microsoft,他们那边存在一个问题,即SharePoint数据集尚未准备好可以请求。

Graph Data Connect仍处于预览阶段,这可能是问题所在。
如果您在启用Data Connect后48小时后仍然遇到相同的问题,您可能需要与Microsoft联系。他们很可能需要进行一些手动操作以使数据集可用。

英文:

I had reached out to Microsoft and there was an issue on their side where the share point datasets were not ready to be requested yet.

Graph Data Connect is still in preview so that might have been the issue.
If you are reading this and you're having the same issue after 48 hours after enabling Data Connect, you might want to reach out to Microsoft as well. They most likely need to do some manual stuff to make the data sets available.

huangapple
  • 本文由 发表于 2023年7月18日 15:13:11
  • 转载请务必保留本文链接:https://go.coder-hub.com/76710306.html
匿名

发表评论

匿名网友

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

确定