Azure Mapping Data Flow:无法将Blob存储数据集用作数据源。

huangapple go评论95阅读模式
英文:

Azure Mapping Data Flow : Not able to use blob storage dataset as a source

问题

我将Azure Blob“数据集”添加为Azure映射数据流的数据源,但无法查看预览,因为显示以下错误:

> 数据集使用“AzureStorage”链接服务类型,数据流不支持此类型。

以下是数据集JSON:

  1. {
  2. "name": "PIT_Input",
  3. "properties": {
  4. "linkedServiceName": {
  5. "referenceName": "data_staging",
  6. "type": "LinkedServiceReference"
  7. },
  8. "annotations": [],
  9. "type": "DelimitedText",
  10. "typeProperties": {
  11. "location": {
  12. "type": "AzureBlobStorageLocation",
  13. "container": "dataflowpoc"
  14. },
  15. "columnDelimiter": ",",
  16. "escapeChar": "\\\"",
  17. "firstRowAsHeader": true,
  18. "quoteChar": "\""
  19. },
  20. "schema": []
  21. }
  22. }

data_staging是类型为Azure Storage的链接服务。

文档说明Azure Blob数据集可以用作源。请告诉我我在这里做错了什么。

英文:

I added a Azure Blob dataset as a source to a Azure mapping data flow, but am not able to view the preview as it is showing the below error :

> Dataset is using 'AzureStorage' linked service type, which is not supported in data flow.

Given below is the dataset JSON :

  1. {
  2. "name": "PIT_Input",
  3. "properties": {
  4. "linkedServiceName": {
  5. "referenceName": "data_staging",
  6. "type": "LinkedServiceReference"
  7. },
  8. "annotations": [],
  9. "type": "DelimitedText",
  10. "typeProperties": {
  11. "location": {
  12. "type": "AzureBlobStorageLocation",
  13. "container": "dataflowpoc"
  14. },
  15. "columnDelimiter": ",",
  16. "escapeChar": "\\",
  17. "firstRowAsHeader": true,
  18. "quoteChar": "\""
  19. },
  20. "schema": []
  21. }
  22. }

data_staging is a linked service of type Azure Storage.

The documentation states that Azure Blob datasets can used as a source.
Please tell me what I'm doing wrong here.

答案1

得分: 1

根据您的dataset JSON,您只选择了容器dataflowpoc,没有指定文件。

您只能预览类型为"DelimitedText"的文件数据:
Azure Mapping Data Flow:无法将Blob存储数据集用作数据源。

在数据集预览数据中,如果容器中的文件具有不同的模式,我们无法预览所有数据:
Azure Mapping Data Flow:无法将Blob存储数据集用作数据源。

数据集 JSON:

  1. {
  2. "name": "DelimitedText1",
  3. "properties": {
  4. "linkedServiceName": {
  5. "referenceName": "AzureBlobStorage1",
  6. "type": "LinkedServiceReference"
  7. },
  8. "annotations": [],
  9. "type": "DelimitedText",
  10. "typeProperties": {
  11. "location": {
  12. "type": "AzureBlobStorageLocation",
  13. "container": "containerleon"
  14. },
  15. "columnDelimiter": ",",
  16. "escapeChar": "\\",
  17. "firstRowAsHeader": false,
  18. "quoteChar": "\""
  19. },
  20. "schema": []
  21. },
  22. "type": "Microsoft.DataFactory/factories/datasets"
  23. }

但在数据流数据预览中,我们可以看到文件中的所有数据:
Azure Mapping Data Flow:无法将Blob存储数据集用作数据源。

我认为您的错误只是偶然发生的,请刷新数据工厂并重试。

更新:

错误已解决:“我将关联服务的类型从Azure存储更改为Azure Blob存储,然后它正常工作了。”

希望对您有所帮助。

英文:

According you dataset JSON, you just choose the container dataflowpoc, didn't specify the file.

You only could preview the file data which type is "DelimitedText":
Azure Mapping Data Flow:无法将Blob存储数据集用作数据源。

Dataset Preview data, we can not preview all the data if files in the container with different schema:
Azure Mapping Data Flow:无法将Blob存储数据集用作数据源。

Dataset JSON:

  1. {
  2. "name": "DelimitedText1",
  3. "properties": {
  4. "linkedServiceName": {
  5. "referenceName": "AzureBlobStorage1",
  6. "type": "LinkedServiceReference"
  7. },
  8. "annotations": [],
  9. "type": "DelimitedText",
  10. "typeProperties": {
  11. "location": {
  12. "type": "AzureBlobStorageLocation",
  13. "container": "containerleon"
  14. },
  15. "columnDelimiter": ",",
  16. "escapeChar": "\\",
  17. "firstRowAsHeader": false,
  18. "quoteChar": "\""
  19. },
  20. "schema": []
  21. },
  22. "type": "Microsoft.DataFactory/factories/datasets"
  23. }

But in Data Flow Data Preview, we can see all the data in the files:
Azure Mapping Data Flow:无法将Blob存储数据集用作数据源。

I think your error just happened by accident, please refresh the Data Factory and try again.

Update:

The error is solved: "I changed the type of the Linked Service from Azure storage to Azure blob storage, and it worked."

Hope this helps.

huangapple
  • 本文由 发表于 2020年1月3日 20:03:17
  • 转载请务必保留本文链接:https://go.coder-hub.com/59578308.html
匿名

发表评论

匿名网友

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

确定