英文:
ADF doesnt create BlobCreation event with dataflow
问题
我有一个管道和一个数据流活动，其中有一个复制数据到 Blob 存储的操作。我已经激活了触发器。
问题是，如果我手动将文件放到存储中，触发器就会起作用。但是当数据流通过复制活动将文件放到 Blob 存储中时，触发器不会被触发。
这是触发器信息：
英文:
I have pipeline and a dataflow activity inside which copies the data to blob storage. I have trigger activated.
Problem is, the trigger works If I place the file manually on storage. But it doesn't get triggered when the dataflow puts file on the blob storage with copy activity.
Here is the trigger info:
答案1
得分: 1
问题在于在使用Parquet格式时，数据流中的一个下沉操作会生成一个BlobRenamed事件，而不是BlobCreation事件。因此，触发器无法获得正确的事件。
英文:
The problem is that a sink in dataflow when using parquet format generates a BlobRenamed event instead of BlobCreation. Therefore, the trigger doesn't get the right event.
答案2
得分: 0
我尝试过，对我来说一切正常。它正在检测特定容器中的 blob 是否被添加。
似乎触发器仅在新文件添加到 blob 存储时才会触发，而不会在旧文件更改时触发。数据流活动在将数据移动到 blob 存储时可能会更新现有文件，而不是生成新文件。
与 @Joel Cochran 在 Blob 路径以...结束 部分中所说的一致，如果触发器没有找到任何包含相似模式的文件，它将不会触发管道，您可以调整触发器以查找新文件和当前文件的更改，从而解决此问题。这可以通过在触发器设置的 Blob 路径以...结束 部分中仅包括 .parquet 来实现，这将使触发器对所提供路径中文件的任何更改做出反应。
请提供正确的详细信息。
有可能触发器未配置为检测数据流活动所做的更改。请检查触发器的设置，确保它正在监视正确的 blob 容器，并设置为检测适当类型的更改，例如新的或修改的 blob。
英文:
I tried and it's working fine for me. it is detecting blob is getting added in particular container.
It appears that the trigger is set up to only react when new files are added to the blob storage and not when old files change. It's possible that the dataflow activity updates an existing file rather than producing a new one when it moves data to the blob storage.
Agreed with @Joel Cochran in Blob path ends with you are passing train_data.parquet if trigger did not find any particular file with name contain similar pattern it will not trigger the pipeline.
You may tweak the trigger to look for changes in both new and current files to fix this. This may be achieved by including the only .parquet in the Blob path ends with section of the trigger setup, which will make the trigger react to any changes to files in the supplied path.
Specify the correct details.
It's possible that the trigger is not configured to detect changes made by the dataflow activity. Check the trigger's settings to ensure that it is monitoring the correct blob container and that it is set up to detect the appropriate types of changes, such as new or modified blobs.
答案3
得分: 0
我最终使用Web活动将自定义Blob事件发送到自定义事件，并在接收管道上使用自定义触发器。
英文:
I ended up using web activity to send custom blob events to custom events and using custom triggers on the receiving pipeline.
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库，让每个人都能够通过互相帮助和分享经验来进步。
评论