英文:
How to concate 2 flowfiles in Apache NiFi based on the column value (csv)?
问题
我是新手使用NiFi,目前正在处理一个任务,其中有一个flowfile:
"a","b","c","d"
"abc","jfx","daw","123"
"eqw","poq","djw","456"
还有另一个flowfile:
"d","e","f","g"
"123","VVV","010","dv2"
"412","GGG","188","kw2"
我需要将它们合并成一个单一的flowfile,其中列"d"相同。所以我会得到:
"a","b","c","d","e","f","g"
"abc","jfx","daw","123","VVV","010","dv2"
"eqw","poq","djw","456","","",""
问题是,如果file1在file2中找不到相同的"d"值,我想查看其他file2-s(不是所有的flowfiles都会有相同的值,但它们都会有相同的列)
谢谢
我尝试了MergeContent,但它没有给出正确的结果。我正在尝试使用分叉增强和连接增强,但我做错了什么。
英文:
I am new to NiFi, and I am currently working on a task where I have a flowfile:
"a","b","c","d" <br>
"abc","jfx","daw","123" <br>
"eqw","poq","djw","456" <br>
And another flowfile:
"d","e","f","g" <br>
"123","VVV","010","dv2" <br>
"412","GGG","188","kw2" <br>
I need to merge them into a single flowfile where columns "d" are the same.
So I would get:
"a","b","c","d","e","f","g" <br>
"abc","jfx","daw","123","VVV","010","dv2" <br>
"eqw","poq","djw","456","","","" <br>
The problem is, if the file1 doesn't find the same value od "d" in file2, I would like to look at other file2-s (not all the flowfiles will have the same values, but all of them will have the same columns)
Thanks
I have tried MergeContent but it doesn't spit the right result. I am trying with fork enrichment and join enrichment but I am doing something wrong.
答案1
得分: 1
如果您的FlowFiles中有一个静态的CSV文件,您可以使用LookupRecord与其他配置CSVRecordLookupService来匹配列d
。对于更复杂的数据丰富场景,请查看ForkEnrichment和JoinEnrichment处理器。
英文:
If one of your FlowFiles is a static CSV file, you could use LookupRecord with the other and configure the CSVRecordLookupService to match on column d
. For more complex enrichment scenarios check out the ForkEnrichment and JoinEnrichment processors.
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库,让每个人都能够通过互相帮助和分享经验来进步。
评论