英文:
how merge multiple flowfile by value of attribute with NiFi
问题
我有一个包含500行数据的文本文件，其中包括三个表的数据，
Table_LCP PX37110286387+0002186861MML30508808 23210471S +0702492378+0702492378+0702492378D+00350 082023-04-262023-04-202023-04-202023-04-26 +000000000000000+000000000000000+00001302EUR+000000000044233+000000000044233+000000000044233+000.0000 2023-05-23 21 N C50ED50 C50BB50 2023-05-231S+0000000000+0601141825+0000001000 +000000000000000+000000000000000 0 0F_AV 5FX7SI+0702492378Table_LCP UI37111286592+0002186911PPL30508900 22037464S +0702373077+0702373077+0702373077D+00350 082023-04-272023-04-212023-04-212023-04-27 +000000000000000+000000000000000+00001302EUR+000000000036075+000000000036075+000000000036075+000.0000 2023-05-16 11 N C50ED50 CF82H50 2023-05-231S+0000000000+0601129451+0000001000 +000000000000000+000000000000000 0 0FATT_AV 5FX7SI+0702373077Table_CCL +0002589171BB+0702528071DL 0001-01-01EUR+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000 1+0000000000000000001-01-01+0702528071Table_LDC PP37143489207+0000+0002045017JHL30633879 914902866 D+00551 2023-05-292023-05-29 +000000000000000+0000000000000003JUI+000000000003800+000000000003167+000000000000000+000.00000 C50ED50 C50ED50 2023-05-232023-05-23+00000S 0 0FUYR_AV 082023-05-2943 3 +005 0Table_LDC PX37143489208+0000+0002050787RRL30633880 23212728S D+00350 2023-05-292023-05-29 +000000000010754+0000000000000003XXX+000000000010754+000000000010754+000000000010754+000.00001 C50ED50 C50ED50 2023-05-23 +00000S 0 0FVFR_AV 082023-05-295 +005 0
我将文件拆分为500个流文件，对于每一行，我分配了一个值，它是表的名称，现在我想合并所有的流文件，最终得到3个流文件，即每个流文件包含一个表的数据，但问题是我无法使用MergeContent处理器按属性值正确合并，原因是我有：
感谢您的帮助
英文:
I have a text file with 500 rows of data which composes the data of three tables,
Table_LCP PX37110286387+0002186861MML30508808 23210471S +0702492378+0702492378+0702492378D+00350 082023-04-262023-04-202023-04-202023-04-26 +000000000000000+000000000000000+00001302EUR+000000000044233+000000000044233+000000000044233+000.0000 2023-05-23 21 N C50ED50 C50BB50 2023-05-231S+0000000000+0601141825+0000001000 +000000000000000+000000000000000 0 0F_AV 5FX7SI+0702492378Table_LCP UI37111286592+0002186911PPL30508900 22037464S +0702373077+0702373077+0702373077D+00350 082023-04-272023-04-212023-04-212023-04-27 +000000000000000+000000000000000+00001302EUR+000000000036075+000000000036075+000000000036075+000.0000 2023-05-16 11 N C50ED50 CF82H50 2023-05-231S+0000000000+0601129451+0000001000 +000000000000000+000000000000000 0 0FATT_AV 5FX7SI+0702373077Table_CCL +0002589171BB+0702528071DL 0001-01-01EUR+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000+000000000000000 1+0000000000000000001-01-01+0702528071Table_LDC PP37143489207+0000+0002045017JHL30633879 914902866 D+00551 2023-05-292023-05-29 +000000000000000+0000000000000003JUI+000000000003800+000000000003167+000000000000000+000.00000 C50ED50 C50ED50 2023-05-232023-05-23+00000S 0 0FUYR_AV 082023-05-2943 3 +005 0Table_LDC PX37143489208+0000+0002050787RRL30633880 23212728S D+00350 2023-05-292023-05-29 +000000000010754+0000000000000003XXX+000000000010754+000000000010754+000000000010754+000.00001 C50ED50 C50ED50 2023-05-23 +00000S 0 0FVFR_AV 082023-05-295 +005 0
I split the file to have 500 flowfile, for each row I assigned a value
which is the name of the table, now I want to merge all the flowfiles to finally have 3 flowfiles i.e. each flowfile composes the data of each table, but the problem that I can't merge correctly using the MergeContent processor by attribute value here is that I have:
Thank you for help
答案1
得分: 0
你不需要分割原始FlowFile。相反，使用PartitionRecord处理器，并设置一个用户定义的属性（例如 table.name），将其设置为指向第一列的RecordPath（如果列名是 id，则使用 /id）。这将会输出3个FlowFiles，每个文件包含各个表的所有行数据。
英文:
You don't need to split the original FlowFile for this. Instead use the PartitionRecord processor with a user-defined property (say table.name) set to the RecordPath pointing at the first column (if the column is id use /id. That will output 3 FlowFiles, with all the rows for each of the tables.
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库，让每个人都能够通过互相帮助和分享经验来进步。
评论