我们可以将二进制的Avro文件拆分,并使用HTTP发送吗?

huangapple go评论79阅读模式
英文:

Can we split a binary avro binary and send it using HTTP?

问题

我对Avro的经验不是很丰富,几周前我在使用Avro将二进制数据通过HTTP 1.1发送到Arduino时使用了它。所以在这里,我的模式会越来越大,我想将二进制数据分成块,然后在接收端重新组装这些块,所以我需要知道以下几点:
1)我们真的可以将Avro二进制数据分成块,然后在接收端重新组装这些块吗?
2)对于一个二进制数据,进行多次HTTP请求和响应是一个好主意吗?还是我应该开始学习MapReduce和Hadoop?

英文:

i don't have a lot of experience with avro, i was using it some weeks ago to send binary data on HTTP 1.1 using golang to an Arduino, so here my schema is going to be more and more big and i want to split that binary into blocks so fo that i need to know :

  1. Can we really Split avro binary into blocks and then reassemble that blocks in reception ?

  2. Is it a good idea to do many HTTP requests and responses for one binary or i have to start learning mapReduce and Hadoop ?

答案1

得分: 1

我不确定你想要实现什么,也不熟悉Arduino。但根据我理解,你似乎想要做类似于Kafka的事情。建议你阅读一下Kafka的工作原理链接

> schema is going to be more and more big

你是指发送的实际数据会越来越大,而不是指模式对吧?

我认为最好的方法是逐条通过TCP发送数据,但是对于你的用例,我没有足够的上下文信息。

英文:

Not sure what you are trying to achieve and I am not familiar with Arduino. But from what I understand, it seems that you trying to do something similar to what kafka does. Would suggest that you read about how kafka work link

> schema is going to be more and more big

you mean the actual data that you are sending, not the schema right?

I think the way to go would be sending data over TCP record by record, but again, there is no enough contex of your usecase

huangapple
  • 本文由 发表于 2021年6月18日 05:46:38
  • 转载请务必保留本文链接:https://go.coder-hub.com/68026879.html
匿名

发表评论

匿名网友

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

确定