英文:
Can we split a binary avro binary and send it using HTTP?
问题
我对Avro的经验不是很丰富,几周前我在使用Avro将二进制数据通过HTTP 1.1发送到Arduino时使用了它。所以在这里,我的模式会越来越大,我想将二进制数据分成块,然后在接收端重新组装这些块,所以我需要知道以下几点:
1)我们真的可以将Avro二进制数据分成块,然后在接收端重新组装这些块吗?
2)对于一个二进制数据,进行多次HTTP请求和响应是一个好主意吗?还是我应该开始学习MapReduce和Hadoop?
英文:
i don't have a lot of experience with avro, i was using it some weeks ago to send binary data on HTTP 1.1 using golang to an Arduino, so here my schema is going to be more and more big and i want to split that binary into blocks so fo that i need to know :
-
Can we really Split avro binary into blocks and then reassemble that blocks in reception ?
-
Is it a good idea to do many HTTP requests and responses for one binary or i have to start learning mapReduce and Hadoop ?
答案1
得分: 1
我不确定你想要实现什么,也不熟悉Arduino。但根据我理解,你似乎想要做类似于Kafka的事情。建议你阅读一下Kafka的工作原理链接。
> schema is going to be more and more big
你是指发送的实际数据会越来越大,而不是指模式对吧?
我认为最好的方法是逐条通过TCP发送数据,但是对于你的用例,我没有足够的上下文信息。
英文:
Not sure what you are trying to achieve and I am not familiar with Arduino. But from what I understand, it seems that you trying to do something similar to what kafka does. Would suggest that you read about how kafka work link
> schema is going to be more and more big
you mean the actual data that you are sending, not the schema right?
I think the way to go would be sending data over TCP record by record, but again, there is no enough contex of your usecase
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库,让每个人都能够通过互相帮助和分享经验来进步。
评论