英文:
How to convert rtp packet payload bytes to any audio data?
问题
我正在使用Java制作一个项目,不使用任何第三方库。我已经成功使用DatagramSocket
建立了UDP连接。然后我开始使用SIP协议进行通信。我已经成功完成了注册和邀请阶段。这是我获取主机和端口的方法,用于传输音频数据流。然后,我成功使用DatagramSocket
建立了到新地址的连接。我开始以RTP数据包的形式接收数据。我成功地从数据包中获取了以下数据:有效载荷类型(在我这里是8或PCMA),时间戳,序列号以及有效载荷数据(字节数组)。现在,我想处理接收到的数据,以便将来使用。也就是说,保存到磁盘,随意转换为任何其他音频格式,播放音频等等。我无法弄清楚从数据包中接收到的字节数组需要做什么。
举个例子,作为一个开始,我想将接收到的数据保存到以AudioFormat.Encoding.PCM_FLOAT
,8000.0赫兹,8位,单声道,每帧160字节的格式保存。为此,我需要做什么?
英文:
I am making a project in java without using any third party libraries. I have successfully established an udp connection using the DatagramSocket
. Then I started communicating using the sip protocol. I have successfully passed the registration and invitation stage. This is how I got the host and port to which the audio data stream will be transmitted. Then I successfully established a connection to the new address using DatagramSocket
. And i began to receive data in the form of rtp packets. I managed to successfully get the following data from the package: Payload type (in my case 8 or PCMA), Timestamp, Sequence number and payload data (byte array). Now I want to process the received data so that I can use it in the future. That is, save to disk, convert to any other audio format at will, play audio, and so on. I can't figure out what exactly needs to be done with the byte array received from the packet.
Let's say for a start I want to save the received data to a file in the AudioFormat.Encoding.PCM_FLOAT
8000.0 Hz, 8 bit, mono, 160 bytes / frame format. What do I need to do for this?
答案1
得分: 2
使用Aaron Clauson的示例,我解决了我的问题。数据包中的字节数组必须按照提议的方案进行转换。我制作了一个实际工作的Kotlin示例,演示了这个过程可能的样子。
一个获取原始RTP数据包中数据的示例。
如果按照sequenceNumber
的正确顺序将结果数组粘合在一起(没有重复项),那么你可以将其写入WAV文件,使用javax.sound.sampled.AudioInputStream
,就像这个示例中所示。
一个简化的示例,演示了如何在Android上实时播放音频流。以及一个简化的示例,展示了如何将麦克风捕获的声音发送到服务器。
英文:
Using the example by Aaron Clauson I solved my problem. The byte array from the packet must be converted according to the proposed scheme. I made a working example of how this might look in Kotlin.
An example of how to get data from a raw rtp package.
If you glue the resulting arrays in the correct order (by sequenceNumber
) and no duplicates, then you can, for example, write this to a WAV file using javax.sound.sampled.AudioInputStream
, as in the example.
A simplified example of how you can play a stream of sound in real time on an Android. And a simplified example of how you can send sound from a microphone to a server.
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库,让每个人都能够通过互相帮助和分享经验来进步。
评论