TransportChannelHandler: Exception in connection from /172.31.88.129:32691 java.lang.IllegalArgumentException: Too large frame: 5135603447296520

huangapple go评论87阅读模式
英文:

TransportChannelHandler: Exception in connection from /172.31.88.129:32691 java.lang.IllegalArgumentException: Too large frame: 5135603447296520

问题

I encountered the following problem when I used the big data tool to test spark running in a k8s cluster:

  1. java.lang.IllegalArgumentException: Too large frame: 5135603447296520289
  2. at org.sparkproject.guava.base.Preconditions.checkArgument(Preconditions.java:119)
  3. at org.apache.spark.network.util.TransportFrameDecoder.decodeNext(TransportFrameDecoder.java:148)
  4. at org.apache.spark.network.util.TransportFrameDecoder.channelRead(TransportFrameDecoder.java:98)
  5. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
  6. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
  7. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
  8. at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
  9. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
  10. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
  11. at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
  12. at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)
  13. at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:722)
  14. at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:658)
  15. at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:584)
  16. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:496)
  17. at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
  18. at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
  19. at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
  20. at java.base/java.lang.Thread.run(Thread.java:833)```
  21. I exposed spark 7077 using nodeport, which can be connected externally using telnet. The log displays that spark runs normally. I used the same nodeport way to expose sparkUI to be accessible normally
  22. [enter image description here](https://i.stack.imgur.com/Oz5Nb.png)
  23. The following is the error message for the big data tool:
  24. ```com.jetbrains.bigdatatools.common.connection.exception.BdtRestExecutionException: Error during GET: /api/v1/version request.
  25. NoHttpResponseException: 172.31.88.129:30210 failed to respond
  26. at com.jetbrains.bigdatatools.common.connection.BdtRestExceptionHelper.wrapRest(BdtRestExceptionHelper.kt:27)
  27. at com.jetbrains.spark.monitoring.connection.SparkMonitoringRestClient.getVersion(SparkMonitoringRestClient.kt:127)
  28. at com.jetbrains.spark.monitoring.connection.SparkMonitoringRestClient.checkConnectionInner(SparkMonitoringRestClient.kt:20)
  29. at com.jetbrains.spark.monitoring.connection.SparkMonitoringRestClient.connectInner(SparkMonitoringRestClient.kt:30)
  30. at com.jetbrains.bigdatatools.common.monitoring.connection.MonitoringClient$connect$1.invoke(MonitoringClient.kt:32)
  31. at com.jetbrains.bigdatatools.common.monitoring.connection.MonitoringClient$connect$1.invoke(MonitoringClient.kt:31)
  32. at com.jetbrains.bigdatatools.common.monitoring.connection.MonitoringClient.connectWrapper(MonitoringClient.kt:77)
  33. at com.jetbrains.bigdatatools.common.monitoring.connection.MonitoringClient.connect(MonitoringClient.kt:31)
  34. at com.jetbrains.bigdatatools.common.monitoring.connection.MonitoringClient.connectWithThrowable(MonitoringClient.kt:36)
  35. at com.jetbrains.spark.monitoring.connection.SparkMonitoringConnectionChecker.checkConnection(SparkMonitoringConnectionChecker.kt:21)
  36. at com.jetbrains.spark.monitoring.settings.SparkConnectionTestingBase.checkConnection(SparkConnectionTestingBase.kt:21)
  37. at com.jetbrains.spark.monitoring.settings.SparkConnectionTestingBase.checkConnection(SparkConnectionTestingBase.kt:13)
  38. at com.jetbrains.bigdatatools.common.rfs.settings.RfsConnectionTestingBase.testConnection(RfsConnectionTestingBase.kt:22)
  39. at com.jetbrains.bigdatatools.common.settings.connections.ConnectionTesting.testConnection(ConnectionData.kt:119)
  40. at com.jetbrains.bigdatatools.common.settings.defaultui.TestConnectionPanelWrapper$runTesting$1.invoke(TestConnectionPanelWrapper.kt:105)
  41. at com.jetbrains.bigdatatools.common.settings.defaultui.TestConnectionPanelWrapper$runTesting$1.invoke(TestConnectionPanelWrapper.kt:84)
  42. at com.jetbrains.bigdatatools.common.util.ThreadUtilsKt.executeOnPooledThread$lambda$3(ThreadUtils.kt:31)
  43. at com.intellij.openapi.application.impl.ApplicationImpl$1.run(ApplicationImpl.java:252)
  44. at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
  45. at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  46. at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
  47. at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
  48. at java.base/java.util.concurrent.Executors$PrivilegedThreadFactory$1$1.run(Executors.java:702)
  49. at java.base/java.util.concurrent.Executors$PrivilegedThreadFactory$1$1.run(Executors.java:699)
  50. at java.base/java.security.AccessController.doPrivileged(AccessController.java:399)
  51. at java.base/java.util.concurrent.Executors$PrivilegedThreadFactory$1.run(Executors.java:699)
  52. at java.base/java.lang.Thread.run(Thread.java:833)
  53. Caused by: com.jetbrains.bigdatatools.common.connection.exception.impl.RestExecutionException: Error during GET: /api/v1/version request.```
  54. so how can i solve this problem? Thanks
  55. i tried to use other port to connect to the spark master but failed.
  56. <details>
  57. <summary>英文:</summary>
  58. I encountered the following problem when I used the big data tool to test spark running in a k8s cluster:

23/05/10 11:38:13 WARN TransportChannelHandler: Exception in connection from /172.31.88.129:32691
java.lang.IllegalArgumentException: Too large frame: 5135603447296520289
at org.sparkproject.guava.base.Preconditions.checkArgument(Preconditions.java:119)
at org.apache.spark.network.util.TransportFrameDecoder.decodeNext(TransportFrameDecoder.java:148)
at org.apache.spark.network.util.TransportFrameDecoder.channelRead(TransportFrameDecoder.java:98)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:722)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:658)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:584)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:496)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Thread.java:833)

  1. I exposed spark 7077 using nodeport, which can be connected externally using telnet. The log displays that spark runs normally. I used the same nodeport way to expose sparkUI to be accessible normally
  2. [enter image description here](https://i.stack.imgur.com/Oz5Nb.png)
  3. The following is the error message for the big data tool

com.jetbrains.bigdatatools.common.connection.exception.BdtRestExecutionException: Error during 'GET: /api/v1/version' request.
NoHttpResponseException: 172.31.88.129:30210 failed to respond
at com.jetbrains.bigdatatools.common.connection.BdtRestExceptionHelper.wrapRest(BdtRestExceptionHelper.kt:27)
at com.jetbrains.spark.monitoring.connection.SparkMonitoringRestClient.getVersion(SparkMonitoringRestClient.kt:127)
at com.jetbrains.spark.monitoring.connection.SparkMonitoringRestClient.checkConnectionInner(SparkMonitoringRestClient.kt:20)
at com.jetbrains.spark.monitoring.connection.SparkMonitoringRestClient.connectInner(SparkMonitoringRestClient.kt:30)
at com.jetbrains.bigdatatools.common.monitoring.connection.MonitoringClient$connect$1.invoke(MonitoringClient.kt:32)
at com.jetbrains.bigdatatools.common.monitoring.connection.MonitoringClient$connect$1.invoke(MonitoringClient.kt:31)
at com.jetbrains.bigdatatools.common.monitoring.connection.MonitoringClient.connectWrapper(MonitoringClient.kt:77)
at com.jetbrains.bigdatatools.common.monitoring.connection.MonitoringClient.connect(MonitoringClient.kt:31)
at com.jetbrains.bigdatatools.common.monitoring.connection.MonitoringClient.connectWithThrowable(MonitoringClient.kt:36)
at com.jetbrains.spark.monitoring.connection.SparkMonitoringConnectionChecker.checkConnection(SparkMonitoringConnectionChecker.kt:21)
at com.jetbrains.spark.monitoring.settings.SparkConnectionTestingBase.checkConnection(SparkConnectionTestingBase.kt:21)
at com.jetbrains.spark.monitoring.settings.SparkConnectionTestingBase.checkConnection(SparkConnectionTestingBase.kt:13)
at com.jetbrains.bigdatatools.common.rfs.settings.RfsConnectionTestingBase.testConnection(RfsConnectionTestingBase.kt:22)
at com.jetbrains.bigdatatools.common.settings.connections.ConnectionTesting.testConnection(ConnectionData.kt:119)
at com.jetbrains.bigdatatools.common.settings.defaultui.TestConnectionPanelWrapper$runTesting$1.invoke(TestConnectionPanelWrapper.kt:105)
at com.jetbrains.bigdatatools.common.settings.defaultui.TestConnectionPanelWrapper$runTesting$1.invoke(TestConnectionPanelWrapper.kt:84)
at com.jetbrains.bigdatatools.common.util.ThreadUtilsKt.executeOnPooledThread$lambda$3(ThreadUtils.kt:31)
at com.intellij.openapi.application.impl.ApplicationImpl$1.run(ApplicationImpl.java:252)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.util.concurrent.Executors$PrivilegedThreadFactory$1$1.run(Executors.java:702)
at java.base/java.util.concurrent.Executors$PrivilegedThreadFactory$1$1.run(Executors.java:699)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:399)
at java.base/java.util.concurrent.Executors$PrivilegedThreadFactory$1.run(Executors.java:699)
at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: com.jetbrains.bigdatatools.common.connection.exception.impl.RestExecutionException: Error during 'GET: /api/v1/version' request.

  1. so how can i solve this problem? Thanks
  2. i tried to use other port to connect to the spark master but failed.
  3. </details>
  4. # 答案1
  5. **得分**: 0
  6. 这可能与Spark版本冲突有关。
  7. 您可以检查版本的兼容性,如果需要的话进行修改,并重新测试。
  8. <details>
  9. <summary>英文:</summary>
  10. This can be related to a spark version conflict.
  11. You can check the version&#39;s compatibility, apply modification if needed and retest.
  12. </details>

huangapple
  • 本文由 发表于 2023年5月10日 19:52:12
  • 转载请务必保留本文链接:https://go.coder-hub.com/76218065.html
匿名

发表评论

匿名网友

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

确定