英文:
Best way to integrate go with Spark
问题
我正在运行Cassandra，并使用gocql驱动程序连接到Cassandra。效果非常好。
我正在考虑使用Apache Spark来分析数据。
我应该用Scala还是Java编写一个Spark应用程序，然后以某种方式将应用程序暴露给go呢？你会怎么做？
我不知道是否有go的Spark驱动程序。
欢迎提供任何指导和信息。
谢谢！
英文:
I am running a Cassandra and I am using gocql driver to connect to Cassandra.<br>Works really good.<br>
I am considering using Apache Spark to analyse on data. <br>
Should I write a Spark application in Scala or Java and then expose the app to go(somehow) - or how would you do it? <br><br>
I am not aware of any go Spark driver.<br><br>
Any directions and information is welcome.
Regards
答案1
得分: 4
我认为在使用Scala处理Cassandra数据时，最好的工具是spark-cassandra-connector。
它非常简单而且功能强大。
英文:
I think the best tool to work on Cassandra data with Scala would be spark-cassandra-connector .
It is so easy and powerful.
答案2
得分: 1
运行使用非JVM语言（如Go）编写的应用程序在Spark上需要Spark本身的支持。生成的应用程序很可能会更慢，并且无法访问所有Spark功能。
要了解如何运行Python Spark应用程序，您可以阅读https://cwiki.apache.org/confluence/display/SPARK/PySpark+Internals。
英文:
Running applications that are written in non JVM languages (such as Go) on Spark requires support from Spark itself. The resulting application will most likely be slower and won't have access to all Spark features.
To understand what it takes to run a python Spark app you can read https://cwiki.apache.org/confluence/display/SPARK/PySpark+Internals
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库，让每个人都能够通过互相帮助和分享经验来进步。
评论