英文:
Is there a way to spin up two hadroop HDFS clusters on the same machine?
问题
有没有办法在同一台机器上启动两个Hadoop HDFS集群?
我在本地主机上试图启动两个集群时遇到数据节点端口冲突的问题。
英文:
Is there a way to spin up two hadoop HDFS clusters on the same machine?
I struggle to spin up two on my localhost because there will be a port conflict for datanode.
答案1
得分: 1
这不太可能,因为一个HADOOP_CONF_DIR
变量将被用于两者,因此只有一个XML配置文件集能够定义任何端口。
理论上,你可以使用多个终端并将该变量导出到不同的位置,然后在这些终端中启动所有服务,但我建议使用虚拟机或Docker来重新映射服务端口到不同的主机端口。
英文:
It's not really possible because one HADOOP_CONF_DIR
variable will be used for both, and so only one set of XML config files will be able to define any ports.
In theory, you could use multiple terminals and export that variable to different locations, then start all services in those terminals, but I'd recommend using a VM or Docker to remap the service port to a different host port.
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库,让每个人都能够通过互相帮助和分享经验来进步。
评论