问题

我正在从AUR构建Hadoop，并遇到与hadoop-hdfs-native有关的构建失败问题。

这是最终的失败信息：

[ERROR] Failed to execute goal org.apache.hadoop:hadoop-maven-plugins:3.3.5:cmake-compile (cmake-compile) on project hadoop-hdfs-native-client: make failed with error code 2 -&gt; [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.hadoop:hadoop-maven-plugins:3.3.5:cmake-compile (cmake-compile) on project hadoop-hdfs-native-client: make failed with error code 2
...
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn &lt;args&gt; -rf :hadoop-hdfs-native-client

这是故障发生前一些日志的示例：

[WARNING] make[2]: *** [main/native/libhdfspp/lib/common/CMakeFiles/common_obj.dir/build.make:146: main/native/libhdfspp/lib/common/CMakeFiles/common_obj.dir/configuration_loader.cc.o] Error 1
[WARNING] /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/common/sasl_digest_md5.cc: In function ‘std::string hdfs::GetMD5Digest(const std::string&amp;)’:
...
[WARNING] make: *** [Makefile:146: all] Error 2

我认为这可能与C++11/17的问题有关，但我对解决方法不太清楚。

英文:

I'm running the build for Hadoop from the AUR and am getting a build failure that has something to do with hadoop-hdfs-native.

Here's the final failure:

[ERROR] Failed to execute goal org.apache.hadoop:hadoop-maven-plugins:3.3.5:cmake-compile (cmake-compile) on project hadoop-hdfs-native-client: make failed with error code 2 -&gt; [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.hadoop:hadoop-maven-plugins:3.3.5:cmake-compile (cmake-compile) on project hadoop-hdfs-native-client: make failed with error code 2
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:375)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:351)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:215)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:171)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:163)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:298)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:960)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:293)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:196)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
    at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:566)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
Caused by: org.apache.maven.plugin.MojoExecutionException: make failed with error code 2
    at org.apache.hadoop.maven.plugin.cmakebuilder.CompileMojo.runMake (CompileMojo.java:229)
    at org.apache.hadoop.maven.plugin.cmakebuilder.CompileMojo.execute (CompileMojo.java:98)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:137)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:370)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:351)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:215)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:171)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:163)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:298)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:960)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:293)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:196)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
    at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:566)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
[ERROR] 
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn &lt;args&gt; -rf :hadoop-hdfs-native-client

And here's a sample from some of the logs right before the failure:

[WARNING] make[2]: *** [main/native/libhdfspp/lib/common/CMakeFiles/common_obj.dir/build.make:146: main/native/libhdfspp/lib/common/CMakeFiles/common_obj.dir/configuration_loader.cc.o] Error 1
[WARNING] /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/common/sasl_digest_md5.cc: In function ‘std::string hdfs::GetMD5Digest(const std::string&amp;)’:
[WARNING] /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/common/sasl_digest_md5.cc:225:11: warning: ‘int MD5_Init(MD5_CTX*)’ is deprecated: Since OpenSSL 3.0 [-Wdeprecated-declarations]
[WARNING]   225 |   MD5_Init(&amp;ctx);
[WARNING]       |   ~~~~~~~~^~~~~~
[WARNING] In file included from /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/common/sasl_digest_md5.cc:23:
[WARNING] /usr/include/openssl/md5.h:49:27: note: declared here
[WARNING]    49 | OSSL_DEPRECATEDIN_3_0 int MD5_Init(MD5_CTX *c);
[WARNING]       |                           ^~~~~~~~
[WARNING] /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/common/sasl_digest_md5.cc:226:13: warning: ‘int MD5_Update(MD5_CTX*, const void*, size_t)’ is deprecated: Since OpenSSL 3.0 [-Wdeprecated-declarations]
[WARNING]   226 |   MD5_Update(&amp;ctx, src.c_str(), src.size());
[WARNING]       |   ~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[WARNING] /usr/include/openssl/md5.h:50:27: note: declared here
[WARNING]    50 | OSSL_DEPRECATEDIN_3_0 int MD5_Update(MD5_CTX *c, const void *data, size_t len);
[WARNING]       |                           ^~~~~~~~~~
[WARNING] /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/common/sasl_digest_md5.cc:227:12: warning: ‘int MD5_Final(unsigned char*, MD5_CTX*)’ is deprecated: Since OpenSSL 3.0 [-Wdeprecated-declarations]
[WARNING]   227 |   MD5_Final(reinterpret_cast&lt;unsigned char *&gt;(res), &amp;ctx);
[WARNING]       |   ~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[WARNING] /usr/include/openssl/md5.h:51:27: note: declared here
[WARNING]    51 | OSSL_DEPRECATEDIN_3_0 int MD5_Final(unsigned char *md, MD5_CTX *c);
[WARNING]       |                           ^~~~~~~~~
[WARNING] make[2]: *** [main/native/libhdfspp/lib/common/CMakeFiles/common_obj.dir/build.make:160: main/native/libhdfspp/lib/common/CMakeFiles/common_obj.dir/hdfs_configuration.cc.o] Error 1
[WARNING] /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/common/util.cc: In function ‘std::string hdfs::SerializeDelimitedProtobufMessage(const google::protobuf::MessageLite*, bool*)’:
[WARNING] /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/common/util.cc:59:27: warning: ‘int google::protobuf::MessageLite::ByteSize() const’ is deprecated: Please use ByteSizeLong() instead [-Wdeprecated-declarations]
[WARNING]    59 |   int size = msg-&gt;ByteSize();
[WARNING]       |              ~~~~~~~~~~~~~^~
[WARNING] In file included from /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/common/util.cc:22:
[WARNING] /usr/include/google/protobuf/message_lite.h:381:7: note: declared here
[WARNING]   381 |   int ByteSize() const { return internal::ToIntSize(ByteSizeLong()); }
[WARNING]       |       ^~~~~~~~
[WARNING] /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/common/util.cc: In function ‘int hdfs::DelimitedPBMessageSize(const google::protobuf::MessageLite*)’:
[WARNING] /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/common/util.cc:72:30: warning: ‘int google::protobuf::MessageLite::ByteSize() const’ is deprecated: Please use ByteSizeLong() instead [-Wdeprecated-declarations]
[WARNING]    72 |   size_t size = msg-&gt;ByteSize();
[WARNING]       |                 ~~~~~~~~~~~~~^~
[WARNING] /usr/include/google/protobuf/message_lite.h:381:7: note: declared here
[WARNING]   381 |   int ByteSize() const { return internal::ToIntSize(ByteSizeLong()); }
[WARNING]       |       ^~~~~~~~
[WARNING] /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/common/util.cc: In function ‘std::string hdfs::GetRandomClientName()’:
[WARNING] /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/common/util.cc:78:20: warning: ‘int RAND_pseudo_bytes(unsigned char*, int)’ is deprecated: Since OpenSSL 1.1.0 [-Wdeprecated-declarations]
[WARNING]    78 |   RAND_pseudo_bytes(&amp;buf[0], 8);
[WARNING]       |   ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~
[WARNING] In file included from /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/common/util.h:28,
[WARNING]                  from /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/common/util.cc:19:
[WARNING] /usr/include/openssl/rand.h:79:29: note: declared here
[WARNING]    79 | OSSL_DEPRECATEDIN_1_1_0 int RAND_pseudo_bytes(unsigned char *buf, int num);
[WARNING]       |                             ^~~~~~~~~~~~~~~~~
[WARNING] make[1]: *** [CMakeFiles/Makefile2:1924: main/native/libhdfspp/lib/common/CMakeFiles/common_obj.dir/all] Error 2
[WARNING] /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/third_party/gmock-1.7.0/gmock-gtest-all.cc: In function ‘bool testing::internal::StackGrowsDown()’:
[WARNING] /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/third_party/gmock-1.7.0/gmock-gtest-all.cc:7485:24: warning: ‘dummy’ may be used uninitialized [-Wmaybe-uninitialized]
[WARNING]  7485 |   StackLowerThanAddress(&amp;dummy, &amp;result);
[WARNING]       |   ~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~
[WARNING] /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/third_party/gmock-1.7.0/gmock-gtest-all.cc:7477:6: note: by argument 1 of type ‘const void*’ to ‘void testing::internal::StackLowerThanAddress(const void*, bool*)’ declared here
[WARNING]  7477 | void StackLowerThanAddress(const void* ptr, bool* result) {
[WARNING]       |      ^~~~~~~~~~~~~~~~~~~~~
[WARNING] /home/dominik/software/hadoop/src/hadoop-rel-release-3.3.5/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/third_party/gmock-1.7.0/gmock-gtest-all.cc:7483:7: note: ‘dummy’ declared here
[WARNING]  7483 |   int dummy;
[WARNING]       |       ^~~~~
[WARNING] make: *** [Makefile:146: all] Error 2

I think it may have something to do with a C++11/17 issue, but the steps needed to fix it are unclear to me.

答案1

得分: 0

我的AUR问题最终得到了回复。解决方案是修改PKGBUILD文件，使构建函数现在如下所示：

build() {
    export JAVA_HOME=/usr/lib/jvm/java-11-openjdk
    export CXXFLAGS="$CXXFLAGS -include cstdint" # 添加的行
    cd hadoop-rel-release-${pkgver}
    mvn package -Pdist,native \
        -Drequire.openssl -Drequire.zstd \
        -Dmaven.javadoc.skip=true -DskipTests
}

这修复了问题并允许完整的构建完成。

英文:

Eventually my question on AUR got a response. The solution was to modify the PKGBUILD so that the build function was now

build() {
    export JAVA_HOME=/usr/lib/jvm/java-11-openjdk
    export CXXFLAGS=&quot;$CXXFLAGS -include cstdint&quot; # added line
    cd hadoop-rel-release-${pkgver}
    mvn package -Pdist,native \
        -Drequire.openssl -Drequire.zstd \
        -Dmaven.javadoc.skip=true -DskipTests
}

This fixed the issue and let the full build finish.

通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库，让每个人都能够通过互相帮助和分享经验来进步。

Apache Hadoop 构建失败，因为 hadoop-hdfs-native-client。

问题

答案1

What difficulties should I expect if I write a NoSQL db using golang but want to run Hadoop mapreduce on it?

有办法在同一台机器上启动两个Hadoop HDFS集群吗？

如何在不使用Spark的情况下从S3读取Parquet文件？ Java

从Kafka主题读取消息并将其转储到HDFS。

What's the correct way to type hint an empty list as a literal in python?

如何在Highcharts Gantt中更改本地化的星期名称

如何在同一个流中使用多个过滤器和映射函数？

如何使用Map/Set来将代码优化到O(n)？

.NET MAUI Android在GitHub Actions上构建失败，错误代码为1。

如何在Playwright视觉比较中屏蔽多个定位器？

在C++中，可以使用可变模板参数来检索类型的内部类型。

selenium.common.exceptions.StaleElementReferenceException: Message: stale element reference: stale element not found

Creating and opening a URL to log in to Website via Basic Auth with Robot Framework/Selenium (Python)

AG Grid 在上下文菜单中以大文本形式打开

发表评论