英文:
Using Composer Dataflow operator to pass classpath jar with main jar
问题
我想使用Composer Dataflow Operator来编排数据流作业。我的Dataflow jar文件需要另外两个无法作为Maven依赖项添加的jar文件。
目前，我是通过以下命令手动运行作业的：
java -cp Mainprocess.jar com.sample.class com.auth.dependency --tmp --staging
当我在Cloud Shell中运行此命令时，PWD中有依赖的jar文件。
是否可以通过Dataflow Operator传递其他的类路径（classpath）jar文件？
英文:
I want to orchestrate a dataflow job using composer dataflow Operator. My dataflow jar needs two additional jar which cannot be added as maven dependency.
Currently, I am running my job manually with below command:
>java -cp Mainprocess.jar com.sample.class com.auth.dependency --tmp --staging
When I am running this in cloud shell I have dependency jar in PWD.
Is it possible to pass the other classpath jars with Dataflow Operator?
答案1
得分: 1
默认情况下，Dataflow会将CLASSPATH中的所有文件分阶段处理。
您可以通过指定filesToStage管道选项来覆盖此行为，并手动指定应该分阶段的jar包集合。
英文:
By default Dataflow stages all files in the CLASSPATH.
You can override this by specifying the filesToStage pipeline option and manually specifying the set of jars that should be staged.
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库，让每个人都能够通过互相帮助和分享经验来进步。
评论