英文:
Cannot install apache-beam==2.35.0, apache-beam[gcp]==2.35.0 apache-beam[gcp]==2.47.0 and apache-beam[gcp]==2.48.0 versions have conflict dependencis
问题
I have a kfp component that installs apache-beam==2.35.0. I run it in Vertex AI on GCP pipelines.
Component header:
@component(
base_image="dockerhub/python:3.7.12",
packages_to_install=["tensorflow-data-validation==1.6.0", "apache-beam==2.35.0"]
)
def generate_statistics(
statistics: Output[Artifact],
dataset: str,
) -> None:
...
But I'm getting this error:
error screenshot
ERROR: Cannot install apache-beam==2.35.0, apache-beam[gcp]==2.35.0, apache-beam[gcp]==2.39.0, apache-beam[gcp]==2.45.0, apache-beam[gcp]==2.47.0 and apache-beam[gcp]==2.48.0 because these package versions have conflicting dependencies.
I don't know why it tries to install multiple versions at the same time?!
英文:
I have a kfp component that installs apache-beam==2.35.0. I run it in Vertex AI on GCP pipelines.
Component header:
@component(
base_image="dockerhub/python:3.7.12",
packages_to_install=["tensorflow-data-validation==1.6.0", "apache-beam==2.35.0"]
)
def generate_statistics(
statistics: Output[Artifact],
dataset: str,
) -> None:
...
But I'm getting this error:
error screenshot
ERROR: Cannot install apache-beam==2.35.0, apache-beam[gcp]==2.35.0, apache-beam[gcp]==2.39.0, apache-beam[gcp]==2.45.0, apache-beam[gcp]==2.47.0 and apache-beam[gcp]==2.48.0 because these package versions have conflicting dependencies.
I don't know why it tries to install multiple versions at the same time?!
答案1
得分: 0
tensorflow-data-validation库依赖于apache-beam，因此它会安装它。
所以，除非您有使用特定版本的apache-beam的要求，否则从要求中将其移除，您就应该没问题。
![Cannot install apache-beam==2.35.0, apache-beam[gcp]==2.35.0 apache-beam[gcp]==2.47.0 and apache-beam[gcp]==2.48.0 versions have conflict dependencis](https://i.stack.imgur.com/5KCpK.png)
英文:
tensorflow-data-validation library has a dependency on apache-beam and so it installs it.
So unless you have requirement to use specific version of apache-beam, remove that from the requiquirement and you should be good.
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库，让每个人都能够通过互相帮助和分享经验来进步。
评论