Installing GDAL for python in Google Cloud Functions — error when deploying

huangapple
go评论95阅读模式
英文:

Installing GDAL for python in Google Cloud Functions -- error when deploying

问题

我在Google Cloud Function中使用Python 3.9时未能成功使用GDAL。我在"requirements.txt"文件中包含了gdal：

  1. numpy
  2. pygrib
  3. requests
  4. google-cloud-storage
  5. gdal

但在部署函数时出现以下错误：

  1. 构建失败: .../setuptools/command/egg_info.py", 行 541, 在运行时
  2.           self.add_defaults()
  3.         文件 "/layers/google.python.pip/pip/lib/python3.9/site-packages/setuptools/command/egg_info.py", 行 578, 在add_defaults中
  4.           sdist.add_defaults(self)
  5.         文件 "/layers/google.python.pip/pip/lib/python3.9/site-packages/setuptools/_distutils/command/sdist.py", 行 228, 在add_defaults中
  6.           self._add_defaults_ext()
  7.         文件 "/layers/google.python.pip/pip/lib/python3.9/site-packages/setuptools/_distutils/command/sdist.py", 行 311, 在_add_defaults_ext中
  8.           build_ext = self.get_finalized_command('build_ext')
  9.         文件 "/layers/google.python.pip/pip/lib/python3.9/site-packages/setuptools/_distutils/cmd.py", 行 299, 在get_finalized_command中
  10.           cmd_obj.ensure_finalized()
  11.         文件 "/layers/google.python.pip/pip/lib/python3.9/site-packages/setuptools/_distutils/cmd.py", 行 107, 在ensure_finalized中
  12.           self.finalize_options()
  13.         文件 "/tmp/pip-install-d9gag00y/gdal_e01a421a21914f03a3c89fd3914501b0/setup.py", 行 255, 在finalize_options中
  14.           gdaldir = self.get_gdal_config('prefix')
  15.         文件 "/tmp/pip-install-d9gag00y/gdal_e01a421a21914f03a3c89fd3914501b0/setup.py", 行 194, 在get_gdal_config中
  16.           raise gdal_config_error(traceback_string + '\n' + msg)
  17.       __main__.gdal_config_error: 最近的调用堆栈（最近的呼叫位于最上方）：
  18.         文件 "/tmp/pip-install-d9gag00y/gdal_e01a421a21914f03a3c89fd3914501b0/setup.py", 行 87, 在fetch_config中
  19.           p = subprocess.Popen([command, args], stdout=subprocess.PIPE)
  20.         文件 "/layers/google.python.runtime/python/lib/python3.9/subprocess.py", 行 951, 在__init__中
  21.           self._execute_child(args, executable, preexec_fn, close_fds,
  22.         文件 "/layers/google.python.runtime/python/lib/python3.9/subprocess.py", 行 1821, 在_execute_child中
  23.           raise child_exception_type(errno_num, err_msg, err_filename)
  24.         FileNotFoundError: [Errno 2] 没有这样的文件或目录：'gdal-config'
  26.         在处理上述异常时，发生了另一个异常：
  28.         最近的调用堆栈（最近的呼叫位于最上方）：
  29.         文件 "/tmp/pip-install-d9gag00y/gdal_e01a421a21914f03a3c89fd3914501b0/setup.py", 行 188, 在get_gdal_config中
  30.           returnfetch_config(option, gdal_config=self.gdal_config)
  31.         文件 "/tmp/pip-install-d9gag00y/gdal_e01a421a21914f03a3c89fd3914501b0/setup.py", 行 90, 在fetch_config中
  32.           raise gdal_config_error(e)
  33.         gdal_config_error: [Errno 2] 没有这样的文件或目录：'gdal-config'
  35.         无法找到gdal-config。确保您已安装GDAL原生库和开发标头。
  36.         
  37.         注意：此错误源自子进程，可能与pip无关。
  38. 错误：metadata-generation-failed

回顾其他类似的帖子，例如GDAL包缺失，似乎需要在运行pip install gdal之前安装GDAL库/标头，即sudo apt-get install libgdal-dev。鉴于我无法为云函数运行apt-get，是否有人有解决方法或解决方法？

英文:

I've been unsuccessful in using GDAL in a Google Cloud Function with Python 3.9. I've included gdal in the "requirements.txt" file:

  1. numpy
  2. pygrib
  3. requests
  4. google-cloud-storage
  5. gdal

But get the following error when deploying the function:

  1. Build failed: .../setuptools/command/egg_info.py", line 541, in run
  2.           self.add_defaults()
  3.         File "/layers/google.python.pip/pip/lib/python3.9/site-packages/setuptools/command/egg_info.py", line 578, in add_defaults
  4.           sdist.add_defaults(self)
  5.         File "/layers/google.python.pip/pip/lib/python3.9/site-packages/setuptools/_distutils/command/sdist.py", line 228, in add_defaults
  6.           self._add_defaults_ext()
  7.         File "/layers/google.python.pip/pip/lib/python3.9/site-packages/setuptools/_distutils/command/sdist.py", line 311, in _add_defaults_ext
  8.           build_ext = self.get_finalized_command('build_ext')
  9.         File "/layers/google.python.pip/pip/lib/python3.9/site-packages/setuptools/_distutils/cmd.py", line 299, in get_finalized_command
  10.           cmd_obj.ensure_finalized()
  11.         File "/layers/google.python.pip/pip/lib/python3.9/site-packages/setuptools/_distutils/cmd.py", line 107, in ensure_finalized
  12.           self.finalize_options()
  13.         File "/tmp/pip-install-d9gag00y/gdal_e01a421a21914f03a3c89fd3914501b0/setup.py", line 255, in finalize_options
  14.           gdaldir = self.get_gdal_config('prefix')
  15.         File "/tmp/pip-install-d9gag00y/gdal_e01a421a21914f03a3c89fd3914501b0/setup.py", line 194, in get_gdal_config
  16.           raise gdal_config_error(traceback_string + '\n' + msg)
  17.       __main__.gdal_config_error: Traceback (most recent call last):
  18.         File "/tmp/pip-install-d9gag00y/gdal_e01a421a21914f03a3c89fd3914501b0/setup.py", line 87, in fetch_config
  19.           p = subprocess.Popen([command, args], stdout=subprocess.PIPE)
  20.         File "/layers/google.python.runtime/python/lib/python3.9/subprocess.py", line 951, in __init__
  21.           self._execute_child(args, executable, preexec_fn, close_fds,
  22.         File "/layers/google.python.runtime/python/lib/python3.9/subprocess.py", line 1821, in _execute_child
  23.           raise child_exception_type(errno_num, err_msg, err_filename)
  24.       FileNotFoundError: [Errno 2] No such file or directory: 'gdal-config'
  25.       
  26.       During handling of the above exception, another exception occurred:
  27.       
  28.       Traceback (most recent call last):
  29.         File "/tmp/pip-install-d9gag00y/gdal_e01a421a21914f03a3c89fd3914501b0/setup.py", line 188, in get_gdal_config
  30.           return fetch_config(option, gdal_config=self.gdal_config)
  31.         File "/tmp/pip-install-d9gag00y/gdal_e01a421a21914f03a3c89fd3914501b0/setup.py", line 90, in fetch_config
  32.           raise gdal_config_error(e)
  33.       gdal_config_error: [Errno 2] No such file or directory: 'gdal-config'
  34.       
  35.       Could not find gdal-config. Make sure you have installed the GDAL native library and development headers.
  36.       [end of output]
  37.   
  38.   note: This error originates from a subprocess, and is likely not a problem with pip.
  39. error: metadata-generation-failed
  41. × Encountered error while generating package metadata.
  42. ╰─> See above for output.
  44. note: This is an issue with the package mentioned above, not pip.
  45. hint: See above for details.; Error ID: c84b3231

Reviewing other similar posts, e.g. GDAL package missing, it seems that the GDAL library/headers needs to be installed, sudo apt-get install libgdal-dev, before the pip install gdal will work. Given that I can't run apt-get for a cloud function, does anyone have a fix or workaround?

答案1

得分: 2

将此内容发布为社区维基，以帮助其他社区成员解决此问题：

"GDAL Libraries is not supported by Google Cloud Function at the moment. However, you can use Cloud Run for special cases where you have full control over the container."

英文:

Posting this as a community wiki to help other community members that will encounter this issue:

GDAL Libraries is not supported by Google Cloud Function at the moment. However, you can use Cloud Run for special cases where you have full control over the container.

huangapple
  • 本文由 发表于 2023年2月6日 04:22:12
  • 转载请务必保留本文链接：https://go.coder-hub.com/75355269.html
  • gdal
  • google-cloud-functions
  • installation
  • pip
  • python
匿名

发表评论

匿名网友

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

确定