Access localhost from within a docker image.

huangapple
go评论90阅读模式
英文:

Access localhost from within a docker image

问题

以下是翻译好的内容：

  1. 我有以下的 .gitlab-ci.yml 文件:
  3. 图像: python:3.8
  5. variables:
  6.   PIP_CACHE_DIR: "$CI_PROJECT_DIR/.cache/pip"
  8. cache:
  9.   paths:
  10.     - .cache/pip
  11.     - venv/
  13. before_script:
  14.   - python -V  # 用于调试打印 Python 版本
  15.   - pip install --upgrade pip
  16.   - pip install virtualenv
  17.   - virtualenv venv
  18.   - source venv/bin/activate
  19.   - pip install -r requirements.txt
  20.   - cp properties_ci properties
  21.   - apt-get update
  22.   - apt-get install net-tools
  24. stages:
  25.   - build
  26.   - test
  27.   - security
  28.   - leanix
  30. include:
  31.   - ...
  33. test:unit:
  34.   stage: ...
  36. test:integration:
  37.     stage: test
  38.     script:
  39.         - echo "0"
  40.         - python app.py &
  41.         - curl 127.0.0.1:8126
  42.         - py.test tests/integration/test_integration.py
  43.     services:
  44.         - name: cassandra:3.11

当我使用命令 python app.py 启动我的 Python 应用程序时，我可以看到以下输出：

  1. $ python app.py
  2. 警告:cassandra.cluster:Cluster.__init__ 调用时指定了 contact_points，但没有指定 load_balancing_policy。在下一个主要版本中，这将引发错误；请指定一个负载均衡策略。(contact_points = ['cassandra'], lbp = None)
  3. 警告:cassandra.connection:未发送身份验证挑战，这很可疑，因为驱动程序预期进行身份验证(配置的 authenticator = PlainTextAuthenticator)
  4. 警告:cassandra.connection:未发送身份验证挑战，这很可疑，因为驱动程序预期进行身份验证(配置的 authenticator = PlainTextAuthenticator)
  5. 创建 keyspace（如果不存在）...
  6. 创建 tables（如果不存在）...
  7.  * 提供 Flask 应用 'src' (延迟加载)
  8.  * 环境: production
  9.    警告: 这是一个开发服务器。请勿在生产部署中使用它。
  10.    请改用生产 WSGI 服务器。
  11.  * 调试模式: 关闭
  12. INFO:werkzeug:警告: 这是一个开发服务器。请勿在生产部署中使用它。
  13.  * 运行在 http://127.0.0.1:8126

因此，连接到 Cassandra 并创建/插入数据工作正常，但集成测试无法访问本地主机上的 Python 应用程序。

在我的集成测试中，我调用 http://127.0.0.1:8126，但显示以下信息：

  1. 创建 keyspace（如果不存在）...
  2. =========================== 简短的测试摘要信息 ============================
  3. 错误 tests/integration/test_integration.py - requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=8126): Max retries exceeded with url: /getCSRFToken (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f316d3df700>: Failed to establish a new connection: [Errno 111] Connection refused'))
  4. !!!!!!!!!!!!!!!!!!!! 中断: 收集期间的 1 个错误 !!!!!!!!!!!!!!!!!!!!
  5. =============================== 3.05 秒内的 1 个错误 ===============================

如何在 Docker 容器内调用本地主机以便访问我的应用程序？我尝试了 127.0.0.1 也不起作用。

编辑 1：

脚本 test_integration.py 包含以下代码的小示例部分：

  1. ...
  2. url = "http://localhost:8126/series/"
  4. import zipfile
  5. with zipfile.ZipFile("tests/integration/20230323.zip", mode="r") as archive:
  6.   # 遍历 zip 文件中的文件
  7.   for zipfilename in archive.filelist:
  8.     txtdata = archive.read(zipfilename)
  9.     if (zipfilename.filename == 'OP_lastchange_CRUDE_2023-03-23.json'):
  10.       payload2 = json.dumps(json.loads(txtdata))
  11.       response = requests.request("POST", url, headers=headers, data=payload2)
  12.       assert response.status_code == 204, "圣诞老人今年不来了！"
  13. ...

编辑 2：

解决方案由 @KamilCuk 提供 - 在 before_script 部分将 Python 应用程序设置为在后台运行，如 python app.py &，并休眠几秒钟，使我的 Python 应用程序可用于调用，例如 http://localhost:8126。

英文:

I have the following .gitlab-ci.yml file :

  1. image: python:3.8
  3. variables:
  4.   PIP_CACHE_DIR: &quot;$CI_PROJECT_DIR/.cache/pip&quot;
  6. cache:
  7.   paths:
  8.     - .cache/pip
  9.     - venv/
  11. before_script:
  12.   - python -V  # Print out python version for debugging
  13.   - pip install --upgrade pip
  14.   - pip install virtualenv
  15.   - virtualenv venv
  16.   - source venv/bin/activate
  17.   - pip install -r requirements.txt
  18.   - cp properties_ci properties
  19.   - apt-get update
  20.   - apt-get install net-tools
  22. stages:
  23.   - build
  24.   - test
  25.   - security
  26.   - leanix
  28. include:
  29.   - ...
  31. test:unit:
  32.   stage: ...
  34. test:integration:
  35.     stage: test
  36.     script:
  37.         - echo &quot;0&quot;
  38.         - python app.py &amp;
  39.         - curl 127.0.0.1:8126
  40.         - py.test tests/integration/test_integration.py
  41.     services:
  42.         - name: cassandra:3.11

When I launch my python application by using the command python app.py I can see the following output :

  1. $ python app.py
  2. WARNING:cassandra.cluster:Cluster.__init__ called with contact_points specified, but no load_balancing_policy. In the next major version, this will raise an error; please specify a load-balancing policy. (contact_points = [&#39;cassandra&#39;], lbp = None)
  3. WARNING:cassandra.connection:An authentication challenge was not sent, this is suspicious because the driver expects authentication (configured authenticator = PlainTextAuthenticator)
  4. WARNING:cassandra.connection:An authentication challenge was not sent, this is suspicious because the driver expects authentication (configured authenticator = PlainTextAuthenticator)
  5. Creating keyspace if not exist...
  6. Creating tables if not exist...
  7.  * Serving Flask app &#39;src&#39; (lazy loading)
  8.  * Environment: production
  9.    WARNING: This is a development server. Do not use it in a production deployment.
  10.    Use a production WSGI server instead.
  11.  * Debug mode: off
  12. INFO:werkzeug:WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.
  13.  * Running on http://127.0.0.1:8126

So connecting to Cassandra and creating/inserting data works well, but the integration tests cannot access the python application on localhost.

In my integration tests I call http://127.0.0.1:8126 but it says the following :

  1. Creating keyspace if not exist...
  2. =========================== short test summary info ============================
  3. ERROR tests/integration/test_integration.py - requests.exceptions.ConnectionError: HTTPConnectionPool(host=&#39;localhost&#39;, port=8126): Max retries exceeded with url: /getCSRFToken (Caused by NewConnectionError(&#39;&lt;urllib3.connection.HTTPConnection object at 0x7f316d3df700&gt;: Failed to establish a new connection: [Errno 111] Connection refused&#39;))
  4. !!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!
  5. =============================== 1 error in 3.05s ===============================

Any ideas how to call localhost inside the docker container so that I can access my application ? I tried also 127.0.0.1 and it does not work.

EDIT 1

The script test_integration.py contains as a small example the following portion of code :

  1. ...
  2. url = &quot;http://localhost:8126/series/&quot;
  4. import zipfile
  5. with zipfile.ZipFile(&quot;tests/integration/20230323.zip&quot;, mode=&quot;r&quot;) as archive:
  6.   #Iterate through files in zip file
  7.   for zipfilename in archive.filelist:
  8.     txtdata = archive.read(zipfilename)
  9.     if (zipfilename.filename == &#39;OP_lastchange_CRUDE_2023-03-23.json&#39;):
  10.       payload2 = json.dumps(json.loads(txtdata))
  11.       response = requests.request(&quot;POST&quot;, url, headers=headers, data=payload2)
  12.       assert response.status_code == 204, &quot;Santa Claus is not coming this year !&quot;
  13. 	  
  14. ...

EDIT 2

The solution is given by @KamilCuk - setting the python app to run in the background in the section before_script like python app.py &amp; and sleeping for several seconds makes my python application available to be called like http://localhost:8126.

答案1

得分: 1

请查看夹具替代方案。将以下内容放入您的 conftest.py 文件中：

  1. @pytest.fixture(scope="session")
  2. def app(request):
  3.     pp = subprocess.Popen("python app.py", shell=True)
  4.     time.sleep(5) # TODO: 替换为等待端口打开
  5.     request.addfinalizer(lambda: (pp.terminate(), pp.wait()))
  6.     return pp

然后在测试中使用：

  1. def test_something(app):
  2.     pass
英文:

Instead consider fixtures. Put the following in your conftest.py:

  1. @pytest.fixture(scope=&quot;session&quot;)
  2. def app(request):
  3.    pp = subprocess.popen(&quot;python app.py&quot;)
  4.    time.sleep(5) # TODO: replace with waiting for open port
  5.    request.addfinalizer(lambda: (pp.terminate(), pp.wait()))
  6.    return pp

Then in tests use:

  1. def test_something(app):
  2.      pass

答案2

得分: 0

以下是代码部分的中文翻译：

  1. image: python:3.8
  3. variables:
  4.   PIP_CACHE_DIR: "$CI_PROJECT_DIR/.cache/pip"
  6. cache:
  7.   paths:
  8.     - .cache/pip
  9.     - venv/
  11. before_script:
  12.   - ...
  13.   - python app.py &
  14.   - sleep 20 # 等待应用程序启动
  16. stages:
  17.   - 构建
  18.   - 运行
  19.   - 测试
  20.   - 安全
  21.   - leanix
  23. include:
  24.   - 项目: ...
  26. services:
  27.   - 名称: cassandra:3.11
  28.     别名: cassandra
  30. test:unit:
  31.   阶段: ...
  33. test:integration:
  34.   阶段: 测试
  35.   脚本:
  36.     - echo "0"
  37.     - py.test tests/integration/test_series.py

请注意，代码中的注释部分没有翻译。

英文:

One of the working solutions, in my case, proposed by KamilCuk, is the following :

  1. image: python:3.8
  3. variables:
  4.   PIP_CACHE_DIR: &quot;$CI_PROJECT_DIR/.cache/pip&quot;
  6. cache:
  7.   paths:
  8.     - .cache/pip
  9.     - venv/
  11. before_script:
  12.   - ...
  13.   - python app.py &amp;
  14.   - sleep 20 # wait for application to start-up
  16. stages:
  17.   - build
  18.   - run
  19.   - test
  20.   - security
  21.   - leanix
  23. include:
  24.   - project: ...
  26. services:
  27.   - name: cassandra:3.11
  28.     alias: cassandra
  30. test:unit:
  31.   stage: ...
  33. test:integration:
  34.   stage: test
  35.   script:
  36.     - echo &quot;0&quot;
  37.     - py.test tests/integration/test_series.py

The solution is given by @KamilCuk - setting the python app to run in the background in the section before_script like python app.py &amp; and sleeping for several seconds sleep 20 makes my python application available to be called like http://localhost:8126.

I need to investigate the other solution proposed by KamilCuk using fixtures.

huangapple
  • 本文由 发表于 2023年4月11日 17:00:26
  • 转载请务必保留本文链接：https://go.coder-hub.com/75984105.html
  • docker
  • gitlab
  • gitlab-ci
  • python
匿名

发表评论

匿名网友

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

确定