RetryError：重试错误[<在0x7f89bc35eb90处完成的未来状态引发了AuthenticationError>]

huangapple
go评论101阅读模式
英文:

tenacity.RetryError: RetryError[<Future at 0x7f89bc35eb90 state=finished raised AuthenticationError>]

问题

I am trying to deploy an app made with streamlit (using also streamlit_chat and streamlit_authenticator). This app is making use of llama-index to create a query engine incorporating chatgpt api. When I state "streamlit run app.py" in my computer, everything works fine, but when I deploy it the following error raises:

2023-06-07 16:45:28.682 Uncaught app exception

Traceback (most recent call last):

File "/home/appuser/venv/lib/python3.10/site-packages/tenacity/init.py", line 382, in call

  1. result = fn(*args, **kwargs)

File "/home/appuser/venv/lib/python3.10/site-packages/llama_index/embeddings/openai.py", line 106, in get_embedding

  1. return openai.Embedding.create(input=[text], engine=engine)["data"][0]["embedding"]

File "/home/appuser/venv/lib/python3.10/site-packages/openai/api_resources/embedding.py", line 33, in create

  1. response = super().create(*args, **kwargs)

File "/home/appuser/venv/lib/python3.10/site-packages/openai/api_resources/abstract/engine_api_resource.py", line 149, in create

) = cls.__prepare_create_request(

File "/home/appuser/venv/lib/python3.10/site-packages/openai/api_resources/abstract/engine_api_resource.py", line 106, in __prepare_create_request

  1. requestor = api_requestor.APIRequestor(

File "/home/appuser/venv/lib/python3.10/site-packages/openai/api_requestor.py", line 138, in init

  1. self.api_key = key or util.default_api_key()

File "/home/appuser/venv/lib/python3.10/site-packages/openai/util.py", line 186, in default_api_key

  1. raise openai.error.AuthenticationError(

openai.error.AuthenticationError: No API key provided. You can set your API key in code using 'openai.api_key = ', or you can set the environment variable OPENAI_API_KEY=). If your API key is stored in a file, you can point the openai module at it with 'openai.api_key_path = '. You can generate API keys in the OpenAI web interface. See https://platform.openai.com/account/api-keys for details.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):

File "/home/appuser/venv/lib/python3.10/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 561, in _run_script

  1. self._session_state.on_script_will_rerun(rerun_data.widget_states)

File "/home/appuser/venv/lib/python3.10/site-packages/streamlit/runtime/state/safe_session_state.py", line 68, in on_script_will_rerun

  1. self._state.on_script_will_rerun(latest_widget_states)

File "/home/appuser/venv/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py", line 482, in on_script_will_rerun

  1. self._call_callbacks()

File "/home/appuser/venv/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py", line 495, in _call_callbacks

  1. self._new_widget_state.call_callback(wid)

File "/home/appuser/venv/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py", line 247, in call_callback

  1. callback(*args, **kwargs)

File "/app/bajoquetumgpt/docsv2.py", line 35, in generate_answer

  1. response = query_engine.query(user_msg)

File "/home/appuser/venv/lib/python3.10/site-packages/llama_index/indices/query/base.py", line 20, in query

  1. return self._query(str_or_query_bundle)

File "/home/appuser/venv/lib/python3.10/site-packages/llama_index/query_engine/retriever_query_engine.py", line 139, in _query

  1. nodes = self._retriever.retrieve(query_bundle)

File "/home/appuser/venv/lib/python3.10/site-packages/llama_index/indices/base_retriever.py", line 21, in retrieve

  1. return self._retrieve(str_or_query_bundle)

File "/home/appuser/venv/lib/python3.10/site-packages/llama_index/token_counter/token_counter.py", line 78, in wrapped_llm_predict

  1. f_return_val = f(_self, *args, **kwargs)

File "/home/appuser/venv/lib/python3.10/site-packages/llama_index/indices/vector_store/retrievers.py", line 62, in _retrieve

  1. self._service_context.embed_model.get_agg_embedding_from_queries(

File "/home/appuser/venv/lib/python3.10/site-packages/llama_index/embeddings/base.py", line 83, in get_agg_embedding_from_queries

  1. query_embeddings = [self.get_query_embedding(query) for query in queries]

File "/home/appuser/venv/lib/python3.10/site-packages/llama_index/embeddings/base.py", line 83, in 

  1. query_embeddings = [self.get_query_embedding(query) for query in queries]

File "/home/appuser/venv/lib/python3.10/site-packages/llama_index/embeddings/base.py", line 72, in get_query_embedding

  1. query_embedding = self._get_query_embedding(query)

File "/home/appuser/venv/lib/python3.10/site-packages/llama_index/embeddings/openai.py", line 223, in _get_query_embedding

  1. return get_embedding(query, engine=engine)

File "/home/appuser/venv/lib/python3.10/site-packages/tenacity/init.py", line 289, in wrapped_f

  1. return self(f, *args, **kw)

File "/home/appuser/venv/lib/python3.10/site-packages/tenacity/init.py", line 379, in call

  1. do = self.iter(retry_state=retry_state)

File "/home/appuser/venv/lib/python3.10/site-packages/tenacity/init.py", line 326, in iter

  1. raise retry_exc from fut.exception()

tenacity.RetryError: RetryError[<Future at 0x7f89bc35eb90 state=finished raised AuthenticationError>]

The code is private but I can show the part where the authenticator and the query engine are used:

  1. import yaml
  2. from yaml.loader import SafeLoader
  3. with open('./config.yaml') as file:
  4.     config = yaml.load(file, Loader=SafeLoader)
  6. authenticator = stauth.Authenticate(
  7.     config['credentials'],
  8.     config['cookie']['name'],
  9.     config['cookie']['key'],
  10.     config['cookie']['expiry_days'],
  11.     config['preauthorized']
  12. )
  13. name, authentication_status, username = authenticator.login('Login', 'main')
  14. print(username, name, authentication_status)
  15. if authentication_status:
  16.     authenticator.logout('Logout', 'main')
  17.     st.write(f'Welcome *{name}*')
  18. elif authentication_status ==
  20. <details>
  21. <summary>英文:</summary>
  23. I am trying to deploy an app made with streamlit (using also streamlit_chat and streamlit_authenticator). This app is making use of llama-index to create a query engine incorporating chatgpt api. When I state &quot;streamlit run app.py&quot; in my computer, everything works fine, but when I deploy it the following error raises:
  25.         2023-06-07 16:45:28.682 Uncaught app exception
  26.     
  27.     Traceback (most recent call last):
  28.     
  29.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/tenacity/__init__.py&quot;, line 382, in __call__
  30.     
  31.         result = fn(*args, **kwargs)
  32.     
  33.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/llama_index/embeddings/openai.py&quot;, line 106, in get_embedding
  34.     
  35.         return openai.Embedding.create(input=[text], engine=engine)[&quot;data&quot;][0][&quot;embedding&quot;]
  36.     
  37.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/openai/api_resources/embedding.py&quot;, line 33, in create
  38.     
  39.         response = super().create(*args, **kwargs)
  40.     
  41.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/openai/api_resources/abstract/engine_api_resource.py&quot;, line 149, in create
  42.     
  43.         ) = cls.__prepare_create_request(
  44.     
  45.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/openai/api_resources/abstract/engine_api_resource.py&quot;, line 106, in __prepare_create_request
  46.     
  47.         requestor = api_requestor.APIRequestor(
  48.     
  49.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/openai/api_requestor.py&quot;, line 138, in __init__
  50.     
  51.         self.api_key = key or util.default_api_key()
  52.     
  53.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/openai/util.py&quot;, line 186, in default_api_key
  54.     
  55.         raise openai.error.AuthenticationError(
  56.     
  57.     openai.error.AuthenticationError: No API key provided. You can set your API key in code using &#39;openai.api_key = &lt;API-KEY&gt;&#39;, or you can set the environment variable OPENAI_API_KEY=&lt;API-KEY&gt;). If your API key is stored in a file, you can point the openai module at it with &#39;openai.api_key_path = &lt;PATH&gt;&#39;. You can generate API keys in the OpenAI web interface. See https://platform.openai.com/account/api-keys for details.
  58.     
  59.     
  60.     The above exception was the direct cause of the following exception:
  61.     
  62.     
  63.     Traceback (most recent call last):
  64.     
  65.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/streamlit/runtime/scriptrunner/script_runner.py&quot;, line 561, in _run_script
  66.     
  67.         self._session_state.on_script_will_rerun(rerun_data.widget_states)
  68.     
  69.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/streamlit/runtime/state/safe_session_state.py&quot;, line 68, in on_script_will_rerun
  70.     
  71.         self._state.on_script_will_rerun(latest_widget_states)
  72.     
  73.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py&quot;, line 482, in on_script_will_rerun
  74.     
  75.         self._call_callbacks()
  76.     
  77.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py&quot;, line 495, in _call_callbacks
  78.     
  79.         self._new_widget_state.call_callback(wid)
  80.     
  81.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py&quot;, line 247, in call_callback
  82.     
  83.         callback(*args, **kwargs)
  84.     
  85.       File &quot;/app/bajoquetumgpt/docsv2.py&quot;, line 35, in generate_answer
  86.     
  87.         response = query_engine.query(user_msg)
  88.     
  89.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/llama_index/indices/query/base.py&quot;, line 20, in query
  90.     
  91.         return self._query(str_or_query_bundle)
  92.     
  93.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/llama_index/query_engine/retriever_query_engine.py&quot;, line 139, in _query
  94.     
  95.         nodes = self._retriever.retrieve(query_bundle)
  96.     
  97.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/llama_index/indices/base_retriever.py&quot;, line 21, in retrieve
  98.     
  99.         return self._retrieve(str_or_query_bundle)
  100.     
  101.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/llama_index/token_counter/token_counter.py&quot;, line 78, in wrapped_llm_predict
  102.     
  103.         f_return_val = f(_self, *args, **kwargs)
  104.     
  105.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/llama_index/indices/vector_store/retrievers.py&quot;, line 62, in _retrieve
  106.     
  107.         self._service_context.embed_model.get_agg_embedding_from_queries(
  108.     
  109.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/llama_index/embeddings/base.py&quot;, line 83, in get_agg_embedding_from_queries
  110.     
  111.         query_embeddings = [self.get_query_embedding(query) for query in queries]
  112.     
  113.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/llama_index/embeddings/base.py&quot;, line 83, in &lt;listcomp&gt;
  114.     
  115.         query_embeddings = [self.get_query_embedding(query) for query in queries]
  116.     
  117.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/llama_index/embeddings/base.py&quot;, line 72, in get_query_embedding
  118.     
  119.         query_embedding = self._get_query_embedding(query)
  120.     
  121.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/llama_index/embeddings/openai.py&quot;, line 223, in _get_query_embedding
  122.     
  123.         return get_embedding(query, engine=engine)
  124.     
  125.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/tenacity/__init__.py&quot;, line 289, in wrapped_f
  126.     
  127.         return self(f, *args, **kw)
  128.     
  129.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/tenacity/__init__.py&quot;, line 379, in __call__
  130.     
  131.         do = self.iter(retry_state=retry_state)
  132.     
  133.       File &quot;/home/appuser/venv/lib/python3.10/site-packages/tenacity/__init__.py&quot;, line 326, in iter
  134.     
  135.         raise retry_exc from fut.exception()
  136.     
  137.     tenacity.RetryError: RetryError[&lt;Future at 0x7f89bc35eb90 state=finished raised AuthenticationError&gt;]
  139. The code is private but I can show the part where the authenticator and the query engine are used:
  141.     import yaml
  142.     from yaml.loader import SafeLoader
  143.     with open(&#39;./config.yaml&#39;) as file:
  144.         config = yaml.load(file, Loader=SafeLoader)
  145.     
  146.     authenticator = stauth.Authenticate(
  147.         config[&#39;credentials&#39;],
  148.         config[&#39;cookie&#39;][&#39;name&#39;],
  149.         config[&#39;cookie&#39;][&#39;key&#39;],
  150.         config[&#39;cookie&#39;][&#39;expiry_days&#39;],
  151.         config[&#39;preauthorized&#39;]
  152.     )
  153.     name, authentication_status, username = authenticator.login(&#39;Login&#39;, &#39;main&#39;)
  154.     print(username, name, authentication_status)
  155.     if authentication_status:
  156.         authenticator.logout(&#39;Logout&#39;, &#39;main&#39;)
  157.         st.write(f&#39;Welcome *{name}*&#39;)
  158.     elif authentication_status == False:
  159.         st.error(&#39;Username/password is incorrect&#39;)
  160.     elif authentication_status == None:
  161.         st.warning(&#39;Please enter your username and password&#39;)
  162.     FIRST_OUTPUT=&quot;&quot;&quot;Hello!&quot;&quot;&quot;
  163.     
  164.     if authentication_status:
  165.         API_KEY = config[&#39;credentials&#39;][&#39;usernames&#39;][username].get(&#39;openaiapi&#39;, &quot;&quot;)
  166.         st.text(&quot;&quot;&quot;First text&quot;&quot;&quot;)
  167.         text_input_container = st.empty()
  168.         if API_KEY==&quot;&quot;:
  169.             API_KEY = text_input_container.text_input(label=&#39;Introduce your OpenAI API Key:&#39;, label_visibility = &#39;hidden&#39;, placeholder=&#39;Introduce your OpenAI API Key:&#39;)
  170.         if API_KEY != &quot;&quot;:
  171.             text_input_container.empty()
  172.         os.environ[&#39;OPENAI_API_KEY&#39;] = API_KEY
  174. And it continues as:
  176.     if API_KEY != &#39;&#39;:
  177.             # Load the index from your saved index.json file
  178.             storage_context = StorageContext.from_defaults(persist_dir=&#39;./storage&#39;)
  179.             # load index
  180.             index = load_index_from_storage(storage_context)
  181.     
  182.     
  183.             query_engine = index.as_query_engine()
  184.     
  185.     
  186.             if &quot;history&quot; not in st.session_state:
  187.                 st.session_state.history = initial_history
  188.             c = st.expander(&quot;Open to see the previous messages!&quot;)
  189.             for i, chat in enumerate(st.session_state.history):
  190.                 if i &lt; len(st.session_state.history)-6:
  191.                     with c:
  192.                         message(**chat, key=str(i)) #unpacking
  193.                 else:
  194.                     message(**chat, key=str(i)) #unpacking
  195.             st.text_input(&quot;You: &quot;, &quot;&quot;, key=&quot;input_text&quot;, on_change = generate_answer)
  197. The function generate_answer is:
  199.     def generate_answer():
  200.         user_msg = st.session_state.input_text
  201.         st.session_state.input_text = &quot;&quot;
  202.         response = query_engine.query(user_msg)
  203.         st.session_state.history.append(
  204.             {&quot;message&quot;: user_msg, &quot;is_user&quot;:True,
  205.             &quot;avatar_style&quot;: &quot;fun-emoji&quot;,
  206.             &quot;seed&quot;: 4}
  207.         )
  208.         st.session_state.history.append(
  209.             {&quot;message&quot;: str(response).strip(), &quot;is_user&quot;:False,
  210.             &quot;avatar_style&quot;: &quot;bottts-neutral&quot;,
  211.             &quot;seed&quot;: 36}
  212.         )
  215. I would love to receive any help with it.
  217. </details>
  220. # 答案1
  221. **得分**: 9
  223. You are probably setting the API key like this:
  224. ```python
  225. os.environ["OPENAI_API_KEY"] = 'YOUR_KEY'

The problem here is because you are filling this variable just in your local environment. To send it to OpenAI you have to do something like this:

  1. import openai
  3. openai.api_key = os.environ["OPENAI_API_KEY"]

I'll let a piece of my code here to you understand better.

  1. from llama_index import SimpleDirectoryReader, GPTVectorStoreIndex, LLMPredictor, ServiceContext, StorageContext, load_index_from_storage
  2. from langchain import OpenAI
  3. import gradio as gr
  4. import os
  5. import openai
  7. # Here I fill my LOCAL environment variable
  8. os.environ["OPENAI_API_KEY"] = 'YOUR_KEY'
  10. def construct_index(directory_path):
  11.     # And here I fill the key to openAI
  12.     openai.api_key = os.environ["OPENAI_API_KEY"]
  13.     num_outputs = 512
  15.     llm_predictor = LLMPredictor(llm=OpenAI(temperature=0.7, model_name="text-davinci-003", max_tokens=num_outputs))
  16.     
  17.     service_context = ServiceContext.from_defaults(llm_predictor=llm_predictor)
  19.     docs = SimpleDirectoryReader(directory_path).load_data()
  21.     index = GPTVectorStoreIndex.from_documents(docs, service_context=service_context)
  23.     index.storage_context.persist()
  24.     return index

That's worked for me.

英文:

You are probably setting the API key like this:

  1.  os.environ[&quot;OPENAI_API_KEY&quot;] = &#39;YOUR_KEY&#39;

The problem here is because you are filling this variable just in your local environment. To send it to OpenAI you have to do something like this:

  1. import openai
  2. openai.api_key = os.environ[&quot;OPENAI_API_KEY&quot;]

I'll let a piece of my code here to you understand better.

  1. from llama_index import SimpleDirectoryReader, GPTVectorStoreIndex, LLMPredictor, ServiceContext, StorageContext, load_index_from_storage
  2. from langchain import OpenAI
  3. import gradio as gr
  4. import os
  5. import openai
  6. # Here I fill my LOCAL environment variable
  7. os.environ[&quot;OPENAI_API_KEY&quot;] = &#39;YOUR_KEY&#39;
  8. def construct_index(directory_path):
  9. # And here I fill the key to openAI
  10. openai.api_key = os.environ[&quot;OPENAI_API_KEY&quot;]
  11. num_outputs = 512
  12. llm_predictor = LLMPredictor(llm=OpenAI(temperature=0.7, model_name=&quot;text-davinci-003&quot;, max_tokens=num_outputs))
  13. service_context = ServiceContext.from_defaults(llm_predictor=llm_predictor)
  14. docs = SimpleDirectoryReader(directory_path).load_data()
  15. index = GPTVectorStoreIndex.from_documents(docs, service_context=service_context)
  16. index.storage_context.persist()
  17. return index

That's worked for me.

答案2

得分: 3

  1. openai.api_key  = "key"
英文: 
  1. os.environ[&quot;OPENAI_API_KEY&quot;] = &#39;YOUR_KEY&#39;

change this

  1. openai.api_key  = &quot;key&quot;

to this

huangapple
  • 本文由 发表于 2023年6月8日 00:56:33
  • 转载请务必保留本文链接：https://go.coder-hub.com/76425556.html
  • llama-index
  • openai-api
  • python
  • streamlit
匿名

发表评论

匿名网友

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

确定