<Blob: BUCKETNAME, PATH, None> could not be converted to unicode python copying data between gcs buckets

huangapple
go评论95阅读模式
英文:

<Blob: BUCKETNAME, PATH, None> could not be converted to unicode python copying data between gcs buckets

问题

I'm trying to copy a file from one GCS bucket to another bucket using Python. I'm not able to copy the file, and it throws the below error.

错误：

  1. 遇到了错误：
  2. <Blob: [[BUCKET]], [[PATH]], None> 无法转换为Unicode
  3. Traceback (most recent call last):
  4.   File "/hadoop/yarn/nm-local-dir/usercache/root/appcache/application_1679321656981_0001/container_e01_1679321656981_0001_01_000001/mllibs/lib/python3.7/site-packages/google/cloud/storage/bucket.py", line 1901, in copy_blob
  5.     new_blob = Blob(bucket=destination_bucket, name=new_name)
  6.   File "/hadoop/yarn/nm-local-dir/usercache/root/appcache/application_1679321656981_0001/container_e01_1679321656981_0001_01_000001/mllibs/lib/python3.7/site-packages/google/cloud/storage/blob.py", line 216, in __init__
  7.     name = _bytes_to_unicode(name)
  8.   File "/hadoop/yarn/nm-local-dir/usercache/root/appcache/application_1679321656981_0001/container_e01_1679321656981_0001_01_000001/mllibs/lib/python3.7/site-packages/google/cloud/_helpers/__init__.py", line 352, in _bytes_to_unicode
  9.     raise ValueError("%r 无法转换为Unicode" % (value,))
  10. ValueError: <Blob: [[BUCKET]], [[PATH]], None> 无法转换为Unicode

代码：

  1. from google.cloud import storage
  2. from google.oauth2 import service_account
  3. from google.cloud import storage
  5. credentials = service_account.Credentials.from_service_account_file("FILE.json")
  6. client = storage.Client(project='PROJECT', credentials=credentials)
  8. print(client)
  10. source_bucket = client.bucket(str(source_bucket))
  11. source_blob = source_bucket.blob(str(source_blob))
  12. destination_bucket = client.bucket(str(destination_bucket))
  13. destination_blob_name = source_bucket.blob(str(destination_blob_name))
  15. blob_copy = source_bucket.copy_blob(source_blob, destination_bucket, destination_blob_name)

我的Python中的Google包版本：

  1. google-api-core          2.11.0
  2. google-auth              2.16.0
  3. google-cloud-bigquery    3.4.1
  4. google-cloud-core        2.3.2
  5. google-cloud-storage     2.7.0
  6. google-crc32c            1.5.0
  7. google-resumable-media   2.4.0
  8. googleapis-common-protos 1.58.0

我不知道出了什么问题。为什么会出现ValueError错误。我遵循了Google的文档。

英文:

I'm trying to copy a file from one gcs bucket to another bucket using python .
I'm not able to copy the file, it throws the below error.

Error:

  1. An error was encountered:
  2. &lt;Blob:[[BUCKET]], [[PATH]], None&gt; could not be converted to unicode
  3. Traceback (most recent call last):
  4.   File &quot;/hadoop/yarn/nm-local-dir/usercache/root/appcache/application_1679321656981_0001/container_e01_1679321656981_0001_01_000001/mllibs/lib/python3.7/site-packages/google/cloud/storage/bucket.py&quot;, line 1901, in copy_blob
  5.     new_blob = Blob(bucket=destination_bucket, name=new_name)
  6.   File &quot;/hadoop/yarn/nm-local-dir/usercache/root/appcache/application_1679321656981_0001/container_e01_1679321656981_0001_01_000001/mllibs/lib/python3.7/site-packages/google/cloud/storage/blob.py&quot;, line 216, in __init__
  7.     name = _bytes_to_unicode(name)
  8.   File &quot;/hadoop/yarn/nm-local-dir/usercache/root/appcache/application_1679321656981_0001/container_e01_1679321656981_0001_01_000001/mllibs/lib/python3.7/site-packages/google/cloud/_helpers/__init__.py&quot;, line 352, in _bytes_to_unicode
  9.     raise ValueError(&quot;%r could not be converted to unicode&quot; % (value,))
  10. ValueError: &lt;Blob: [[BUCKET]], [[PATH]], None&gt; could not be converted to unicode

The code:

  1. from google.cloud import storage
  2. from google.oauth2 import service_account
  3. from google.cloud import storage
  5. credentials = service_account.Credentials.from_service_account_file(&quot;FILE.json&quot;)
  6. client = storage.Client(project=&#39;PROJECT&#39;, credentials=credentials)
  8. print(client)
  10. source_bucket = client.bucket(str(source_bucket))
  11. source_blob = source_bucket.blob(str(source_blob))
  12. destination_bucket = client.bucket(str(destination_bucket))
  13. destination_blob_name=source_bucket.blob(str(destination_blob_name))
  15. blob_copy = source_bucket.copy_blob(source_blob, destination_bucket, destination_blob_name)

My google package versions for python :

  1. google-api-core          2.11.0
  2. google-auth              2.16.0
  3. google-cloud-bigquery    3.4.1
  4. google-cloud-core        2.3.2
  5. google-cloud-storage     2.7.0
  6. google-crc32c            1.5.0
  7. google-resumable-media   2.4.0
  8. googleapis-common-protos 1.58.0

I have no idea what is wrong. Why the ValueError is coming. I followed the documentation from google.

答案1

得分: 2

The argument destination_blob_name is supposed to be a string.

So you need to change

  1. destination_blob_name=source_bucket.blob(str(destination_blob_name))

to

  1. destination_blob_name = str(destination_blob_name)
英文:

The argument destination_blob_name is supposed to be a string.

So you need to change

  1. destination_blob_name=source_bucket.blob(str(destination_blob_name))

to

  1. destination_blob_name = str(destination_blob_name)

huangapple
  • 本文由 发表于 2023年3月21日 00:53:08
  • 转载请务必保留本文链接：https://go.coder-hub.com/75793145.html
  • gcs
  • google-bucket
  • google-cloud-platform
  • google-cloud-storage
  • python
匿名

发表评论

匿名网友

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

确定