从OneDrive文件中提取实时数据到BigQuery

huangapple go评论79阅读模式
英文:

Ingest Live Data from One Drive File to Big Query

问题

我想在Big Query中创建一个表,每当存储在OneDrive中的Excel表格更新时,它会自动更新。

使用Google Sheets可以实现相同的功能,但是我无法对存储在OneDrive中的Excel表格进行相同的操作。

由于政策问题,我无法直接使用Google Sheets,并且也无法使用任何扩展程序将数据从OneDrive拉取到Google Sheets,因为这是一个不允许连接到OneDrive的企业OneDrive。

除了Google套件之外,将数据上传到Big Query的唯一方法是手动上传CSV文件,但是由于这是一个每小时更新的表格,这种方法并不可行。

英文:

I want to create a table in Big Query, that automatically updated whenever an excel sheet stored in One Drive is updated.

The same is possible using Google Sheets, however I am unable to do the same for an Excel sheet stored in OneDrive.

Due to policy issues, I am unable to use google sheets directly, and can't use any extensions to pull data from One Drive to Google sheet as well, since its a corporate one drive that doesn't allow connections to one drive.

The only way to upload data to Big Query other than Google suite is to manually upload a csv file, but that is not feasible as this is a sheet that is updated hourly.

答案1

得分: 1

有一个Python连接器可以连接到OneDrive,你可以使用它来使用Python每小时检查OneDrive文件,然后下载更新的Excel表格,并将新数据上传到BigQuery。

可以使用Windows的任务计划程序或Linux的Cron来每小时调度Python脚本。

英文:

There is a Python connector to OneDrive https://github.com/OneDrive/onedrive-sdk-python you can use to check the OneDrive file hourly with Python, then download the updated Excel Sheet and upload the new data to BigQuery https://cloud.google.com/python/docs/reference/bigquery/latest

Python script can be scheduled hourly with Task Scheduler on Windows or Cron on Linux.从OneDrive文件中提取实时数据到BigQuery

huangapple
  • 本文由 发表于 2023年8月9日 17:44:15
  • 转载请务必保留本文链接:https://go.coder-hub.com/76866485.html
匿名

发表评论

匿名网友

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

确定