英文:
Ingest Live Data from One Drive File to Big Query
问题
我想在Big Query中创建一个表,每当存储在OneDrive中的Excel表格更新时,它会自动更新。
使用Google Sheets可以实现相同的功能,但是我无法对存储在OneDrive中的Excel表格进行相同的操作。
由于政策问题,我无法直接使用Google Sheets,并且也无法使用任何扩展程序将数据从OneDrive拉取到Google Sheets,因为这是一个不允许连接到OneDrive的企业OneDrive。
除了Google套件之外,将数据上传到Big Query的唯一方法是手动上传CSV文件,但是由于这是一个每小时更新的表格,这种方法并不可行。
英文:
I want to create a table in Big Query, that automatically updated whenever an excel sheet stored in One Drive is updated.
The same is possible using Google Sheets, however I am unable to do the same for an Excel sheet stored in OneDrive.
Due to policy issues, I am unable to use google sheets directly, and can't use any extensions to pull data from One Drive to Google sheet as well, since its a corporate one drive that doesn't allow connections to one drive.
The only way to upload data to Big Query other than Google suite is to manually upload a csv file, but that is not feasible as this is a sheet that is updated hourly.
答案1
得分: 1
有一个Python连接器可以连接到OneDrive,你可以使用它来使用Python每小时检查OneDrive文件,然后下载更新的Excel表格,并将新数据上传到BigQuery。
可以使用Windows的任务计划程序或Linux的Cron来每小时调度Python脚本。
英文:
There is a Python connector to OneDrive https://github.com/OneDrive/onedrive-sdk-python you can use to check the OneDrive file hourly with Python, then download the updated Excel Sheet and upload the new data to BigQuery https://cloud.google.com/python/docs/reference/bigquery/latest
Python script can be scheduled hourly with Task Scheduler on Windows or Cron on Linux.
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库,让每个人都能够通过互相帮助和分享经验来进步。
评论