英文:
How to get usage statistics from Databricks or SQL Databricks?
问题
我正在寻找一种从Databricks（数据科学与工程和SQL角色）获取使用统计信息的方法。
例如：
-
我创建了一个表。我想知道特定用户查询该表的次数。
-
管道触发了多少次？
-
运行DLT管道需要多长时间？
有没有获取使用统计信息的方法？
英文:
I am looking for a way to get usage statistics from Databricks (Data Science & Engineering and SQL persona).
For example:
-
I created a table. I want to know how many times a specific user queried that table.
-
How many times a pipeline was triggered?
-
How long it took to run a DLT pipeline?
Is there any way to get usage statistics?
答案1
得分: 1
是的，有几种方法可以从Databricks获取使用统计信息：
Databricks UI：
Databricks UI提供有关表、笔记本和作业的使用信息。您可以查看表被访问的次数，笔记本运行的次数以及作业运行的持续时间。
审计日志：
Databricks维护审计日志，可用于跟踪用户活动并监视使用统计信息。这些日志包含有关执行的活动类型、执行活动的用户以及执行活动的时间的信息。
Databricks REST API：
Databricks REST API提供对Databricks资源的编程访问，包括使用统计信息。您可以使用API检索有关表的使用情况、作业运行历史以及其他使用统计信息的信息。
Databricks Delta指标：
Databricks Delta提供有关Databricks Delta表的详细指标，包括读取和写入的次数、表的大小以及作业运行的持续时间的信息。
随时参考此文档：https://docs.databricks.com/administration-guide/account-settings/audit-logs.html
英文:
Yes, there are several ways to get usage statistics from Databricks:
Databricks UI:
The Databricks UI provides information on the usage of tables, notebooks, and jobs. You can view the number of times a table was accessed, the number of times a notebook was run, and the duration of a job run.
Audit Logs:
Databricks maintains audit logs that can be used to track user activity and monitor usage statistics. These logs contain information on the type of activity performed, the user who performed the activity, and the time the activity was performed.
Databricks REST API:
The Databricks REST API provides programmatic access to Databricks resources, including usage statistics. You can use the API to retrieve information on table usage, job run history, and other usage statistics.
Databricks Delta Metrics:
Databricks Delta provides detailed metrics on the usage of Databricks Delta tables, including information on the number of reads and writes, the size of the tables, and the duration of job runs.
freel free to refer this doc : https://docs.databricks.com/administration-guide/account-settings/audit-logs.html
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库，让每个人都能够通过互相帮助和分享经验来进步。
评论