How to get the whole cluster information in azure databricks at the runtime?

The below code was working for the older version and the version has changed the code is not working in databricks.

Latest Version :12.0 (includes Apache Spark 3.3.1, Scala 2.12)

dbutils.notebook.entry_point.getDbutils().notebook().getContext().tags()

what is the alteranative for this code?

Error:py4j.security.Py4JSecurityException: Method public scala.collection.immutable.Map com.databricks.backend.common.rpc.CommandContext.tags() is not whitelisted on class class com.databricks.backend.common.rpc.CommandContext

You can get most of cluster info directly from Spark config:

%scala
val p = "spark.databricks.clusterUsageTags."
spark.conf.getAll
  .collect{ case (k, v) if k.startsWith(p) => s"${k.replace(p, "")}: $v" }
  .toList.sorted.foreach(println)

%python
p = "spark.databricks.clusterUsageTags."
conf = [f"{k.replace(p, '')}: {v}" for k, v in spark.sparkContext.getConf().getAll() if k.startswith(p)]
for l in sorted(conf): print(l)

[...]
clusterId: 0123-456789-0abcde1
clusterLastActivityTime: 1676449848620
clusterName: test
clusterNodeType: Standard_F4s_v2
[...]

</details>



# 答案2
**得分**: 0

我已创建了以下具有 12.0 DBS 运行时的集群，如下所示：

- 以上命令已按要求提供输出，没有任何错误：

- 但如果您需要集群信息，那么您可以使用 `Clusters 2.0` API。以下代码将有效：

```python
import requests
import json

my_json = {"cluster_id": spark.conf.get("spark.databricks.clusterUsageTags.clusterId")}    

auth = {"Authorization": "Bearer <your_access_token>"}

response = requests.get('https://<workspace_url>/api/2.0/clusters/get', json=my_json, headers=auth).json()
print(response)

import requests
import json

my_json = {"cluster_id": spark.conf.get("spark.databricks.clusterUsageTags.clusterId")}    

auth = {"Authorization": "Bearer <your_access_token>"}

response = requests.get('https://<workspace_url>/api/2.0/clusters/get', json = my_json, headers=auth).json()
print(response)