Databricks AWS 计算集群位置

huangapple go评论131阅读模式
英文:

Databricks AWS compute cluster location

问题

我已经在AWS上托管了Databricks,但我看不到为Databricks创建的任何EC2实例。是否有人可以解释一下,如果我在我的VPC中使用AWS创建Databricks,计算会在我的AWS VPC之外创建吗?
如果是的话,计算会在哪里创建?

英文:

I have hosted Databricks on top of AWS, but I cannot see any EC2 instance created for Databricks. Can anyone explain me, if I create databricks using aws in my VPC, will the computation be created outside my AWS VPC?
If yes, where will the computation be created?

答案1

得分: 1

除了像Serverless SQL Warehouses这样的无服务器选项外,Databricks具有将您的云环境(数据平面)与其云环境(控制平面)分开的架构。您的所有计算(EC2实例/虚拟机)和数据都在您的云环境中创建。
链接:https://docs.databricks.com/getting-started/overview.html

如果在AWS Databricks工作区中启动Databricks集群,您可以在EC2控制台中找到它。确保您查看的是与您的Databricks工作区部署到的AWS区域相同的区域。您还可以使用标签来过滤在您的AWS帐户中由Databricks提供的EC2实例,例如自动添加到所有集群的Vendor=Databricks标签:
链接:https://docs.databricks.com/administration-guide/account-settings/usage-detail-tags.html

英文:

Except for Serverless options like Serverless SQL Warehouses, Databricks has an architecture that separates your Cloud environment (the Data Plane) from their cloud environment (the Control Plane). All of your compute (EC2 instances / VMs) and data are created within your Cloud environment.
https://docs.databricks.com/getting-started/overview.html

If you launch a Databricks Cluster in an AWS Databricks workspace, you can find it in the EC2 console. Make sure you are looking in the same AWS region that your Databricks workspace is deployed to. You can also use tags to filter to EC2 instances provisioned by Databricks in your AWS account, such as the Vendor=Databricks tag which is automatically added to all clusters:

https://docs.databricks.com/administration-guide/account-settings/usage-detail-tags.html

huangapple
  • 本文由 发表于 2023年7月13日 22:04:10
  • 转载请务必保留本文链接:https://go.coder-hub.com/76680275.html
匿名

发表评论

匿名网友

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

确定