英文:
Maximum number of rows limit on Bigtable
问题
我有一个存储约100亿行数据的要求在Bigtable上。未来数据可能会增长到约1000亿。
我尝试在这里的文档中找到关于Bigtable最大行数的信息，但没有提到Bigtable可以容纳的最大行数。每行数据的大小大约为1 KB。
英文:
I have a requirement to store around ~10 billion rows at Big Table. Data Might grow to ~100 billion in future.
I tried to find the maximum info in the documentation here, but there is no such mention of the maximum amount of rows Bigtable can have. The data size of each row would be around 1 KB
答案1
得分: 2
根据文档-1，
> Cloud Bigtable是一个稀疏填充的表，可以扩展到数十亿行和数千列。
关于Cloud Bigtable行的限制可以很大，但不是无限的，行可以包含约100个列族和数百万个列，但建议行大小为100MB。
在BigTable中，表内数据的限制基于数据大小，而不是列或行的数量（除了“每个表的列族”）。因此，您需要确保行大小在文档-2中规定的硬限制内，
> 作为最佳实践，设计您的模式以保持数据大小在文档中推荐的限制内。
英文:
As per the Documentation-1,
>Cloud Bigtable is a sparsely populated table that can scale to billions of rows and thousands of columns.
About the limitation Cloud Bigtable Rows can be big but are not infinite, the rows can contain ~100 column families and millions of columns but the recommendation is 100MB for row size.
In BigTable, the limit of the data within a table is based on data size instead of the number of columns or rows (except for "Column families per table"). Therefore you need to make sure the row size should be within the hard limit as stated in the Documentation-2,
>As a best practice, design your schema to keep the size of your data within the recommended limits in the Documentation.
答案2
得分: 0
1000亿行 x 1 KB/行 = 100 TB的存储。
对于SSD存储，Bigtable的限制是每个节点5 TB链接，但设计目标是70%的存储利用率链接，所以您需要（100 /（5 * 0.70））= 28个节点。
us-central1地区的默认BigTable节点限制为200个链接。
Google Bigtable支持宠物字节的存储。根据您问题中的信息，Bigtable将支持您的要求，即1000亿行，每行1 KB。
英文:
100 billion rows x 1 KB/row = 100 TB of storage.
For SSD storage, the Bigtable limit is 5 TB per node link but the design goal is 70% storage utilization link so you need (100 / (5 * .70)) = 28 nodes.
The default BigTable node limit is 200 nodes for us-central1. link
Google Bigtable supports petabytes of storage. Based upon the information in your question, Bigtable will support your requirement of 100 billion rows of 1 KB per row.
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库，让每个人都能够通过互相帮助和分享经验来进步。
评论