英文:
NoSQL Workbench commit to DynamoDB incomplete
问题
I use NoSQL Workbench to design (single-table) the PK SK and Non-Key Attributes by creating the test data in VS Code as JSON, then import into the workbench. I repeat this over the course of weeks as I build up the key-designs. Once I like how it behaves I create the table in DynamoDB and start coding queries. Twice in the last few years I run into a situation where after a while the Workbench commit to DynamoDB fails to read the entire test data set. I'm sure the test data is valid JSON. The workbench pops a dialog that states how many items were not committed. If I delete the new table and re-commit, sometimes the number of items not committed changes. The DynamoDB cloud-watch log is not helpful. Next time it happens, I'll revisit this post and add the log message.
This is what I do when that happens. I use the Workbench to create a new model, export the JSON, then I snip the "NonKeyAttributes" and "TableData" table data sections and add them to the new JSON model and then import, and the commit to DynamoDB takes all the test data.
Since these are single-table designs, the PK and SK are highly overloaded, but I don't see why that would cause the metadata to get corrupted; i.e., hence the need for a new model.
If anyone can shed some light on what might be happening, I'd be grateful or an easier way to fix the problem.
英文:
I use NoSQL Workbench to design (single-table) the PK SK and Non-Key Attributes by creating the test data in VS Code as JSON, then import into the workbench. I repeat this over the course of weeks as I build up the key-designs. Once I like how it behaves I create the table in DynamoDB and start coding queries. Twice in the last few years I run into a situation where after awhile the Workbench commit to DynamoDB fails to read the entire test data set. I'm sure the test data is valid JSON. The workbench pop a dialog that states how many items were not committed. If I delete the new table and re-commit sometimes the number of items not committed changes. The DynamoDB cloud-watch log is not helpful. Next time it happens, I'll revisit this post and add the log message.
This is what I do when that happens. I use the Workbench to create a new model, export the JSON, then I snip the "NonKeyAttributes" and "TableData" table data sections and add them to the new JSON model and then import and the commit to DynamoDB takes all the test data.
Since these are single-table designs, the PK and SK are highly overloaded, but I don't see why that would cause the meta data to get corrupted; i.e., hence the need for a new model.
If anyone can shed some light on what might be happening I'd be grateful or an easier way to fix the problem.
答案1
得分: 1
这可能是因为NoSQLWorkbench定义表格具有1WCU，导致在尝试迁移大量数据时出现节流，导致一些项目被丢弃。团队已经意识到这个边缘情况，将在即将发布的更新中解决此问题。
英文:
I believe this happens as NoSQLWorkbench defines the table to have 1WCU which causes throttling when trying to migrate large amounts of data, resulting in some items being dropped.
The team are aware of this edge case and it should be updated in an upcoming release to resolve this issue.
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库，让每个人都能够通过互相帮助和分享经验来进步。
评论