Terraform动态循环以创建多个DynamoDB。

huangapple
go评论93阅读模式
英文:

Terraform dynamic loop to create multiple dynamodb

问题

我正在尝试创建一个动态方法来创建多个DynamoDB表格，每个表格都有自己的属性。我尝试使用动态块、列表对象等for循环，但无法为每个表格迭代属性。目标是一次性创建具有不同属性和每个表格的全局索引的多个表格。我有以下结构的terraform.tfvars和main.tf：

变量声明：

  1. variable "dynamodb_table" {
  2.   type = list(object({
  3.     table_name         = string
  4.     billing_mode       = string
  5.     read_capacity      = optional(number)
  6.     write_capacity     = optional(string)
  7.     hash_key           = string
  8.     ttl_attribute_name = string
  9.     ttl_enabled        = string
  10.     range_key          = optional(string)
  11.     attribute = object({
  12.       name = string
  13.       type = string
  14.     })
  15.   }))
  16. }
  18. variable "global_secondary_indexes" {
  19.   description = "Describe a GSI for the table; subject to the normal limits on the number of GSIs, projected attributes, etc."
  20.   type = list(object({
  21.     index_name               = string
  22.     index_projection_type    = string
  23.     index_range_key          = string
  24.     index_hash_key           = string
  25.     index_write_capacity     = optional(string)
  26.     index_read_capacity      = optional(string)
  27.     index_non_key_attributes = list(string)
  28.   }))
  30.   default = []
  31. }
  1. dynamodb_table = [
  2.       {
  3.         table_name   = "devops-test-01",
  4.         billing_mode = "PAY_PER_REQUEST",
  5.         hash_key           = "UserId",
  6.         range_key          = "GameTitle",
  7.         ttl_attribute_name = "ttl_attribute_name",
  8.         ttl_enabled        = "false"
  9.         attribute = [
  10.           {
  11.             name = "UserId",
  12.             type = "S"
  13.           },
  14.           {
  15.             name = "GameTitle",
  16.             type = "S"
  17.           }
  18.         ]
  19.       },
  20.       {
  21.         table_name   = "devops-test-02",
  22.         billing_mode = "PAY_PER_REQUEST",
  23.         hash_key           = "GameTitle",
  24.         ttl_attribute_name = "ttl_attribute_name",
  25.         ttl_enabled        = "false"
  26.       }
  27.     ]
  29.     global_secondary_indexes = [
  30.       {
  31.         index_name               = "TitleIndex",
  32.         index_hash_key           = "UserId",
  33.         index_range_key          = "GameTitle",
  34.         index_projection_type    = "INCLUDE",
  35.         index_non_key_attributes = ["Id"]
  36.       }
  38.     ]
  40.     default_tags = {
  41.       "Environment" = "Dev",
  42.       "Owner"       = "xxx"
  43.     }
  1. resource "aws_dynamodb_table" "basic-dynamodb-table" {
  2.       for_each       = { for key, value in var.dynamodb_table : key => value }
  3.       name           = each.value.table_name
  4.       billing_mode   = each.value.billing_mode
  5.       read_capacity  = each.value.read_capacity
  6.       write_capacity = each.value.write_capacity
  7.       hash_key       = each.value.hash_key
  8.       range_key      = each.value.range_key
  9.       ttl {
  10.         attribute_name = each.value.ttl_attribute_name
  11.         enabled        = each.value.ttl_enabled
  12.       }
  14.       dynamic "attribute" {
  16.         for_each = { for key, value in var.attributes : key => value }
  17.         content {
  18.           name = attribute.value.name
  19.           type = attribute.value.type
  20.         }
  21.       }
  23.       dynamic "global_secondary_index" {
  24.         for_each = var.global_secondary_indexes
  25.         content {
  26.           name               = global_secondary_index.value.index_name
  27.           hash_key           = global_secondary_index.value.index_hash_key
  28.           projection_type    = global_secondary_index.value.index_projection_type
  29.           range_key          = lookup(global_secondary_index.value, "index_range_key", null)
  30.           read_capacity      = lookup(global_secondary_index.value, "index_read_capacity", null)
  31.           write_capacity     = lookup(global_secondary_index.value, "index_write_capacity", null)
  32.           non_key_attributes = lookup(global_secondary_index.value, "index_non_key_attributes", null)
  33.         }
  34.       }
  37.       tags = merge(
  38.         var.default_tags,
  39.         {
  40.           Name = each.value.table_name
  41.       })
  43.     }

这段代码产生以下错误：

给定的值不适用于在variable.tf:6,1-26中声明的var.dynamodb_table：element 0：需要对象。

英文:

I'm trying to create a dynamic method to create multiple dynamodb tables with their own attributes. I tried for loops with dynamic blocks, list objects, etc but was not able to iterate attributes for each table. The goal is to have multiple tables with different attributes and global indexes for each table in one go. I have terraform.tfvars and main.tf with the following structure:

Variable declaration:

  1. variable "dynamodb_table" {
  2.   type = list(object({
  3.     table_name         = string
  4.     billing_mode       = string
  5.     read_capacity      = optional(number)
  6.     write_capacity     = optional(string)
  7.     hash_key           = string
  8.     ttl_attribute_name = string
  9.     ttl_enabled        = string
  10.     range_key          = optional(string)
  11.     attribute = object({
  12.       name = string
  13.       type = string
  14.     })
  15.   }))
  16. }
  18. variable "global_secondary_indexes" {
  19.   description = "Describe a GSI for the table; subject to the normal limits on the number of GSIs, projected attributes, etc."
  20.   type = list(object({
  21.     index_name               = string
  22.     index_projection_type    = string
  23.     index_range_key          = string
  24.     index_hash_key           = string
  25.     index_write_capacity     = optional(string)
  26.     index_read_capacity      = optional(string)
  27.     index_non_key_attributes = list(string)
  28.   }))
  30.   default = []
  31. }
  1. dynamodb_table = [
  2.       {
  3.         table_name   = "devops-test-01",
  4.         billing_mode = "PAY_PER_REQUEST",
  5.         hash_key           = "UserId",
  6.         range_key          = "GameTitle",
  7.         ttl_attribute_name = "ttl_attribute_name",
  8.         ttl_enabled        = "false"
  9.         attribute = [
  10.           {
  11.             name = "UserId"
  12.             type = "S"
  13.           },
  14.           {
  15.             name = "GameTitle"
  16.             type = "S"
  17.           }
  18.         ]
  19.       },
  20.       {
  21.         table_name   = "devops-test-02",
  22.         billing_mode = "PAY_PER_REQUEST",
  23.         hash_key           = "GameTitle",
  24.         ttl_attribute_name = "ttl_attribute_name",
  25.         ttl_enabled        = "false"
  26.       }
  27.     ]
  29.     global_secondary_indexes = [
  30.       {
  31.         index_name               = "TitleIndex"
  32.         index_hash_key           = "UserId"
  33.         index_range_key          = "GameTitle"
  34.         index_projection_type    = "INCLUDE"
  35.         index_non_key_attributes = ["Id"]
  36.       }
  38.     ]
  40.     default_tags = {
  41.       "Environment" = "Dev",
  42.       "Owner"       = "xxx"
  43.     }
  1. resource "aws_dynamodb_table" "basic-dynamodb-table" {
  2.       for_each       = { for key, value in var.dynamodb_table : key => value }
  3.       name           = each.value.table_name
  4.       billing_mode   = each.value.billing_mode
  5.       read_capacity  = each.value.read_capacity
  6.       write_capacity = each.value.write_capacity
  7.       hash_key       = each.value.hash_key
  8.       range_key      = each.value.range_key
  9.       ttl {
  10.         attribute_name = each.value.ttl_attribute_name
  11.         enabled        = each.value.ttl_enabled
  12.       }
  14.       dynamic "attribute" {
  16.         for_each = { for key, value in var.attributes : key => value }
  17.         content {
  18.           name = attribute.value.name
  19.           type = attribute.value.type
  20.         }
  21.       }
  23.       dynamic "global_secondary_index" {
  24.         for_each = var.global_secondary_indexes
  25.         content {
  26.           name               = global_secondary_index.value.index_name
  27.           hash_key           = global_secondary_index.value.index_hash_key
  28.           projection_type    = global_secondary_index.value.index_projection_type
  29.           range_key          = lookup(global_secondary_index.value, "index_range_key", null)
  30.           read_capacity      = lookup(global_secondary_index.value, "index_read_capacity", null)
  31.           write_capacity     = lookup(global_secondary_index.value, "index_write_capacity", null)
  32.           non_key_attributes = lookup(global_secondary_index.value, "index_non_key_attributes", null)
  33.         }
  34.       }
  37.       tags = merge(
  38.         var.default_tags,
  39.         {
  40.           Name = each.value.table_name
  41.       })
  43.     }

This code produces the following error:

> The given value is not suitable for var.dynamodb_table declared at variable.tf:6,1-26: element 0: attribute │ "attribute": object required

答案1

得分: 2

你没有分享你的 attributes 变量，但我已经在 dynamodb_table 变量中使用了 attributes。

你的主要问题是 dynamodb_table 变量中的 attribute 属性是必需的，但你没有在 devops-test-02 表中为它提供任何值。

variables.tf 文件中的代码部分如下：

  1. variable "dynamodb_table" {
  2.   type = list(object({
  3.     table_name   = string
  4.     billing_mode = string
  5.     hash_key           = string
  6.     ttl_attribute_name = string
  7.     ttl_enabled        = string
  8.     attribute = list(object({
  9.       name = string
  10.       type = string
  11.     }))
  12.   }))
  13.   default = [
  14.     {
  15.       table_name         = "devops-test-01",
  16.       billing_mode       = "PAY_PER_REQUEST",
  17.       hash_key           = "UserId",
  18.       ttl_attribute_name = "ttl_attribute_name",
  19.       ttl_enabled        = "false",
  20.       attribute = [
  21.         {
  22.           name = "UserId",
  23.           type = "S"
  24.         },
  25.         {
  26.           name = "GameTitle",
  27.           type = "S"
  28.         }
  29.       ]
  30.     },
  31.     {
  32.       table_name         = "devops-test-02",
  33.       billing_mode       = "PAY_PER_REQUEST",
  34.       hash_key           = "GameTitle",
  35.       ttl_attribute_name = "ttl_attribute_name",
  36.       ttl_enabled        = "false",
  37.       attribute = [
  38.         {
  39.           name = "UserId",
  40.           type = "S"
  41.         },
  42.         {
  43.           name = "GameTitle",
  44.           type = "S"
  45.         }
  46.       ]
  47.     }
  48.   ]
  49. }
  51. variable "global_secondary_indexes" {
  52.   description = "Describe a GSI for the table; subject to the normal limits on the number of GSIs, projected attributes, etc."
  53.   type = list(object({
  54.     index_name            = string
  55.     index_projection_type = string
  56.     index_range_key       = string
  57.     index_hash_key        = string
  58.     index_non_key_attributes = list(string)
  59.   }))
  61.   default = [
  62.     {
  63.       index_name               = "TitleIndex",
  64.       index_hash_key           = "UserId",
  65.       index_range_key          = "GameTitle",
  66.       index_projection_type    = "INCLUDE",
  67.       index_non_key_attributes = ["Id"]
  68.     }
  69.   ]
  70. }
  72. variable "default_tags" {
  73.   default = {
  74.     "Environment" = "Dev",
  75.     "Owner"       = "xxx"
  76.   }
  77. }

dynamodb.tf 文件中的代码部分如下：

  1. resource "aws_dynamodb_table" "basic-dynamodb-table" {
  2.   for_each       = { for key, value in var.dynamodb_table : value.table_name => value }
  3.   name           = each.value.table_name
  4.   billing_mode   = each.value.billing_mode
  5.   read_capacity  = lookup(each.value, "read_capacity", null)
  6.   write_capacity = lookup(each.value, "write_capacity", null)
  7.   hash_key       = each.value.hash_key
  8.   range_key      = lookup(each.value, "range_key", null)
  9.   ttl {
  10.     attribute_name = each.value.ttl_attribute_name
  11.     enabled        = each.value.ttl_enabled
  12.   }
  14.   dynamic "attribute" {
  15.     for_each = { for key, value in each.value.attribute : key => value }
  16.     content {
  17.       name = attribute.value.name
  18.       type = attribute.value.type
  19.     }
  20.   }
  22.   dynamic "global_secondary_index" {
  23.     for_each = var.global_secondary_indexes
  24.     content {
  25.       name               = global_secondary_index.value.index_name
  26.       hash_key           = global_secondary_index.value.index_hash_key
  27.       projection_type    = global_secondary_index.value.index_projection_type
  28.       range_key          = lookup(global_secondary_index.value, "index_range_key", null)
  29.       read_capacity      = lookup(global_secondary_index.value, "index_read_capacity", null)
  30.       write_capacity     = lookup(global_secondary_index.value, "index_write_capacity", null)
  31.       non_key_attributes = lookup(global_secondary_index.value, "index_non_key_attributes", null)
  32.     }
  33.   }
  35.   tags = merge(
  36.     var.default_tags,
  37.     {
  38.       Name = each.value.table_name
  39.   })
  40. }

更新 2023-01-17：在 DynamoDB 表中添加了 Kinesis 流目标资源。

  1. resource "aws_kinesis_stream" "example" {
  2.   for_each = aws_dynamodb_table.basic-dynamodb-table
  4.   name        = "${each.key}_table_stream"
  5.   shard_count = 1
  6. }
  8. resource "aws_dynamodb_kinesis_streaming_destination" "example" {
  9.     for_each = aws_dynamodb_table.basic-dynamodb-table
  10.     
  11.     stream_arn = aws_kinesis_stream.example[each.key].arn   
  12.     table_name = each.key
  13. }
英文:

You did not share your attributes variable but I have used attributes in dynamodb_table variable.

Your main problem is attribute property in dynamodb_table variable is requeired but you did not provide any value for it in devops-test-02 table values.

variables.tf

  1. variable "dynamodb_table" {
  2.   type = list(object({
  3.     table_name   = string
  4.     billing_mode = string
  5.     // read_capacity      = optional(number)
  6.     //write_capacity     = optional(string)
  7.     hash_key           = string
  8.     ttl_attribute_name = string
  9.     ttl_enabled        = string
  10.     //range_key          = optional(string)
  11.     attribute = list(object({
  12.       name = string
  13.       type = string
  14.     }))
  15.   }))
  16.   default = [
  17.     {
  18.       table_name         = "devops-test-01",
  19.       billing_mode       = "PAY_PER_REQUEST",
  20.       hash_key           = "UserId",
  21.       range_key          = "GameTitle",
  22.       ttl_attribute_name = "ttl_attribute_name",
  23.       ttl_enabled        = "false"
  24.       attribute = [
  25.         {
  26.           name = "UserId"
  27.           type = "S"
  28.         },
  29.         {
  30.           name = "GameTitle"
  31.           type = "S"
  32.         }
  33.       ]
  34.     },
  35.     {
  36.       table_name         = "devops-test-02",
  37.       billing_mode       = "PAY_PER_REQUEST",
  38.       hash_key           = "GameTitle",
  39.       ttl_attribute_name = "ttl_attribute_name",
  40.       ttl_enabled        = "false"
  41.       attribute = [
  42.         {
  43.           name = "UserId"
  44.           type = "S"
  45.         },
  46.         {
  47.           name = "GameTitle"
  48.           type = "S"
  49.         }
  50.       ]
  51.     }
  52.   ]
  53. }
  55. variable "global_secondary_indexes" {
  56.   description = "Describe a GSI for the table; subject to the normal limits on the number of GSIs, projected attributes, etc."
  57.   type = list(object({
  58.     index_name            = string
  59.     index_projection_type = string
  60.     index_range_key       = string
  61.     index_hash_key        = string
  62.     //index_write_capacity     = optional(string)
  63.     //index_read_capacity      = optional(string)
  64.     index_non_key_attributes = list(string)
  65.   }))
  67.   default = [
  68.     {
  69.       index_name               = "TitleIndex"
  70.       index_hash_key           = "UserId"
  71.       index_range_key          = "GameTitle"
  72.       index_projection_type    = "INCLUDE"
  73.       index_non_key_attributes = ["Id"]
  74.     }
  75.   ]
  76. }
  78. variable "default_tags" {
  79.   default = {
  80.     "Environment" = "Dev",
  81.     "Owner"       = "xxx"
  82.   }
  83. }

dynamodb.tf

  1. resource "aws_dynamodb_table" "basic-dynamodb-table" {
  2.   for_each       = { for key, value in var.dynamodb_table : value.table_name => value }
  3.   name           = each.value.table_name
  4.   billing_mode   = each.value.billing_mode
  5.   read_capacity  = lookup(each.value, "read_capacity", null)
  6.   write_capacity = lookup(each.value, "write_capacity", null)
  7.   hash_key       = each.value.hash_key
  8.   range_key      = lookup(each.value, "range_key", null)
  9.   ttl {
  10.     attribute_name = each.value.ttl_attribute_name
  11.     enabled        = each.value.ttl_enabled
  12.   }
  14.   dynamic "attribute" {
  15.     for_each = { for key, value in each.value.attribute : key => value }
  16.     content {
  17.       name = attribute.value.name
  18.       type = attribute.value.type
  19.     }
  20.   }
  22.   dynamic "global_secondary_index" {
  23.     for_each = var.global_secondary_indexes
  24.     content {
  25.       name               = global_secondary_index.value.index_name
  26.       hash_key           = global_secondary_index.value.index_hash_key
  27.       projection_type    = global_secondary_index.value.index_projection_type
  28.       range_key          = lookup(global_secondary_index.value, "index_range_key", null)
  29.       read_capacity      = lookup(global_secondary_index.value, "index_read_capacity", null)
  30.       write_capacity     = lookup(global_secondary_index.value, "index_write_capacity", null)
  31.       non_key_attributes = lookup(global_secondary_index.value, "index_non_key_attributes", null)
  32.     }
  33.   }
  36.   tags = merge(
  37.     var.default_tags,
  38.     {
  39.       Name = each.value.table_name
  40.   })
  41. }

UPDATE 2023-01-17
Add Kinesis streaming destination resource to dynamodb tables.

  1. resource "aws_kinesis_stream" "example" {
  2.   for_each = aws_dynamodb_table.basic-dynamodb-table
  4.   name        = "${each.key}_table_stream"
  5.   shard_count = 1
  6. }
  8. resource "aws_dynamodb_kinesis_streaming_destination" "example" {
  9.     for_each = aws_dynamodb_table.basic-dynamodb-table
  10.     
  11.     stream_arn = aws_kinesis_stream.example[each.key].arn   
  12.     table_name = each.key
  13. }

huangapple
  • 本文由 发表于 2023年1月9日 16:13:06
  • 转载请务必保留本文链接：https://go.coder-hub.com/75054589.html
  • amazon-web-services
  • terraform
  • terraform-provider-aws
匿名

发表评论

匿名网友

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

确定