使用terraform v0.12 生成gitlab repo 創建部署tf 文件

 

以前寫過一個使用模版引擎+ rest 接口的模式，生成tf 文件，v0.12 直接提供了方便的json 處理函數
我們可以直接結合http 以及templatefile providers 方便的生成文件

rest api 格式

因為有一個數據格式的問題，在rest 接口中直接就暴露了parent 的tf 信息,后邊在說明出有一個解決方法

{
   "data": {
    "projects": [
        {
          "name": "firstrong",
          "path":"firstrong",
          "description":"firstrong",
          "group" : "firstrong"
        },
        {
           "name": "secondrong",
           "path":"secondrong",
           "description":"secondrong",
           "group": "secondrong"
        },
        {
            "name": "thirdrong",
            "path":"thirdrong",
            "description":"thirdrong",
            "group": "thirdrong"
        }
    ],
    "groups_parent":[
        {
          "name":"firstrong",
          "path":"firstrong",
          "description":"firstrong"
        },
        {
            "name":"secondrong",
            "path":"secondrong",
             "description":"secondrong"
        },
        {
            "name":"thirdrong",
            "path":"thirdrong",
            "description":"thirdrong"
        }
    ],
    "subgroups":[
        {
          "name":"demoapp",
          "path":"demoapp",
          "parent":"${gitlab_group.firstrong.id}"
        },
        {
            "name":"demoapp2",
            "path":"demoapp2",
            "parent":"${gitlab_group.secondrong.id}"
        },
        {
            "name":"demoapp3",
            "path":"demoapp3",
            "parent":"${gitlab_group.thirdrong.id}"
        }
    ]

   } 
}

tf 配置

• main.tf 文件

data "http" "example" {
  url = "http://localhost:8080/app.json"
}

resource "local_file" "foo2" {
    content = "${templatefile("backends.tmpl", "${jsondecode(data.http.example.body)}")}"
    filename = "init2.sh"
}

• 模版文件

provider "gitlab" {
    base_url = "http://gitserver/api/v4/"
    token = "xxxxxx"
}

%{ for item in data.projects ~}
resource "gitlab_group" "${item.name}" {
    name = "${item.name}"
    path = "${item.path}"
    description = "${item.description}"
}
%{ endfor ~}

%{ for item in data.groups_parent ~}
resource "gitlab_group" "${item.name}" {
    name = "${item.name}"
    path = "${item.path}"
    description = "${item.description}"
}
%{ endfor ~}

%{ for item in data.subgroups ~}
resource "gitlab_group" "${item.name}" {
    name = "${item.name}"
    path = "${item.path}"
    parent_id = "${item.parent}"
}
%{ endfor ~}

生成文件

• init

 terraform init

效果

Initializing the backend...

Initializing provider plugins...

The following providers do not have any version constraints in configuration,
so the latest version was installed.

To prevent automatic upgrades to new major versions that may contain breaking
changes, it is recommended to add version = "..." constraints to the
corresponding provider blocks in configuration, with the constraint strings
suggested below.

* provider.http: version = "~> 1.1"
* provider.local: version = "~> 1.2"

Terraform has been successfully initialized!

You may now begin working with Terraform. Try running "terraform plan" to see
any changes that are required for your infrastructure. All Terraform commands
should now work.

If you ever set or change modules or backend configuration for Terraform,
rerun this command to reinitialize your working directory. If you forget, other
commands will detect it and remind you to do so if necessary.

• pan

 terraform  plan

效果

Refreshing Terraform state in-memory prior to plan...
The refreshed state will be used to calculate this plan, but will not be
persisted to local or remote state storage.

data.http.example: Refreshing state...
local_file.foo2: Refreshing state... [id=98c83d090df2e6559c0225e00f2419dc4c554701]

------------------------------------------------------------------------

No changes. Infrastructure is up-to-date.

This means that Terraform did not detect any differences between your
configuration and real physical resources that exist. As a result, no
actions need to be performed.

• apply

 terraform  apply

效果

data.http.example: Refreshing state...
local_file.foo2: Refreshing state... [id=98c83d090df2e6559c0225e00f2419dc4c554701]

An execution plan has been generated and is shown below.
Resource actions are indicated with the following symbols:
  + create

Terraform will perform the following actions:

  # local_file.foo2 will be created
  + resource "local_file" "foo2" {
      + content = "\nprovider \"gitlab\" {\n base_url = \"http://gitserver/api/v4/\"\n token = \"xxxxxx\"\n}\n\nresource \"gitlab_group
\" \"firstrong\" {\n name = \"firstrong\"\n path = \"firstrong\"\n description = \"firstrong\"\n}\nresource \"gitlab_group\" \"second
rong\" {\n name = \"secondrong\"\n path = \"secondrong\"\n description = \"secondrong\"\n}\nresource \"gitlab_group\" \"thirdrong\" {
\n name = \"thirdrong\"\n path = \"thirdrong\"\n description = \"thirdrong\"\n}\n\nresource \"gitlab_group\" \"firstrong\" {\n nam
e = \"firstrong\"\n path = \"firstrong\"\n description = \"firstrong\"\n}\nresource \"gitlab_group\" \"secondrong\" {\n name = \"seco
ndrong\"\n path = \"secondrong\"\n description = \"secondrong\"\n}\nresource \"gitlab_group\" \"thirdrong\" {\n name = \"thirdrong\"\
n path = \"thirdrong\"\n description = \"thirdrong\"\n}\n\nresource \"gitlab_group\" \"demoapp\" {\n name = \"demoapp\"\n path = \
"demoapp\"\n parent_id = \"${gitlab_group.firstrong.id}\"\n}\nresource \"gitlab_group\" \"demoapp2\" {\n name = \"demoapp2\"\n path =
 \"demoapp2\"\n parent_id = \"${gitlab_group.secondrong.id}\"\n}\nresource \"gitlab_group\" \"demoapp3\" {\n name = \"demoapp3\"\n pa
th = \"demoapp3\"\n parent_id = \"${gitlab_group.thirdrong.id}\"\n}\n"
      + filename = "init2.sh"
      + id = (known after apply)
    }

Plan: 1 to add, 0 to change, 0 to destroy.

Do you want to perform these actions?
  Terraform will perform the actions described above.
  Only 'yes' will be accepted to approve.

  Enter a value: yes

local_file.foo2: Creating...
local_file.foo2: Creation complete after 0s [id=98c83d090df2e6559c0225e00f2419dc4c554701]

Apply complete! Resources: 1 added, 0 changed, 0 destroyed.

說明

以上只是一個簡單的v0.12 的試用，注意當前gitlab 插件不支持v0.12 ，后邊估計會好吧,對於模版包含特殊字符的處理
參考如下：

provider "gitlab" {
    base_url = "http://gitserver/api/v4/"
    token = "xxxxxx"
}

%{ for item in data.projects ~}
resource "gitlab_group" "${item.name}" {
    name = "${item.name}"
    path = "${item.path}"
    description = "${item.description}"
}
%{ endfor ~}

%{ for item in data.groups_parent ~}
resource "gitlab_group" "${item.name}" {
    name = "${item.name}"
    path = "${item.path}"
    description = "${item.description}"
}
%{ endfor ~}

%{ for item in data.subgroups ~}
resource "gitlab_group" "${item.name}" {
    name = "${item.name}"
    path = "${item.path}"
    parent_id = "$${gitlab_group.${item.parent}.id}"
}
%{ endfor ~}

參考資料

https://www.terraform.io/docs/configuration/functions/templatefile.html 
https://www.terraform.io/docs/configuration/functions/jsondecode.html 
https://www.terraform.io/docs/configuration/expressions.html#string-templates 
https://github.com/rongfengliang/terraform-gtilab-demo.git