Skip to content

Add CDW playbook for DW datacatalog and virutal warehouse creation - #46

Draft
raju-saravanan wants to merge 3 commits into
cloudera-labs:develfrom
raju-saravanan:cdw-level-2
Draft

Add CDW playbook for DW datacatalog and virutal warehouse creation#46
raju-saravanan wants to merge 3 commits into
cloudera-labs:develfrom
raju-saravanan:cdw-level-2

Conversation

@raju-saravanan

@raju-saravanan raju-saravanan commented Jul 15, 2021 •
edited
Loading

Copy link
Copy Markdown

Listed below are the full sets of configurations that can be used in the DW playbook.

dw:
  overlay_network: {'yes' to enable overlay network}
  private_load_balancer: {'yes' to enable private load balancer}
  private_worker_nodes: {'yes' to enable private worker nodes}
  tags: {list of tags that will be applied to all the VWs created}
    <key1>: <"value1">
    <key2>: <"value2">
  definitions:
    - name: { if provided, this will be the name of the database catalog, else new one will be generated}
      use_default_dbc: {'yes' to use the default database catalog for below VWs}
      load_demo_data: {'yes' to load demo data}
      virtual_warehouses:
        - name: { if provided, this will be used, else a new name will be generated}
          vw_type: { this can be either 'hive' or 'impala' }
          template: { size of the vw, this can be 'xsmall', 'small', 'medium' etc]
          autoscaling: {VW autoscaling parameters}
             min_cluster: {min number of instances}
            max_cluster: {max number of instances}
          tags: {list of tags that will be applied to this VW}
            <key1>: <"value1">
            <key2>: <"value2">
          configs:
            common_configs: {common configs that will be applied to all applications, see 'dw_vw' module documentation}
            application_configs: {application specif configurations, see 'dw_vw' module documentation}
            enable_sso: {'yes' to enable sso}
            ldap_groups: {list of ldap groups to be enabled for auth}

Changes in this PR are done in conjunction with the following PRs:

This was referenced Jul 15, 2021
Closed
Closed
Merged
@raju-saravanan
raju-saravanan force-pushed the cdw-level-2 branch 3 times, most recently from ddd7463 to 8f482a2 Compare July 23, 2021 10:00
@raju-saravanan
Add CDW playbook
18318b2 
Signed-off-by: Saravanan Raju <saravanan.footloose@gmail.com>
@raju-saravanan
Remove use_default_dbc
7d94350 
Signed-off-by: Saravanan Raju <saravanan.footloose@gmail.com>
@raju-saravanan
Rename virtual warehouse configs
10e35f1 
Signed-off-by: Saravanan Raju <saravanan.footloose@gmail.com>
@wmudge
wmudge marked this pull request as draft March 10, 2022 19:59
@wmudge wmudge added the duplicate This issue or pull request already exists label Nov 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

1 more reviewer
@Chaffelson Chaffelson Chaffelson approved these changes
Reviewers whose approvals may not affect merge requirements

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

duplicate This issue or pull request already exists

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@raju-saravanan @Chaffelson @wmudge