Skip to content

Commit d157f25

Browse files
ROunofFscouturiersaleem-mirzaMuhammad Mirzafdhex
authored
Update workshop to use EKS 1.21 (#1478)
* Update to 1.21 (#1425) * upgrade mermaid module to 9.1.3 (#1429) * Kubectl 1.21 (#1430) * Change kubectl to 1.21 * Bottlerocket update (#1434) * Updating node type from t2.small to t3.small * Decreased the amount of required nodes from 3 to 1 * update gatekeeper to V3.8 (#1427) Co-authored-by: Muhammad Mirza <[email protected]> * upgrade documentation for cluster upgrade (#1426) * upgrade documentation for cluster upgrade * fix cluster upgrade version numbers Co-authored-by: Muhammad Mirza <[email protected]> * Feature/cis benchmark update (#1428) * updated CIS-Benchmark for Kubernetes v.122 * fix version number Co-authored-by: Muhammad Mirza <[email protected]> * fixed wording, updated image version to AL2, updated UI screenshot to 2022 UI (#1439) * updated to use latest release of sealed secrets (#1432) * fixed deprecated versioning on SecretProviderClass (#1431) * upgrade karpenter version to compatible with eks 1.21 (#1437) * removed generator flag to avoid warning (#1438) Co-authored-by: Prakash Srinivasan <[email protected]> * Feature/eks 1.21 250cloudinsights (#1443) * Update http_data.md (#1436) * Add modified files for CI Co-authored-by: krish-kp <[email protected]> * Update basic-pod-limits.md (#1435) * Update basic-pod-limits.md Updated warning messages on deprecated flags * Update pod-priority.md As node groups are t3 small creating priority class with 1G memory doesn't create enough pod replicas to show the high/low priority class on the pod priority. Reducing to 128M is able to show pod movement from low to high priority. * Update advanced-pod-limits.md * Update resource-quota.md * Update prereqs.md Updated kubectl version on the output * EFS/CSI driver version for 1.21 and beyond is 1.3 (#1447) changing to kubectl apply -k "github.com/kubernetes-sigs/aws-efs-csi-driver/deploy/kubernetes/overlays/stable/?ref=release-1.3" Source : https://github.com/kubernetes-sigs/aws-efs-csi-driver * Update http_data.md (#1436) (#1449) * Update http_data.md * Update http_data.md Co-authored-by: krish-kp <[email protected]> * Updated image for data sources (#1451) * updated manifest challenge comment to match solution (#1452) * Minor changes to Advanced Batch (#1456) * Removed `and` from sentence to improve readability * Improved sentence for readability. * Fixed broken link Co-authored-by: krish-kp <[email protected]> * Update CustomResourceDefinition API version (#1455) * Update http_data.md (#1436) * Update CustomResourceDefinition API version Co-authored-by: krish-kp <[email protected]> Co-authored-by: Danilo Silva <[email protected]> * Update dashboard version (#1454) Update dashboard version from v2.0.0 to v2.2.0 as stated in the k8s 1.21 dash docs: https://v1-21.docs.kubernetes.io/docs/tasks/access-application-cluster/web-ui-dashboard/ * Update 260_weave_flux lab (#1462) * update 260_weave_flux lab * Cleanup 210_jenkins (#1463) * Update http_data.md (#1436) * Update http_data.md * Update http_data.md * Cleanup jenkins module as it's currently broken Co-authored-by: krish-kp <[email protected]> * upgrade and test istio to version 1.14.1 for 310_servicemesh_with_istio (#1459) * upgrade documentation for cluster upgrade * fix cluster upgrade version numbers * upgrade istio version to 1.14.x Co-authored-by: Muhammad Mirza <[email protected]> * Update kubeflow workshop (#1460) * EKS 1.21 kubeflow workshop update * update screenshots Co-authored-by: Pradhan <[email protected]> * 200 migrate to eks (#1466) * Update http_data.md (#1436) * Update http_data.md * Update http_data.md * Tested with k8s v1.21 and simplified instructions * Removed deletion of the cluster Co-authored-by: krish-kp <[email protected]> * Update to 1.21 (#1469) Co-authored-by: Sajjan AVS <[email protected]> * Updated screenshots and elasticsearch to opensearch (#1464) * Update setup_es.md Changed Elasticsearch to Opensearch * Added new screenshot with updated UI * Update image name * Delete the older version of the dashboard image * Update to 1.21 (#1470) * Krish kp patch 2 (#1473) Update supported CNI for v1.21 Co-authored-by: Sebastien <[email protected]> Co-authored-by: Saleem Mirza <[email protected]> Co-authored-by: Muhammad Mirza <[email protected]> Co-authored-by: Florian Dudouet <[email protected]> Co-authored-by: Shridhar <[email protected]> Co-authored-by: Prakash Srinivasan <[email protected]> Co-authored-by: Prakash Srinivasan <[email protected]> Co-authored-by: Jyothi Goudar <[email protected]> Co-authored-by: krish-kp <[email protected]> Co-authored-by: Ulrich B <[email protected]> Co-authored-by: pachelbel007 <[email protected]> Co-authored-by: rishigera <[email protected]> Co-authored-by: Tolu Okuboyejo <[email protected]> Co-authored-by: Danilo Souza <[email protected]> Co-authored-by: Danilo Silva <[email protected]> Co-authored-by: oussama-mechlaoui <[email protected]> Co-authored-by: jackchen <[email protected]> Co-authored-by: Sushant Pradhan <[email protected]> Co-authored-by: Pradhan <[email protected]> Co-authored-by: Naresh Dhiman <[email protected]> Co-authored-by: sajjanavs <[email protected]> Co-authored-by: Sajjan AVS <[email protected]> Co-authored-by: Praachee Gokhale <[email protected]>
1 parent f007ff1 commit d157f25

File tree

87 files changed

+964
-1322
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

87 files changed

+964
-1322
lines changed

content/020_prerequisites/k8stools.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ for the download links.](https://docs.aws.amazon.com/eks/latest/userguide/gettin
1717

1818
```bash
1919
sudo curl --silent --location -o /usr/local/bin/kubectl \
20-
https://amazon-eks.s3.us-west-2.amazonaws.com/1.19.6/2021-01-05/bin/linux/amd64/kubectl
20+
https://s3.us-west-2.amazonaws.com/amazon-eks/1.21.5/2022-01-21/bin/linux/amd64/kubectl
2121

2222
sudo chmod +x /usr/local/bin/kubectl
2323
```

content/030_eksctl/launcheks.md

+2-2
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,7 @@ If you do see the correct role, proceed to next step to create an EKS cluster.
3232
### Create an EKS cluster
3333

3434
{{% notice warning %}}
35-
`eksctl` version must be 0.38.0 or above to deploy EKS 1.19, [click here](/030_eksctl/prerequisites) to get the latest version.
35+
`eksctl` version must be 0.58.0 or above to deploy EKS 1.21, [click here](/030_eksctl/prerequisites) to get the latest version.
3636
{{% /notice %}}
3737

3838
Create an eksctl deployment file (eksworkshop.yaml) use in creating your cluster using the following syntax:
@@ -46,7 +46,7 @@ kind: ClusterConfig
4646
metadata:
4747
name: eksworkshop-eksctl
4848
region: ${AWS_REGION}
49-
version: "1.19"
49+
version: "1.21"
5050
5151
availabilityZones: ["${AZS[0]}", "${AZS[1]}", "${AZS[2]}"]
5252

content/advanced/310_servicemesh_with_istio/download.md

+2-2
Original file line numberDiff line numberDiff line change
@@ -8,11 +8,11 @@ draft: false
88
Before we can get started configuring Istio we’ll need to first install the command line tools that you will interact with. To do this run the following.
99

1010
{{% notice info %}}
11-
We will use istio version `1.10.0`
11+
We will use istio version `1.14.1`
1212
{{% /notice %}}
1313

1414
```bash
15-
echo 'export ISTIO_VERSION="1.10.0"' >> ${HOME}/.bash_profile
15+
echo 'export ISTIO_VERSION="1.14.1"' >> ${HOME}/.bash_profile
1616
source ${HOME}/.bash_profile
1717
```
1818

content/advanced/310_servicemesh_with_istio/introduction.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ draft: false
66
---
77

88
{{% notice info %}}
9-
This chapter has been updated to Istio 1.10.x
9+
This chapter has been updated to Istio 1.14.x
1010
[Click here](https://istio.io/latest/news/releases/1.10.x/) to know more about this new release.
1111
{{% /notice %}}
1212

content/advanced/410_batch/artifact.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -88,7 +88,7 @@ If `ROLE_NAME` is not set, please review: [/030_eksctl/test/](/030_eksctl/test/)
8888
ROLE_NAME is eksctl-eksworkshop-eksctl-nodegro-NodeInstanceRole-RPDET0Z4IJIF
8989
{{< /output >}}
9090

91-
Create and policy and attach to the worker node role.
91+
Create a policy and attach to the worker node role.
9292

9393
```bash
9494
cat <<EoF > ~/environment/batch_policy/k8s-s3-policy.json

content/advanced/410_batch/deploy.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ draft: false
77

88
### Deploy Argo Controller
99

10-
Argo run in its own namespace and deploys as a CustomResourceDefinition.
10+
Argo runs in its own namespace and deploys as a CustomResourceDefinition (CRD).
1111

1212
Deploy the Controller and UI.
1313

content/advanced/410_batch/workflow-simple.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@ EoF
2929
Now deploy the workflow using the argo CLI.
3030

3131
{{% notice note %}}
32-
You can also run workflow specs directly using kubectl but the argo CLI provides syntax checking, nicer output, and requires less typing. For the equivalent `kubectl` commands, see [Argo CLI](https://argoproj.github.io/docs/argo/examples/readme.html#argo-cli).
32+
You can also run workflow specs directly using kubectl but the argo CLI provides syntax checking, nicer output, and requires less typing. For the equivalent `kubectl` commands, see [Argo CLI](https://argoproj.github.io/argo-workflows/walk-through/argo-cli/#argo-cli).
3333
{{% /notice %}}
3434

3535
```bash

content/advanced/420_kubeflow/cleanup.md

+13-3
Original file line numberDiff line numberDiff line change
@@ -23,11 +23,21 @@ aws s3 rb s3://$S3_BUCKET --force --region $AWS_REGION
2323
kubectl delete secret/aws-secret
2424
kubectl delete secret/aws-secret -n kubeflow
2525
```
26-
Run these commands to uninstall Kubeflow from your EKS cluster
26+
Next, delete all existing Kubeflow profiles.
27+
28+
```bash
29+
kubectl get profile
30+
kubectl delete profile --all
2731
```
28-
cd ${KF_DIR}
29-
kfctl delete -V -f ${CONFIG_FILE}
32+
33+
You can delete a Kubeflow deployment by running the `kubectl delete` command on the manifest according to the deployment option you chose. For example, to delete a vanilla installation, run the following command:
34+
35+
```bash
36+
kustomize build deployments/vanilla/ | kubectl delete -f -
3037
```
38+
39+
This command assumes that you have the repository in the same state as when you installed Kubeflow.
40+
3141
Scale the cluster back to previous size
3242
```
3343
eksctl scale nodegroup --cluster eksworkshop-eksctl --name $NODEGROUP_NAME --nodes 3

content/advanced/420_kubeflow/dashboard.md

+4-6
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Kubeflow Dashboard"
3-
date: 2019-08-22T00:00:00-08:00
3+
date: 2022-07-16T00:00:00-08:00
44
weight: 20
55
draft: false
66
---
@@ -18,12 +18,10 @@ Leave the current terminal running because if you kill the process, you will loo
1818

1919
![dashboard](/images/kubeflow/dashboard-welcome.png)
2020

21-
Click on **Start Setup**
21+
In the login screen, use the default email (`[email protected]`) and password (`12341234`)
2222

23-
Specify the namespace as **eksworkshop**
23+
![dashboard](/images/kubeflow/dashboard-login.png)
2424

25-
![dashboard](/images/kubeflow/dashboard-create-namespace.png)
26-
27-
Click on **Finish** to view the dashboard
25+
After logging in, you will be redirected to the Kubeflow dashboard screen:
2826

2927
![dashboard](/images/kubeflow/dashboard-first-look.png)

content/advanced/420_kubeflow/fairing.md

+8-1
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Fairing"
3-
date: 2019-11-13T21:55:32-05:00
3+
date: 2022-07-16T00:00:00-08:00
44
weight: 60
55
pre: '<i class="fa fa-film" aria-hidden="true"></i> '
66
draft: false
@@ -36,6 +36,8 @@ Create new Python 3 Notebook if one doesn't exist. Run the command below to clon
3636
```
3737
Click Run. This will clone the repo into your notebook server
3838

39+
![dashboard](/images/kubeflow/fairing-git-clone.png)
40+
3941
Close the notebook tab, go back to the notebook server, select the notebook that we just used and click **Shutdown**.
4042

4143
![dashboard](/images/kubeflow/fairing-shutdown-notebook.png)
@@ -54,6 +56,7 @@ Review the content and click first cell and click **Run**. This will let you ins
5456

5557
Wait till it finishes, go to next cell and click **Run**. Here is expected result
5658
![dashboard](/images/kubeflow/fairing-install-from-github.png)
59+
![dashboard](/images/kubeflow/fairing-validate-installed-packages.png)
5760

5861
Now that we have fairing installed, we will train a model authored in Python. The model will create a linear regression model that allows us to learn a function or relationship from a given set of continuous data. For example, we are given some data points of x and corresponding y and we need to learn the relationship between them that is called a hypothesis.
5962

@@ -66,9 +69,13 @@ Now, lets use fairing and push the image into ECR which can be used for remote t
6669

6770
Before you run authenticate with ECR, change the region if needed. Run this cell and login so that you can perform ECR operations
6871

72+
![dashboard](/images/kubeflow/fairing-ecr-login.png)
73+
6974
Run the next cell and create an ECR repository (fairing-job) in the same region. You should see similar output
75+
7076
![dashboard](/images/kubeflow/fairing-create-ecr-repo.png)
7177

78+
7279
Let's run next cell. Fairing pushes the image to ECR and then deploys the model remotely
7380

7481
![dashboard](/images/kubeflow/fairing-remote-job.png)

0 commit comments

Comments
 (0)