ContextQMD
Back to Gitlabhq

Use Auto DevOps to deploy an application to Amazon Elastic Kubernetes Service (EKS)

doc/topics/autodevops/cloud_deployments/auto_devops_with_eks.md

18.11.213.5 KB
Original Source

This tutorial gets you started with Auto DevOps using an example of how to deploy an application to Amazon Elastic Kubernetes Service (EKS).

The tutorial uses the GitLab native Kubernetes integration, so you don't need to create a Kubernetes cluster manually using the AWS console.

You can also follow this tutorial on a GitLab Self-Managed instance. Ensure your own runners are configured.

To deploy a project to EKS:

  1. Configure your Amazon account
  2. Create a Kubernetes cluster and deploy the agent
  3. Create a new project from a template
  4. Configure the agent
  5. Install Ingress
  6. Configure Auto DevOps
  7. Enable Auto DevOps and run the pipeline
  8. Deploy the application

Configure your Amazon account

Before you create and connect your Kubernetes cluster to your GitLab project, you need an Amazon Web Services account. Sign in with an existing Amazon account or create a new one.

Create a Kubernetes cluster

To create a new cluster on Amazon EKS:

If you prefer, you can also create a cluster manually using eksctl.

Create an application project from a template

Use a GitLab project template to get started. As the name suggests, those projects provide a bare-bones application built on some well-known frameworks.

[!warning] Create the application project in the group hierarchy at the same level or below the project for cluster management. Otherwise, it fails to authorize the agent.

  1. In the upper-right corner, select Create new ({{< icon name="plus" >}}) and New project/repository.
  2. Select Create from template.
  3. Select the Ruby on Rails template.
  4. Give your project a name, optionally a description, and make it public so that you can take advantage of the features available in the GitLab Ultimate plan.
  5. Select Create project.

Now you have an application project to deploy to the EKS cluster.

Configure the agent

Next, configure the GitLab agent for Kubernetes so you can use it to deploy the application project.

  1. Go to the project you created to manage the cluster.
  2. Go to the agent configuration file (.gitlab/agents/eks-agent/config.yaml) and edit it.
  3. Configure ci_access:projects attribute. Use the application project path as id:
yaml
ci_access:
  projects:
    - id: path/to/application-project

Install Ingress

After your cluster is running, you must install NGINX Ingress Controller as a load balancer to route traffic from the internet to your application. Install the NGINX Ingress Controller through the GitLab Cluster management project template, or manually using the command line:

  1. Ensure you have kubectl and Helm installed on your machine.

  2. Create an IAM role to access the cluster.

  3. Create an access token to access the cluster.

  4. Use kubectl to connect to your cluster:

    shell
    helm upgrade --install ingress-nginx ingress-nginx \
--repo https://kubernetes.github.io/ingress-nginx \
--namespace gitlab-managed-apps --create-namespace

# Check that the ingress controller is installed successfully
kubectl get service ingress-nginx-controller -n gitlab-managed-apps

Configure Auto DevOps

Follow these steps to configure the base domain and other settings required for Auto DevOps.

  1. A few minutes after you install NGINX, the load balancer obtains an IP address, and you can get the external IP address with the following command:

    shell
    kubectl get all -n gitlab-managed-apps --selector app.kubernetes.io/instance=ingress-nginx

    Replace gitlab-managed-apps if you have overwritten your namespace.

    Next, find the actual external IP address for your cluster with the following command:

    shell
    nslookup [External IP]

    Where the [External IP] is the hostname found with the previous command.

    The IP address might be listed in the Non-authoritative answer: section of the response.

    Copy this IP address, as you need it in the next step.

  2. Go back to the application project.

  3. In the left sidebar, select Settings > CI/CD and expand Variables.

    • Add a key called KUBE_INGRESS_BASE_DOMAIN with the application deployment domain as the value. For this example, use the domain <IP address>.nip.io.
    • Add a key called KUBE_NAMESPACE with a value of the Kubernetes namespace for your deployments to target. You can use different namespaces per environment. Configure the environment, use the environment scope.
    • Add a key called KUBE_CONTEXT with a value like path/to/agent/project:eks-agent. Select the environment scope of your choice.
    • Select Save changes.

Enable Auto DevOps and run the pipeline

While Auto DevOps is enabled by default, Auto DevOps can be disabled for the entire instance (for GitLab Self-Managed instances) and for individual groups. Complete these steps to enable Auto DevOps if it's disabled:

  1. In the top bar, select Search or go to and find the application project.

  2. Select Settings > CI/CD.

  3. Expand Auto DevOps.

  4. Select Default to Auto DevOps pipeline to display more options.

  5. In Deployment strategy, select your desired continuous deployment strategy to deploy the application to production after the pipeline successfully runs on the default branch.

  6. Select Save changes.

  7. Edit .gitlab-ci.yml file to include the Auto DevOps template and commit the change to the default branch:

    yaml
    include:
- template: Auto-DevOps.gitlab-ci.yml

The commit should trigger a pipeline. The next section explains what each job does in the pipeline.

Deploy the application

When your pipeline runs, what is it doing?

To view the jobs in the pipeline, select the pipeline's status badge. The {{< icon name="status_running" >}} icon displays when pipeline jobs are running, and updates without refreshing the page to {{< icon name="status_success" >}} (for success) or {{< icon name="status_failed" >}} (for failure) when the jobs complete.

The jobs are separated into stages:

  • Build - The application builds a Docker image and uploads it to your project's Container Registry (Auto Build).

  • Test - GitLab runs various checks on the application, but all jobs except test are allowed to fail in the test stage:

    • The test job runs unit and integration tests by detecting the language and framework (Auto Test)
    • The code_quality job checks the code quality and is allowed to fail (Auto Code Quality)
    • The container_scanning job checks the Docker container if it has any vulnerabilities and is allowed to fail (auto container scanning)
    • The dependency_scanning job checks if the application has any dependencies susceptible to vulnerabilities and is allowed to fail (Auto dependency scanning)
    • Jobs suffixed with -sast run static analysis on the current code to check for potential security issues, and are allowed to fail (Auto SAST)
    • The secret-detection job checks for leaked secrets and is allowed to fail (auto secret detection)

  • Review - Pipelines on the default branch include this stage with a dast_environment_deploy job. To learn more, see dynamic application security testing (DAST).

  • Production - After the tests and checks finish, the application deploys in Kubernetes (Auto Deploy).

  • Performance - Performance tests are run on the deployed application (Auto Browser Performance Testing).

  • Cleanup - Pipelines on the default branch include this stage with a stop_dast_environment job.

After running a pipeline, you should view your deployed website and learn how to monitor it.

Monitor your project

After successfully deploying your application, you can view its website and check on its health on the Environments page by navigating to Operate > Environments. This page displays details about the deployed applications, and the right-hand column displays icons that link you to common environment tasks:

  • Open live environment ({{< icon name="external-link" >}}) - Opens the URL of the application deployed in production
  • Monitoring ({{< icon name="chart" >}}) - Opens the metrics page where Prometheus collects data about the Kubernetes cluster and how the application affects it in terms of memory usage, CPU usage, and latency
  • Deploy to ({{< icon name="play" >}} {{< icon name="chevron-lg-down" >}}) - Displays a list of environments you can deploy to
  • Terminal ({{< icon name="terminal" >}}) - Opens a web terminal session inside the container where the application is running
  • Re-deploy to environment ({{< icon name="repeat" >}}) - For more information, see Retrying and rolling back
  • Stop environment ({{< icon name="stop" >}}) - For more information, see Stopping an environment

GitLab displays the deploy board below the environment's information, with squares representing pods in your Kubernetes cluster, color-coded to show their status. Hovering over a square on the deploy board displays the state of the deployment, and selecting the square takes you to the pod's logs page.

Although the example shows only one pod hosting the application at the moment, you can add more pods by defining the REPLICAS CI/CD variable in Settings > CI/CD > Variables.

Work with branches

Next, create a feature branch to add content to your application:

  1. In your project's repository, go to the following file: app/views/welcome/index.html.erb. This file should only contain a paragraph: <p>You're on Rails!</p>.

  2. Open the GitLab Web IDE to make the change.

  3. Edit the file so it contains:

    html
    <p>You're on Rails! Powered by GitLab Auto DevOps.</p>

  4. Stage the file. Add a commit message, then create a new branch and a merge request by selecting Commit.

After submitting the merge request, GitLab runs your pipeline, and all the jobs in it, as described previously, in addition to a few more that run only on branches other than the default branch.

After a few minutes a test fails, which means a test was 'broken' by your change. Select the failed test job to see more information about it:

plaintext
Failure:
WelcomeControllerTest#test_should_get_index [/app/test/controllers/welcome_controller_test.rb:7]:
<You're on Rails!> expected but was
<You're on Rails! Powered by GitLab Auto DevOps.>..
Expected 0 to be >= 1.

bin/rails test test/controllers/welcome_controller_test.rb:4

To fix the broken test:

  1. Return to your merge request.
  2. In the upper-right corner, select Code, then select Open in Web IDE.
  3. In the left-hand directory of files, find the test/controllers/welcome_controller_test.rb file, and select it to open it.
  4. Change line 7 to say You're on Rails! Powered by GitLab Auto DevOps.
  5. In the left sidebar, select Source Control ({{< icon name="merge" >}}).
  6. Write a commit message, and select Commit.

Return to the Overview page of your merge request, and you should not only see the test passing, but also the application deployed as a review application. You can visit it by selecting the View app {{< icon name="external-link" >}} button to see your changes deployed.

After merging the merge request, GitLab runs the pipeline on the default branch, and then deploys the application to production.

Conclusion

After implementing this project, you should have a solid understanding of the basics of Auto DevOps. You started from building and testing, to deploying and monitoring an application all in GitLab. Despite its automatic nature, Auto DevOps can also be configured and customized to fit your workflow. Here are some helpful resources for further reading:

  1. Auto DevOps
  2. Multiple Kubernetes clusters
  3. Incremental rollout to production
  4. Disable jobs you don't need with CI/CD variables
  5. Use your own buildpacks to build your application