Skip to content

TODO

Here comes a list of things to touch upon at some point during the Scala Academy. Consider it a scrapbook.

  1. Testcontainers

Introduction to Cloudera Enterprise 6.3

Read the following documents. Get familiar with the basics.

  1. Overview of Cloudera and the Cloudera Documentation Set
  2. CDH Overview
  3. Cloudera Manager Overview
  4. (optional) Cluster Management

Important

From Cloudera Community Forum:

We currently don't support any docker-based sandbox/quickstart clusters. The one available in GitHub is of a very old CDH version.

Exercises: Spark on minikube

  1. Demo: Running Spark Structured Streaming on minikube
  2. Demo: Spark and Local Filesystem in minikube

Exercise: HorizontalPodAutoscaler Walkthrough

HorizontalPodAutoscaler Walkthrough

Deployments in Kubernetes

Read Deployments.

(optional) Exercise: Kafka Streams on minikube

This is a fairly challenging (hard?) exercise and hence optional. It should help you understand how to scale applications up and down but more importantly how to deploy a Kafka application that consumes records from a Kafka cluster on minikube (if possible) or outside minikube.

Scaling up and down a Kafka Streams application on minikube.

  1. Create a Kafka Streams application
  2. Deploy it to Kubernetes (minikube)

The main challenge is to set up a Kafka cluster so it is accessible to the Kafka Streams application.

Back to top