incubator/spring-cloud-data-flow/README.md
NOTE: This chart has been DEPRECATED. Please use stable/spring-cloud-data-flow.
Spring Cloud Data Flow is a toolkit for building data integration and real-time data processing pipelines.
Pipelines consist of Spring Boot apps, built using the Spring Cloud Stream or Spring Cloud Task microservice frameworks. This makes Spring Cloud Data Flow suitable for a range of data processing use cases, from import/export to event streaming and predictive analytics.
This chart will provision a fully functional and fully featured Spring Cloud Data Flow installation that can deploy and manage data processing pipelines in the cluster that it is deployed to.
MySQL and Redis are used as the stores for Spring Cloud Data Flow state and RabbitMQ is used for the pipelines' messaging layer.
For more information on Spring Cloud Data Flow and its capabilities, see it's documentation.
Assumes that serviceAccount credentials are available so the deployed Data Flow server can access the API server (Works on GKE and Minikube by default). See Configure Service Accounts for Pods
To install the chart with the release name my-release:
$ helm install --name my-release incubator/spring-cloud-data-flow
If you are using a cluster that does not have a load balancer (like Minikube) then you can install using a NodePort:
$ helm install --name my-release --set server.service.type=NodePort incubator/spring-cloud-data-flow
Note that this chart pulls in many different Docker images so can take a while to fully install.
The following tables list the configurable parameters and their default values.
| Parameter | Description | Default |
|---|---|---|
| rbac.create | Create RBAC configurations | true |
| Parameter | Description | Default |
|---|---|---|
| serviceAccount.create | Create ServiceAccount | true |
| serviceAccount.name | ServiceAccount name | (generated if not specified) |
| Parameter | Description | Default |
|---|---|---|
| dataflowUsername | The username for the primary user | user |
| dataflowPassword | The password for the primary user | password |
| dataflowRoles | The roles assigned to the primary user | ROLE_VIEW, ROLE_CREATE |
| dataflowAdminUsername | The username for the admin user | admin |
| dataflowAdminPassword | The password for the admin user | admin |
| dataflowAdminRoles | The roles assigned to the admin user | ROLE_MANAGE, ROLE_VIEW |
| Parameter | Description | Default |
|---|---|---|
| server.version | The version/tag of the Data Flow server | 1.6.2.RELEASE |
| server.imagePullPolicy | The imagePullPolicy of the Data Flow server | IfNotPresent |
| server.service.type | The service type for the Data Flow server | LoadBalancer |
| server.service.externalPort | The external port for the Data Flow server | 80 |
| Parameter | Description | Default |
|---|---|---|
| skipper.version | The version/tag of the Skipper server | 1.0.9.RELEASE |
| skipper.imagePullPolicy | The imagePullPolicy of the Skipper server | IfNotPresent |
| skipper.platformName | The name of the configured platform account | minikube |
| skipper.service.type | The service type for the Skipper server | ClusterIP |
| Parameter | Description | Default |
|---|---|---|
| metrics.version | The version/tag of the Metrics server | 2.0.0.RELEASE |
| metrics.imagePullPolicy | The imagePullPolicy of the Metrics server | IfNotPresent |
| metrics.service.type | The service type for the Metrics server | ClusterIP |
| Parameter | Description | Default |
|---|---|---|
| deployer.resourceLimits.cpu | Deployer resource limit for cpu | 500m |
| deployer.resourceLimits.memory | Deployer resource limit for memory | 1024Mi |
| deployer.readinessProbe.initialDelaySeconds | Deployer readiness probe initial delay | 120 |
| deployer.livenessProbe.initialDelaySeconds | Deployer liveness probe initial delay | 90 |
| Parameter | Description | Default |
|---|---|---|
| rabbitmq.rabbitmqUsername | RabbitMQ user name | user |
| Parameter | Description | Default |
|---|---|---|
| mysql.mysqlDatabase | MySQL database name | dataflow |