Back to Arkime

Build

capture/plugins/kafka/README.md

6.3.11.1 KB
Original Source

Kafka Write Plugin

The kafka writer plugin sends the SPI to Kafka instead of Elasticsearch.

Please note that communication to Elasticsearch is still needed, for the stats and other housekeeping tasks.

Build

./easybutton-build.sh --kafka

Configure

The table below list all the possible configuration option of the kafka plugin.

PropertyDetailsExample
kafkaBootstrapServersbootstrap servers, comma separated, to connect to1.2.3.4:9020,5.6.7.8:9020
kafkaTopictopic to send the SPI toarkime-spi
kafkaSSLwhether to enable SSL security protocoltrue
kafkaSSLCALocationpath where the SSL CA is located/path/to/ca.crt
kafkaSSLCertificateLocationpath where the SSL client certificate is located/path/to/client.crt
kafkaSSLKeyLocationpath where the SSL client key is located/path/to/client.key
kafkaSSLKeyPasswordoptional password for the client key
kafkaMsgFormathow to send the SPI data: bulk (default, raw bulk msg), bulk1 (bulk formatted, but just 1 doc), doc (just the doc)bulk