ContextQMD
Back to Ntopng

Collecting nProbe Flows Using Kafka

doc/src/flow_dump/kafka/collect_flows.rst

6.61.1 KB
Original Source

.. _KafkaFlowcollection:

Collecting nProbe Flows Using Kafka

Similar to ZMQ, you can use Kafka to collect flows exported by nProbe. In order to do this you can specify kafka://<broker>[;<topic>;<options>] or kafka-ssl://<broker>[;<topic>;<options>] depending if you use plain text or SSL/TLS connections to the Kafka broker. As usual you can specify multiple brokers IP (and ports) by splitting them with a comma (,).

Example

Below you can find some examples:

  • Collect flows sent by nProbe to Kafka broker active on 127.0.0.1 on the default port (9092). Use: :code:-i kafka://127.0.0.1
  • Collect flows sent by nProbe to Kafka brokers 127.0.0.1:7689, 192.168.1.20:9092 and 192.168.1.2:909. Use: :code:-i kafka://127.0.0.1:7689,192.168.1.20:9092,192.168.1.2:9092

.. note::

Topic names cannot be changed in ntopng/nProbe.
Please make sure that the topics are created on the kafka broker before exporting data. See `Kafka docs <https://kafka.apache.org/quickstart>`_ for more information abotu Kafka configuration.