FlowMagic NextIO Components · Version 26.3

FlowMagic Message Broker Services

Reference for FlowMagic IPFIX data diode, Kafka, and syslog message components.

UI Path: NextIO Diagram EditorComponentsMessage Broker Services ID: nextio-flowmagic-message-broker

Use these components to receive and send IPFIX, Kafka, or syslog messages as part of a NextIO service.

Component Reference

Match transport, endpoint, topic, and message-format settings with the system on the other end of each connection.

NextIO message broker service components This page documents 5 components in the Message Broker Services palette group.

For the shared Name, Notes, display, and pad-editing controls, see Common Component Properties.

IPFIX Data Diode
Kafka Msg Broker
Kafka Msg Sender
Syslog Msg Broker
Syslog Msg Sender

IPFIX Data Diode

IPFIX Data Diode component icon

Forwards IPFIX records through a one-way TCP-to-UDP service path.

Connection	Initial count	Initial pad names	Allowed count	Properties panel
Input	1	1	1	Hidden (fixed)
Output	1	1	1	Hidden (fixed)

Configuration Reference

TCP Listening Port — TCP listening Port Initial value:

8088.

Enable UDP VLAN — Enable UDP VLAN Tag Initial value:

Disabled.

UDP VLAN ID — UDP VLAN ID Initial value:

2022.

UDP Source IP — UDP Source IP Initial value:

Required.

UDP Destination IP — UDP destination IP Initial value:

Required.

UDP Destination Port — UDP destination Port Initial value:

8088.

UDP MTU — UDP MTU to use Initial value:

1522.

Frame Format — Optimized for the framing structure Initial value:

ipfix.

Max TCP Conn. — Maximum incoming TCP connections Initial value:

2048.

Buffer (MB) — Max TCP to UDP conversion buffer measured in MB Initial value:

32.

IPFIX Data Diode properties panel in the NextIO Service Editor — IPFIX Data Diode properties panel

Back to component list

Kafka Msg Broker

Kafka Msg Broker component icon

Kafka Message Broker

Connection	Initial count	Initial pad names	Allowed count	Properties panel
Input	1	1	1	Hidden (fixed)
Output	1	1	1	Hidden (fixed)

Configuration Reference

Listen IP — Kafka listener bind IP; 0.0.0.0 binds all local addresses in the connected OS Port namespace Initial value:

0.0.0.0.

Listen Port — Kafka listener TCP port Initial value:

9092.

Advertised Host — Host name or IP returned in Kafka metadata; empty uses the OS Port IP Initial value:

not set.

Advertised Port — Port returned in Kafka metadata Initial value:

9092.

Topic — First-release Logstash topic to accept; empty allows the topic policy to decide Initial value:

not set.

Topic Policy — JSON topic allow-list or auto-create policy Initial value:

{"allow":[],"auto_create":true}.

Security Protocol — Kafka listener security protocol Initial value:

SASL over SSL.

Client Trust Certificates — CA certificates used to validate client certificates Initial value:

Configured in the editor.

Server TLS Identity — Server certificate chain and matching private key Initial value:

Configured in the editor.

SASL Mechanisms — SASL mechanisms enabled on the listener Initial value:

SCRAM SHA 256.

SCRAM Users — SCRAM usernames and passwords Initial value:

None.

PLAIN Users — PLAIN usernames and passwords Initial value:

None.

Max Connections — Maximum concurrent Logstash client connections Initial value:

1024.

Listen Backlog — TCP listen backlog Initial value:

1024.

Worker Queue Depth — Internal decoded-message queue depth Initial value:

4096.

Message Mbuf Size — Contiguous mbuf data-room size used for decoded Kafka messages Initial value:

1048576.

Message Mbuf Pool — Private mbuf pool size in MB for decoded Kafka messages Initial value:

4096.

Kafka Msg Broker properties panel in the NextIO Service Editor — Kafka Msg Broker properties panel

Back to component list

Kafka Msg Sender

Kafka Msg Sender component icon

Kafka Message Sender

Connection	Initial count	Initial pad names	Allowed count	Properties panel
Input	1	1	1	Hidden (fixed)
Output	1	1	1	Hidden (fixed)

Configuration Reference

Bootstrap Servers — Destination Kafka bootstrap servers Initial value:

Required.

Client ID — Kafka producer client ID Initial value:

nextio-kafka-msg-sender.

Bind IP Addr — Optional local IP address for Kafka producer sockets; empty uses OS routing in the connected OS Port namespace Initial value:

not set.

Security Protocol — Destination Kafka security protocol Initial value:

SASL over SSL.

SASL Mechanism — Destination Kafka SASL mechanism Initial value:

SCRAM-SHA-256.

SASL Username — Destination Kafka SASL username Initial value:

not set.

SASL Password — Destination Kafka SASL password Initial value:

not set.

SASL JAAS Config — Optional JAAS-style SASL configuration content Initial value:

not set.

Server Trust Certificates — CA certificates used to validate the remote Kafka server Initial value:

Configured in the editor.

Client TLS Identity — Optional client certificate chain and matching private key Initial value:

Configured in the editor.

Message Max Bytes — Maximum producer record size Initial value:

1048576.

Queue Max Messages — librdkafka queue.buffering.max.messages Initial value:

100000.

Queue Max KBytes — librdkafka queue.buffering.max.kbytes Initial value:

1048576.

Linger MS — librdkafka linger.ms Initial value:

0.

Delivery Report — Enable librdkafka delivery report callback Initial value:

Disabled.

Kafka Msg Sender properties panel in the NextIO Service Editor — Kafka Msg Sender properties panel

Back to component list

Syslog Msg Broker

Syslog Msg Broker component icon

Syslog Message Broker

Connection	Initial count	Initial pad names	Allowed count	Properties panel
Input	1	1	1	Hidden (fixed)
Output	1	1	1	Hidden (fixed)

Configuration Reference

Listeners — Repeatable Syslog listener definitions Initial value:

udp-514.

Client CA PEM — CA certificates used to validate Syslog TLS clients Initial value:

not set.

Server Cert PEM — Syslog TLS server certificate Initial value:

not set.

Server Key PEM — Syslog TLS server private key Initial value:

not set.

Client Authentication — TLS client certificate policy Initial value:

none.

Minimum TLS Version — Minimum accepted TLS protocol version Initial value:

1.2.

Max Message Size — Maximum Syslog message body accepted after framing Initial value:

8192.

Parse Mode — Primary Syslog message parser Initial value:

auto.

Tolerant Parsing — Salvage common non-standard RFC 3164/5424 messages before raw fallback Initial value:

Enabled.

Invalid Message Policy — Forward or drop messages that require raw fallback Initial value:

pass.

Payload Parsers — Optional message-body decoders Initial value:

4 configured items.

Hash Raw Evidence — Compute SHA-256 of each immutable raw message Initial value:

Disabled.

Severity Filter — Enable severity filtering after parsing Initial value:

Disabled.

Severity Filter Mode — Allow or drop selected severities Initial value:

allow.

Severity Values — Severities used by the enabled filter Initial value:

1 configured item.

Facility Filter — Enable facility filtering after parsing Initial value:

Disabled.

Facility Filter Mode — Allow or drop selected facilities Initial value:

allow.

Facility Values — Facilities used by the enabled filter Initial value:

1 configured item.

Redaction Rules — Ordered RE2 rules used to construct a separate delivery message Initial value:

None.

Output Payload — Bytes handed to the NextIO/Data Diode path Initial value:

original.

Ingress Queue Depth — Maximum normalized records awaiting dispatch Initial value:

8192.

Output Queue Depth — Maximum records awaiting NextIO batch handoff Initial value:

8192.

Batch Records — Maximum records per Go-to-C handoff Initial value:

64.

Batch Bytes — Target maximum bytes per Go-to-C handoff Initial value:

1048576.

Batch Delay — Maximum batching delay in milliseconds Initial value:

2.

Message Mbuf Pool — Private NextIO message-body pool in MB Initial value:

64.

Syslog Msg Broker properties panel in the NextIO Service Editor — Syslog Msg Broker properties panel

Back to component list

Syslog Msg Sender

Syslog Msg Sender component icon

Syslog Message Sender

Connection	Initial count	Initial pad names	Allowed count	Properties panel
Input	1	1	1	Hidden (fixed)
Output	1	1	1	Hidden (fixed)

Configuration Reference

Transport — Destination Syslog transport Initial value:

udp.

Destination IP — Destination Syslog receiver IP address Initial value:

Required.

Destination Port — Destination Syslog receiver port; use 6514 explicitly for standard Syslog over TLS Initial value:

514.

Source IP — Optional local source IP; empty uses OS routing in the connected OS Port namespace Initial value:

not set.

Source Port — Optional local source port; 0 lets the OS choose Initial value:

0.

Socket TX Buffer — Socket send buffer bytes; 0 uses the operating-system default Initial value:

0.

Output Format — Preserve the exact body or convert parsed fields to a destination format Initial value:

preserve.

TCP/TLS Framing — RFC 6587 framing; octet counting is the recommended default Initial value:

Octet counted.

Default PRI — PRI used when converting a message without a valid priority Initial value:

13.

Default Hostname — Hostname used during conversion when the source field is absent Initial value:

not set.

Default App Name — Application name used during conversion when the source field is absent Initial value:

not set.

RFC 3164 Timezone — Timezone used for RFC 3164 output timestamps Initial value:

UTC.

Max Message Size — Maximum input and rendered Syslog message body size Initial value:

8192.

Server CA PEM — Optional trusted CA certificates; empty uses system trust roots Initial value:

not set.

Client Cert PEM — Optional client certificate for mutual TLS Initial value:

not set.

Client Key PEM — Optional client private key for mutual TLS Initial value:

not set.

TLS Server Name — Certificate name to verify; empty verifies the destination IP Initial value:

not set.

Minimum TLS Version — Minimum accepted TLS protocol version Initial value:

1.2.

Connect Timeout — TCP/TLS connect and TLS handshake timeout in milliseconds Initial value:

5000.

Send Timeout — Socket write timeout in milliseconds Initial value:

1000.

Initial Reconnect — Initial TCP/TLS reconnect delay in milliseconds Initial value:

100.

Maximum Reconnect — Maximum TCP/TLS reconnect delay in milliseconds Initial value:

5000.

TCP Keepalive — TCP keepalive period in seconds; 0 disables sender configuration Initial value:

30.

Sender Queue Depth — Bounded queue between gRPC admission and destination output Initial value:

8192.

Bridge Batch Records — Maximum SWQ messages copied in one C-to-Go call Initial value:

64.

Bridge Batch Bytes — Reusable SWQ-to-gRPC batch arena size Initial value:

1048576.

Idle Poll Delay — SWQ bridge wait in microseconds when no message is available Initial value:

50.

gRPC Max Message — Maximum internal gRPC request/response size; keep above bridge batch bytes Initial value:

4194304.

gRPC Batch Timeout — Internal UDS batch call timeout in milliseconds Initial value:

5000.

Compute Resources — Allocate compute resource for the service Initial value:

1 configured item.

Syslog Msg Sender properties panel in the NextIO Service Editor — Syslog Msg Sender properties panel

Back to component list