In this section we will show you how to set up a Kafka Connection Manager to access an Apache Kafka broker.
Configure Basic connectivity settings
- Once the connection manager dialog opens in General tab enter Broker Server(s).
The value would look like:
- Enter Authentication.
- Select SASL SSL for Security Protocol .
- Select Plain for SASL Mechanism.
- Enter Username.
- Enter Password.
Configure Advanced connectivity settings
- In tab Advanced tab enter Additional Options. The syntax of Additional Options is
name=value1[;name2=value2]...[;nameN=valueN]. The value would look like:
reconnect.backoff.ms=1000;retry.backoff.ms=50.You can see available options in Available Options text field.
Congratulations! You have successfully configured a Kafka Connection Manager.
Use the General page of the Kafka Connection Manager dialog to specify properties for connecting to the Kafka broker
The broker server name(s) and an optional port (default is 9092) using the syntax
localhost:9092). When connecting to bootstrap servers set, its members should be enumerated like this:
The security protocol:
Value Description Plaintext Don't use any authentication or encryption method. SSL Authenticate via SSL certificate SASL Plaintext Authenticate by unencrypted username and password. SASL SSL Authenticate with a username and password that are encrypted with an SSL certificate.
The SASL mechanism:
Value Description GSSAPI Use Generic Security Service Application Program Interface. Plain Use unencrypted authentication mechanism SCRAM-SHA-256 Use Salted Challenge Response Authentication Mechanism with SHA-256 encryption. SCRAM-SHA-512 Use Salted Challenge Response Authentication Mechanism with SHA-512 encryption. OAuth Bearer Use OAuth 2 Authorization Framework.
The username to authenticate with (SASL Plaintext, SASL SSL security protocol when using Plain, SCRAM-SHA-256, SCRAM-SHA-512 SASL mechanism).
The password to authenticate with (SASL Plaintext, SASL SSL security protocol when using Plain, SCRAM-SHA-256, SCRAM-SHA-512 SASL mechanism).
Specify whether to check for certificate revocation
The path to the client certificate file (usually *.PFX)
The passphrase for the client certificate
Тhe timeout to attempt a connection before timing out.
Use the Advanced page of the Kafka Connection Manager dialog to specify advanced options
Specify additional connection options, when necessary, via the syntax:
name=value1[&name2=value2]...[&nameN=valueN]. Refer to Kafka documentation for detailed explanation of each option.
- New: Introduced connection.
Ready to give it a try?
COZYROC SSIS+ Components Suite is free for testing in your development environment.