MSK
Kubemq MSK target connector allows services using kubemq server to store messages on MSK specific topics.

Prerequisites

The following are required to run the redis target connector:
  • kubemq cluster
  • MSK set up in aws
  • kubemq-targets deployment

Configuration

MSK source connector configuration properties:
Properties Key
Required
Description
Example
brokers
yes
MSK brokers connection, comma separated
"localhost:9092"
topic
yes
MSK stored topic
"TestTopic"
consumerGroup
yes
MSK consumer group name
"Group1
saslUsername
no
SASL based authentication with broker
"user"
saslPassword
no
SASL based authentication with broker
"pass"
Example:
1
bindings:
2
- name: kubemq-query-msk
3
source:
4
kind: kubemq.query
5
name: kubemq-query
6
properties:
7
address: "kubemq-cluster:50000"
8
client_id: "kubemq-query-msk-connector"
9
auth_token: ""
10
channel: "query.MSK"
11
group: ""
12
auto_reconnect: "true"
13
reconnect_interval_seconds: "1"
14
max_reconnects: "0"
15
target:
16
kind: aws.msk
17
name: aws-msk
18
properties:
19
brokers: "localhost:9092"
20
topic: "TestTopic"
Copied!

Usage

Get Request

Get request metadata setting:
Metadata Key
Required
Description
Possible values
key
yes
MSK message key base64
"a2V5"
headers
no
MSK message headers Key Value base64
[{"Key": "ZG9n","Value": "bWV0YTE="}]
Example:
1
{
2
"metadata": {
3
"key": "a2V5",
4
"headers": [{"Key": "ZG9n","Value": "bWV0YTE="}]
5
},
6
"data": null
7
}
Copied!
Last modified 11mo ago