Kubemq kinesis target connector allows services using kubemq server to access aws kinesis service.
Prerequisites
The following required to run the aws-kinesis target connector:
aws account with kinesis active service
Configuration
sns target connector configuration properties:
Example:
bindings:
- name: kubemq-query-aws-kinesis
source:
kind: kubemq.query
name: kubemq-query
properties:
address: "kubemq-cluster:50000"
client_id: "kubemq-query-aws-kinesis"
auth_token: ""
channel: "query.aws.kinesis"
group: ""
auto_reconnect: "true"
reconnect_interval_seconds: "1"
max_reconnects: "0"
target:
kind: aws.kinesis
name: aws-kinesis
properties:
aws_key: "id"
aws_secret_key: 'json'
region: "region"
token: ""
Usage
List Streams
list kinesis streams
List Streams:
Example:
{
"metadata": {
"method": "list_streams"
},
"data": null
}
List Stream Consumers
list kinesis Stream Consumers.
List Stream Consumers:
Example:
{
"metadata": {
"method": "list_stream_consumers",
"stream_arn": "arn::mystream"
},
"data": null
}
Create Stream
Create a kinesis Stream.
Create Stream:
Example:
{
"metadata": {
"method": "create_stream",
"stream_name": "my_stream",
"shard_count": "1"
},
"data": null
}
List Shards
list stream Shards .
List Shards:
Example:
{
"metadata": {
"method": "list_shards",
"stream_name": "my_stream"
},
"data": null
}
Get Shard Iterator
Get Shard Iterator used to preform get data .
Get Shard Iterator:
Example:
{
"metadata": {
"method": "get_shard_iterator",
"shard_iterator_type": "LATEST",
"stream_name": "my_stream",
"shard_id": "8619-AWE1"
},
"data": null
}
Put Record
Send data to stream .
Put Record:
Example:
{
"metadata": {
"method": "put_record",
"partition_key": "0356",
"stream_name": "my_stream"
},
"data": "eyJteV9yZXN1bHQiOiJvayJ9"
}
Put Records
Send multi data to a stream .
Put Records:
Example:
{
"metadata": {
"method": "put_records",
"stream_name": "my_stream"
},
"data": "eyIxIjoiZXlKdGVWOXlaWE4xYkhRaU9pSnZheUo5IiwiMiI6ImV5SnRlVjl5WlhOMWJIUXlJam9pYjJzaEluMD0ifQ=="
}
Put Records
Send multi data to a stream .
Put Records:
Example:
{
"metadata": {
"method": "put_records",
"stream_name": "my_stream"
},
"data": "eyIxIjoiZXlKdGVWOXlaWE4xYkhRaU9pSnZheUo5IiwiMiI6ImV5SnRlVjl5WlhOMWJIUXlJam9pYjJzaEluMD0ifQ=="
}
Get Records
Get multi data from a stream .
Get Records:
Example:
{
"metadata": {
"method": "put_records",
"stream_name": "my_stream",
"limit": "1"
},
"data": null
}