Kinesis
Kubemq kinesis target connector allows services using kubemq server to access aws kinesis service.
Prerequisites
The following required to run the aws-kinesis target connector:
kubemq cluster
aws account with kinesis active service
kubemq-source deployment
Configuration
sns target connector configuration properties:
Properties Key
Required
Description
Example
aws_key
yes
aws key
aws key supplied by aws
aws_secret_key
yes
aws secret key
aws secret key supplied by aws
region
yes
region
aws region
token
no
aws token ("default" empty string
aws token
Example:
Usage
List Streams
list kinesis streams
List Streams:
Metadata Key
Required
Description
Possible values
method
yes
type of method
"list_streams"
Example:
List Stream Consumers
list kinesis Stream Consumers.
List Stream Consumers:
Metadata Key
Required
Description
Possible values
method
yes
type of method
"list_stream_consumers"
stream_arn
yes
aws stream arn of the desired stream
"arn::mystream"
Example:
Create Stream
Create a kinesis Stream.
Create Stream:
Metadata Key
Required
Description
Possible values
method
yes
type of method
"create_stream"
stream_name
yes
aws stream name as string
"string"
shard_count
no
number of shards to create (default 1)
"1"
Example:
List Shards
list stream Shards .
List Shards:
Metadata Key
Required
Description
Possible values
method
yes
type of method
"list_shards"
stream_name
yes
aws stream name as string
"string"
Example:
Get Shard Iterator
Get Shard Iterator used to preform get data .
Get Shard Iterator:
Metadata Key
Required
Description
Possible values
method
yes
type of method
"get_shard_iterator"
stream_name
yes
aws stream name as string
"string"
shard_iterator_type
yes
aws shard iterator type
shard_id
yes
aws shard full id (can be acquired using list shard)
Example:
Put Record
Send data to stream .
Put Record:
Metadata Key
Required
Description
Possible values
method
yes
type of method
"put_record"
stream_name
yes
aws stream name as string
"string"
partition_key
yes
determines which shard in the stream the data record is assigned to.
data
yes
Message to send to stream
string
Example:
Put Records
Send multi data to a stream .
Put Records:
Metadata Key
Required
Description
Possible values
method
yes
type of method
"put_records"
stream_name
yes
aws stream name as string
"string"
data
yes
Key value pair of partition_key(string) and message([]byte)
Example:
Put Records
Send multi data to a stream .
Put Records:
Metadata Key
Required
Description
Possible values
method
yes
type of method
"put_records"
stream_name
yes
aws stream name as string
"string"
data
yes
Key value pair of partition_key(string) and message([]byte)
Example:
Get Records
Get multi data from a stream .
Get Records:
Metadata Key
Required
Description
Possible values
method
yes
type of method
"get_records"
stream_name
yes
aws stream name as string
"string"
limit
no
Number of limit message to get (default "1")
"int value"
Example:
Last updated