BigTable
Kubemq gcp-bigtable target connector allows services using kubemq server to access google bigtable server.

Prerequisites

The following required to run the gcp-bigtable target connector:
  • kubemq cluster
  • gcp-bigtable set up
  • kubemq-source deployment

Configuration

bigtable target connector configuration properties:
Properties Key
Required
Description
Example
project_id
yes
gcp bigtable project_id
"/myproject"
credentials
yes
gcp credentials files
"<google json credentials"
instance
yes
bigtable instance name
"<bigtable instance name"
Example:
1
bindings:
2
- name: kubemq-query-gcp-bigtable
3
source:
4
kind: kubemq.query
5
name: kubemq-query
6
properties:
7
address: "kubemq-cluster:50000"
8
client_id: "kubemq-query-gcp-bigtable-connector"
9
auth_token: ""
10
channel: "query.gcp.bigtable"
11
group: ""
12
auto_reconnect: "true"
13
reconnect_interval_seconds: "1"
14
max_reconnects: "0"
15
target:
16
kind: gcp.bigtable
17
name: gcp-bigtable
18
properties:
19
project_id: "id"
20
credentials: 'json'
21
instance: "instance"
Copied!

Usage

Create Column Family

Create Column Family:
Metadata Key
Required
Description
Possible values
method
yes
type of method
"create_column_family"
column_family
yes
the column_family to create
"valid unique string"
table_name
yes
the table name
"table name to assign the column family"
Example:
1
{
2
"metadata": {
3
"method": "create_column_family",
4
"column_family": "valid_unique_string",
5
"table_name": "valid_table_string"
6
},
7
"data": null
8
}
Copied!

Create Table

Create a table:
Metadata Key
Required
Description
Possible values
method
yes
type of method
"create_table"
table_name
yes
the table name
"table name to delete or create"
Example:
1
{
2
"metadata": {
3
"method": "create_table",
4
"table_name": "valid_table_string"
5
},
6
"data": null
7
}
Copied!

Delete Table

Delete the table:
Metadata Key
Required
Description
Possible values
method
yes
type of method
"delete_table"
table_name
yes
the table name
"table name to delete or create"
Example:
1
{
2
"metadata": {
3
"method": "delete_table",
4
"table_name": "valid_table_string"
5
},
6
"data": null
7
}
Copied!

Write Rows

Write new rows to table by column family
Metadata Key
Required
Description
Possible values
method
yes
type of method
"write"
table_name
yes
the table name
"table name to delete or create"
column_family
yes
the column_family to create
"valid unique string"
Example:
1
{
2
"metadata": {
3
"method": "write",
4
"column_family": "valid_unique_string",
5
"table_name": "valid_table_string"
6
},
7
"data": "eyJpZCI6MSwibmFtZSI6InRlc3QxIiwic2V0X3Jvd19rZXkiOiIxIn0="
8
}
Copied!

Delete Rows

Delete rows from table by prefix
Metadata Key
Required
Description
Possible values
method
yes
type of method
"delete_row"
table_name
yes
the table name
"table name to delete or create"
row_key_prefix
yes
the row key
"valid unique string"
Example:
1
{
2
"metadata": {
3
"method": "delete_row",
4
"row_key_prefix": "valid unique string",
5
"table_name": "valid_table_string"
6
},
7
"data": null
8
}
Copied!

Get All Rows

Get all rows from the table:
Metadata Key
Required
Description
Possible values
method
yes
type of method
"get_all_rows"
table_name
yes
the table name
"table name to delete or create"
row_key_prefix
no
the row key
"valid unique string"
column_name
no
the column to return
"column name"
Example:
```json { "metadata": { "method": "get_all_rows", "table_name": "valid_table_string" }, "data": null }
Last modified 11mo ago