Links

BigTable

Kubemq gcp-bigtable target connector allows services using kubemq server to access google bigtable server.

Prerequisites

The following required to run the gcp-bigtable target connector:
  • kubemq cluster
  • gcp-bigtable set up
  • kubemq-source deployment

Configuration

bigtable target connector configuration properties:
Properties Key
Required
Description
Example
project_id
yes
gcp bigtable project_id
"/myproject"
credentials
yes
gcp credentials files
"<google json credentials"
instance
yes
bigtable instance name
"<bigtable instance name"
Example:
bindings:
- name: kubemq-query-gcp-bigtable
source:
kind: kubemq.query
name: kubemq-query
properties:
address: "kubemq-cluster:50000"
client_id: "kubemq-query-gcp-bigtable-connector"
auth_token: ""
channel: "query.gcp.bigtable"
group: ""
auto_reconnect: "true"
reconnect_interval_seconds: "1"
max_reconnects: "0"
target:
kind: gcp.bigtable
name: gcp-bigtable
properties:
project_id: "id"
credentials: 'json'
instance: "instance"

Usage

Create Column Family

Create Column Family:
Metadata Key
Required
Description
Possible values
method
yes
type of method
"create_column_family"
column_family
yes
the column_family to create
"valid unique string"
table_name
yes
the table name
"table name to assign the column family"
Example:
{
"metadata": {
"method": "create_column_family",
"column_family": "valid_unique_string",
"table_name": "valid_table_string"
},
"data": null
}

Create Table

Create a table:
Metadata Key
Required
Description
Possible values
method
yes
type of method
"create_table"
table_name
yes
the table name
"table name to delete or create"
Example:
{
"metadata": {
"method": "create_table",
"table_name": "valid_table_string"
},
"data": null
}

Delete Table

Delete the table:
Metadata Key
Required
Description
Possible values
method
yes
type of method
"delete_table"
table_name
yes
the table name
"table name to delete or create"
Example:
{
"metadata": {
"method": "delete_table",
"table_name": "valid_table_string"
},
"data": null
}

Write Rows

Write new rows to table by column family
Metadata Key
Required
Description
Possible values
method
yes
type of method
"write"
table_name
yes
the table name
"table name to delete or create"
column_family
yes
the column_family to create
"valid unique string"
Example:
{
"metadata": {
"method": "write",
"column_family": "valid_unique_string",
"table_name": "valid_table_string"
},
"data": "eyJpZCI6MSwibmFtZSI6InRlc3QxIiwic2V0X3Jvd19rZXkiOiIxIn0="
}

Delete Rows

Delete rows from table by prefix
Metadata Key
Required
Description
Possible values
method
yes
type of method
"delete_row"
table_name
yes
the table name
"table name to delete or create"
row_key_prefix
yes
the row key
"valid unique string"
Example:
{
"metadata": {
"method": "delete_row",
"row_key_prefix": "valid unique string",
"table_name": "valid_table_string"
},
"data": null
}

Get All Rows

Get all rows from the table:
Metadata Key
Required
Description
Possible values
method
yes
type of method
"get_all_rows"
table_name
yes
the table name
"table name to delete or create"
row_key_prefix
no
the row key
"valid unique string"
column_name
no
the column to return
"column name"
Example:
```json { "metadata": { "method": "get_all_rows", "table_name": "valid_table_string" }, "data": null }
Last modified 2yr ago