Query Group
Load-balance KubeMQ Query handling across a consumer group with the C++ SDK so each query is answered once.
Overview
A consumer group scales query handling horizontally without touching the caller's side. Instead of one process answering every query on a channel, you run several identical handler instances under the same group name, and the broker routes each query to exactly one member — never to all of them. That turns a single responder into a pool you can grow or shrink to match load, which matters for anything RPC-shaped: a lookup service, a cache-fill handler, a synchronous read path behind an API.
It works by tying group membership to the subscription call: client->SubscribeToQueries(channel, group, ...) with a non-empty group load-balances across every subscriber sharing that channel and group. The sender calls client->SendQuery exactly as it would against a single handler — it never knows how many members exist or which one answered.
Gotchas: channel and group name must match exactly, or a typo quietly creates a second, empty group instead of erroring. Omit group and every subscriber reverts to broadcast, each answering independently. A stuck group member isn't bypassed — the caller just sees a timeout.
Prerequisites
- KubeMQ server running on
localhost:50000 - C++ SDK installed (vcpkg or CMake FetchContent)
- C++17 compiler (GCC 9+, Clang 9+, MSVC 2019+)
Code
// Example: queries/consumer_group
//
// Demonstrates load-balanced query handling with consumer groups.
// Multiple handlers in the same group share the query workload.
//
// Channel: cpp-queries.consumer-group
// Client ID: cpp-queries-consumer-group-client
//
// Run with a KubeMQ server on localhost:50000
// (see https://docs.kubemq.io/deploy).
#include <kubemq/kubemq.h>
#include <atomic>
#include <chrono>
#include <iostream>
#include <thread>
int main() {
std::cout << "[1] Connecting to localhost:50000" << std::endl;
kubemq::ClientOptions options;
options.set_address("localhost", 50000);
options.set_client_id("cpp-queries-consumer-group-client");
auto client_result = kubemq::Client::Create(options);
if (!client_result.ok()) {
std::cerr << "[ERROR] Failed to create client: " << client_result.status().message()
<< std::endl;
return 1;
}
auto& client = *client_result;
std::string channel = "cpp-queries.consumer-group";
std::string group = "cpp-queries-reader-group";
std::atomic<bool> query_handled{false};
// Subscribe with a consumer group.
std::cout << "[2] Subscribing to queries with group " << group << std::endl;
auto sub_result = client->SubscribeToQueries(
channel, group,
[&client, &query_handled](const kubemq::QueryReceive& q) {
std::cout << "[4] Worker received: body=" << q.body << std::endl;
auto now_epoch = std::chrono::duration_cast<std::chrono::seconds>(
std::chrono::system_clock::now().time_since_epoch())
.count();
auto reply_result = kubemq::QueryReply::Builder()
.SetRequestId(q.id)
.SetResponseTo(q.response_to)
.SetBody("group-result")
.SetExecuted(true)
.SetExecutedAt(now_epoch)
.Build();
if (!reply_result.ok()) {
std::cerr << "[ERROR] Build reply: " << reply_result.status().message()
<< std::endl;
return;
}
auto send_status = client->SendQueryResponse(*reply_result);
if (!send_status.ok()) {
std::cerr << "[ERROR] SendQueryResponse: " << send_status.message() << std::endl;
return;
}
query_handled.store(true);
},
[](const kubemq::Status& err) {
std::cerr << "[ERROR] Group error: " << err.message() << std::endl;
});
if (!sub_result.ok()) {
std::cerr << "[ERROR] SubscribeToQueries: " << sub_result.status().message() << std::endl;
return 1;
}
auto& sub = *sub_result;
// Allow subscription to fully establish before sending.
std::this_thread::sleep_for(std::chrono::milliseconds(300));
// Send a query to the group.
std::cout << "[3] Sending query to group " << group << std::endl;
auto query_build = kubemq::Query::Builder()
.SetChannel(channel)
.SetBody("group-fetch")
.SetTimeout(std::chrono::seconds(10))
.Build();
if (!query_build.ok()) {
std::cerr << "[ERROR] Build query: " << query_build.status().message() << std::endl;
return 1;
}
auto resp_result = client->SendQuery(*query_build);
if (!resp_result.ok()) {
std::cerr << "[ERROR] SendQuery: " << resp_result.status().message() << std::endl;
return 1;
}
std::cout << "[5] Group response: executed=" << std::boolalpha << resp_result->executed
<< " body=" << resp_result->body << std::endl;
// Wait for the handler to finish processing.
std::this_thread::sleep_for(std::chrono::seconds(1));
// Cancel the subscription explicitly.
// Note: The Subscription destructor also calls Cancel(), but explicit
// cleanup is shown here for clarity and to match Go's defer pattern.
sub->Cancel();
std::cout << "[6] Subscription cancelled" << std::endl;
auto close_status = client->Close();
if (!close_status.ok()) {
std::cerr << "[ERROR] Close failed: " << close_status.message() << std::endl;
return 1;
}
std::cout << "[7] Client closed" << std::endl;
return 0;
}How It Works
- Subscribes to queries with a consumer group for load-balanced delivery.
- Each query is handled by exactly one member of the consumer group.
- Sends a query and receives the response from whichever group member handled it.
- Enables horizontal scaling of query processors.
Related
Was this page helpful?