ksqlDB Java Client unable to surface connection exception
I'm usingimplementation ('io.confluent.ksql:ksqldb-api-client:7.3.1')and I'm running into issues throwing exception on connection loss on the code below@Overridepublic <T> Flux<T>...
View ArticleHow to create an array of Kafka topics using KSQL and bash
I want to delete topics at the start of my script but want to make sure the topic actually exists before deleting to prevent error. My thinking was to create an array of all topics and then to loop...
View ArticleIssues with kSqlDB client for Java in Quarkus app - BatchedQueryResult hangs...
This is my Java codeimport io.confluent.ksql.api.client.BatchedQueryResult;import io.confluent.ksql.api.client.Client;import io.confluent.ksql.api.client.ClientOptions;import...
View ArticleKSQLDB - Materializing a view from a Table used a lot of SPACE
I have created a materializing a view from Table - Table Join. During operation, a lot of capacity is generated in the system but it are non-windowed joins according to KSQLDB document.The ultimate...
View ArticleEfficient way to delete record in ksqldb table
I have followingstream "my_stream" with id(key)source table "my_table" with id(primary key)stream-table joined "my_joined" (show below)stream "my_table_tombstone" for sending "tombstone" message to...
View ArticleWhat is the start of first window in Kafka Streams/Ksqldb Time windows
Kafka Streams and ksqlDB are based on the Unix epoch time in the UTC timezone. So my question is. If i define a tumbling window with window size of 5 minutes, the first windows will begin at 00:00:00...
View ArticleKsql - streams from topics with different partition numbers
I am trying to join messages from 2 different kafka topics which have different partition numbers with ksqlDB.When i create streams from each topics and trying to join them, ksqlDB does not allow bec....
View ArticleClik here to view.
Ksqldb: connect to Confluent Schema Registry with Basic Auth
I'm currently prototyping a use case for ksqlDB which is supposed to read from a Kafka topic populated with String keys and Avro values.I'm using the following docker-compose.yml to setup my dev...
View ArticleCan't count records in an index on Elasticsearch
I used this query to count hit number(docs) between specific time range with 15 minutes interval but the output is wrongGET /logs-iis.access-default/_search{"size": 0,"query": {"range": {"@timestamp":...
View ArticleKSQLDB connection refused to Kafka Connect
I am doing PoC on KSQLDB Elasticsearch connector.I am following from 2 documents online:One:https://ksqldb.io/quickstart.htmlAll working fine and well and after I fallowedSecond...
View ArticleClik here to view.
How to store the customer first travel table at all time
I have a Customer, Travel topics. I want a analysis that show customer first travel travelid in the table.for e.g.create table customer_first_travel asselect t.custid custid,...
View ArticleHow to track (metrics / telemetry / logging) missed RHS joins in a ksql /...
I have a ksqlDB stream that is doing a CREATE STREAM AS SELECT lhs.*, rhs.* FROM lhs LEFT JOIN rhs WITHIN 15 SECONDS GRACE PERIOD 30 SECONDS ON rhs.join_key = lhs.join_key.Generally in my application,...
View ArticleKSQL pull query not working properly if Primary KEY is integer
I have create a table from another aggregate table, but the pull query seemed not functioning properly, it only working properly for emit changes, or in clause (at least 2 arguments) I am using...
View ArticleHow to create a ksqlDB table that deserizalies from a topic using...
I am using this local environment:---version: '2'services: zookeeper: image: confluentinc/cp-zookeeper:7.5.1 hostname: zookeeper container_name: zookeeper ports: - "2181:2181" environment:...
View ArticleIn ksqldb, why is the column name from a schema definition not resolved when...
I have this json-schema:{"$id": "http://schema-registry:8081/schemas/ids/1","$schema": "https://json-schema.org/draft/2020-12/schema","title": "Locationvalue","type": "object","properties":...
View ArticleKSQLDB REST API: single query returns different results
Dears,I am newby in case of ksqldb. My simple query executed several times returns different results:[ksqluser][node1][~/home]$ date && curl -X POST "http://A.B.231.50:8088/query" -H...
View Articlecan KSQLDB UDTF achieve ROW_NUM order by function?
I am trying to understand before I implement UDTF ROW_NUM, I am wondering whether can UTDF doing sorting among all the row while computing to return as Struct type...
View ArticleIssues with complex processing use-case in ksqlDB
I've been trying to get a ksql query up and running which is meant to process the following records:{"id": "2bc9461a-96e3-479f-95e2-ee7238954010","lineItems": [ {"referenceId":...
View ArticleHow to SELECT and deserialize HEADER value in ksqlDB?
I have created this tableCREATE SOURCE TABLE locations ( id VARCHAR PRIMARY KEY, meta ARRAY<STRUCT<key STRING, value BYTES>> HEADERS) WITH ( KAFKA_TOPIC = 'locations', VALUE_FORMAT =...
View Article(io.confluent.connect.avro.AvroDataConfig:370) Exception in thread "main"...
I am running ksql-tests via command line and I get this error. I tried adding jar manually to classpath before running tests, but still shows this error.How can I run ksql-test-runner via command line....
View Article
