Petre Gordan created KAFKA-10569:
------------------------------------
Summary: Running aggregate queries on KSQL client side is getting
to ERROR Shutdown broker because all log dirs in ...
Key: KAFKA-10569
URL: https://issues.apache.org/jira/browse/KAFKA-10569
Project: Kafka
Issue Type: Bug
Components: clients
Affects Versions: 2.5.0
Environment: local
Reporter: Petre Gordan
Attachments: KSQLDBServerSideErrors.txt, KafkaClusterLogs.txt,
ProductsOrders.txt, ZiikeeperSideLog.txt
Working on Windows 10 and I'm running locally:
* in powershell, zookeeper with: *bin\windows\zookeeper-server-start.bat
config\zookeeper.properties*
* in powershell, kafka-server
*bin\windows\kafka-server-start.bat config\server.properties*
* in bash (with ubuntu) ksqldb server
sudo bin/ksql-server-start etc/ksqldb/ksql-server.properties
* in bash (with ubuntu) ksql client
sudo bin/ksql http://0.0.0.0:8088
After all of these are sorted, than, I'm starting to practice the Kafka. So,
I'm creating tables, streams, making inserts, and all good. I can do small
queries like:
select * from products emit changes;, etc.
All good until at this step.
When, I'm trying to run every type of aggregate query, than is showing the
result after a while, but into the end, after I will press Ctrl+C to terminate
that and to do other query, everything is down.
For example, see the attached .sql script, and after I will run that script the
products table and orders stream are created with success and populated with
success.
After that if I run this query:
select ProductRowKey, count(ProductRowKey) from orders group by ProductRowKey
emit changes;
I can see the results, all good, but into the end if I will press Ctrl + C,
than everything is down.
Looking into the logs and taking based on the time history the main raised
warning and issues are:
* first is raised this:
Query terminated due to exception:org.eclipse.jetty.io.EofException
(io.confluent.ksql.rest.server.resources.streaming.QueryStreamWriter:95)
* than this: INFO stream-client [_confluent-ksql-default_transient State
transition from RUNNING to PENDING_SHUTDOWN
(org.apache.kafka.streams.KafkaStreams:285)
* than these:
INFO stream-thread [_confluent-ksql-default_transient Informed to shut down
(org.apache.kafka.streams.processor.internals.StreamThread:1116)
State transition from RUNNING to PENDING_SHUTDOWN
(org.apache.kafka.streams.processor.internals.StreamThread:221)
Shutdown complete
(org.apache.kafka.streams.processor.internals.StreamThread:1150)
* than this:
INFO stream-thread [qtp2032891036-47] Deleting obsolete state directory 0_0 for
task 0_0 as 1ms has elapsed
* than this:
WARN Could not clean up the schema registry for query:
_confluent-ksql-default_transient_
* than this:
WARN [Producer clientId=producer-1] Connection to node 0
(localhost/127.0.0.1:9092) could not be established. Broker may not be
available. (org.apache.kafka.clients.NetworkClient:763)
all of these from above on the KSQLDB server side logs,
* finally this on the Kafka cluster side:
ERROR Shutdown broker because all log dirs in ........ have failed
(kafka.log.LogManager)
And after that everything is down.
Please help me with these.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
