I think I have to admit that it was my stupid mistake ☺
When you add a Kafka Consumer you need to specify a pipeline I did not know
what it meant.
For the kafka-read-pokemon-data it
is ${PROJECT_HOME}/transforms/kafka-consumer-read-pokemon-data-child.hpl
I thought that the hpl file WAS the pipeline.
But I now found out that it defines the fields.So when I started my copied pipeline it was not able to find a proper hpl. Therefore the GUI started to go crazy . so my apologies to all Op do 20 jan. 2022 om 10:31 schreef Sergio Ramazzina (SERASOFT) < [email protected]>: > Hi Hans-Peter, > > I totally agree with Hans Van Akelyen. We have kafka consumer in > production without any problem so a reproduction path is very welcome. > > Best > > Sergio > Il 20/01/2022 08:12, Hans Van Akelyen ha scritto: > > Hi Hans-Peter, > > A freezing UI is definitely a no-go so I am interested in a reproduction > path for this so we can avoid this. > The Kafka transforms have received some love and are being used in > projects so I'm sure we will figure it out. > As getting all the information via email might be a painful process, feel > free to reach out to me on hansva[at]apache.org with your timezone so we > can plan a short call to go over your problem. > > Cheers, > Hans > > On Wed, 19 Jan 2022 at 16:24, HG <[email protected]> wrote: > >> Hi, >> >> No kafka is not in a docker container. >> Even then the kafka pokemon producer and consumer would have the same >> issue. >> >> Perhaps I am on to something. >> When I click on Output and choose show input fields a window pops up >> "Searching for input fields..." >> That hangs. >> >> I must have missed something with the fields. It seems that just copying >> the file does not work as I expected 😑 >> >> 2022/01/19 16:16:19 - Hop - Projects enabled >> 2022/01/19 16:16:19 - Hop - Enabling project : 'samples' >> Exception in thread "Thread-30" java.lang.StackOverflowError >> at >> java.xml/javax.xml.parsers.FactoryFinder.findServiceProvider(FactoryFinder.java:302) >> at >> java.xml/javax.xml.parsers.FactoryFinder.find(FactoryFinder.java:261) >> at >> java.xml/javax.xml.parsers.DocumentBuilderFactory.newInstance(DocumentBuilderFactory.java:140) >> at >> org.apache.hop.core.xml.XmlParserFactoryProducer.createSecureDocBuilderFactory(XmlParserFactoryProducer.java:50) >> >> Any clues? >> >> Regards Hans-Peter >> >> >> >> Op wo 19 jan. 2022 om 15:56 schreef Sergio Ramazzina (SERASOFT) < >> [email protected]>: >> >>> Are you using Kafka in docker? If yes be sure the networking is >>> configured correctly. >>> Il 19/01/2022 15:55, HG ha scritto: >>> >>> Hi, >>> >>> Yes I have 2 topics and tried both. >>> One is filled with a console-producer >>> The other one with the sample pokemon producer. >>> When I modify the parameters Hop-gui comes up with auto suggest .. >>> >>> The state always remains : Initializing . >>> After that it spins out of control (Hop-gui does not respond anymore). >>> >>> Regards Hans-Peter >>> >>> >>> Op wo 19 jan. 2022 om 15:30 schreef Sergio Ramazzina (SERASOFT) < >>> [email protected]>: >>> >>>> Ciao Hans, >>>> >>>> I strongly suggest to review your configuration. It seems to me that >>>> you >>>> are pointing to the wrong topic because no data is coming in. Are you >>>> sure you are reading from the same topic you are writing to? >>>> >>>> Cheers >>>> >>>> Sergio >>>> >>>> Il 19/01/2022 11:20, HG ha scritto: >>>> > Hello all, >>>> > >>>> > I am trying to learn hop and setup a kafka environment. >>>> > The pokemon examples both work. >>>> > >>>> > Now I want to read other data. >>>> > For this I copied the /kafka-consumer-read-pokemon-data-child.hpl >>>> file >>>> > and changed the <pipelinePath> entry to match the new name. >>>> > >>>> > When I start this new pipeline it never gets in the running state. >>>> > The console shows : >>>> > 2022/01/19 11:17:22 - kafka-consumer-hans-peter - Execution started >>>> > for pipeline [kafka-consumer-hans-peter] >>>> > 2022/01/19 11:17:22 - kafka-consumer-hans-peter - Executing this >>>> > pipeline using the Local Pipeline Engine with run configuration >>>> 'local' >>>> > >>>> > I have to terminate the gui with control-c. >>>> > It is the same pipeline as in the pokemon examples. >>>> > >>>> > What am I doing wrong? >>>> > >>>> > Regards Hans-Peter >>>> > >>>> > >>>> >>>
