Thank you
Sent: Monday, July 14, 2025 at 10:55 AM
From: "Hans Van Akelyen"
To: users@hop.apache.org
Subject: Re: Fw: Any plans to support Python 3.X?
Brandon has started working on something to upgrade/improve the old plugin.
https://github.com/usbrandon/hop-cpython
what the status is a
Stirring the Hornet’s Nest:
- Why is Apache Hop better than KNIME?
I've been asked this question a few times when recommending Hop to users.
I have some arguments of my own — but what are yours?
Best!
Thank you - I'll take a look at it.
I already know that I will throw away all this 'Docker' baggage – I hate this software.
Sent: Monday, December 30, 2024 at 4:41 PM
From: "Hans Van Akelyen"
To: users@hop.apache.org
Subject: Re: Do you have any experience running Hop pipelines in Apache Ai
Hi,
Do you have any experience running Hop pipelines in Apache Airflow?
Specifically, I mean managing logging, reporting execution status, etc.
Best,
P
What's the sense to manually increment row ID?
You can use SQL Script as well.
INSERT INTO my_table (id, name) VALUES (nextval('db."myfield_seq"'), ?);
Sent: Tuesday, December 17, 2024 at 2:07 PM
From: mh...@lstelcom.com
To: users@hop.apache.org
Subject: RE: How to create data with
Gentlemens,
you're doing a great job. But do you have plans to build an interface for orchestrating pipelines and workflows?
A scheduler, calendar, visualization of execution results... It seems to me that this would be a real 'game changer' for this project.
I see how much Airflow is d
I'm able to pass through registration process (although I have my account there - cannot login) but when I click on 'confirm registration' I'm transfered to https://hop.apache.org/accounts/complete/email/?verification_code=xxx page where I get message:
Not Found
The requested URL was not foun
Hi,
I cannot login to https://translate.project-hop.org/accounts/login/
I cannot reset password: 'The password can not be reset because there is no account registered for this e-mail at Weblate.' ?
I cannot create new account:
Not Found
The requested URL was not found on this server.
Thank you!
Sent: Wednesday, June 05, 2024 at 2:07 PM
From: "Davide Cisco"
To: users@hop.apache.org
Subject: Re: Migration to new version
Hello,
if you choose not to transfer the audit folder, Hop will run anyway... it will just start auditing (i.e. extremely detailed logging) on a n
Thank you.
I think 'audit' folder is not necessary - these are just logs, right? 'New' hop will run even if data from this folder were not transfered?
Sent: Tuesday, June 04, 2024 at 2:30 PM
From: "Davide Cisco"
To: users@hop.apache.org
Subject: Re: Migration to new version
Hello,
norm
Hi,
is there any tuto what to do to migrate Hop to new version (environment settings, projects...)?
Regards
So I have python script running but wonder how I can produce rows from dataFrame?
Script returns dataFrame what is just one row for Hop.
Regards
Thanks for all these suggestions.
Sent: Wednesday, May 01, 2024 at 12:08 PM
From: "Thad Guidry"
To: users@hop.apache.org
Subject: Re: Any idea why "Script" cast error 'ImportError: No module named pandas in
Thank you for your assistance.
I've changed 2.4.0-SNAPSHOT to 2.9.0-SNAPSHOT in pom.xml
Still got error:
[INFO] BUILD FAILURE
[INFO]
[INFO] Total time: 40.966 s
[INFO] Finished at: 2024-05-01T12:47:55+02:00
[INFO]
Thanks. I use this plugin in Kettle.
Tried to compile it for HOP:
[INFO]
[INFO] BUILD FAILURE
[INFO]
[INFO] Total time: 5.486 s
[INFO] Finished at:
In this case I try to open and read XLSB files but pandas is usefull in othe data manipulation scenarios.
Sent: Wednesday, May 01, 2024 at 1:39 AM
From: "Thad Guidry"
To: users@hop.apache.org
Subject: Re: Any idea why "Script" cast error 'ImportError: No module named pandas in
Hello,
is there any way to read ' xlsb' files in HOP?
I can read that "Apache POI added support for streaming reading of XLSB (no write support) in 3.16." so maybe it will be possible soon in HOP?
Regards,
"You currently cannot use Pandas with Jython, because it depends on CPython specific native extensions.
One dependency is NumPy, the other is Cython (which is actually not a native CPython extension, but generates such)."
https://stackoverflow.com/questions/36213908/how-can-i-import-pandas
One more question about Hop JAVA location.
Does Hop have something like PENTAHO_JAVA_HOME?
I have software on my PC that use different versions of Java.
Thanks for help
Hell dear Hop creators,
Any idea why "Script" cast error 'ImportError: No module named pandas in
Thank you very much for help - it works.
U're right obout parameter names - here it was productId not productid :-)
Sent: Tuesday, March 12, 2024 at 12:02 PM
From: "Geoffrey Cleaves"
To: users@hop.apache.org
Subject: Re: How to use parameters in "Neo4j Cypher"?
Try simply $productid.
Hello dear Hop users!
Could you please tell me how to use parameters in "Neo4j Cypher"?
In Parameters tab I have:
productid (parameter), product_id (Field), Integer (Neo4j Type)
'product_id' comes from csv file collumn - hop earlier.
My query is something like:
MATCH path = (.
Hello Dear Hop Creators!
I'm trying to load data into Neo4j db. All works great except vector search properties; embeddings.
In Neo4j syntax we use:
CREATE (Product1:Product {id: 10, name:'Some name', description:'Some product desc', embedding: [-1.00518711e-01, ...,-2.13430752e-03]})
Dear hop users and creators,
Why don't we find a function in the calculator to subtract a certain number of days from a date?
For example, I have the date '2023-07-26' and I want to know what date is 3 days back.
Not number of hours, minutes or milliseconds but just want '2023-07-23'
Unfortunately none of these methods work :-(
Sent: Wednesday, May 31, 2023 at 4:54 PM
From: hans.van.akel...@gmail.com
To: users@hop.apache.org
Subject: Re: Fw: ETL metadata injection - how to add header to text file
Hi,
Providing a String with value Y/1/true should work to set that checkb
Hi,
you have Hop Server REST commands here:
https://hop.apache.org/manual/latest/hop-server/rest-api.html
For instance to start pipeline you execute Start Pipeline. I guess it will be (never played with Hop Server but have experience with Carte):
http://localhost:8081/hop/startPipeline
Sorry for bringing this up, but does anyone have any ideas.
Is there any way to get the header or is it not possible to get it?
Sent: Tuesday, May 09, 2023 at 4:21 PM
From: pod...@gmx.com
To: users@hop.apache.org
Subject: ETL metadata injection - how to add header to text file
I'm
Hello dear Hop creaters,
I'm learning "ETL metadata injection". I succeeded with test transformations but I wonder how to insert header in result text file.
In "ETL metadata injection" hop, in "Text file output" I see; HEADER => Include header row (Y/N).
So I added one more hop, "Add const
So Matt, I have no idea how can I sent JSON to Carte server. Maybe you have some example?
Best
Sent: Tuesday, March 21, 2023 at 1:43 PM
From: "Matt Casters"
To: users@hop.apache.org
Subject: Re: HOP Server REST API
Again, you can already do this using the existing web service. The only
I meant Hop Server could handle POST payload. Now it is only possible to call it with parameters, for instance:
http://127.0.0.1:8181/kettle/executeTrans/?trans=sometransformation.ktr&patameter1=m42
But sometimes I need to post XML, JSON or else
Sent: Tuesday, March 21, 2023 at 1:06 PM
Fr
Would be great if we could sent some palyload to Carte (I do not know what's the name in Hop) - not only parameters. That's what I've always missed in Kettle.
Sent: Thursday, March 09, 2023 at 9:36 AM
From: "Matt Casters"
To: users@hop.apache.org
Subject: Re: HOP Server REST API
Hi Phil,
Thank you!
Sent: Friday, December 02, 2022 at 1:07 PM
From: "Hans Van Akelyen"
To: pod...@gmx.com, users@hop.apache.org
Subject: Re: Any trick to read data from Excel file where no of columns is not known?
It’s not part of our distribution but there is a python transform [1]
Cheers,
Hans
Thank you Matt,
that looks quite mosaic :-)
Maybe I'd try to use Python in the first stages. But there's no Python action
in Hop :-(
There will be one day?
Regards
Sent: Thursday, December 01, 2022 at 4:28 PM
From: "Matt Casters"
To: users@hop.apache.org
Subject: Re: Any trick to read d
Hello,
do we have some way to read data from Excel file where number of columns is
unknown?
I mean sometimes file can be like:
column_1; column_2
but other time
column_1; column_2; column_3; column_3
Normally we need to define them in 'Fields' tab - possible not to do that in a
fixed way?
R
I did open issue in Jira:
HOP-4575[https://issues.apache.org/jira/browse/HOP-4575]
Looks like bug
This feature ([2]
https://hop.apache.org/manual/latest/hop-gui/perspective-execution-information.html#top)]
does not work here. Clicking on localization icon gives nothing.
When pressing CTRL-Shif
Thank you very much for your help!
I will check out the options you mention - I did not know that I can preview
Beam File Input result (however I'm aware that I can do this in Text File
Input).
Before I go deeper with this; will Beam engine give me some performance gain
comparing to Hop proces
Hi,
I'm playing with Beam pipeline. My goal is to merge two big files.
So I have source (one of two) file like:
column_one|colum_two
0099"|"0080199111"
...
My trivial pipeline is:
Beam File Input => Text file output
I created definition for Beam File Input: separator "|", column_one - strin
Thank you.
I got it - this file is created in the project directory when new Pipeline Run
Configuration is created. Variables are in ... 'variables' tab.
BTW: When I move to new Hop version, how to import projects into new version?
There's some tutorial about that?
Best
Sent: Thursday, Nove
Hi,
I try to build some pipeline in Hop - test Beam feature.
Where I can find variable for 'Input location' for Beam Input? If we look at
complex.hpl example we have ${DATA_INPUT} definition for file. Where it is
defined?
I found it months ago but completely forgotten where it was.
Thanks fo
Great!
I'm going to test this new version soon
Mike
Sent: Tuesday, October 18, 2022 at 11:54 AM
From: "Bart Maertens"
To: annou...@apache.org, d...@hop.apache.org, users@hop.apache.org
Subject: [ANNOUNCE] Apache Hop 2.1.0
The Apache Hop PMC and community are pleased to announce the ge
Useful - thank you!
Sent: Tuesday, October 11, 2022 at 2:38 PM
From: "christian.gutkne...@bluewin.ch"
To: users@hop.apache.org
Subject: Re: Re: Ho to convert date in format ‘04/Oct/22 1:24 PM’ to 'normal one'?
Hi all
For date and time conversion I found this table to be helpful: https://
Thank you.
I had problem to read it. Meanwhile I found that the oryginal format should be
'dd/MMM/yy h:mm a'.
Thank you anyway!
Sent: Tuesday, October 11, 2022 at 2:16 PM
From: "Bart Maertens"
To: users@hop.apache.org
Subject: Re: Ho to convert date in format ‘04/Oct/22 1:24 PM’ to 'normal
Hello dear HOP creators!
Is there any way I can convert date like ‘04/Oct/22 1:24 PM’ to ‘04/10/2022
1:24’ format in Hop?
Regards,
Mike
I think Merge Join is not working with Beam. I spent many hours trying to make it work without success.
For this reason I decided to go back to Kettle - will be back when it's solved.
Regards,
Mike
Sent: Friday, September 02, 2022 at 3:14 PM
From: "Fabian Peters"
To: users@hop.apach
HI,
I see "Synchronize after merge" does nothing but executes separate query for each row.
So it will be terrible slow with hundreds of thousands of records.
Sent: Tuesday, August 30, 2022 at 1:53 PM
From: "Hans Van Akelyen"
To: users@hop.apache.org
Subject: Re: Dimension lookup/update
That's a good idea - thank you!
Sent: Tuesday, August 30, 2022 at 1:53 PM
From: "Hans Van Akelyen"
To: users@hop.apache.org
Subject: Re: Dimension lookup/update
Another solution to avoid all the lookups is to use a table input and load the source table.
Then you can use "Merge Rows (diff)"
Thank you both for quick reaction.
I'm searching for some way to quickly update table with millions of records.
I know 'Insert / update' but this is terrible slow - so may queries.
I know I can do some workaround like instert into temp table and execute SQL query (update table takin
Hello!
I try to use 'Dimension lookup/update' hop and I do not understand the meaning of two fields in properties:
"Date range start field / Table date range end"
My data has no date column. I do not need it. So I cannot specify any date. What this field is for and how to ignore it?
After another few days I spent on it I'm quite close this is some bug in software:
Capture1.PNG - when executed 'Local'
"2022/06/07 22:53:53 - merge_join_test - client_id Integer(15) : There was a data type error: the data type of java.lang.String object ["Some customer 4"] does not cor
Hi,
since 3 hours I'm trying to do such trivial thing like opne file in Beam input.
My file is:
80010;Some customer 1;2344;Address 1
80011;Some customer 2;7546;Address 2
80012;Some customer 3;4564;Address 3
80013;Some customer 4;7564;Address 4
80014;Some customer 5;2354;Address 5
I tried several things but I need help:
"[local], [collection] or [auto]":
- 'local' means use embeded Flink (so Hop has Flink engine built in?)?
- 'auto' will generate some engine independent Flink job?
- 'collection' ?
It is executed in my PC Flink installation only if i set The Flink
Wow! That's really you Matt!? You're a living legend to me :-)
Kettle was (still is) amazing piece of software. I was sad that Hitachi Vantara is killing this product. But when I started looking on the Internet to see if there was any alternative and it turned out that there is Hop, I was delig
Hello community!
I'm learning Apache Flink. I launched test installation on my PC (version 1.13.6), I have HOP running and now I want to run first pipeline on Flink.
Yet for some reason it does not work. What I did:
1. I exported fat jar according to this tutorial:
https://hop.apach
53 matches
Mail list logo