Re: Fw: Any plans to support Python 3.X?

2025-07-14 Thread podunk
  Thank you   Sent: Monday, July 14, 2025 at 10:55 AM From: "Hans Van Akelyen" To: users@hop.apache.org Subject: Re: Fw: Any plans to support Python 3.X? Brandon has started working on something to upgrade/improve the old plugin. https://github.com/usbrandon/hop-cpython what the status is a

Stirring the Hornet’s Nest

2025-07-08 Thread podunk
Stirring the Hornet’s Nest:   - Why is Apache Hop better than KNIME?   I've been asked this question a few times when recommending Hop to users. I have some arguments of my own — but what are yours?   Best!

Re: Do you have any experience running Hop pipelines in Apache Airflow?

2024-12-31 Thread podunk
Thank you - I'll take a look at it. I already know that I will throw away all this 'Docker' baggage – I hate this software.     Sent: Monday, December 30, 2024 at 4:41 PM From: "Hans Van Akelyen" To: users@hop.apache.org Subject: Re: Do you have any experience running Hop pipelines in Apache Ai

Do you have any experience running Hop pipelines in Apache Airflow?

2024-12-30 Thread podunk
  Hi,   Do you have any experience running Hop pipelines in Apache Airflow? Specifically, I mean managing logging, reporting execution status, etc.   Best,   P

Re: RE: How to create data with a seq_next val

2024-12-17 Thread podunk
What's the sense to manually increment row ID?   You can use SQL Script as well.   INSERT INTO my_table (id, name) VALUES (nextval('db."myfield_seq"'), ?);     Sent: Tuesday, December 17, 2024 at 2:07 PM From: mh...@lstelcom.com To: users@hop.apache.org Subject: RE: How to create data with

Any plans to build an interface for orchestrating pipelines and workflows?

2024-12-16 Thread podunk
  Gentlemens,   you're doing a great job. But do you have plans to build an interface for orchestrating pipelines and workflows? A scheduler, calendar, visualization of execution results... It seems to me that this would be a real 'game changer' for this project.   I see how much Airflow is d

Re: Weblate - this project is live?

2024-06-22 Thread podunk
I'm able to pass through registration process (although I have my account there - cannot login) but when I click on 'confirm registration' I'm transfered to https://hop.apache.org/accounts/complete/email/?verification_code=xxx page where I get message:   Not Found The requested URL was not foun

Weblate - this project is live?

2024-06-20 Thread podunk
Hi,   I cannot login to https://translate.project-hop.org/accounts/login/ I cannot reset password: 'The password can not be reset because there is no account registered for this e-mail at Weblate.' ? I cannot create new account: Not Found The requested URL was not found on this server.    

Re: Migration to new version

2024-06-10 Thread podunk
Thank you!     Sent: Wednesday, June 05, 2024 at 2:07 PM From: "Davide Cisco" To: users@hop.apache.org Subject: Re: Migration to new version Hello,   if you choose not to transfer the audit folder, Hop will run anyway... it will just start auditing (i.e. extremely detailed logging) on a n

Re: Migration to new version

2024-06-05 Thread podunk
Thank you. I think 'audit' folder is not necessary - these are just logs, right? 'New' hop will run even if data from this folder were not transfered?     Sent: Tuesday, June 04, 2024 at 2:30 PM From: "Davide Cisco" To: users@hop.apache.org Subject: Re: Migration to new version Hello,   norm

Migration to new version

2024-06-04 Thread podunk
  Hi,   is there any tuto what to do to migrate Hop to new version (environment settings, projects...)?   Regards

How to generate rows from pandas DataFrame?

2024-05-01 Thread podunk
  So I have python script running but wonder how I can produce rows from dataFrame? Script returns dataFrame what is just one row for Hop.   Regards

Re: Any idea why "Script" cast error 'ImportError: No module named pandas in

2024-05-01 Thread podunk
Thanks for all these suggestions.     Sent: Wednesday, May 01, 2024 at 12:08 PM From: "Thad Guidry" To: users@hop.apache.org Subject: Re: Any idea why "Script" cast error 'ImportError: No module named pandas in

Re: Any idea why "Script" cast error 'ImportError: No module named pandas in

2024-05-01 Thread podunk
Thank you for your assistance. I've changed 2.4.0-SNAPSHOT  to 2.9.0-SNAPSHOT in pom.xml Still got error:   [INFO] BUILD FAILURE [INFO] [INFO] Total time:  40.966 s [INFO] Finished at: 2024-05-01T12:47:55+02:00 [INFO]

Re: Any idea why "Script" cast error 'ImportError: No module named pandas in

2024-05-01 Thread podunk
Thanks. I use this plugin in Kettle. Tried to compile it for HOP:   [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time:  5.486 s [INFO] Finished at:

Re: Any idea why "Script" cast error 'ImportError: No module named pandas in

2024-05-01 Thread podunk
In this case I try to open and read XLSB files but pandas is usefull in othe data manipulation scenarios.     Sent: Wednesday, May 01, 2024 at 1:39 AM From: "Thad Guidry" To: users@hop.apache.org Subject: Re: Any idea why "Script" cast error 'ImportError: No module named pandas in

Read xlsb files

2024-04-30 Thread podunk
  Hello,   is there any way to read ' xlsb' files in HOP? I can read that "Apache POI added support for streaming reading of XLSB (no write support) in 3.16." so maybe it will be possible soon in HOP?   Regards,

Re: Any idea why "Script" cast error 'ImportError: No module named pandas in

2024-04-30 Thread podunk
"You currently cannot use Pandas with Jython, because it depends on CPython specific native extensions. One dependency is NumPy, the other is Cython (which is actually not a native CPython extension, but generates such)."   https://stackoverflow.com/questions/36213908/how-can-i-import-pandas

Does Hop have something like PENTAHO_JAVA_HOME?

2024-04-23 Thread podunk
One more question about Hop JAVA location. Does Hop have something like PENTAHO_JAVA_HOME?   I have software on my PC that use different versions of Java.   Thanks for help    

Any idea why "Script" cast error 'ImportError: No module named pandas in

2024-04-23 Thread podunk
  Hell dear Hop creators,   Any idea why "Script" cast error 'ImportError: No module named pandas in

Re: How to use parameters in "Neo4j Cypher"?

2024-03-12 Thread podunk
  Thank you very much for help - it works. U're right obout parameter names - here it was productId not productid :-)   Sent: Tuesday, March 12, 2024 at 12:02 PM From: "Geoffrey Cleaves" To: users@hop.apache.org Subject: Re: How to use parameters in "Neo4j Cypher"? Try simply $productid. 

How to use parameters in "Neo4j Cypher"?

2024-03-12 Thread podunk
  Hello dear Hop users!   Could you please tell me how to use parameters in "Neo4j Cypher"? In Parameters tab I have:   productid (parameter), product_id (Field), Integer (Neo4j Type) 'product_id' comes from csv file collumn - hop earlier.   My query is something like:   MATCH path = (.

Load data into Neo4j [Neo4J Output]

2024-01-16 Thread podunk
  Hello Dear Hop Creators!   I'm trying to load data into Neo4j db. All works great except vector search properties; embeddings.   In Neo4j syntax we use: CREATE (Product1:Product {id: 10, name:'Some name', description:'Some product desc', embedding: [-1.00518711e-01, ...,-2.13430752e-03]})

How to get date - x days in calculator?

2023-07-26 Thread podunk
  Dear hop users and creators,   Why don't we find a function in the calculator to subtract a certain number of days from a date? For example, I have the date '2023-07-26' and I want to know what date is 3 days back. Not number of hours, minutes or milliseconds but just want '2023-07-23'

Re: Fw: ETL metadata injection - how to add header to text file

2023-07-17 Thread podunk
Unfortunately none of these methods work :-(   Sent: Wednesday, May 31, 2023 at 4:54 PM From: hans.van.akel...@gmail.com To: users@hop.apache.org Subject: Re: Fw: ETL metadata injection - how to add header to text file Hi, Providing a String with value Y/1/true should work to set that checkb

Re: Hop-Server

2023-06-05 Thread podunk
Hi,   you have Hop Server REST commands here:   https://hop.apache.org/manual/latest/hop-server/rest-api.html   For instance to start pipeline you execute Start Pipeline. I guess it will be (never played with Hop Server but have experience with Carte): http://localhost:8081/hop/startPipeline

Fw: ETL metadata injection - how to add header to text file

2023-05-31 Thread podunk
Sorry for bringing this up, but does anyone have any ideas. Is there any way to get the header or is it not possible to get it?   Sent: Tuesday, May 09, 2023 at 4:21 PM From: pod...@gmx.com To: users@hop.apache.org Subject: ETL metadata injection - how to add header to text file       I'm

ETL metadata injection - how to add header to text file

2023-05-09 Thread podunk
  Hello dear Hop creaters,   I'm learning "ETL metadata injection". I succeeded with test transformations but I wonder how to insert header in result text file. In "ETL metadata injection" hop, in "Text file output" I see; HEADER => Include header row (Y/N). So I added one more hop, "Add const

Re: HOP Server REST API

2023-03-21 Thread podunk
  So Matt, I have no idea how can I sent JSON to Carte server. Maybe you have some example? Best   Sent: Tuesday, March 21, 2023 at 1:43 PM From: "Matt Casters" To: users@hop.apache.org Subject: Re: HOP Server REST API Again, you can already do this using the existing web service. The only

Re: HOP Server REST API

2023-03-21 Thread podunk
I meant Hop Server could handle POST payload. Now it is only possible to call it with parameters, for instance:   http://127.0.0.1:8181/kettle/executeTrans/?trans=sometransformation.ktr&patameter1=m42   But sometimes I need to post XML, JSON or else Sent: Tuesday, March 21, 2023 at 1:06 PM Fr

Re: HOP Server REST API

2023-03-21 Thread podunk
  Would be great if we could sent some palyload to Carte (I do not know what's the name in Hop) - not only parameters. That's what I've always missed in Kettle.   Sent: Thursday, March 09, 2023 at 9:36 AM From: "Matt Casters" To: users@hop.apache.org Subject: Re: HOP Server REST API Hi Phil,

Re: Any trick to read data from Excel file where no of columns is not known?

2022-12-02 Thread podunk
Thank you!     Sent: Friday, December 02, 2022 at 1:07 PM From: "Hans Van Akelyen" To: pod...@gmx.com, users@hop.apache.org Subject: Re: Any trick to read data from Excel file where no of columns is not known? It’s not part of our distribution but there is a python transform [1] Cheers, Hans

Re: Any trick to read data from Excel file where no of columns is not known?

2022-12-02 Thread podunk
Thank you Matt,   that looks quite mosaic :-) Maybe I'd try to use Python in the first stages. But there's no Python action in Hop :-( There will be one day? Regards     Sent: Thursday, December 01, 2022 at 4:28 PM From: "Matt Casters" To: users@hop.apache.org Subject: Re: Any trick to read d

Any trick to read data from Excel file where no of columns is not known?

2022-12-01 Thread podunk
Hello, do we have some way to read data from Excel file where number of columns is unknown? I mean sometimes file can be like: column_1; column_2 but other time column_1; column_2; column_3; column_3 Normally we need to define them in 'Fields' tab - possible not to do that in a fixed way? R

Re: Beam File Input - unexpected result

2022-11-09 Thread podunk
I did open issue in Jira: HOP-4575[https://issues.apache.org/jira/browse/HOP-4575] Looks like bug   This feature ([2] https://hop.apache.org/manual/latest/hop-gui/perspective-execution-information.html#top)] does not work here. Clicking on localization icon gives nothing. When pressing CTRL-Shif

Re: Beam File Input - unexpected result

2022-11-07 Thread podunk
Thank you very much for your help! I will check out the options you mention - I did not know that I can preview Beam File Input result (however I'm aware that I can do this in Text File Input). Before I go deeper with this; will Beam engine give me some performance gain comparing to Hop proces

Beam File Input - unexpected result

2022-11-04 Thread podunk
Hi,   I'm playing with Beam pipeline. My goal is to merge two big files. So I have source (one of two) file like:   column_one|colum_two 0099"|"0080199111" ...   My trivial pipeline is: Beam File Input => Text file output I created definition for Beam File Input: separator "|", column_one - strin

Re: Where I can find variable for 'Input location' for Beam Input?

2022-11-04 Thread podunk
Thank you. I got it - this file is created in the project directory when new Pipeline Run Configuration is created. Variables are in ... 'variables' tab. BTW: When I move to new Hop version, how to import projects into new version? There's some tutorial about that?   Best    Sent: Thursday, Nove

Where I can find variable for 'Input location' for Beam Input?

2022-11-03 Thread podunk
Hi, I try to build some pipeline in Hop - test Beam feature. Where I can find variable for 'Input location' for Beam Input? If we look at complex.hpl example we have ${DATA_INPUT} definition for file. Where it is defined? I found it months ago but completely forgotten where it was. Thanks fo

Re: [ANNOUNCE] Apache Hop 2.1.0

2022-10-20 Thread podunk
Great! I'm going to test this new version soon   Mike     Sent: Tuesday, October 18, 2022 at 11:54 AM From: "Bart Maertens" To: annou...@apache.org, d...@hop.apache.org, users@hop.apache.org Subject: [ANNOUNCE] Apache Hop 2.1.0 The Apache Hop PMC and community are pleased to announce the ge

Re: Re: Ho to convert date in format ‘04/Oct/22 1:24 PM’ to 'normal one'?

2022-10-11 Thread podunk
Useful - thank you!     Sent: Tuesday, October 11, 2022 at 2:38 PM From: "christian.gutkne...@bluewin.ch" To: users@hop.apache.org Subject: Re: Re: Ho to convert date in format ‘04/Oct/22 1:24 PM’ to 'normal one'? Hi all   For date and time conversion I found this table to be helpful: https://

Re: Ho to convert date in format ‘04/Oct/22 1:24 PM’ to 'normal one'?

2022-10-11 Thread podunk
Thank you. I had problem to read it. Meanwhile I found that the oryginal format should be 'dd/MMM/yy h:mm a'. Thank you anyway!     Sent: Tuesday, October 11, 2022 at 2:16 PM From: "Bart Maertens" To: users@hop.apache.org Subject: Re: Ho to convert date in format ‘04/Oct/22 1:24 PM’ to 'normal

Ho to convert date in format ‘04/Oct/22 1:24 PM’ to 'normal one'?

2022-10-11 Thread podunk
Hello dear HOP creators!   Is there any way I can convert date like ‘04/Oct/22 1:24 PM’ to ‘04/10/2022 1:24’ format in Hop? Regards, Mike  

Re: Merge join issue on Beam [was: Join rows transform loops forever on Beam]

2022-09-05 Thread podunk
I think Merge Join is not working with Beam. I spent many hours trying to make it work without success. For this reason I decided to go back to Kettle - will be back when it's solved.   Regards,   Mike     Sent: Friday, September 02, 2022 at 3:14 PM From: "Fabian Peters" To: users@hop.apach

Re: Dimension lookup/update

2022-08-31 Thread podunk
HI,   I see "Synchronize after merge" does nothing but executes separate query for each row. So it will be terrible slow with hundreds of thousands of records.     Sent: Tuesday, August 30, 2022 at 1:53 PM From: "Hans Van Akelyen" To: users@hop.apache.org Subject: Re: Dimension lookup/update

Re: Dimension lookup/update

2022-08-30 Thread podunk
That's a good idea - thank you!     Sent: Tuesday, August 30, 2022 at 1:53 PM From: "Hans Van Akelyen" To: users@hop.apache.org Subject: Re: Dimension lookup/update Another solution to avoid all the lookups is to use a table input and load the source table. Then you can use "Merge Rows (diff)"

Re: Dimension lookup/update

2022-08-30 Thread podunk
  Thank you both for quick reaction.   I'm searching for some way to quickly update table with millions of records.   I know 'Insert / update' but this is terrible slow - so may queries.   I know I can do some workaround like instert into temp table and execute SQL query (update table takin

Dimension lookup/update

2022-08-30 Thread podunk
  Hello!   I try to use 'Dimension lookup/update' hop and I do not understand the meaning of two fields in properties:   "Date range start field / Table date range end"   My data has no date column. I do not need it. So I cannot specify any date. What this field is for and how to ignore it?

Re: Beam input - problem with data format

2022-06-07 Thread podunk
  After another few days I spent on it I'm quite close this is some bug in software:   Capture1.PNG - when executed 'Local'   "2022/06/07 22:53:53 - merge_join_test - client_id Integer(15) : There was a data type error: the data type of java.lang.String object ["Some customer 4"] does not cor

Beam input - problem with data format

2022-06-03 Thread podunk
  Hi,   since 3 hours I'm trying to do such trivial thing like opne file in Beam input.   My file is:   80010;Some customer 1;2344;Address 1 80011;Some customer 2;7546;Address 2 80012;Some customer 3;4564;Address 3 80013;Some customer 4;7564;Address 4 80014;Some customer 5;2354;Address 5  

Re: How to send pipeline to Flink?

2022-06-01 Thread podunk
I tried several things but I need help:   "[local], [collection] or [auto]": - 'local' means use embeded Flink (so Hop has Flink engine built in?)? - 'auto' will generate some engine independent Flink job? - 'collection' ?   It is executed in my PC Flink installation only if i set The Flink

Re: How to send pipeline to Flink?

2022-05-31 Thread podunk
Wow! That's really you Matt!? You're a living legend to me :-)   Kettle was (still is) amazing piece of software. I was sad that Hitachi Vantara is killing this product. But when I started looking on the Internet to see if there was any alternative and it turned out that there is Hop, I was delig

How to send pipeline to Flink?

2022-05-30 Thread podunk
  Hello community!     I'm learning Apache Flink. I launched test installation on my PC (version 1.13.6), I have HOP running and now I want to run first pipeline on Flink. Yet for some reason it does not work. What I did:   1. I exported fat jar according to this tutorial: https://hop.apach