Re: [I] [Feature Request]: Allow users to define default data types (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #2756: URL: https://github.com/apache/hop/issues/2756#issuecomment-1813339564 I proposed the introduction of a new "DDL" metadata type (#2781) so perhaps we need some DDL Settings to go along with that. We could steer data types in a certain direction as post

Re: [I] [Feature Request]: Option to Execute DDL SQL on the fly (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #2781: URL: https://github.com/apache/hop/issues/2781#issuecomment-1813334068 It's not because of the technical limitations that we've been staying away from this. It's because of the bad practices it encourages to actually use this. Perhaps we can introdu

Re: [I] [Bug]: Documentation - Web service doc - 1st parameter - execute or service? (hop)

2023-11-15 Thread via GitHub
kranskydog commented on issue #3277: URL: https://github.com/apache/hop/issues/3277#issuecomment-1813332406 re consistency - for this particular example, copy the 'Request Parameters' table from the first one to the second one, so it doesn't look like an afterthought -- This is an autom

Re: [I] [Feature Request]: I would like to run a project without having it added to hop-config.json (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #2916: URL: https://github.com/apache/hop/issues/2916#issuecomment-1813295867 To avoid having to add lots of options we could perhaps create this nameless project as per definition a folder location with in it contained all that is needed to run, including one

Re: [I] [Feature Request]: Use thousands separators in input boxes where possible. (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #2931: URL: https://github.com/apache/hop/issues/2931#issuecomment-1813285645 I'm sorry Brandon. I'm at a loss about what exactly you're asking for here. Which large numbers do you need to enter in the Parquet Output Dialog? -- This is an automated message

Re: [I] [Bug]: Cannot use Ctrl-C/Ctrl-V to copy paste into input boxes for setting up JDBC Generic connections URL (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #2967: URL: https://github.com/apache/hop/issues/2967#issuecomment-1813273753 Also couldn't reproduce on 2.7.0 (master) on Kubuntu 22.04.3 LTS -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [I] [Bug]: Dimension lookup/update cache issue (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #2978: URL: https://github.com/apache/hop/issues/2978#issuecomment-1813270273 Is this still an issue? If so, can we have an example that reproduces the problem? Thanks! -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [I] [Bug]: Injecting constant values only not working for Select Value transformation (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #2986: URL: https://github.com/apache/hop/issues/2986#issuecomment-1813268169 If you think about it, this is an incorrect usage of the constant values. It would only make sense for lists of exactly one constant value. That's why this was written in the [doc

Re: [I] [Bug]: When you edit a Note in dark mode, make no changes, and close the note, the font and background colors can change (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #2989: URL: https://github.com/apache/hop/issues/2989#issuecomment-1813253124 Still an issue in 2.7.0, increase priority to fix. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

Re: [I] [Task]: While editing a Pipeline Action on a workflow, the “play icon” is used with flyout “Edit this metadata element” such that it is non-intuitive (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #2991: URL: https://github.com/apache/hop/issues/2991#issuecomment-1813251611 It's the icon for the "Run Configuration" metadata element, which you can edit. -- This is an automated message from the Apache Git Service. To respond to the message, please log o

Re: [I] [Task]: While editing a Pipeline Action on a workflow, the “play icon” is used with flyout “Edit this metadata element” such that it is non-intuitive (hop)

2023-11-15 Thread via GitHub
mattcasters closed issue #2991: [Task]: While editing a Pipeline Action on a workflow, the “play icon” is used with flyout “Edit this metadata element” such that it is non-intuitive URL: https://github.com/apache/hop/issues/2991 -- This is an automated message from the Apache Git Service. To

Re: [I] [Feature Request]: Add the "Output steps metrics" transform to HOP (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #3003: URL: https://github.com/apache/hop/issues/3003#issuecomment-1813249343 Workaround is to get this information after the execution with the "Execution Information" transform in another pipeline. -- This is an automated message from the Apache Git Servic

Re: [I] [Bug]: non-unique key-value mapping for simple mapping transformation when using metadata injection transformation (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #3025: URL: https://github.com/apache/hop/issues/3025#issuecomment-1813246654 [issue-3025.zip](https://github.com/apache/hop/files/13369477/issue-3025.zip) Confirmed. We need to add the injection details in the Hop metadata annotations of the properties

Re: [I] Webservice URL custon (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #3098: URL: https://github.com/apache/hop/issues/3098#issuecomment-1813216771 So I guess what's being asked is to provide real Enterprise Application Integration functionality like you see in Boomi, Mulesoft, and others. I think it's indeed possible to do

Re: [I] [Feature Request]: Filter: Add "data preview" icons (hop)

2023-11-15 Thread via GitHub
nadment commented on issue #3137: URL: https://github.com/apache/hop/issues/3137#issuecomment-1813212001 I also think it's a good idea to place the data grid icon close to the arrows, with the number of records in the tooltip. -- This is an automated message from the Apache Git Service. T

Re: [I] [Bug]: removing workflow logging entry and file causes errors in Execution Information (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #3078: URL: https://github.com/apache/hop/issues/3078#issuecomment-1813207970 Logging to files is eventually consistent and the Neo4j implementation should be transactional. It's always possible that deleting execution nodes doesn't work correctly. However,

Re: [I] [Feature Request]: Add an Incremental Batch ID for Logging (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #3087: URL: https://github.com/apache/hop/issues/3087#issuecomment-1813204629 It was a nightmare in PDI because it's hard to impossible to get right in a concurrent execution scenario. Especially with multiple instances running, even on the same machine, it w

Re: [I] [Bug]: Adding a new Parameter by pressing the tab key multiple times in the Pipeline executor messes up GUI (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #3099: URL: https://github.com/apache/hop/issues/3099#issuecomment-1813199516 I can't reproduce this unfortunately. Is this still an issue for you on 2.6.0? -- This is an automated message from the Apache Git Service. To respond to the message, please log o

Re: [I] [Bug]: I use hop to run Pipeline in flink, can I get the JobID of Flink? (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #3131: URL: https://github.com/apache/hop/issues/3131#issuecomment-1813194107 For DataFlow we solved it by saving the specific details like Job ID, project ID, region, as details in the execution information location. So the `pipeline` object above is a

Re: [I] [Feature Request]: JavaScript: Pass all fields to ErrorHandling (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #3144: URL: https://github.com/apache/hop/issues/3144#issuecomment-1813169695 I'm don't think we can grab output values from the context when the script errors out with an exception. Perhaps you can handle the exception in the script itself? -- This is an

Re: [I] [Feature request]: Set Variables - add support for parents of a pipeline. (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #3232: URL: https://github.com/apache/hop/issues/3232#issuecomment-1813161564 Again, it's too complicated for me. If you have a need for usage tips, perhaps you can post a question to the mailing list or on the Mattermost chat service. Perhaps if you explain

Re: [I] [Bug]: Script transform with python fails when no data is present in the stream (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #3174: URL: https://github.com/apache/hop/issues/3174#issuecomment-1813154638 Perhaps we can create a new option in the Script transform to not process rows when there is no input to cover this scenario. -- This is an automated message from the Apache Git Se

Re: [I] [Bug]: Script transform with python fails when no data is present in the stream (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #3174: URL: https://github.com/apache/hop/issues/3174#issuecomment-1813138927 Well, I'm not sure we _can_ actually fix this. We want to have the Script transform being capable of generating rows, as shown in the integration tests for this transform. On the f

Re: [I] [Task]: Add new documentation page for: Fields, Parameters, and Variables (hop)

2023-11-15 Thread via GitHub
Mattang-Dan commented on issue #3185: URL: https://github.com/apache/hop/issues/3185#issuecomment-1813106274 I think it would be great to have a page that compares data row fields to variables to parameters in details, with all the common issues. Now you could copy the same information com

Re: [I] [Feature request]: Set Variables - add support for parents of a pipeline. (hop)

2023-11-15 Thread via GitHub
Mattang-Dan commented on issue #3232: URL: https://github.com/apache/hop/issues/3232#issuecomment-1813103235 for example, I could not use a Simple evaluation action in a workflow by referencing a parameter from a sub pipeline (unless it was my mistake). I had to use a variable in the Simple

Re: [I] [Bug]: Long table names result in a hard-to-read dialog buttons and overlap in Table Output transform (hop)

2023-11-15 Thread via GitHub
Mattang-Dan commented on issue #3398: URL: https://github.com/apache/hop/issues/3398#issuecomment-1813101413 It looks like the latest build (Nov. 15 of Hop 2.7) fixes this issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [I] [Bug]: Long table names result in a hard-to-read dialog buttons and overlap in Table Output transform (hop)

2023-11-15 Thread via GitHub
Mattang-Dan closed issue #3398: [Bug]: Long table names result in a hard-to-read dialog buttons and overlap in Table Output transform URL: https://github.com/apache/hop/issues/3398 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[I] [Bug]: Long table names result in a hard-to-read dialog buttons and overlap in Table Output transform (hop)

2023-11-15 Thread via GitHub
Mattang-Dan opened a new issue, #3398: URL: https://github.com/apache/hop/issues/3398 ### Apache Hop version? 2.7 ### Java version? openjdk 11.0.19 2023-04-18 LTS OpenJDK Runtime Environment Microsoft-7621296 (build 11.0.19+7-LTS) OpenJDK 64-Bit Server VM Microsoft-76212

Re: [I] [Feature Request]: Parquet File Output Base File Name Field Select (hop)

2023-11-15 Thread via GitHub
harrisward commented on issue #3242: URL: https://github.com/apache/hop/issues/3242#issuecomment-1812835680 I think that makes sense? Leave it up to the user to sort their data :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [I] [Feature Request]: Parquet File Output Base File Name Field Select (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #3242: URL: https://github.com/apache/hop/issues/3242#issuecomment-1812802221 Start a new file each time we get a new filename in the stream of rows? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

Re: [I] [Bug]:Get filename: Y/N flags not working properly when language is not English (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #3294: URL: https://github.com/apache/hop/issues/3294#issuecomment-1812792912 I would reject this case on the ground that we never translate data or metadata and wouldn't recommend starting with it. So IMO this is actually a feature request for proper tr

Re: [I] [Bug]: HopServer Shutdown listener requires no authentication (hop)

2023-11-15 Thread via GitHub
mattcasters commented on issue #3367: URL: https://github.com/apache/hop/issues/3367#issuecomment-1812786277 Thank you very much Michael! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] fix jsonpath renaming, #3315 (hop)

2023-11-15 Thread via GitHub
hansva merged PR #3396: URL: https://github.com/apache/hop/pull/3396 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hop.apache.org

[PR] fix jsonpath renaming, #3315 (hop)

2023-11-15 Thread via GitHub
hansva opened a new pull request, #3396: URL: https://github.com/apache/hop/pull/3396 **Please** add a meaningful description for your change here Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly an

Re: [I] [Feature Request]: Enhance "Enhanced JSON Output" to generate Arrays on field level (hop)

2023-11-15 Thread via GitHub
hansva commented on issue #3395: URL: https://github.com/apache/hop/issues/3395#issuecomment-1812113279 You are right, I think with the option you added you should be able to create all you need. You might need some extra steps but you should be able to create whatever json you need now,

Re: [I] [Feature Request]: Enhance "Enhanced JSON Output" to generate Arrays on field level (hop)

2023-11-15 Thread via GitHub
hansva closed issue #3395: [Feature Request]: Enhance "Enhanced JSON Output" to generate Arrays on field level URL: https://github.com/apache/hop/issues/3395 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [I] [Feature Request]: Enhance "Enhanced JSON Output" to generate Arrays on field level (hop)

2023-11-15 Thread via GitHub
vdwals commented on issue #3395: URL: https://github.com/apache/hop/issues/3395#issuecomment-1812068497 Hi, Good idea. I'm happy I could contribute and I might be able to continue doing so. I have issues imagening the expected outcome. |Nr|Name|Option| |::|::|::|

Re: [I] [Feature Request]: Parquet File Output Base File Name Field Select (hop)

2023-11-15 Thread via GitHub
harrisward commented on issue #3242: URL: https://github.com/apache/hop/issues/3242#issuecomment-1812012028 I think you are right and it would be the ability to write multiple files. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

Re: [I] [Feature Request]: Enhance "Enhanced JSON Output" to generate Arrays (hop)

2023-11-15 Thread via GitHub
hansva commented on issue #3287: URL: https://github.com/apache/hop/issues/3287#issuecomment-1811985123 I will mark this one as completed and created a follow up #3395 I think it would still be useful to have this option on field/element level -- This is an automated message from the Apac

Re: [I] [Feature Request]: Enhance "Enhanced JSON Output" to generate Arrays (hop)

2023-11-15 Thread via GitHub
hansva closed issue #3287: [Feature Request]: Enhance "Enhanced JSON Output" to generate Arrays URL: https://github.com/apache/hop/issues/3287 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe