PhilipCubix opened a new issue, #7086:
URL: https://github.com/apache/hop/issues/7086

   ### Apache Hop version?
   
   2.17
   
   ### Java version?
   
   OpenJDK 64-Bit Server VM Temurin-21.0.9+10
   
   ### Operating system
   
   Windows
   
   ### What happened?
   
   Hi,
   
   We're using the JSONinput transform with the "ignore empty file" setting 
checked, but without the "ignore missing path" setting checked.
   
   So we would be expecting an empty file to stop being processed immediately 
after it is detected, but Hop continues processing these empty files, and it 
then throws errors when it cannot find the paths it is expecting:
   
   `2026/05/02 12:01:44 - tariffNumber.0 - File 
[file:///C:/hopworkdir/cubix_ts_bc_tariffNumber_2026-05-02_120128_1.json] is 
empty!
   2026/05/02 12:01:44 - shipToAddress.0 - File 
[file:///C:/hopworkdir/cubix_ts_bc_shipToAddress_2026-05-02_120127_1.json] is 
empty!
   2026/05/02 12:01:44 - shipToAddress.0 - ERROR: 
   2026/05/02 12:01:44 - shipToAddress.0 - We can not find any data with path 
[$.value.*.address]!
   2026/05/02 12:01:44 - shipmentMethod.0 - Finished processing (I=20, O=0, 
R=0, W=20, U=0, E=0)
   2026/05/02 12:01:44 - tariffNumber.0 - ERROR: 
   2026/05/02 12:01:44 - tariffNumber.0 - We can not find any data with path 
[$.value.*.ccsImportTax]!
   2026/05/02 12:01:44 - glAccount.0 - File 
[file:///C:/hopworkdir/cubix_ts_bc_glAccount_2026-05-02_120128_1.json] is empty!
   2026/05/02 12:01:44 - shipToAddress.0 - ERROR: 
org.apache.hop.pipeline.transforms.jsoninput.exception.JsonInputException: 
   2026/05/02 12:01:44 - shipToAddress.0 - We can not find any data with path 
[$.value.*.address]!
   2026/05/02 12:01:44 - shipToAddress.0 - 
   2026/05/02 12:01:44 - shipToAddress.0 -      at 
org.apache.hop.pipeline.transforms.jsoninput.reader.FastJsonReader.evalCombinedResult(FastJsonReader.java:322)
   2026/05/02 12:01:44 - shipToAddress.0 -      at 
org.apache.hop.pipeline.transforms.jsoninput.reader.FastJsonReader.getRow(FastJsonReader.java:210)
   2026/05/02 12:01:44 - shipToAddress.0 -      at 
org.apache.hop.pipeline.transforms.jsoninput.reader.FastJsonReader.parseStringValue(FastJsonReader.java:200)
   2026/05/02 12:01:44 - shipToAddress.0 -      at 
org.apache.hop.pipeline.transforms.jsoninput.JsonInput.parseNextInputToRowSet(JsonInput.java:286)
   2026/05/02 12:01:44 - shipToAddress.0 -      at 
org.apache.hop.pipeline.transforms.jsoninput.JsonInput.getOneOutputRow(JsonInput.java:394)
   2026/05/02 12:01:44 - shipToAddress.0 -      at 
org.apache.hop.pipeline.transforms.jsoninput.JsonInput.processRow(JsonInput.java:117)
   2026/05/02 12:01:44 - shipToAddress.0 -      at 
org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:54)
   2026/05/02 12:01:44 - shipToAddress.0 -      at 
java.base/java.lang.Thread.run(Unknown Source)
   2026/05/02 12:01:44 - tariffNumber.0 - ERROR: 
org.apache.hop.pipeline.transforms.jsoninput.exception.JsonInputException: 
   2026/05/02 12:01:44 - tariffNumber.0 - We can not find any data with path 
[$.value.*.ccsImportTax]!
   2026/05/02 12:01:44 - tariffNumber.0 - 
   2026/05/02 12:01:44 - tariffNumber.0 -       at 
org.apache.hop.pipeline.transforms.jsoninput.reader.FastJsonReader.evalCombinedResult(FastJsonReader.java:322)
   2026/05/02 12:01:44 - tariffNumber.0 -       at 
org.apache.hop.pipeline.transforms.jsoninput.reader.FastJsonReader.getRow(FastJsonReader.java:210)
   2026/05/02 12:01:44 - tariffNumber.0 -       at 
org.apache.hop.pipeline.transforms.jsoninput.reader.FastJsonReader.parseStringValue(FastJsonReader.java:200)
   2026/05/02 12:01:44 - tariffNumber.0 -       at 
org.apache.hop.pipeline.transforms.jsoninput.JsonInput.parseNextInputToRowSet(JsonInput.java:286)
   2026/05/02 12:01:44 - tariffNumber.0 -       at 
org.apache.hop.pipeline.transforms.jsoninput.JsonInput.getOneOutputRow(JsonInput.java:394)
   2026/05/02 12:01:44 - tariffNumber.0 -       at 
org.apache.hop.pipeline.transforms.jsoninput.JsonInput.processRow(JsonInput.java:117)
   2026/05/02 12:01:44 - tariffNumber.0 -       at 
org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:54)
   2026/05/02 12:01:44 - tariffNumber.0 -       at 
java.base/java.lang.Thread.run(Unknown Source)
   2026/05/02 12:01:44 - glAccount.0 - ERROR: 
   2026/05/02 12:01:44 - glAccount.0 - We can not find any data with path 
[$.value.*.accountCategory]!
   2026/05/02 12:01:44 - Get variables 15.0 - Finished processing (I=0, O=0, 
R=20, W=20, U=0, E=0)
   2026/05/02 12:01:44 - glAccount.0 - ERROR: 
org.apache.hop.pipeline.transforms.jsoninput.exception.JsonInputException: 
   2026/05/02 12:01:44 - glAccount.0 - We can not find any data with path 
[$.value.*.accountCategory]!
   2026/05/02 12:01:44 - glAccount.0 - 
   2026/05/02 12:01:44 - glAccount.0 -  at 
org.apache.hop.pipeline.transforms.jsoninput.reader.FastJsonReader.evalCombinedResult(FastJsonReader.java:322)
   2026/05/02 12:01:44 - glAccount.0 -  at 
org.apache.hop.pipeline.transforms.jsoninput.reader.FastJsonReader.getRow(FastJsonReader.java:210)
   2026/05/02 12:01:44 - glAccount.0 -  at 
org.apache.hop.pipeline.transforms.jsoninput.reader.FastJsonReader.parseStringValue(FastJsonReader.java:200)
   2026/05/02 12:01:44 - glAccount.0 -  at 
org.apache.hop.pipeline.transforms.jsoninput.JsonInput.parseNextInputToRowSet(JsonInput.java:286)
   2026/05/02 12:01:44 - glAccount.0 -  at 
org.apache.hop.pipeline.transforms.jsoninput.JsonInput.getOneOutputRow(JsonInput.java:394)
   2026/05/02 12:01:44 - glAccount.0 -  at 
org.apache.hop.pipeline.transforms.jsoninput.JsonInput.processRow(JsonInput.java:117)
   2026/05/02 12:01:44 - glAccount.0 -  at 
org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:54)
   2026/05/02 12:01:44 - glAccount.0 -  at 
java.base/java.lang.Thread.run(Unknown Source)
   2026/05/02 12:01:44 - tariffNumber.0 - Finished processing (I=0, O=0, R=0, 
W=0, U=0, E=1)
   2026/05/02 12:01:44 - shipToAddress.0 - Finished processing (I=0, O=0, R=0, 
W=0, U=0, E=1)
   2026/05/02 12:01:44 - glAccount.0 - Finished processing (I=0, O=0, R=0, W=0, 
U=0, E=1)
   2026/05/02 12:01:44 - staging-BC-read-data - Pipeline detected one or more 
transforms with errors.
   2026/05/02 12:01:44 - staging-BC-read-data - Pipeline is killing the other 
transforms!`
   
   
   ### Issue Priority
   
   Priority: 2
   
   ### Issue Component
   
   Component: Transforms


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to