hansva opened a new issue, #9279:
URL: https://github.com/apache/hop/issues/9279
### Apache Hop version?
2.20.0
### Java version?
21
### Operating system
Other
### What happened?
`BeamAvroFileIOTest` in `plugins/engines/beam` fails now and then:
[ERROR] BeamAvroFileIOTest.rowLimitCapsWhatOneWorkerEmits:130
expected: <[keep-me|alice|1]> but was: <[keep-me|bob|2]>
[ERROR] BeamAvroFileIOTest.writeThenReadKeepsTheIncomingRow:115
expected: <alice> but was: <bob>
**Cause**
The test writes two rows, `Create.of(alice, bob)`, through
`AvroIO.writeGenericRecords(...).withoutSharding()` on the Direct runner. Then
it expects `alice` to be the first record in the file. Beam does not promise
any element order through a write. Writing a single shard groups the rows by
key, and the Direct runner shuffles bundles on purpose. So the file sometimes
starts with `bob`.
- `writeThenReadKeepsTheIncomingRow` checks the records by position and
fails when `bob` comes first.
- `rowLimitCapsWhatOneWorkerEmits` reads with a row limit of 1. The reader
correctly returns the first record in the file, but the test always expects
`alice`.
The Avro input and output code works correctly. Only the test is wrong.
### Issue Priority
Priority: 2
### Issue Component
Component: Beam
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
