This is an automated email from the ASF dual-hosted git repository.
apitrou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new 971bf38150 GH-38745: [Integration] Fix huge integration test (#38746)
971bf38150 is described below
commit 971bf381508c3633781f872a6cb3a4e8cc2a1f81
Author: Antoine Pitrou <[email protected]>
AuthorDate: Thu Nov 16 15:59:42 2023 +0100
GH-38745: [Integration] Fix huge integration test (#38746)
### Rationale for this change
For some reason, the decimal files generated by the integration test suite
have as many record batches as columns.
This looks like a programming error rather than something deliberate.
### What changes are included in this PR?
Use similar batch sizes as for other test files.
### Are these changes tested?
Yes.
### Are there any user-facing changes?
No.
* Closes: #38745
Authored-by: Antoine Pitrou <[email protected]>
Signed-off-by: Antoine Pitrou <[email protected]>
---
dev/archery/archery/integration/datagen.py | 6 ++----
1 file changed, 2 insertions(+), 4 deletions(-)
diff --git a/dev/archery/archery/integration/datagen.py
b/dev/archery/archery/integration/datagen.py
index 1ce2775c16..ff10c0bb03 100644
--- a/dev/archery/archery/integration/datagen.py
+++ b/dev/archery/archery/integration/datagen.py
@@ -1520,8 +1520,7 @@ def generate_decimal128_case():
for i, precision in enumerate(range(3, 39))
]
- possible_batch_sizes = 7, 10
- batch_sizes = [possible_batch_sizes[i % 2] for i in range(len(fields))]
+ batch_sizes = [7, 10]
# 'decimal' is the original name for the test, and it must match
# provide "gold" files that test backwards compatibility, so they
# can be appropriately skipped.
@@ -1535,8 +1534,7 @@ def generate_decimal256_case():
for i, precision in enumerate(range(37, 70))
]
- possible_batch_sizes = 7, 10
- batch_sizes = [possible_batch_sizes[i % 2] for i in range(len(fields))]
+ batch_sizes = [7, 10]
return _generate_file('decimal256', fields, batch_sizes)
