Re: [I] `test_sort_1k_mem` failed with too many open file error when I run locally [datafusion]

2024-05-27 Thread via GitHub 


mustafasrepo commented on issue #10674:
URL: https://github.com/apache/datafusion/issues/10674#issuecomment-2132823540

   On macos I use command `ulimit -S -n 2048` in the terminal to increase open 
file limit (Not aware of any cargo only solution).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org

[I] `test_sort_1k_mem` failed with too many open file error when I run locally [datafusion]

2024-05-25 Thread via GitHub 


jayzhan211 opened a new issue, #10674:
URL: https://github.com/apache/datafusion/issues/10674

   ### Describe the bug
   
   It has been annoyed me a while
   I get this error when run locally, and the failure **is not shown in CI**
   ```
   failures:
   
    fuzz_cases::sort_fuzz::test_sort_1k_mem stdout 
   thread 'fuzz_cases::sort_fuzz::test_sort_1k_mem' panicked at 
datafusion/core/tests/fuzz_cases/sort_fuzz.rs:148:63:
   called `Result::unwrap()` on an `Err` value: Execution("Failed to create 
partition file at 
\"/var/folders/73/gkp858j550z_tt8bx1m8k67wgn/T/.tmpXo6QCe/.tmpv6tET2\": Os 
{ code: 24, kind: Uncategorized, message: \"Too many open files\" }")
   note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
   
   
   failures:
   fuzz_cases::sort_fuzz::test_sort_1k_mem
   
   test result: FAILED. 23 passed; 1 failed; 0 ignored; 0 measured; 0 filtered 
out; finished in 11.56s
   ```
   
   ### To Reproduce
   
   `cargo test --lib --tests --bins --features avro,json`
   
   ### Expected behavior
   
   I expect to run the test pass locally. what setting should I use?
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org