[GitHub] [spark] sadikovi commented on pull request #38277: [SPARK-40815][SQL] Add `DelegateSymlinkTextInputFormat` to workaround `SymlinkTextInputSplit` bug

2022-11-03 Thread GitBox
sadikovi commented on PR #38277: URL: https://github.com/apache/spark/pull/38277#issuecomment-1303041794 Issue is reproducible even with SymlinkTextInputFormat, not related to delegate class. Also, the test runs just fine when "SPARK-34512: Disable validate default values when parsing Avro

[GitHub] [spark] sadikovi commented on pull request #38277: [SPARK-40815][SQL] Add `DelegateSymlinkTextInputFormat` to workaround `SymlinkTextInputSplit` bug

2022-11-03 Thread GitBox
sadikovi commented on PR #38277: URL: https://github.com/apache/spark/pull/38277#issuecomment-1303013950 Actually, I can repro by running the entire test suite, does not reproduce when running the test individually. -- This is an automated message from the Apache Git Service. To respond t

[GitHub] [spark] sadikovi commented on pull request #38277: [SPARK-40815][SQL] Add `DelegateSymlinkTextInputFormat` to workaround `SymlinkTextInputSplit` bug

2022-11-03 Thread GitBox
sadikovi commented on PR #38277: URL: https://github.com/apache/spark/pull/38277#issuecomment-1303009433 @dongjoon-hyun I am trying to repro with JDK 11 (11.0.16) and the test passes just fine. Did you have to do any special setup to trigger the problem? -- This is an automated message fr

[GitHub] [spark] sadikovi commented on pull request #38277: [SPARK-40815][SQL] Add `DelegateSymlinkTextInputFormat` to workaround `SymlinkTextInputSplit` bug

2022-11-03 Thread GitBox
sadikovi commented on PR #38277: URL: https://github.com/apache/spark/pull/38277#issuecomment-1302660409 Let me open a PR to disable the test and I will open a fix as a follow-up. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] sadikovi commented on pull request #38277: [SPARK-40815][SQL] Add `DelegateSymlinkTextInputFormat` to workaround `SymlinkTextInputSplit` bug

2022-11-03 Thread GitBox
sadikovi commented on PR #38277: URL: https://github.com/apache/spark/pull/38277#issuecomment-1301835813 @HyukjinKwon Strange, there is nothing JDK specific in the test. Can you share how I can reproduce the issue locally with JDK 11 or JDK 17? I can open a follow-up PR to fix the test tomo

[GitHub] [spark] sadikovi commented on pull request #38277: [SPARK-40815][SQL] Add `DelegateSymlinkTextInputFormat` to workaround `SymlinkTextInputSplit` bug

2022-10-31 Thread GitBox
sadikovi commented on PR #38277: URL: https://github.com/apache/spark/pull/38277#issuecomment-1297826231 Thank you @dongjoon-hyun for merging 👍. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [spark] sadikovi commented on pull request #38277: [SPARK-40815][SQL] Add `DelegateSymlinkTextInputFormat` to workaround `SymlinkTextInputSplit` bug

2022-10-31 Thread GitBox
sadikovi commented on PR #38277: URL: https://github.com/apache/spark/pull/38277#issuecomment-1297806098 Thanks for updating the PR title 👍. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp