Re: [PR] [HUDI-7390] fix: HoodieStreamer no longer works without --props being supplied [hudi]
danny0405 merged PR #11414: URL: https://github.com/apache/hudi/pull/11414 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [HUDI-7390] fix: HoodieStreamer no longer works without --props being supplied [hudi]
hudi-bot commented on PR #11414: URL: https://github.com/apache/hudi/pull/11414#issuecomment-2154749790 ## CI report: * 3ffd431d11a16bfb032e905eceb5374d901cb6ee Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24270) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [HUDI-7390] fix: HoodieStreamer no longer works without --props being supplied [hudi]
hudi-bot commented on PR #11414: URL: https://github.com/apache/hudi/pull/11414#issuecomment-2154656824 ## CI report: * 3ffd431d11a16bfb032e905eceb5374d901cb6ee Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24270) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [HUDI-7390] fix: HoodieStreamer no longer works without --props being supplied [hudi]
hudi-bot commented on PR #11414: URL: https://github.com/apache/hudi/pull/11414#issuecomment-2154644253 ## CI report: * 3ffd431d11a16bfb032e905eceb5374d901cb6ee UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[PR] [HUDI-7390] fix: HoodieStreamer no longer works without --props being supplied [hudi]
wombatu-kun opened a new pull request, #11414: URL: https://github.com/apache/hudi/pull/11414 When attempting to run HoodieStreamer without a props file, specifying all required extra configuration via --hoodie-conf parameters, the execution fails and an exception is thrown: `HoodieIOException: Cannot read properties from dfs from file file:/private/tmp/hudi-props-repro/src/test/resources/streamer-config/dfs-source.properties` ### Change Logs When --props is not provided in command, then `propsFilePath` is set to default DEFAULT_DFS_SOURCE_PROPERTIES. So, if propsFilePath == DEFAULT_DFS_SOURCE_PROPERTIES, we should not try to read props file. ### Impact none ### Risk level (write none, low medium or high below) none ### Documentation Update none - _The config description must be updated if new configs are added or the default value of the configs are changed_ - _Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the ticket number here and follow the [instruction](https://hudi.apache.org/contribute/developer-setup#website) to make changes to the website._ ### Contributor's checklist - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [ ] Change Logs and Impact were stated clearly - [ ] Adequate tests were added if applicable - [ ] CI passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org