[jira] [Updated] (HUDI-118) Hudi CLI : Provide options for passing properties to Compactor, Cleaner and ParquetImporter
[ https://issues.apache.org/jira/browse/HUDI-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-118: Fix Version/s: (was: 0.5.2) 0.5.1 > Hudi CLI : Provide options for passing properties to Compactor, Cleaner and > ParquetImporter > > > Key: HUDI-118 > URL: https://issues.apache.org/jira/browse/HUDI-118 > Project: Apache Hudi (incubating) > Issue Type: Improvement > Components: CLI, Common Core, newbie >Reporter: Balaji Varadarajan >Assignee: Pratyaksh Sharma >Priority: Minor > Labels: pull-request-available > Fix For: 0.5.1 > > Time Spent: 20m > Remaining Estimate: 0h > > For non-trivial CLI operations, we have a standalone script in hudi-utilities > that users can call directly using spark-submit (usually). We also have > commands in hudi-cli to invoke the commands directly from hudi-cli shell. > There was an earlier effort to allow users to pass properties directly to the > scripts in hudi-utilities but we still need to give the same functionality to > the corresponding commands in hudi-cli. > In hudi-cli, Compaction (schedule/compact), Cleaner and HDFSParquetImporter > command does not have option to pass DFS properties file. This is a followup > to PR [https://github.com/apache/incubator-hudi/pull/691] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-118) Hudi CLI : Provide options for passing properties to Compactor, Cleaner and ParquetImporter
[ https://issues.apache.org/jira/browse/HUDI-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi updated HUDI-118: --- Fix Version/s: (was: 0.5.1) 0.5.2 > Hudi CLI : Provide options for passing properties to Compactor, Cleaner and > ParquetImporter > > > Key: HUDI-118 > URL: https://issues.apache.org/jira/browse/HUDI-118 > Project: Apache Hudi (incubating) > Issue Type: Improvement > Components: CLI, Common Core, newbie >Reporter: Balaji Varadarajan >Assignee: Pratyaksh Sharma >Priority: Minor > Labels: pull-request-available > Fix For: 0.5.2 > > Time Spent: 20m > Remaining Estimate: 0h > > For non-trivial CLI operations, we have a standalone script in hudi-utilities > that users can call directly using spark-submit (usually). We also have > commands in hudi-cli to invoke the commands directly from hudi-cli shell. > There was an earlier effort to allow users to pass properties directly to the > scripts in hudi-utilities but we still need to give the same functionality to > the corresponding commands in hudi-cli. > In hudi-cli, Compaction (schedule/compact), Cleaner and HDFSParquetImporter > command does not have option to pass DFS properties file. This is a followup > to PR [https://github.com/apache/incubator-hudi/pull/691] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-118) Hudi CLI : Provide options for passing properties to Compactor, Cleaner and ParquetImporter
[ https://issues.apache.org/jira/browse/HUDI-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-118: --- Status: Closed (was: Patch Available) > Hudi CLI : Provide options for passing properties to Compactor, Cleaner and > ParquetImporter > > > Key: HUDI-118 > URL: https://issues.apache.org/jira/browse/HUDI-118 > Project: Apache Hudi (incubating) > Issue Type: Improvement > Components: CLI, Common Core, newbie >Reporter: Balaji Varadarajan >Assignee: Pratyaksh Sharma >Priority: Minor > Labels: pull-request-available > Fix For: 0.5.1 > > Time Spent: 20m > Remaining Estimate: 0h > > For non-trivial CLI operations, we have a standalone script in hudi-utilities > that users can call directly using spark-submit (usually). We also have > commands in hudi-cli to invoke the commands directly from hudi-cli shell. > There was an earlier effort to allow users to pass properties directly to the > scripts in hudi-utilities but we still need to give the same functionality to > the corresponding commands in hudi-cli. > In hudi-cli, Compaction (schedule/compact), Cleaner and HDFSParquetImporter > command does not have option to pass DFS properties file. This is a followup > to PR [https://github.com/apache/incubator-hudi/pull/691] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-118) Hudi CLI : Provide options for passing properties to Compactor, Cleaner and ParquetImporter
[ https://issues.apache.org/jira/browse/HUDI-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-118: -- Fix Version/s: 0.5.1 > Hudi CLI : Provide options for passing properties to Compactor, Cleaner and > ParquetImporter > > > Key: HUDI-118 > URL: https://issues.apache.org/jira/browse/HUDI-118 > Project: Apache Hudi (incubating) > Issue Type: Improvement > Components: CLI, Common Core, newbie >Reporter: Balaji Varadarajan >Assignee: Pratyaksh Sharma >Priority: Minor > Labels: pull-request-available > Fix For: 0.5.1 > > Time Spent: 10m > Remaining Estimate: 0h > > For non-trivial CLI operations, we have a standalone script in hudi-utilities > that users can call directly using spark-submit (usually). We also have > commands in hudi-cli to invoke the commands directly from hudi-cli shell. > There was an earlier effort to allow users to pass properties directly to the > scripts in hudi-utilities but we still need to give the same functionality to > the corresponding commands in hudi-cli. > In hudi-cli, Compaction (schedule/compact), Cleaner and HDFSParquetImporter > command does not have option to pass DFS properties file. This is a followup > to PR [https://github.com/apache/incubator-hudi/pull/691] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-118) Hudi CLI : Provide options for passing properties to Compactor, Cleaner and ParquetImporter
[ https://issues.apache.org/jira/browse/HUDI-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-118: Component/s: Common Core > Hudi CLI : Provide options for passing properties to Compactor, Cleaner and > ParquetImporter > > > Key: HUDI-118 > URL: https://issues.apache.org/jira/browse/HUDI-118 > Project: Apache Hudi (incubating) > Issue Type: Improvement > Components: CLI, Common Core, newbie >Reporter: Balaji Varadarajan >Assignee: Pratyaksh Sharma >Priority: Minor > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > For non-trivial CLI operations, we have a standalone script in hudi-utilities > that users can call directly using spark-submit (usually). We also have > commands in hudi-cli to invoke the commands directly from hudi-cli shell. > There was an earlier effort to allow users to pass properties directly to the > scripts in hudi-utilities but we still need to give the same functionality to > the corresponding commands in hudi-cli. > In hudi-cli, Compaction (schedule/compact), Cleaner and HDFSParquetImporter > command does not have option to pass DFS properties file. This is a followup > to PR [https://github.com/apache/incubator-hudi/pull/691] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-118) Hudi CLI : Provide options for passing properties to Compactor, Cleaner and ParquetImporter
[ https://issues.apache.org/jira/browse/HUDI-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-118: Status: Patch Available (was: In Progress) > Hudi CLI : Provide options for passing properties to Compactor, Cleaner and > ParquetImporter > > > Key: HUDI-118 > URL: https://issues.apache.org/jira/browse/HUDI-118 > Project: Apache Hudi (incubating) > Issue Type: Improvement > Components: CLI, newbie >Reporter: Balaji Varadarajan >Assignee: Pratyaksh Sharma >Priority: Minor > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > For non-trivial CLI operations, we have a standalone script in hudi-utilities > that users can call directly using spark-submit (usually). We also have > commands in hudi-cli to invoke the commands directly from hudi-cli shell. > There was an earlier effort to allow users to pass properties directly to the > scripts in hudi-utilities but we still need to give the same functionality to > the corresponding commands in hudi-cli. > In hudi-cli, Compaction (schedule/compact), Cleaner and HDFSParquetImporter > command does not have option to pass DFS properties file. This is a followup > to PR [https://github.com/apache/incubator-hudi/pull/691] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-118) Hudi CLI : Provide options for passing properties to Compactor, Cleaner and ParquetImporter
[ https://issues.apache.org/jira/browse/HUDI-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-118: Labels: pull-request-available (was: ) > Hudi CLI : Provide options for passing properties to Compactor, Cleaner and > ParquetImporter > > > Key: HUDI-118 > URL: https://issues.apache.org/jira/browse/HUDI-118 > Project: Apache Hudi (incubating) > Issue Type: Improvement > Components: CLI, newbie >Reporter: Balaji Varadarajan >Assignee: Pratyaksh Sharma >Priority: Minor > Labels: pull-request-available > > For non-trivial CLI operations, we have a standalone script in hudi-utilities > that users can call directly using spark-submit (usually). We also have > commands in hudi-cli to invoke the commands directly from hudi-cli shell. > There was an earlier effort to allow users to pass properties directly to the > scripts in hudi-utilities but we still need to give the same functionality to > the corresponding commands in hudi-cli. > In hudi-cli, Compaction (schedule/compact), Cleaner and HDFSParquetImporter > command does not have option to pass DFS properties file. This is a followup > to PR [https://github.com/apache/incubator-hudi/pull/691] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-118) Hudi CLI : Provide options for passing properties to Compactor, Cleaner and ParquetImporter
[ https://issues.apache.org/jira/browse/HUDI-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan updated HUDI-118: Description: For non-trivial CLI operations, we have a standalone script in hudi-utilities that users can call directly using spark-submit (usually). We also have commands in hudi-cli to invoke the commands directly from hudi-cli shell. There was an earlier effort to allow users to pass properties directly to the scripts in hudi-utilities but we still need to give the same functionality to the corresponding commands in hudi-cli. In hudi-cli, Compaction (schedule/compact), Cleaner and HDFSParquetImporter command does not have option to pass DFS properties file. This is a followup to PR [https://github.com/apache/incubator-hudi/pull/691] was:Compaction (schedule/compact), Cleaner and HDFSParquetImporter command does not have option to pass DFS properties file. This is a followup to PR https://github.com/apache/incubator-hudi/pull/691 > Hudi CLI : Provide options for passing properties to Compactor, Cleaner and > ParquetImporter > > > Key: HUDI-118 > URL: https://issues.apache.org/jira/browse/HUDI-118 > Project: Apache Hudi (incubating) > Issue Type: Improvement > Components: CLI, newbie >Reporter: Balaji Varadarajan >Assignee: Pratyaksh Sharma >Priority: Minor > > For non-trivial CLI operations, we have a standalone script in hudi-utilities > that users can call directly using spark-submit (usually). We also have > commands in hudi-cli to invoke the commands directly from hudi-cli shell. > There was an earlier effort to allow users to pass properties directly to the > scripts in hudi-utilities but we still need to give the same functionality to > the corresponding commands in hudi-cli. > In hudi-cli, Compaction (schedule/compact), Cleaner and HDFSParquetImporter > command does not have option to pass DFS properties file. This is a followup > to PR [https://github.com/apache/incubator-hudi/pull/691] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-118) Hudi CLI : Provide options for passing properties to Compactor, Cleaner and ParquetImporter
[ https://issues.apache.org/jira/browse/HUDI-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan updated HUDI-118: Summary: Hudi CLI : Provide options for passing properties to Compactor, Cleaner and ParquetImporter (was: Provide CLI Option for passing properties to Compactor, Cleaner and ParquetImporter) > Hudi CLI : Provide options for passing properties to Compactor, Cleaner and > ParquetImporter > > > Key: HUDI-118 > URL: https://issues.apache.org/jira/browse/HUDI-118 > Project: Apache Hudi (incubating) > Issue Type: Improvement > Components: CLI, newbie >Reporter: Balaji Varadarajan >Assignee: Pratyaksh Sharma >Priority: Minor > > Compaction (schedule/compact), Cleaner and HDFSParquetImporter command does > not have option to pass DFS properties file. This is a followup to PR > https://github.com/apache/incubator-hudi/pull/691 -- This message was sent by Atlassian Jira (v8.3.4#803005)
