[ 
https://issues.apache.org/jira/browse/HUDI-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404818#comment-17404818
 ] 

ASF GitHub Bot commented on HUDI-2364:
--------------------------------------

hudi-bot commented on pull request #3540:
URL: https://github.com/apache/hudi/pull/3540#issuecomment-905980036


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "01cf15ad7e1cfdca2b282236756e31e8338b5a09",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "01cf15ad7e1cfdca2b282236756e31e8338b5a09",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 01cf15ad7e1cfdca2b282236756e31e8338b5a09 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run travis` re-run the last Travis build
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Run compaction without user schema file provided
> ------------------------------------------------
>
>                 Key: HUDI-2364
>                 URL: https://issues.apache.org/jira/browse/HUDI-2364
>             Project: Apache Hudi
>          Issue Type: New Feature
>            Reporter: Wenning Ding
>            Priority: Major
>              Labels: pull-request-available
>
> Currently to run Hudi compaction manually, customers have to pass the avsc 
> file of data schema by themselves,
>  e.g. in Hudi CLI,
>  
> {{}}
> {code:java}
> compaction run --compactionInstant 20201203005420 \ --parallelism 2 
> --sparkMemory 2G \ --schemaFilePath s3://xxx/hudi/mor_schema.avsc \ 
> --propsFilePath file:///home/hadoop/config.properties --retry 1
> {code}
> Let customers provide avsc file is not a good option. Some customers don’t 
> know how to generate this schema file, and some customers pass the wrong 
> schema file and get other exceptions. We should handle this logic inside Hudi 
> if possible.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to