[GitHub] [incubator-hudi] vinothchandar commented on issue #1105: [WIP] [HUDI-405] Fix sync no hive partition at first time

2020-01-01 Thread GitBox
vinothchandar commented on issue #1105: [WIP] [HUDI-405] Fix sync no hive 
partition at first time
URL: https://github.com/apache/incubator-hudi/pull/1105#issuecomment-570112392
 
 
   @lamber-ken can you fix the PR title.. 
   I am going to ask @bvaradar to take a quick look and confirm dropping this 
is fine at uber.. and after these two we can merge


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [incubator-hudi] vinothchandar commented on issue #1105: [WIP] [HUDI-405] Fix sync no hive partition at first time

2019-12-31 Thread GitBox
vinothchandar commented on issue #1105: [WIP] [HUDI-405] Fix sync no hive 
partition at first time
URL: https://github.com/apache/incubator-hudi/pull/1105#issuecomment-57005
 
 
   >option("hoodie.datasource.hive_sync.assume_date_partitioning", true).
   
   We don't expect this to be set by anyone except Uber.. `false` has been the 
default ever since.. So I think the right thing may be is to remove this config 
from DataSource if thats what causes this issue.. We should still keep this on 
the WriteClient level. 
http://hudi.apache.org/configurations.html#withAssumeDatePartitioning clearly 
calls out the version requirements.. 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [incubator-hudi] vinothchandar commented on issue #1105: [WIP] [HUDI-405] Fix sync no hive partition at first time

2019-12-31 Thread GitBox
vinothchandar commented on issue #1105: [WIP] [HUDI-405] Fix sync no hive 
partition at first time
URL: https://github.com/apache/incubator-hudi/pull/1105#issuecomment-569980467
 
 
   >So, modify assumeDatePartitioning to ! assumeDatePartitioning is the best 
way to fix this issue.
   
   This is not going to fix this issue..  and we should not be changing this 
code.. It will cause side effects, like I mentioned before.
   
   Can we reproduce this issue in a unit test or sample code first? 
   
   
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [incubator-hudi] vinothchandar commented on issue #1105: [WIP] [HUDI-405] Fix sync no hive partition at first time

2019-12-31 Thread GitBox
vinothchandar commented on issue #1105: [WIP] [HUDI-405] Fix sync no hive 
partition at first time
URL: https://github.com/apache/incubator-hudi/pull/1105#issuecomment-569971619
 
 
   @lamber-ken I still don't fully understand the need for this fix.. Can you 
please summarize where we are? 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services