[Discuss] Migrate from log4j to slf4j

2019-11-25 Thread lamberken
Hi, everyone Currently, there are three kinds of java logging framework in hudi's project (java.util.logging.Logger、org.apache.log4j.Logger、org.slf4j.Logger). The org.apache.log4j.Logger doesn't support placeholders, so it‘s hard for us to format the message like | logger.info(String.format(

Re: Spark v2.3.2 : Duplicate entries found for each primary Key

2019-11-25 Thread Bhavani Sudha
Thanks Kabeer. Will take a look and merge. - Sudha On Sun, Nov 24, 2019 at 1:11 PM Kabeer Ahmed wrote: > Dear Sudha, > > I have added a new question and answer in the comments section now (last > one on the link: https://cwiki.apache.org/confluence/display/HUDI/FAQ >

Re: [Discuss] Migrate from log4j to slf4j

2019-11-25 Thread Vinoth Chandar
Hi, Its log4j actually across the board. (I think there are a couple files that have non log4j loggers? might be good to fix to log4j as well for now to be consistent) Nonetheless, there is a JIRA for this already https://issues.apache.org/jira/browse/HUDI-233 Main thing we need to be mindful o

Re: [Discuss] Convenient time for weekly sync meeting

2019-11-25 Thread Vinoth Chandar
Look forward as well! On Sun, Nov 24, 2019 at 1:15 PM Kabeer Ahmed wrote: > Vinoth - my friend. Apologies for the delayed response. > > I will wake up at 5am and join the call. It is no worry for me. For 1 > person, having a second slot doesnt make sense at all. Plus I would love to > be on the

Re: Hudi vs AresDB?

2019-11-25 Thread Vinoth Chandar
Hi Marina, Thanks for reaching out. Hudi is now part of the Apache Software Foundation actually. :) Cutting to the chase, although you can build real-time dashboards using both, both systems are pretty different and provide different tradeoffs. For e.g: - AresDB primarily keeps data in memory (

Re:Re: [Discuss] Migrate from log4j to slf4j

2019-11-25 Thread lamberken
Thanks, I don't know there is a JIRA for this already(HUDI-233). We can talk about it under that issue. Best, lamberken At 2019-11-26 03:09:40, "Vinoth Chandar" wrote: >Hi, > >Its log4j actually across the board. (I think there are a couple files that >have non log4j loggers? might be good