Re:Congrats to our newest committers!

2021-01-27 Thread lamber-ken
Congratulations to Wang Xianghu and Li Wei, great job ! At 2021-01-27 19:16:24, "leesf" wrote: >Hi all, > >I am very happy to announce our newest committers. > >Wang Xianghu: Xianghu has done a great job in decoupling hudi with spark >and implemented the first version of flink and contributed bu

Re:Re: [VOTE] Release 0.5.3, release candidate #2

2020-06-11 Thread lamber-ken
+1 At 2020-06-11 15:10:13, "Bhavani Sudha" wrote: >+1 (binding) > >Downloaded tar and verified compile [OK] > >Run integration test locally. [OK] > >Run a few tests in IDE. [OK] > >Run quickstart [OK] > >Verify NOTICE and LICENSE exists [OK] > >Check Checksum [OK] > >Check no Binary files in sou

Re:hudi关于spark2.3版本不兼容的问题

2020-06-06 Thread lamber-ken
你好, 从1.5.2版本开始,仅支持spark-2.4.4,avro的版本是1.8.2,所以请升级到spark-2.4.4版本,再使用hudi。 另:方便加微信吗?微信号:xleesf,加入国内最大微信群 在 2020-06-06 18:15:20,"gaofeng5...@capinfo.com.cn" 写道: ’我们大数据集群spark版本为2.3,然后执行hudi的代码报错: Exception in thread "main" java.lang.NoSuchMethodError: org.apache.avro.Schema.createUnion([L

Re: [DISSCUSS] Trigger a Travis-CI rebuild without pushing a commit

2020-06-05 Thread Lamber Ken
ready raised a lira for this: https://github.com/apache/hudi/pull/1706 https://issues.apache.org/jira/browse/HUDI-998 Thanks, Lamber-Ken On 2020/06/01 15:14:32, Vinoth Chandar wrote: > Great! I left some comment on the PR. around licensing and maintenance > overhead. > > On Sun, M

Re: TLP Announcement

2020-06-04 Thread Lamber Ken
Great news, and thank you all and congratulations. On 2020/06/04 14:28:33, Vinoth Chandar wrote: > Hello all, > > The ASF press release announcing Apache Hudi as TLP is live! Thanks for all > your contributions! We could not have been achieved that without such a > great community effort! > >

Re: [DISSCUSS] Trigger a Travis-CI rebuild without pushing a commit

2020-05-31 Thread Lamber Ken
Hi forks, Learned from travis and github actions api docs these days, I used my project as a demo[1], the demo pull request will always fail, please use "rerun tests" command, it will rerun tests automatically. if you are interested, try it. Best, Lamber-Ken [1] https://github.com/

Re: delete the test module hudi-integ-test

2020-05-28 Thread Lamber Ken
based on hongdd, local build, can use: mvn clean install -DskipTests -DskipITs -Dcheckstyle.skip=true -Drat.skip=true best On 2020/05/28 10:57:17, cooper wrote: > dear all: > when i build the project,the following error occurred,could delete the > unimport moudle? > > [ERROR] Failed to exec

Re: [DISSCUSS] Trigger a Travis-CI rebuild without pushing a commit

2020-05-27 Thread Lamber Ken
"retest this please" https://github.com/apache/carbondata/pull/3387 Thanks, Lamber-Ken On 2020/05/27 21:24:57, Prashant Wason wrote: > I have used force push (git push -f) to re-trigger Travis build. I don't > know if force push has any side effect but it does save an extra

Re: [DISSCUSS] Trigger a Travis-CI rebuild without pushing a commit

2020-05-27 Thread Lamber Ken
Thanks Sivabalan For committers / pmcs, they can use these tools to trigger rebuilid directly, But for contributors, they can open the url, but the retrigger button will hidden. Best, Lamber-Ken On 2020/05/27 13:13:53, Sivabalan wrote: > Not sure if this is a common practice. But can&#

[DISSCUSS] Trigger a Travis-CI rebuild without pushing a commit

2020-05-26 Thread Lamber Ken
tion" https://github.com/apache/bookkeeper/pull/2158 But, I can't find a effective solution from Github and Travis's documentation[1], any thoughts or opinions? Best, Lamber-Ken [1] https://docs.travis-ci.comhttps://support.github.com

Re: hudi对应的spark-avro的问题

2020-05-26 Thread Lamber Ken
另外一个细节点:用apache的邮箱,收不到图片。 谢谢 On 2020/05/26 07:23:02, "gaofeng5...@capinfo.com.cn" wrote: > > > > spark版本2.3.2.3.1.0.0-78,提交代码为: > def main(args: Array[String]): Unit = { > val spark = SparkSession.builder.appName("Demo") > .config("spark.serializer", "org.apache.spark.serializer.KryoS

Re: hudi对应的spark-avro的问题

2020-05-26 Thread Lamber Ken
嗨,从 hudi-0.5.2 版本后,推荐使用 spark-2.4.4 版本,同时在spark-2.4.4中,spark-avro被单独出来,需要手动添加到 jars 目录中。并不兼容spark-2.3.3版。 如果有其他问题,联系微信 19941866946,进国内微信群。 On 2020/05/26 07:23:02, "gaofeng5...@capinfo.com.cn" wrote: > > > > spark版本2.3.2.3.1.0.0-78,提交代码为: > def main(args: Array[String]): Unit = { > val sp

Re: Adding Usages to powered by page

2020-05-21 Thread Lamber Ken
Hello all, In addition, it would be nice to add the official website to the comments, if so, we can find the logo, and add it to powered_by page. Thanks Lamber-Ken On 2020/05/21 15:51:58, Vinoth Chandar wrote: > Hello all, > > If you are using Apache Hudi and interested in featuri

Re: Subscribing to commits@

2020-05-21 Thread Lamber Ken
thanks, very useful to me. +1 recommended it to anyone. On 2020/02/28 01:00:36, Vinoth Chandar wrote: > Folks, > > Realized some folks may not have noticed this. But > https://lists.apache.org/list.html?comm...@hudi.apache.org has all the > github/jira activity, in a single place.. > > If y

Re: hudi dependency conflicts for test

2020-05-21 Thread Lamber-Ken
, date_format($"timestamp", "-MM-dd")) inputDF.write.format("org.apache.hudi"). options(hudiOptions). mode("Overwrite"). save(basePath) spark.read.format("org.apache.hudi").load(basePath + "/*/*").show();

Re:Re: Apache Hudi Graduation vote on general@incubator

2020-05-18 Thread lamber-ken
Gread job! and good luck for apache hudi project. Best, Lamber-Ken At 2020-05-19 13:35:11, "Vinoth Chandar" wrote: >Folks, > >the vote has passed! >https://lists.apache.org/thread.html/r86278a1a69bbf340fa028aca784869297bd20ab50a71f4006669cdb5%40%3Cgeneral.incubato

Re:[RESULT] [VOTE] Apache Hudi graduation to top level project

2020-05-09 Thread lamber-ken
Congratulations ! Best, Lamber-Ken At 2020-05-10 13:57:10, "Vinoth Chandar" wrote: >Hello all, > >The vote proposing Apache Hudi graduating as a top level project has passed >with the following +1. votes; > >*PPMC +1 votes (11)* > > * Bhav

Re:[VOTE] Apache Hudi graduation to top level project

2020-05-06 Thread lamber-ken
+1 At 2020-05-07 04:55:48, "Vinoth Chandar" wrote: >Hello all, > >Per our discussion on the dev mailing list ( >https://lists.apache.org/thread.html/rc98303d9f09665af90ab517ea0baeb7c374e9a5478d8424311e285cd%40%3Cdev.hudi.apache.org%3E >) > >I would like to call a VOTE for Apache H

Re:[DISCUSS] Bug bash?

2020-04-22 Thread lamber-ken
Wow, challenging job, +1 Best, Lamber-Ken At 2020-04-23 04:51:01, "Vinoth Chandar" wrote: >Just floating a very random idea here. :) > >Would there be interest in doing a bug bash for a week, where we >aggressively close out some pesky bugs that have been lingeri

Re:Checking out the asf svn repo

2020-04-16 Thread lamber-ken
Hi Vinoth, You can get help from the following documentation[1] [1] https://infra.apache.org/version-control.html Best, Lamber-Ken At 2020-04-17 08:24:01, "Vinoth Chandar" wrote: >Hello all, > >Can anyone here (potentially from prior experience with oth

Re:Re: New PPMC Member : Bhavani Sudha

2020-04-09 Thread lamber-ken
Congrats Sudha! Well deserved! Best, Lamber-Ken 在 2020-04-09 13:23:38,"Bhavani Sudha" 写道: >Thank you all :) I am excited to be part of Hudi PPMC. > >-Sudha > >On Wed, Apr 8, 2020 at 12:48 PM Shiyan Xu >wrote: > >> Congrats Sudha! Well deserved! >

Re:Re: New Committer: lamber-ken

2020-04-09 Thread lamber-ken
Dear team, Thank you all, let us together strive to work together! Best, Lamber-Ken At 2020-04-09 03:49:12, "Shiyan Xu" wrote: >Congrats Lamber-ken! Well deserved! > >On Wed, Apr 8, 2020 at 4:52 AM Sivabalan wrote: > >> Congrats Lamber! Well deserved. &g

Re:Re: [DISSCUSS] Troubleshooting flow

2020-04-03 Thread lamber-ken
Thanks you all, Agree with Sudha, it's ok to answer simple questions and move debugging type of questions to GH issues. So, let's try to guide users who asking debugging questions to use GH issues if possible. Thanks, Lamber-Ken At 2020-04-03 07:19:26, "Bhavani Sudha