Re:Re: How to write a performance test program

2019-12-23 Thread lamberken
Hi @Vinoth, Here are reproduce steps. 1, Build from latest source mvn clean package -DskipTests -DskipITs -Dcheckstyle.skip=true -Drat.skip=true 2, Write Data export SPARK_HOME=/work/BigData/install/spark/spark-2.3.3-bin-hadoop2.6 ${SPARK_HOME}/bin/spark-shell --jars `ls

Re: How to write a performance test program

2019-12-23 Thread Vinoth Chandar
Could you give 0.5.0-incubating (last release) a shot in the meantime? Lamberken, do you have steps to reproduce this issue. Love to get a JIRA filed so we could fix before the next release. On Mon, Dec 23, 2019 at 7:25 PM lamberken wrote: > > Hi @mayu1, > > I guess you used the latest master

How to write a performance test program

2019-12-23 Thread ma...@bonc.com.cn
hello! I want to modify the quickstart program for performance testing and generate a dataset of ten million rows. However, the program will report an error after running it multiple times. error: Exception in thread "main" org.apache.hudi.exception.HoodieCommitException: Failed to archive