Hi, We learned the hard way spark1 vs spark2 . Can we drop spark1 now? What do you think?
olaf > Am 13.03.2019 um 06:16 schrieb Konstantin Boudnik <c...@apache.org>: > > While I am all for the latest and greatest, I learned to be cautious > when it gets to the software. Especially, when we look at something > considering itself on the "top of the stack". Hence I welcome your the > conservative approach! > -- > With regards, > Konstantin (Cos) Boudnik > 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622 > > Disclaimer: Opinions expressed in this email are those of the author, > and do not necessarily represent the views of any company the author > might be affiliated with at the moment of writing. > >> On Wed, Mar 13, 2019 at 5:58 AM Evans Ye <evan...@apache.org> wrote: >> >> Thank you all for the support! >> >> Until now, I was dealing with various compatibility issue for Spark. >> However there're too many incompatible components with spark 2.4.0: >> >> https://ci.bigtop.apache.org/view/Packages/job/Bigtop-trunk-packages/ >> >> Therefore I'd like to revoke the 2.4.0 upgrade and just slightly bump it up >> to 2.2.3. >> The new release date is targeted at the end of March. >> >> >> >> Jun HE <ryan.j...@gmail.com> 於 2019年3月6日 週三 下午9:28寫道： >> >>> Awesome, and huge +1 to this! >>> >>> Konstantin Boudnik <c...@boudnik.org> 于2019年3月6日周三 下午9:11写道： >>> >>>> Oh my, that's amazing! Thank you man! >>>> +1 on moving directly to 1.4 >>>> -- >>>> With regards, >>>> Konstantin >>>> >>>> On March 5, 2019 12:58:44 AM GMT+03:00, Olaf Flebbe <o...@oflebbe.de> >>> wrote: >>>>> Hi Evans, >>>>> >>>>> You found and fixed a lot of bugs and made the smoke tests work, so a >>>>> big +1 . >>>>> >>>>> Olaf >>>>> >>>>>> Am 04.03.2019 um 08:12 schrieb Evans Ye <evan...@apache.org>: >>>>>> >>>>>> -1 welcomed as well !!! >>>>>> >>>>>> Evans Ye <evan...@apache.org> 於 2019年3月4日 週一 下午3:11寫道： >>>>>> >>>>>>> Hi all, >>>>>>> >>>>>>> The overhaul as well as development is almost completed. With >>>>> several new >>>>>>> features added, I'd like to propose to release Bigtop 1.4.0 directly >>>>>>> instead of doing 1.3.1 release(https://s.apache.org/2a8K). This >>>>> helps to >>>>>>> promote these new features: >>>>>>> >>>>>>> 1. Full support to build and test inside docker with one stop >>>>> seamlessly >>>>>>> integration. >>>>>>> Now just one command to build and test components: >>>>>>> Example: >>>>>>> $ ./gradlew spark-ind repo-ind docker-provisioner -POS=ubuntu-16.04 >>>>>>> -Pnexus -Penable_local_repo -Pstack=spark-standalone >>>>> -Psmoke-tests=spark >>>>>>> >>>>>>> 2. Support to build from git commit hash >>>>>>> Example: >>>>>>> $ ./gradlew kafka-pkg-ind >>>>> -Pgit_repo=https://github.com/apache/kafka.git >>>>>>> -Pgit_ref=1.1 -Pgit_sha1=4dae083af486eaedd27c69c973c74605bffd416b >>>>>>> -Pbase_version=1.1.1 >>>>>>> >>>>>>> 3. Version bumps and tests >>>>>>> Hadoop 2.8.5, Kafka 1.1.1, Spark 2.4.0, Alluxio 1.8.1 >>>>>>> New smoke tests: Flink, Giraph (Crunch) >>>>>>> >>>>>>> 4. Loooooooots of bug fixes! >>>>>>> >>>>>>> If agreed, please +1 and I'll still serve as the RM for 1.4 release, >>>>> if no >>>>>>> preemption ;) >>>>>>> >>>>>>> >>>>>>> Best, >>>>>>> Evans >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>> >>>
