Hi folks,

As you have may have noticed, the 0.6.0 release is out. Huge shoutout to
our RM, Sudha for pulling this off!

As always, thanks for all our users/contributors. congrats everyone!
Onwards and upwards to the next one.

Thanks
Vinoth

On Thu, Aug 20, 2020 at 11:32 AM Vinoth Chandar <[email protected]> wrote:

> RC-1 is out!  lets all test and vote!
>
> On Wed, Aug 19, 2020 at 8:49 AM Pratyaksh Sharma <[email protected]>
> wrote:
>
>> Hi Allen,
>>
>> Yes, it's a serialization (runtime) issue. I am working on fixing it.
>>
>> On Wed, Aug 19, 2020 at 7:04 PM Sivabalan <[email protected]> wrote:
>>
>> > That would be of great help Allen. Much appreciated.
>> >
>> > On Wed, Aug 19, 2020 at 9:30 AM Allen Underwood
>> > <[email protected]> wrote:
>> >
>> > > Thanks Sivabalan,
>> > >
>> > > That's definitely the issue I had to resolve when introducing Joda
>> time.
>> > > I'll have a look back at my code to see how I got around it.  If I
>> > remember
>> > > correctly, in the original code, the DateTime object was being saved
>> as
>> > an
>> > > instance variable on the object and I had to do things differently in
>> the
>> > > Joda time approach - but it turned out not to be a big deal because
>> the
>> > > instance variable wasn't needed.
>> > >
>> > > I'll see if I can get a PR in to help fix this.
>> > >
>> > > The worst part is no unit tests catch this - it's a runtime issue I
>> > assume
>> > > due to how Spark serializes state.
>> > >
>> > > Thanks,
>> > >
>> > > Allen
>> > >
>> > > On Wed, Aug 19, 2020 at 9:23 AM Sivabalan <[email protected]> wrote:
>> > >
>> > >> I am not sure if all findings so far have been documented here. but
>> this
>> > >> is
>> > >>
>> > >>
>> > >> the ticket AFSIK: https://issues.apache.org/jira/browse/HUDI-1177
>> > >>
>> > >>
>> > >>
>> > >>
>> > >>
>> > >> On Wed, Aug 19, 2020 at 9:15 AM Allen Underwood
>> > >>
>> > >>
>> > >> <[email protected]> wrote:
>> > >>
>> > >>
>> > >>
>> > >>
>> > >>
>> > >> > Just out of curiosity - what's the blocker - you have an issue?  I
>> had
>> > >>
>> > >>
>> > >> > originally done the code to make that work.
>> > >>
>> > >>
>> > >> >
>> > >>
>> > >>
>> > >> > On Wed, Aug 19, 2020 at 12:51 AM Vinoth Chandar <[email protected]
>> >
>> > >> wrote:
>> > >>
>> > >>
>> > >> >
>> > >>
>> > >>
>> > >> >> We still have 1 blocker issue from TimestampKeyGenerator issue
>> with
>> > >> joda
>> > >>
>> > >>
>> > >> >> DateTimeFormatter. Sudha (RM) and Pratyaksh are going to look into
>> > >> this.
>> > >>
>> > >>
>> > >> >>
>> > >>
>> > >>
>> > >> >> In the meantime, here's the progress, plans around testing so
>> far. If
>> > >>
>> > >>
>> > >> >> folks
>> > >>
>> > >>
>> > >> >> in the community can help test the release branch in the next
>> couple
>> > of
>> > >>
>> > >>
>> > >> >> days, it would be of great help!
>> > >>
>> > >>
>> > >> >>
>> > >>
>> > >>
>> > >> >>
>> > >>
>> > >>
>> > >> >>    - Testing plan here: Stability tested by balaji running spark
>> > >>
>> > >>
>> > >> >> streaming,
>> > >>
>> > >>
>> > >> >>    Correctness (Nishith testing on release branch, Udit to help
>> with
>> > >> EMR
>> > >>
>> > >>
>> > >> >> setup)
>> > >>
>> > >>
>> > >> >>    - Testing plan continued: Spark datasource MOR, .. Marker based
>> > >>
>> > >>
>> > >> >>    rollback, upgrade-downgrade (vinoth is on this)
>> > >>
>> > >>
>> > >> >>    - Testing plan : bootstrap (balaji tested for hive), udit has
>> it
>> > >>
>> > >>
>> > >> >> working
>> > >>
>> > >>
>> > >> >>    for Presto in EMR.
>> > >>
>> > >>
>> > >> >>    - Testing plan: bulk_insert v2 (vinoth tested for correctness,
>> > file
>> > >>
>> > >>
>> > >> >>    sizes. ), performance (tested on a cluster, microbenchmarks)
>> > >>
>> > >>
>> > >> >>
>> > >>
>> > >>
>> > >> >>
>> > >>
>> > >>
>> > >> >> There will also be some blogs/docs to explain new stuff.
>> > >>
>> > >>
>> > >> >>
>> > >>
>> > >>
>> > >> >>    - Blogs to explain new stuff: sort modes (vinoth), simple index
>> > >>
>> > >>
>> > >> >>    (vinoth), bootstrap (balaji), multi delta-streamer (pratyaksh),
>> > >> Spark
>> > >>
>> > >>
>> > >> >>    Streaming/DeltaStreamer continuous mode blog (balaji)
>> > >>
>> > >>
>> > >> >>    - Docs: All missing docs will be added by Sudha.
>> > >>
>> > >>
>> > >> >>
>> > >>
>> > >>
>> > >> >>
>> > >>
>> > >>
>> > >> >>
>> > >>
>> > >>
>> > >> >>
>> > >>
>> > >>
>> > >> >> On Tue, Aug 18, 2020 at 1:58 AM Bhavani Sudha <
>> > [email protected]
>> > >> >
>> > >>
>> > >>
>> > >> >> wrote:
>> > >>
>> > >>
>> > >> >>
>> > >>
>> > >>
>> > >> >> > Quick update on the RC.
>> > >>
>> > >>
>> > >> >> >
>> > >>
>> > >>
>> > >> >> > Found a build issue when building scala 2.12 and sent a PR for
>> > that -
>> > >>
>> > >>
>> > >> >> > https://github.com/apache/hudi/pull/1976 . Working on resolving
>> > >> this in
>> > >>
>> > >>
>> > >> >> > the
>> > >>
>> > >>
>> > >> >> > release branch and updating RC. Will update soon.
>> > >>
>> > >>
>> > >> >> >
>> > >>
>> > >>
>> > >> >> > Thanks,
>> > >>
>> > >>
>> > >> >> > Sudha
>> > >>
>> > >>
>> > >> >> >
>> > >>
>> > >>
>> > >> >> > On Fri, Aug 14, 2020 at 5:56 PM Vinoth Chandar <
>> [email protected]>
>> > >>
>> > >>
>> > >> >> wrote:
>> > >>
>> > >>
>> > >> >> >
>> > >>
>> > >>
>> > >> >> > > Thanks Sudha! This is means master is now open for regular
>> PRs.
>> > >> Thanks
>> > >>
>> > >>
>> > >> >> > for
>> > >>
>> > >>
>> > >> >> > > your patience, everyone.
>> > >>
>> > >>
>> > >> >> > >
>> > >>
>> > >>
>> > >> >> > > On Fri, Aug 14, 2020 at 3:51 PM Bhavani Sudha <
>> > >>
>> > >>
>> > >> >> [email protected]>
>> > >>
>> > >>
>> > >> >> > > wrote:
>> > >>
>> > >>
>> > >> >> > >
>> > >>
>> > >>
>> > >> >> > > > Hello all,
>> > >>
>> > >>
>> > >> >> > > >
>> > >>
>> > >>
>> > >> >> > > > We have cut the release branch -
>> > >>
>> > >>
>> > >> >> > > > https://github.com/apache/hudi/tree/release-0.6.0 . Since
>> it
>> > is
>> > >>
>> > >>
>> > >> >> > already
>> > >>
>> > >>
>> > >> >> > > > Friday, we will be sending the release candidate early next
>> > week
>> > >>
>> > >>
>> > >> >> (after
>> > >>
>> > >>
>> > >> >> > > > some testing).
>> > >>
>> > >>
>> > >> >> > > >
>> > >>
>> > >>
>> > >> >> > > > Happy Friday!
>> > >>
>> > >>
>> > >> >> > > >
>> > >>
>> > >>
>> > >> >> > > > Thanks,
>> > >>
>> > >>
>> > >> >> > > > Sudha
>> > >>
>> > >>
>> > >> >> > > >
>> > >>
>> > >>
>> > >> >> > > > On Wed, Aug 12, 2020 at 3:56 PM [email protected] <
>> > >>
>> > >>
>> > >> >> [email protected]
>> > >>
>> > >>
>> > >> >> > >
>> > >>
>> > >>
>> > >> >> > > > wrote:
>> > >>
>> > >>
>> > >> >> > > >
>> > >>
>> > >>
>> > >> >> > > > >
>> > >>
>> > >>
>> > >> >> > > > > Hi Folks,
>> > >>
>> > >>
>> > >> >> > > > > We are continuing to work on CI stabilization and will cut
>> > the
>> > >>
>> > >>
>> > >> >> > release
>> > >>
>> > >>
>> > >> >> > > > > once we stabilize the builds hopefully tonight/tomorrow.
>> > >>
>> > >>
>> > >> >> > > > > Thanks,Balaji.V
>> > >>
>> > >>
>> > >> >> > > > >     On Tuesday, August 11, 2020, 09:15:05 PM PDT, Vinoth
>> > >> Chandar <
>> > >>
>> > >>
>> > >> >> > > > > [email protected]> wrote:
>> > >>
>> > >>
>> > >> >> > > > >
>> > >>
>> > >>
>> > >> >> > > > >  Hello all,
>> > >>
>> > >>
>> > >> >> > > > >
>> > >>
>> > >>
>> > >> >> > > > > Update on this. We have landed most of the blockers for
>> the
>> > >> 0.6.0
>> > >>
>> > >>
>> > >> >> > > release
>> > >>
>> > >>
>> > >> >> > > > > and I am currently working on the last major blocker,
>> > >> HUDI-1013.
>> > >>
>> > >>
>> > >> >> > > > > We are working through some unexpected CI flakiness. We
>> hope
>> > to
>> > >>
>> > >>
>> > >> >> > > stabilize
>> > >>
>> > >>
>> > >> >> > > > > master, cut the RC, and then open up master for regular PR
>> > >> merges.
>> > >>
>> > >>
>> > >> >> > > > > ETA for this is tomorrow night PST (Aug 12, PST).
>> > >>
>> > >>
>> > >> >> > > > >
>> > >>
>> > >>
>> > >> >> > > > > We will keep this thread posted!
>> > >>
>> > >>
>> > >> >> > > > >
>> > >>
>> > >>
>> > >> >> > > > > Thanks
>> > >>
>> > >>
>> > >> >> > > > > Vinoth
>> > >>
>> > >>
>> > >> >> > > > >
>> > >>
>> > >>
>> > >> >> > > > > On Tue, Aug 4, 2020 at 9:47 PM Vinoth Chandar <
>> > >> [email protected]>
>> > >>
>> > >>
>> > >> >> > > wrote:
>> > >>
>> > >>
>> > >> >> > > > >
>> > >>
>> > >>
>> > >> >> > > > > > Small correction:
>> > >>
>> > >>
>> > >> >> > > > > >
>> > >>
>> > >>
>> > >> >> > > > > > >> Vinoth working on code review, tests for PR 1876,
>> > >>
>> > >>
>> > >> >> > > > > > This is landed!
>> > >>
>> > >>
>> > >> >> > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >
>> > >>
>> > >>
>> > >> >> > > > > > On Tue, Aug 4, 2020 at 9:44 PM Bhavani Sudha <
>> > >>
>> > >>
>> > >> >> > > [email protected]>
>> > >>
>> > >>
>> > >> >> > > > > > wrote:
>> > >>
>> > >>
>> > >> >> > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> Hello all,
>> > >>
>> > >>
>> > >> >> > > > > >>
>> > >>
>> > >>
>> > >> >> > > > > >> We are targeting the end of this week to cut RC. Here
>> is
>> > an
>> > >>
>> > >>
>> > >> >> update
>> > >>
>> > >>
>> > >> >> > > of
>> > >>
>> > >>
>> > >> >> > > > > >> where
>> > >>
>> > >>
>> > >> >> > > > > >> we are at release blockers.
>> > >>
>> > >>
>> > >> >> > > > > >>
>> > >>
>> > >>
>> > >> >> > > > > >> 0.6.0 Release blocker status (board
>> > >>
>> > >>
>> > >> >> > > > > >> <
>> > >>
>> > >>
>> > >> >> > > > > >>
>> > >>
>> > >>
>> > >> >> > > > >
>> > >>
>> > >>
>> > >> >> > > >
>> > >>
>> > >>
>> > >> >> > >
>> > >>
>> > >>
>> > >> >> >
>> > >>
>> > >>
>> > >> >>
>> > >>
>> >
>> https://issues.apache.org/jira/secure/RapidBoard.jspa?rapidView=397&projectKey=HUDI&view=detail&selectedIssue=HUDI-69
>> > >>
>> > >>
>> > >> >> > > > > >> >)
>> > >>
>> > >>
>> > >> >> > > > > >> ,
>> > >>
>> > >>
>> > >> >> > > > > >>
>> > >>
>> > >>
>> > >> >> > > > > >>    - Spark Datasource/MOR
>> > >>
>> > >>
>> > >> >> > https://github.com/apache/hudi/pull/1848
>> > >>
>> > >>
>> > >> >> > > > > needs
>> > >>
>> > >>
>> > >> >> > > > > >> to
>> > >>
>> > >>
>> > >> >> > > > > >>    be tested by gary/balaji (About to land)
>> > >>
>> > >>
>> > >> >> > > > > >>    - Hive Sync restructuring (Review done, about to
>> land)
>> > >>
>> > >>
>> > >> >> > > > > >>    - Bootstrap
>> > >>
>> > >>
>> > >> >> > > > > >>      - Vinoth working on code review, tests for PR
>> 1876,
>> > >>
>> > >>
>> > >> >> > > > > >>      - then udit will rework PR 1702 (In Code review)
>> > >>
>> > >>
>> > >> >> > > > > >>      - then we will review, land PR 1870, 1869
>> > >>
>> > >>
>> > >> >> > > > > >>    - Bulk insert V2 PR 1834, lower risk, independent
>> PR,
>> > >> well
>> > >>
>> > >>
>> > >> >> > tested
>> > >>
>> > >>
>> > >> >> > > > > >> already
>> > >>
>> > >>
>> > >> >> > > > > >>      - Dependent PR 1149 to be landed,
>> > >>
>> > >>
>> > >> >> > > > > >>      - and modes to be respected in V2 impl as well (At
>> > >> risk)
>> > >>
>> > >>
>> > >> >> > > > > >>    - Upgrade Downgrade Hooks, PR 1858 : (In Code
>> review)
>> > >>
>> > >>
>> > >> >> > > > > >>    - HUDI-1054- Marker list perf improvement, Udit has
>> a
>> > PR
>> > >> out
>> > >>
>> > >>
>> > >> >> > > > > >>    - HUDI-115 : Overwrite with... ordering issue, Sudha
>> > has
>> > >> a
>> > >>
>> > >>
>> > >> >> PR
>> > >>
>> > >>
>> > >> >> > > > nearing
>> > >>
>> > >>
>> > >> >> > > > > >>    landing
>> > >>
>> > >>
>> > >> >> > > > > >>    - HUDI-1098 : Marker file issue with non-existent
>> > files.
>> > >> (In
>> > >>
>> > >>
>> > >> >> > Code
>> > >>
>> > >>
>> > >> >> > > > > >> review)
>> > >>
>> > >>
>> > >> >> > > > > >>    - Spark Streaming + Async Compaction , test
>> complete,
>> > >> code
>> > >>
>> > >>
>> > >> >> > review
>> > >>
>> > >>
>> > >> >> > > > > >>    comments and land PR 1752 (About to land)
>> > >>
>> > >>
>> > >> >> > > > > >>    - Spark DataSource/Hive MOR Incremental Query
>> HUDI-920
>> > >> (At
>> > >>
>> > >>
>> > >> >> > risk)
>> > >>
>> > >>
>> > >> >> > > > > >>    - Flink/Multi Engine refactor, will need a large
>> rebase
>> > >> and
>> > >>
>> > >>
>> > >> >> > > rework,
>> > >>
>> > >>
>> > >> >> > > > > >>    review, land (At risk for 0.6.0)
>> > >>
>> > >>
>> > >> >> > > > > >>    - BloomIndex V2 - Global index implementation. (At
>> > risk)
>> > >>
>> > >>
>> > >> >> > > > > >>    - HUDI-845 : Parallel writing i.e allow multiple
>> > writers
>> > >>
>> > >>
>> > >> >> > (Pushed
>> > >>
>> > >>
>> > >> >> > > > out
>> > >>
>> > >>
>> > >> >> > > > > of
>> > >>
>> > >>
>> > >> >> > > > > >>    0.6.0)
>> > >>
>> > >>
>> > >> >> > > > > >>    - HUDI-860 : Small File Handling without memory
>> caching
>> > >>
>> > >>
>> > >> >> (Pushed
>> > >>
>> > >>
>> > >> >> > > out
>> > >>
>> > >>
>> > >> >> > > > > of
>> > >>
>> > >>
>> > >> >> > > > > >>    0.6.0)
>> > >>
>> > >>
>> > >> >> > > > > >>
>> > >>
>> > >>
>> > >> >> > > > > >>
>> > >>
>> > >>
>> > >> >> > > > > >> Thanks,
>> > >>
>> > >>
>> > >> >> > > > > >> Sudha
>> > >>
>> > >>
>> > >> >> > > > > >>
>> > >>
>> > >>
>> > >> >> > > > > >> On Mon, Aug 3, 2020 at 3:41 PM Vinoth Chandar <
>> > >>
>> > >>
>> > >> >> [email protected]>
>> > >>
>> > >>
>> > >> >> > > > > wrote:
>> > >>
>> > >>
>> > >> >> > > > > >>
>> > >>
>> > >>
>> > >> >> > > > > >> > +1 (we need to formalize this well)
>> > >>
>> > >>
>> > >> >> > > > > >> > But having just blockers land first, would help not
>> just
>> > >> with
>> > >>
>> > >>
>> > >> >> > > > > rebasing,
>> > >>
>> > >>
>> > >> >> > > > > >> but
>> > >>
>> > >>
>> > >> >> > > > > >> > also wind down towards cutting an RC by end of week.
>> > >>
>> > >>
>> > >> >> > > > > >> >
>> > >>
>> > >>
>> > >> >> > > > > >> >
>> > >>
>> > >>
>> > >> >> > > > > >> > On Mon, Aug 3, 2020 at 2:53 PM Bhavani Sudha <
>> > >>
>> > >>
>> > >> >> > > > [email protected]
>> > >>
>> > >>
>> > >> >> > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > wrote:
>> > >>
>> > >>
>> > >> >> > > > > >> >
>> > >>
>> > >>
>> > >> >> > > > > >> > > Hello all,
>> > >>
>> > >>
>> > >> >> > > > > >> > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > As we are all hustling towards getting the blockers
>> > in,
>> > >> I
>> > >>
>> > >>
>> > >> >> > wanted
>> > >>
>> > >>
>> > >> >> > > > to
>> > >>
>> > >>
>> > >> >> > > > > >> > propose
>> > >>
>> > >>
>> > >> >> > > > > >> > > a code/merge freeze until we cut a release for
>> 0.6.0
>> > >> and
>> > >>
>> > >>
>> > >> >> > > restrict
>> > >>
>> > >>
>> > >> >> > > > > it
>> > >>
>> > >>
>> > >> >> > > > > >> to
>> > >>
>> > >>
>> > >> >> > > > > >> > > only merging blockers identified for this release.
>> It
>> > >> would
>> > >>
>> > >>
>> > >> >> > > reduce
>> > >>
>> > >>
>> > >> >> > > > > >> > rebasing
>> > >>
>> > >>
>> > >> >> > > > > >> > > time for blockers in progress. If we feel some
>> issue
>> > is
>> > >> a
>> > >>
>> > >>
>> > >> >> > > serious
>> > >>
>> > >>
>> > >> >> > > > > >> blocker
>> > >>
>> > >>
>> > >> >> > > > > >> > > we can discuss it here and bump it's priority.
>> > >>
>> > >>
>> > >> >> > > > > >> > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > Please share your thoughts or concerns.
>> > >>
>> > >>
>> > >> >> > > > > >> > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > Thanks,
>> > >>
>> > >>
>> > >> >> > > > > >> > > Sudha
>> > >>
>> > >>
>> > >> >> > > > > >> > >
>> > >>
>> > >>
>> > >> >> > > > > >> > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > On Mon, Aug 3, 2020 at 8:19 AM Vinoth Chandar <
>> > >>
>> > >>
>> > >> >> > > [email protected]>
>> > >>
>> > >>
>> > >> >> > > > > >> wrote:
>> > >>
>> > >>
>> > >> >> > > > > >> > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > Given enough time has passed, Sudha can be our RM
>> > for
>> > >>
>> > >>
>> > >> >> 0.6.0.
>> > >>
>> > >>
>> > >> >> > > > > >> > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > On the release blocker progress, we landed few
>> > >> blockers
>> > >>
>> > >>
>> > >> >> over
>> > >>
>> > >>
>> > >> >> > > the
>> > >>
>> > >>
>> > >> >> > > > > >> > weekend,
>> > >>
>> > >>
>> > >> >> > > > > >> > > > with some almost ready for landing
>> > >>
>> > >>
>> > >> >> > > > > >> > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > Will send out a status update again tomorrow
>> night
>> > >> PST!
>> > >>
>> > >>
>> > >> >> > > > > >> > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > On Mon, Aug 3, 2020 at 8:17 AM Vinoth Chandar <
>> > >>
>> > >>
>> > >> >> > > > [email protected]>
>> > >>
>> > >>
>> > >> >> > > > > >> > wrote:
>> > >>
>> > >>
>> > >> >> > > > > >> > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > > Hi anton.
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > > We were hoping to cut a release by last
>> weekend.
>> > New
>> > >>
>> > >>
>> > >> >> > target
>> > >>
>> > >>
>> > >> >> > > is
>> > >>
>> > >>
>> > >> >> > > > > >> this
>> > >>
>> > >>
>> > >> >> > > > > >> > > > > weekend!
>> > >>
>> > >>
>> > >> >> > > > > >> > > > > (tbh we were thrown off a bit due to COVID in
>> Q2,
>> > >>
>> > >>
>> > >> >> given a
>> > >>
>> > >>
>> > >> >> > > lot
>> > >>
>> > >>
>> > >> >> > > > of
>> > >>
>> > >>
>> > >> >> > > > > >> > > > > PMC/Committers had additional kid care duties.
>> Now
>> > >> we
>> > >>
>> > >>
>> > >> >> are
>> > >>
>> > >>
>> > >> >> > > back
>> > >>
>> > >>
>> > >> >> > > > > to
>> > >>
>> > >>
>> > >> >> > > > > >> > > normal
>> > >>
>> > >>
>> > >> >> > > > > >> > > > > cadence)
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > > Going forward, I plan to start a discussion
>> around
>> > >>
>> > >>
>> > >> >> > planning,
>> > >>
>> > >>
>> > >> >> > > > > >> > > prioritizing
>> > >>
>> > >>
>> > >> >> > > > > >> > > > > and other release processes after 0.6.0. Would
>> be
>> > >>
>> > >>
>> > >> >> great to
>> > >>
>> > >>
>> > >> >> > > > have
>> > >>
>> > >>
>> > >> >> > > > > >> the
>> > >>
>> > >>
>> > >> >> > > > > >> > > > > community weigh in even more in these things
>> > >> upfront.
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > > Thanks
>> > >>
>> > >>
>> > >> >> > > > > >> > > > > Vinoth
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > > On Fri, Jul 31, 2020 at 6:49 PM Anton Zuyeu <
>> > >>
>> > >>
>> > >> >> > > > > >> [email protected]>
>> > >>
>> > >>
>> > >> >> > > > > >> > > > wrote:
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> Hi All,
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >>
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> I apologize for possibly dumb question but
>> when
>> > was
>> > >>
>> > >>
>> > >> >> 0.6.0
>> > >>
>> > >>
>> > >> >> > > > > >> planned to
>> > >>
>> > >>
>> > >> >> > > > > >> > > be
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> released? Can't find any dates on Hudi related
>> > >> pages.
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >>
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> On Thu, Jul 30, 2020 at 10:36 AM Vinoth
>> Chandar <
>> > >>
>> > >>
>> > >> >> > > > > >> [email protected]>
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> wrote:
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >>
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > Is anyone able to help with the at risk
>> items?
>> > :)
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > On Thu, Jul 30, 2020 at 7:07 AM leesf <
>> > >>
>> > >>
>> > >> >> > > [email protected]
>> > >>
>> > >>
>> > >> >> > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > wrote:
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > @Vinoth Chandar <[email protected]>
>> Thanks
>> > for
>> > >>
>> > >>
>> > >> >> the
>> > >>
>> > >>
>> > >> >> > > > > reminder,
>> > >>
>> > >>
>> > >> >> > > > > >> > > marked
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> to
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > blocker, and next week would be ok to me.
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > Vinoth Chandar <[email protected]>
>> > >> 于2020年7月30日周四
>> > >>
>> > >>
>> > >> >> > > > > 上午11:35写道:
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > @leesf <[email protected]>  can we
>> > please
>> > >>
>> > >>
>> > >> >> mark
>> > >>
>> > >>
>> > >> >> > the
>> > >>
>> > >>
>> > >> >> > > > > >> relevant
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > ticket(s)
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > with blocker priority, so it's easier to
>> > >> track?
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > Looks like we are nearing a choice for
>> RM.
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > Any more thoughts on timelines? Looks
>> like
>> > >>
>> > >>
>> > >> >> everyone
>> > >>
>> > >>
>> > >> >> > > so
>> > >>
>> > >>
>> > >> >> > > > > far
>> > >>
>> > >>
>> > >> >> > > > > >> is
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> leaning
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > towards completeness of the release over
>> > >> doing
>> > >>
>> > >>
>> > >> >> it
>> > >>
>> > >>
>> > >> >> > > > sooner?
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > On Wed, Jul 29, 2020 at 6:36 PM vino
>> yang <
>> > >>
>> > >>
>> > >> >> > > > > >> > > [email protected]>
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > wrote:
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > +1 on Sudha being RM for the release.
>> And
>> > >>
>> > >>
>> > >> >> looking
>> > >>
>> > >>
>> > >> >> > > > > >> forward to
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> 0.6.0.
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > Best,
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > Vino
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > leesf <[email protected]>
>> > 于2020年7月30日周四
>> > >>
>> > >>
>> > >> >> > > 上午9:15写道:
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > +1 on Sudha on being RM, and PR#1810
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > >
>> > https://github.com/apache/hudi/pull/1810
>> > >>
>> > >>
>> > >> >> > > (abstract
>> > >>
>> > >>
>> > >> >> > > > > >> hive
>> > >>
>> > >>
>> > >> >> > > > > >> > > sync
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > module)
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > would
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > also goes to this release.
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > Sivabalan <[email protected]>
>> > >>
>> > >>
>> > >> >> 于2020年7月30日周四
>> > >>
>> > >>
>> > >> >> > > > > 上午2:18写道:
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > +1 on Sudha being RM for the
>> release.
>> > >>
>> > >>
>> > >> >> Makes
>> > >>
>> > >>
>> > >> >> > > sense
>> > >>
>> > >>
>> > >> >> > > > > to
>> > >>
>> > >>
>> > >> >> > > > > >> > push
>> > >>
>> > >>
>> > >> >> > > > > >> > > > the
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > release
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > by
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > a
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > week.
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > On Wed, Jul 29, 2020 at 1:35 AM
>> > >>
>> > >>
>> > >> >> > > > [email protected]
>> > >>
>> > >>
>> > >> >> > > > > <
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > [email protected]
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > wrote:
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > >  +1 on Sudha on being RM for
>> this
>> > >>
>> > >>
>> > >> >> release.
>> > >>
>> > >>
>> > >> >> > > Also
>> > >>
>> > >>
>> > >> >> > > > > >> agree
>> > >>
>> > >>
>> > >> >> > > > > >> > on
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > pushing
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > the
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > release date by a week.
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > Balaji.V
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > >    On Tuesday, July 28, 2020,
>> > >> 10:08:41
>> > >>
>> > >>
>> > >> >> PM
>> > >>
>> > >>
>> > >> >> > > PDT,
>> > >>
>> > >>
>> > >> >> > > > > >> > Bhavani
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> Sudha <
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > [email protected]> wrote:
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > >  Thanks Vinoth for the update. I
>> > can
>> > >>
>> > >>
>> > >> >> > > volunteer
>> > >>
>> > >>
>> > >> >> > > > to
>> > >>
>> > >>
>> > >> >> > > > > >> RM
>> > >>
>> > >>
>> > >> >> > > > > >> > > this
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > release.
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > Understand 0.6.0 release is
>> delayed
>> > >> than
>> > >>
>> > >>
>> > >> >> > what
>> > >>
>> > >>
>> > >> >> > > > we
>> > >>
>> > >>
>> > >> >> > > > > >> > > > originally
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > discussed.
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > Q2
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > has been really hard with COVID
>> and
>> > >>
>> > >>
>> > >> >> > > everything
>> > >>
>> > >>
>> > >> >> > > > > >> going
>> > >>
>> > >>
>> > >> >> > > > > >> > on.
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> Given
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > that
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > we
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > are
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > at this point, I feel by
>> delaying
>> > >> the RC
>> > >>
>> > >>
>> > >> >> > by a
>> > >>
>> > >>
>> > >> >> > > > > week
>> > >>
>> > >>
>> > >> >> > > > > >> or
>> > >>
>> > >>
>> > >> >> > > > > >> > so
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> more
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > if
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > we
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > can
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > get
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > some of the 'At risk' items in,
>> I
>> > >> would
>> > >>
>> > >>
>> > >> >> > vote
>> > >>
>> > >>
>> > >> >> > > > for
>> > >>
>> > >>
>> > >> >> > > > > >> that.
>> > >>
>> > >>
>> > >> >> > > > > >> > > > That
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> is
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > just
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > my
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > personal opinion. I ll let
>> others
>> > >> chime
>> > >>
>> > >>
>> > >> >> in.
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > Thanks,
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > Sudha
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > On Tue, Jul 28, 2020 at 9:48 PM
>> > >> Vinoth
>> > >>
>> > >>
>> > >> >> > > Chandar
>> > >>
>> > >>
>> > >> >> > > > <
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > [email protected]>
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > wrote:
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > > Hello all,
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > > Just wanted to kickstart a
>> thread
>> > >> to
>> > >>
>> > >>
>> > >> >> firm
>> > >>
>> > >>
>> > >> >> > > up
>> > >>
>> > >>
>> > >> >> > > > > the
>> > >>
>> > >>
>> > >> >> > > > > >> RC
>> > >>
>> > >>
>> > >> >> > > > > >> > > cut
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> date
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > for
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > 0.6.0
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > and
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > > pick a RM. (any volunteers?,
>> if
>> > >> not I
>> > >>
>> > >>
>> > >> >> > self
>> > >>
>> > >>
>> > >> >> > > > > >> nominate
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> myself)
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > > Here's an update on where we
>> are
>> > at
>> > >>
>> > >>
>> > >> >> with
>> > >>
>> > >>
>> > >> >> > > the
>> > >>
>> > >>
>> > >> >> > > > > >> > remaining
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > release
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > blockers.
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > I
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > > have marked items as "At risk"
>> > >>
>> > >>
>> > >> >> assuming
>> > >>
>> > >>
>> > >> >> > we
>> > >>
>> > >>
>> > >> >> > > > cut
>> > >>
>> > >>
>> > >> >> > > > > RC
>> > >>
>> > >>
>> > >> >> > > > > >> > > > sometime
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > next
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > week.
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > > Please chime in with your
>> > thoughts.
>> > >>
>> > >>
>> > >> >> > > Ideally,
>> > >>
>> > >>
>> > >> >> > > > we
>> > >>
>> > >>
>> > >> >> > > > > >> > don't
>> > >>
>> > >>
>> > >> >> > > > > >> > > > take
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > any
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > more
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > > blockers. If we also want to
>> > knock
>> > >> off
>> > >>
>> > >>
>> > >> >> > the
>> > >>
>> > >>
>> > >> >> > > at
>> > >>
>> > >>
>> > >> >> > > > > >> risk
>> > >>
>> > >>
>> > >> >> > > > > >> > > > items,
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > then
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > we
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > would
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > > at-least push dates by another
>> > week
>> > >>
>> > >>
>> > >> >> (my
>> > >>
>> > >>
>> > >> >> > > > guess).
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > > 0.6.0 Release blocker status
>> > (board
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > > <
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >>
>> > >>
>> > >>
>> > >> >> > > > > >> > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > >
>> > >>
>> > >>
>> > >> >> > > > > >> >
>> > >>
>> > >>
>> > >> >> > > > > >>
>> > >>
>> > >>
>> > >> >> > > > >
>> > >>
>> > >>
>> > >> >> > > >
>> > >>
>> > >>
>> > >> >> > >
>> > >>
>> > >>
>> > >> >> >
>> > >>
>> > >>
>> > >> >>
>> > >>
>> >
>> https://issues.apache.org/jira/secure/RapidBoard.jspa?rapidView=397&projectKey=HUDI&view=detail&selectedIssue=HUDI-69
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > > >)
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > > ,
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    - Spark Datasource/MOR
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > >
>> https://github.com/apache/hudi/pull/1848
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > needs
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > > to
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    be tested by gary/balaji
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    - Bootstrap
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >      - Vinoth working on code
>> > >> review,
>> > >>
>> > >>
>> > >> >> > tests
>> > >>
>> > >>
>> > >> >> > > > for
>> > >>
>> > >>
>> > >> >> > > > > >> PR
>> > >>
>> > >>
>> > >> >> > > > > >> > > 1876,
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >      - then udit will rework
>> PR
>> > >> 1702
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >      - then we will review,
>> land
>> > PR
>> > >>
>> > >>
>> > >> >> 1870,
>> > >>
>> > >>
>> > >> >> > > > 1869
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >      - Also need to fix
>> HUDI-999,
>> > >>
>> > >>
>> > >> >> > HUDI-1021
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    - Bulk insert V2 PR 1834,
>> > lower
>> > >>
>> > >>
>> > >> >> risk,
>> > >>
>> > >>
>> > >> >> > > > > >> independent
>> > >>
>> > >>
>> > >> >> > > > > >> > > PR,
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> well
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > tested
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > > already
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >      - Dependent PR 1149 to be
>> > >> landed,
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >      - and modes to be
>> respected
>> > >> in V2
>> > >>
>> > >>
>> > >> >> > impl
>> > >>
>> > >>
>> > >> >> > > > as
>> > >>
>> > >>
>> > >> >> > > > > >> well
>> > >>
>> > >>
>> > >> >> > > > > >> > > (At
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> risk)
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    - Upgrade Downgrade Hooks,
>> PR
>> > >> 1858
>> > >>
>> > >>
>> > >> >> :
>> > >>
>> > >>
>> > >> >> > > Siva
>> > >>
>> > >>
>> > >> >> > > > > has
>> > >>
>> > >>
>> > >> >> > > > > >> a
>> > >>
>> > >>
>> > >> >> > > > > >> > PR
>> > >>
>> > >>
>> > >> >> > > > > >> > > > out,
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > code
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > completing
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    this week
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    - HUDI-1054- Marker list
>> perf
>> > >>
>> > >>
>> > >> >> > > improvement,
>> > >>
>> > >>
>> > >> >> > > > > >> Udit
>> > >>
>> > >>
>> > >> >> > > > > >> > > has a
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> PR
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > out
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    - HUDI-115 : Overwrite
>> with...
>> > >>
>> > >>
>> > >> >> > ordering
>> > >>
>> > >>
>> > >> >> > > > > issue,
>> > >>
>> > >>
>> > >> >> > > > > >> > > Sudha
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> has a
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > PR
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > nearing
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    landing
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    - HUDI-1098 : Marker file
>> > issue
>> > >>
>> > >>
>> > >> >> with
>> > >>
>> > >>
>> > >> >> > > > > >> non-existent
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> files.
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > Siva
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > to
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > begin
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    impl
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    - Spark Streaming + Async
>> > >>
>> > >>
>> > >> >> Compaction ,
>> > >>
>> > >>
>> > >> >> > > > test
>> > >>
>> > >>
>> > >> >> > > > > >> > > complete,
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> code
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > review
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    comments and land PR 1752
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    - Spark DataSource/Hive MOR
>> > >>
>> > >>
>> > >> >> > Incremental
>> > >>
>> > >>
>> > >> >> > > > > Query
>> > >>
>> > >>
>> > >> >> > > > > >> > > > HUDI-920
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> (At
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > risk)
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    - Flink/Multi Engine
>> refactor,
>> > >> will
>> > >>
>> > >>
>> > >> >> > > need a
>> > >>
>> > >>
>> > >> >> > > > > >> large
>> > >>
>> > >>
>> > >> >> > > > > >> > > > rebase
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > and
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > rework,
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    review, land (At risk for
>> > 0.6.0,
>> > >>
>> > >>
>> > >> >> high
>> > >>
>> > >>
>> > >> >> > > > scope,
>> > >>
>> > >>
>> > >> >> > > > > >> may
>> > >>
>> > >>
>> > >> >> > > > > >> > > not
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> have
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > enough
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > time)
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    - BloomIndex V2 - Global
>> index
>> > >>
>> > >>
>> > >> >> > > > > implementation.
>> > >>
>> > >>
>> > >> >> > > > > >> > (At
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> risk)
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    - HUDI-845 : Parallel
>> writing
>> > >> i.e
>> > >>
>> > >>
>> > >> >> > allow
>> > >>
>> > >>
>> > >> >> > > > > >> multiple
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> writers
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > (At
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > risk)
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >    - HUDI-860 : Small File
>> > Handling
>> > >>
>> > >>
>> > >> >> > without
>> > >>
>> > >>
>> > >> >> > > > > >> memory
>> > >>
>> > >>
>> > >> >> > > > > >> > > > caching
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > (At
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > risk)
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > > Thanks
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > > Vinoth
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > --
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > Regards,
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > > -Sivabalan
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >> >
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >>
>> > >>
>> > >>
>> > >> >> > > > > >> > > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > > >
>> > >>
>> > >>
>> > >> >> > > > > >> > >
>> > >>
>> > >>
>> > >> >> > > > > >> >
>> > >>
>> > >>
>> > >> >> > > > > >>
>> > >>
>> > >>
>> > >> >> > > > > >
>> > >>
>> > >>
>> > >> >> > > >
>> > >>
>> > >>
>> > >> >> > >
>> > >>
>> > >>
>> > >> >> >
>> > >>
>> > >>
>> > >> >>
>> > >>
>> > >>
>> > >> >
>> > >>
>> > >>
>> > >> >
>> > >>
>> > >>
>> > >> > --
>> > >>
>> > >
>> > >>
>> > >> > *Allen Underwood*
>> > >>
>> > >>
>> > >> > Principal Software Engineer
>> > >>
>> > >>
>> > >> > Broadcom | Symantec Enterprise Division
>> > >>
>> > >>
>> > >> > *Mobile*: 404.808.5926
>> > >>
>> > >>
>> > >> >
>> > >>
>> > >>
>> > >>
>> > >>
>> > >>
>> > >>
>> > >>
>> > >>
>> > >> --
>> > >>
>> > >>
>> > >> Regards,
>> > >>
>> > >>
>> > >> -Sivabalan
>> > >>
>> > >>
>> > >>
>> > >
>> > > --
>> > > *Allen Underwood*
>> > > Principal Software Engineer
>> > > Broadcom | Symantec Enterprise Division
>> > > *Mobile*: 404.808.5926
>> > >
>> > >
>> > > --
>> > Regards,
>> > -Sivabalan
>> >
>>
>

Reply via email to