Re: 0.11.0 release timeline

2022-03-27 Thread Shiyan Xu
Hi All, just a reminder on the timeline, as discussed earlier:

- Mar 31 00:00 PST : feature freeze - new features/functionalities won't be
merged to master (3 days from now)
- Apr 03 00:00 PST : cut release branch and start RC voting/testing (6 days
from now)

Thank you.


On Wed, Mar 23, 2022 at 4:42 AM Vinoth Chandar  wrote:

> +1 from me, as long as we don’t push it out more.
>
> On Tue, Mar 22, 2022 at 12:29 Raymond Xu 
> wrote:
>
> > Ok Vinoth, thanks for highlighting this. BigQuery integration is an
> > important feature to add to 0.11.0. I also see some other inflight work
> > from the backlog. To accommodate this and other inflight issues / testing
> > activities, I suggest making a one-time adjustment: pushing 7 days from
> the
> > original timeline, as in Mar 31 feature freeze and Apr 3 for cutting
> > release branch.
> >
> > Sounds good to the community here?
> >
> > --
> > Best,
> > Raymond
> >
> >
> > On Tue, Mar 22, 2022 at 12:50 PM Vinoth Govindarajan <
> > vinoth.govindara...@gmail.com> wrote:
> >
> > > Hi Raymond,
> > > I'm working on the Hudi <> BigQuery Integration RFC-34, I'm trying to
> > wrap
> > > up everything and send out the PR before the end of this week, I was
> > > wondering would it be possible to include this PR as part of the 0.11.0
> > > release, let me know what I need to do to make this part of next
> release,
> > > thanks!
> > >
> > > Best,
> > > Vinoth
> > >
> > >
> > > On Fri, Mar 18, 2022 at 10:58 PM Raymond Xu <
> xu.shiyan.raym...@gmail.com
> > >
> > > wrote:
> > >
> > > > Hi all,
> > > >
> > > > As we're approaching late March when we intended to release 0.11.0,
> I'd
> > > > like to call out this timeline
> > > >
> > > > - Mar 24 00:00 PST : feature freeze - new features/functionalities
> > won't
> > > be
> > > > merged to master (6 days from now)
> > > > - Mar 27 00:00 PST : cut release branch and start RC voting/testing
> (9
> > > days
> > > > from now)
> > > >
> > > > Please kindly highlight any concerns. Thank you.
> > > >
> > > > Best,
> > > > Raymond
> > > >
> > >
> >
>


-- 
Best,
Shiyan


[ANNOUNCE] Hudi Community Update(2022-03-14 ~ 2022-03-27)

2022-03-27 Thread leesf
Dear community,

Nice to share Hudi community bi-weekly updates for 2022-03-14 ~ 2022-03-27
with updates on features, bug fixes.


===
Features


[Core] Rebase Data Skipping flow to rely on MT Column Stats index [1]
[Flink] Support backend switch in HoodieFlinkStreamer [2]
[Flink] Support flink multiple versions [3]
[Core] Provide an option to trigger clean every nth commit [4]
[Flink] Flink bulk_insert support bucket hash index [5]
[Core] Supporting Composite Expressions over Data Table Columns in Data
Skipping flow [6]



[1] https://issues.apache.org/jira/browse/HUDI-3514
[2] https://issues.apache.org/jira/browse/HUDI-3607
[3] https://issues.apache.org/jira/browse/HUDI-3665
[4] https://issues.apache.org/jira/browse/HUDI-1436
[5] https://issues.apache.org/jira/browse/HUDI-3701
[6] https://issues.apache.org/jira/browse/HUDI-3594


===
Bugs

[Flink] flink sync hive metadata supports table properties and serde
properties [1]
[Core] Automatically adjust write configs based on metadata table and write
concurrency mode [2]
[Core] Replace RDD with HoodieData in HoodieSparkTable and commit executors
[3]
[Core] Refactored Spark DataSource Relations to avoid code duplication [4]
[Core] Fixing Column Stats index to properly handle first Data Table commit
[5]
[Core] Refactor hive sync tool / config to use reflection and standardize
configs [6]
[Core] Refactoring MergeOnReadRDD to avoid duplication, fetch only
projected columns [7]
[Core] Do not throw exception when instant to rollback does not exist in
metadata table active timeline [8]
[Core] OOM occurred when use bulk_insert cow table with flink BUCKET index
[9]


[1] https://issues.apache.org/jira/browse/HUDI-3589
[2] https://issues.apache.org/jira/browse/HUDI-3404
[3] https://issues.apache.org/jira/browse/HUDI-2439
[4] https://issues.apache.org/jira/browse/HUDI-3457
[5] https://issues.apache.org/jira/browse/HUDI-3663
[6] https://issues.apache.org/jira/browse/HUDI-2883
[7] https://issues.apache.org/jira/browse/HUDI-3396
[8] https://issues.apache.org/jira/browse/HUDI-3435
[9] https://issues.apache.org/jira/browse/HUDI-3716




Best,
Leesf