Re: Apache ORC 1.8/1.7 and 1.6 EOL Release

2022-09-08 Thread Dongjoon Hyun
I forgot to mention the following. As of today, additionally,

Apache Iceberg starts to use Apache ORC 1.8.0 (Thanks to William)
Apache Impala starts to use Apache ORC 1.7.6 (Thanks to Quanlong)

Dongjoon.

On Thu, Sep 8, 2022 at 1:34 AM Dongjoon Hyun 
wrote:

> Thank you all.
>
> Since there are no explicit requests in this thread, I closed the 1.6.15
> milestone for now.
>
> https://github.com/apache/orc/milestone/8
>
> Dongjoon
>
> On Mon, Sep 5, 2022 at 11:28 PM Dongjoon Hyun 
> wrote:
>
>> Thank you so much, Quanlong. That would be great!
>>
>> Dongjoon.
>>
>> On Mon, Sep 5, 2022 at 10:51 PM Quanlong Huang 
>> wrote:
>>
>>> Impala currently uses the Java lib in 1.6.2 and the cpp lib in 1.7. I
>>> think
>>> it makes sense to bump its dependent java version to 1.7 as well.
>>> Filed an JIRA for this:
>>> https://issues.apache.org/jira/browse/IMPALA-11554
>>>
>>> Thanks,
>>> Quanlong
>>>
>>> On Tue, Sep 6, 2022 at 11:42 AM Dongjoon Hyun 
>>> wrote:
>>>
>>> > Thank you for sharing them too, William. Yes, unfortunately, they are
>>> stuck
>>> > there for a long time.
>>> >
>>> > You already did lots of releases these days.
>>> >
>>> > I can handle the 1.6 EOL release if needed at this time. :)
>>> >
>>> > Thanks,
>>> > Dongjoon.
>>> >
>>> >
>>> > On Mon, Sep 5, 2022 at 5:33 PM William H. 
>>> wrote:
>>> >
>>> > > Currently, Apache Flink, Hive, and Impala are using the following ORC
>>> > > versions:
>>> > > Flink - 1.5.6
>>> > > Impala - 1.6.2
>>> > > Hive - 1.6.9
>>> > >
>>> > > They cannot use 1.6.15 even if we deliver.
>>> > > However, if there is a need for EOL release, I can volunteer for it.
>>> > >
>>> > > Bests,
>>> > > William
>>> > >
>>> > > On Sun, Sep 4, 2022 at 12:44 PM Dongjoon Hyun <
>>> dongjoon.h...@gmail.com>
>>> > > wrote:
>>> > > >
>>> > > > Hi, All.
>>> > > >
>>> > > > As of today, Apache ORC community recommends 1.8.0 as the latest
>>> > version
>>> > > > and 1.7.6 as the stable version.
>>> > > >
>>> > > > https://orc.apache.org/releases/
>>> > > >
>>> > > > As announced in the mailing thread before,
>>> > > >
>>> > > >
>>> https://lists.apache.org/thread/0prq5pt6wnm16zqnvthk85ljhxg7ycvs
>>> > > >
>>> > > > The following projects were using 1.7.6.
>>> > > >
>>> > > >   - SPARK-40134 Update ORC to 1.7.6 (Apache Spark 3.4.0 3.3.1)
>>> > > >   - ICEBERG #5580 ORC: Upgrade to 1.7.6 (Apache Iceberg 0.15)
>>> > > >   - ARROW-17478 Update ORC to 1.7.6 (Apache Arrow 9.0)
>>> > > >   - DRUID #12928 Update ORC to 1.7.6 (Apache Druid 0.24)
>>> > > >
>>> > > > AFAIK, William actively made PRs to migrate them from 1.7.6 to
>>> 1.8.0.
>>> > > > Currently, the following is done and the others are under community
>>> > > reviews.
>>> > > >
>>> > > >   - Homebrew (orc-tools)
>>> > > >   - Apache Spark 3.4.0 (SPARK-40323 Update ORC to 1.8.0)
>>> > > >
>>> > > > Finally, note that Apache ORC 1.6.0 was released on 2019-09-03 (3
>>> years
>>> > > > ago) and has served us well with 15 maintenance releases (1.6.11 ~
>>> > > 1.6.14)
>>> > > > during its lifetime. Today, Apache ORC 1.6.0 reaches End-Of-Life
>>> and
>>> > > > branch-1.6 has no patch for 1.6.15.
>>> > > >
>>> > > > https://github.com/apache/orc/commits/branch-1.6
>>> > > >
>>> > > > The Apache ORC community is wondering if there is a blocker when
>>> 1.6.14
>>> > > > users migrate to 1.7.6 or 1.8.0. Please try 1.8.0/1.7.6 and let us
>>> > > > know within the next three days if there is a specific bug-fix
>>> backport
>>> > > > request and valid reasons. In that case, we may want to deliver an
>>> > > official
>>> > > > EOL release for that. Otherwise, we can skip 1.6.15 in favor of
>>> 1.7.6
>>> > and
>>> > > > 1.8.0.
>>> > > >
>>> > > > Cheers,
>>> > > > Dongjoon.
>>> > >
>>> >
>>>
>>


Re: Apache ORC 1.8/1.7 and 1.6 EOL Release

2022-09-08 Thread Dongjoon Hyun
Thank you all.

Since there are no explicit requests in this thread, I closed the 1.6.15
milestone for now.

https://github.com/apache/orc/milestone/8

Dongjoon

On Mon, Sep 5, 2022 at 11:28 PM Dongjoon Hyun 
wrote:

> Thank you so much, Quanlong. That would be great!
>
> Dongjoon.
>
> On Mon, Sep 5, 2022 at 10:51 PM Quanlong Huang 
> wrote:
>
>> Impala currently uses the Java lib in 1.6.2 and the cpp lib in 1.7. I
>> think
>> it makes sense to bump its dependent java version to 1.7 as well.
>> Filed an JIRA for this:
>> https://issues.apache.org/jira/browse/IMPALA-11554
>>
>> Thanks,
>> Quanlong
>>
>> On Tue, Sep 6, 2022 at 11:42 AM Dongjoon Hyun 
>> wrote:
>>
>> > Thank you for sharing them too, William. Yes, unfortunately, they are
>> stuck
>> > there for a long time.
>> >
>> > You already did lots of releases these days.
>> >
>> > I can handle the 1.6 EOL release if needed at this time. :)
>> >
>> > Thanks,
>> > Dongjoon.
>> >
>> >
>> > On Mon, Sep 5, 2022 at 5:33 PM William H. 
>> wrote:
>> >
>> > > Currently, Apache Flink, Hive, and Impala are using the following ORC
>> > > versions:
>> > > Flink - 1.5.6
>> > > Impala - 1.6.2
>> > > Hive - 1.6.9
>> > >
>> > > They cannot use 1.6.15 even if we deliver.
>> > > However, if there is a need for EOL release, I can volunteer for it.
>> > >
>> > > Bests,
>> > > William
>> > >
>> > > On Sun, Sep 4, 2022 at 12:44 PM Dongjoon Hyun <
>> dongjoon.h...@gmail.com>
>> > > wrote:
>> > > >
>> > > > Hi, All.
>> > > >
>> > > > As of today, Apache ORC community recommends 1.8.0 as the latest
>> > version
>> > > > and 1.7.6 as the stable version.
>> > > >
>> > > > https://orc.apache.org/releases/
>> > > >
>> > > > As announced in the mailing thread before,
>> > > >
>> > > >
>> https://lists.apache.org/thread/0prq5pt6wnm16zqnvthk85ljhxg7ycvs
>> > > >
>> > > > The following projects were using 1.7.6.
>> > > >
>> > > >   - SPARK-40134 Update ORC to 1.7.6 (Apache Spark 3.4.0 3.3.1)
>> > > >   - ICEBERG #5580 ORC: Upgrade to 1.7.6 (Apache Iceberg 0.15)
>> > > >   - ARROW-17478 Update ORC to 1.7.6 (Apache Arrow 9.0)
>> > > >   - DRUID #12928 Update ORC to 1.7.6 (Apache Druid 0.24)
>> > > >
>> > > > AFAIK, William actively made PRs to migrate them from 1.7.6 to
>> 1.8.0.
>> > > > Currently, the following is done and the others are under community
>> > > reviews.
>> > > >
>> > > >   - Homebrew (orc-tools)
>> > > >   - Apache Spark 3.4.0 (SPARK-40323 Update ORC to 1.8.0)
>> > > >
>> > > > Finally, note that Apache ORC 1.6.0 was released on 2019-09-03 (3
>> years
>> > > > ago) and has served us well with 15 maintenance releases (1.6.11 ~
>> > > 1.6.14)
>> > > > during its lifetime. Today, Apache ORC 1.6.0 reaches End-Of-Life and
>> > > > branch-1.6 has no patch for 1.6.15.
>> > > >
>> > > > https://github.com/apache/orc/commits/branch-1.6
>> > > >
>> > > > The Apache ORC community is wondering if there is a blocker when
>> 1.6.14
>> > > > users migrate to 1.7.6 or 1.8.0. Please try 1.8.0/1.7.6 and let us
>> > > > know within the next three days if there is a specific bug-fix
>> backport
>> > > > request and valid reasons. In that case, we may want to deliver an
>> > > official
>> > > > EOL release for that. Otherwise, we can skip 1.6.15 in favor of
>> 1.7.6
>> > and
>> > > > 1.8.0.
>> > > >
>> > > > Cheers,
>> > > > Dongjoon.
>> > >
>> >
>>
>


Re: Apache ORC 1.8/1.7 and 1.6 EOL Release

2022-09-05 Thread Dongjoon Hyun
Thank you so much, Quanlong. That would be great!

Dongjoon.

On Mon, Sep 5, 2022 at 10:51 PM Quanlong Huang 
wrote:

> Impala currently uses the Java lib in 1.6.2 and the cpp lib in 1.7. I think
> it makes sense to bump its dependent java version to 1.7 as well.
> Filed an JIRA for this: https://issues.apache.org/jira/browse/IMPALA-11554
>
> Thanks,
> Quanlong
>
> On Tue, Sep 6, 2022 at 11:42 AM Dongjoon Hyun 
> wrote:
>
> > Thank you for sharing them too, William. Yes, unfortunately, they are
> stuck
> > there for a long time.
> >
> > You already did lots of releases these days.
> >
> > I can handle the 1.6 EOL release if needed at this time. :)
> >
> > Thanks,
> > Dongjoon.
> >
> >
> > On Mon, Sep 5, 2022 at 5:33 PM William H. 
> wrote:
> >
> > > Currently, Apache Flink, Hive, and Impala are using the following ORC
> > > versions:
> > > Flink - 1.5.6
> > > Impala - 1.6.2
> > > Hive - 1.6.9
> > >
> > > They cannot use 1.6.15 even if we deliver.
> > > However, if there is a need for EOL release, I can volunteer for it.
> > >
> > > Bests,
> > > William
> > >
> > > On Sun, Sep 4, 2022 at 12:44 PM Dongjoon Hyun  >
> > > wrote:
> > > >
> > > > Hi, All.
> > > >
> > > > As of today, Apache ORC community recommends 1.8.0 as the latest
> > version
> > > > and 1.7.6 as the stable version.
> > > >
> > > > https://orc.apache.org/releases/
> > > >
> > > > As announced in the mailing thread before,
> > > >
> > > > https://lists.apache.org/thread/0prq5pt6wnm16zqnvthk85ljhxg7ycvs
> > > >
> > > > The following projects were using 1.7.6.
> > > >
> > > >   - SPARK-40134 Update ORC to 1.7.6 (Apache Spark 3.4.0 3.3.1)
> > > >   - ICEBERG #5580 ORC: Upgrade to 1.7.6 (Apache Iceberg 0.15)
> > > >   - ARROW-17478 Update ORC to 1.7.6 (Apache Arrow 9.0)
> > > >   - DRUID #12928 Update ORC to 1.7.6 (Apache Druid 0.24)
> > > >
> > > > AFAIK, William actively made PRs to migrate them from 1.7.6 to 1.8.0.
> > > > Currently, the following is done and the others are under community
> > > reviews.
> > > >
> > > >   - Homebrew (orc-tools)
> > > >   - Apache Spark 3.4.0 (SPARK-40323 Update ORC to 1.8.0)
> > > >
> > > > Finally, note that Apache ORC 1.6.0 was released on 2019-09-03 (3
> years
> > > > ago) and has served us well with 15 maintenance releases (1.6.11 ~
> > > 1.6.14)
> > > > during its lifetime. Today, Apache ORC 1.6.0 reaches End-Of-Life and
> > > > branch-1.6 has no patch for 1.6.15.
> > > >
> > > > https://github.com/apache/orc/commits/branch-1.6
> > > >
> > > > The Apache ORC community is wondering if there is a blocker when
> 1.6.14
> > > > users migrate to 1.7.6 or 1.8.0. Please try 1.8.0/1.7.6 and let us
> > > > know within the next three days if there is a specific bug-fix
> backport
> > > > request and valid reasons. In that case, we may want to deliver an
> > > official
> > > > EOL release for that. Otherwise, we can skip 1.6.15 in favor of 1.7.6
> > and
> > > > 1.8.0.
> > > >
> > > > Cheers,
> > > > Dongjoon.
> > >
> >
>


Re: Apache ORC 1.8/1.7 and 1.6 EOL Release

2022-09-05 Thread Quanlong Huang
Impala currently uses the Java lib in 1.6.2 and the cpp lib in 1.7. I think
it makes sense to bump its dependent java version to 1.7 as well.
Filed an JIRA for this: https://issues.apache.org/jira/browse/IMPALA-11554

Thanks,
Quanlong

On Tue, Sep 6, 2022 at 11:42 AM Dongjoon Hyun 
wrote:

> Thank you for sharing them too, William. Yes, unfortunately, they are stuck
> there for a long time.
>
> You already did lots of releases these days.
>
> I can handle the 1.6 EOL release if needed at this time. :)
>
> Thanks,
> Dongjoon.
>
>
> On Mon, Sep 5, 2022 at 5:33 PM William H.  wrote:
>
> > Currently, Apache Flink, Hive, and Impala are using the following ORC
> > versions:
> > Flink - 1.5.6
> > Impala - 1.6.2
> > Hive - 1.6.9
> >
> > They cannot use 1.6.15 even if we deliver.
> > However, if there is a need for EOL release, I can volunteer for it.
> >
> > Bests,
> > William
> >
> > On Sun, Sep 4, 2022 at 12:44 PM Dongjoon Hyun 
> > wrote:
> > >
> > > Hi, All.
> > >
> > > As of today, Apache ORC community recommends 1.8.0 as the latest
> version
> > > and 1.7.6 as the stable version.
> > >
> > > https://orc.apache.org/releases/
> > >
> > > As announced in the mailing thread before,
> > >
> > > https://lists.apache.org/thread/0prq5pt6wnm16zqnvthk85ljhxg7ycvs
> > >
> > > The following projects were using 1.7.6.
> > >
> > >   - SPARK-40134 Update ORC to 1.7.6 (Apache Spark 3.4.0 3.3.1)
> > >   - ICEBERG #5580 ORC: Upgrade to 1.7.6 (Apache Iceberg 0.15)
> > >   - ARROW-17478 Update ORC to 1.7.6 (Apache Arrow 9.0)
> > >   - DRUID #12928 Update ORC to 1.7.6 (Apache Druid 0.24)
> > >
> > > AFAIK, William actively made PRs to migrate them from 1.7.6 to 1.8.0.
> > > Currently, the following is done and the others are under community
> > reviews.
> > >
> > >   - Homebrew (orc-tools)
> > >   - Apache Spark 3.4.0 (SPARK-40323 Update ORC to 1.8.0)
> > >
> > > Finally, note that Apache ORC 1.6.0 was released on 2019-09-03 (3 years
> > > ago) and has served us well with 15 maintenance releases (1.6.11 ~
> > 1.6.14)
> > > during its lifetime. Today, Apache ORC 1.6.0 reaches End-Of-Life and
> > > branch-1.6 has no patch for 1.6.15.
> > >
> > > https://github.com/apache/orc/commits/branch-1.6
> > >
> > > The Apache ORC community is wondering if there is a blocker when 1.6.14
> > > users migrate to 1.7.6 or 1.8.0. Please try 1.8.0/1.7.6 and let us
> > > know within the next three days if there is a specific bug-fix backport
> > > request and valid reasons. In that case, we may want to deliver an
> > official
> > > EOL release for that. Otherwise, we can skip 1.6.15 in favor of 1.7.6
> and
> > > 1.8.0.
> > >
> > > Cheers,
> > > Dongjoon.
> >
>


Re: Apache ORC 1.8/1.7 and 1.6 EOL Release

2022-09-05 Thread Dongjoon Hyun
Thank you for sharing them too, William. Yes, unfortunately, they are stuck
there for a long time.

You already did lots of releases these days.

I can handle the 1.6 EOL release if needed at this time. :)

Thanks,
Dongjoon.


On Mon, Sep 5, 2022 at 5:33 PM William H.  wrote:

> Currently, Apache Flink, Hive, and Impala are using the following ORC
> versions:
> Flink - 1.5.6
> Impala - 1.6.2
> Hive - 1.6.9
>
> They cannot use 1.6.15 even if we deliver.
> However, if there is a need for EOL release, I can volunteer for it.
>
> Bests,
> William
>
> On Sun, Sep 4, 2022 at 12:44 PM Dongjoon Hyun 
> wrote:
> >
> > Hi, All.
> >
> > As of today, Apache ORC community recommends 1.8.0 as the latest version
> > and 1.7.6 as the stable version.
> >
> > https://orc.apache.org/releases/
> >
> > As announced in the mailing thread before,
> >
> > https://lists.apache.org/thread/0prq5pt6wnm16zqnvthk85ljhxg7ycvs
> >
> > The following projects were using 1.7.6.
> >
> >   - SPARK-40134 Update ORC to 1.7.6 (Apache Spark 3.4.0 3.3.1)
> >   - ICEBERG #5580 ORC: Upgrade to 1.7.6 (Apache Iceberg 0.15)
> >   - ARROW-17478 Update ORC to 1.7.6 (Apache Arrow 9.0)
> >   - DRUID #12928 Update ORC to 1.7.6 (Apache Druid 0.24)
> >
> > AFAIK, William actively made PRs to migrate them from 1.7.6 to 1.8.0.
> > Currently, the following is done and the others are under community
> reviews.
> >
> >   - Homebrew (orc-tools)
> >   - Apache Spark 3.4.0 (SPARK-40323 Update ORC to 1.8.0)
> >
> > Finally, note that Apache ORC 1.6.0 was released on 2019-09-03 (3 years
> > ago) and has served us well with 15 maintenance releases (1.6.11 ~
> 1.6.14)
> > during its lifetime. Today, Apache ORC 1.6.0 reaches End-Of-Life and
> > branch-1.6 has no patch for 1.6.15.
> >
> > https://github.com/apache/orc/commits/branch-1.6
> >
> > The Apache ORC community is wondering if there is a blocker when 1.6.14
> > users migrate to 1.7.6 or 1.8.0. Please try 1.8.0/1.7.6 and let us
> > know within the next three days if there is a specific bug-fix backport
> > request and valid reasons. In that case, we may want to deliver an
> official
> > EOL release for that. Otherwise, we can skip 1.6.15 in favor of 1.7.6 and
> > 1.8.0.
> >
> > Cheers,
> > Dongjoon.
>


Re: Apache ORC 1.8/1.7 and 1.6 EOL Release

2022-09-05 Thread William H.
Currently, Apache Flink, Hive, and Impala are using the following ORC versions:
Flink - 1.5.6
Impala - 1.6.2
Hive - 1.6.9

They cannot use 1.6.15 even if we deliver.
However, if there is a need for EOL release, I can volunteer for it.

Bests,
William

On Sun, Sep 4, 2022 at 12:44 PM Dongjoon Hyun  wrote:
>
> Hi, All.
>
> As of today, Apache ORC community recommends 1.8.0 as the latest version
> and 1.7.6 as the stable version.
>
> https://orc.apache.org/releases/
>
> As announced in the mailing thread before,
>
> https://lists.apache.org/thread/0prq5pt6wnm16zqnvthk85ljhxg7ycvs
>
> The following projects were using 1.7.6.
>
>   - SPARK-40134 Update ORC to 1.7.6 (Apache Spark 3.4.0 3.3.1)
>   - ICEBERG #5580 ORC: Upgrade to 1.7.6 (Apache Iceberg 0.15)
>   - ARROW-17478 Update ORC to 1.7.6 (Apache Arrow 9.0)
>   - DRUID #12928 Update ORC to 1.7.6 (Apache Druid 0.24)
>
> AFAIK, William actively made PRs to migrate them from 1.7.6 to 1.8.0.
> Currently, the following is done and the others are under community reviews.
>
>   - Homebrew (orc-tools)
>   - Apache Spark 3.4.0 (SPARK-40323 Update ORC to 1.8.0)
>
> Finally, note that Apache ORC 1.6.0 was released on 2019-09-03 (3 years
> ago) and has served us well with 15 maintenance releases (1.6.11 ~ 1.6.14)
> during its lifetime. Today, Apache ORC 1.6.0 reaches End-Of-Life and
> branch-1.6 has no patch for 1.6.15.
>
> https://github.com/apache/orc/commits/branch-1.6
>
> The Apache ORC community is wondering if there is a blocker when 1.6.14
> users migrate to 1.7.6 or 1.8.0. Please try 1.8.0/1.7.6 and let us
> know within the next three days if there is a specific bug-fix backport
> request and valid reasons. In that case, we may want to deliver an official
> EOL release for that. Otherwise, we can skip 1.6.15 in favor of 1.7.6 and
> 1.8.0.
>
> Cheers,
> Dongjoon.