Yeah, the end users (e.g. SQL writers) are not aware of the catalog mode. I don't think IMPALA-7127 is a breaking change unless we remove the legacy catalog mode (like what we did for Sentry). So we can leave it to 4.1 if we can't resolve it soon. For removing the legacy catalog mode, we can leave it to the next major version release.
On Sun, Apr 4, 2021 at 9:35 PM Jim Apple <jbap...@apache.org> wrote: > Sounds great! One thing I didn't quite understand about your views on 7127, > the fetch-on-demand metadata. Are you saying we should wait on that until > 4.1? > > On Sun, Apr 4, 2021 at 2:06 AM Quanlong Huang <huangquanl...@gmail.com> > wrote: > > > Hi all, > > > > Impala-3.4.0 was released in April 2020. It has been a long time since > the > > last release. One reason is that this is a major version release so we > hope > > it can take all the necessary breaking changes [1]. Listing all the > > unresolved breaking changes here (I may miss some): > > > > - IMPALA-2210: Make Parquet the default file format > > - IMPALA-9690: Bump minimum x86-64 CPU requirements > > - IMPALA-7127: Use the fetch-on-demand metadata (LocalCatalog) mode by > > default > > - I think this one is not visible to end users so maybe we can skip > it. > > > > However, we've got lots of amazing features/improvements, e.g. > > > > - Multi-threading > > - New SQL features to support all TPC-DS 99 queries (without manually > > rewriting) > > - Transparent query retry > > - Read support on full ACID ORC tables > > - Apache DataSketches integration > > - Apache Iceberg integration > > - arm64 support > > - ... > > > > I think it's time to release 4.0.0 to make them visible to our users. > It'd > > be good if the breaking changes discussed in this thread [1] can land > soon. > > Otherwise, I propose leaving them to the next major version release. > > > > Thus, I propose that we release 4.0.0 soon and I volunteer to be its > > release manager. Please speak up and let the community know your ideas, > > especially on the breaking changes. All feedback is welcome! > > > > PS This is not a VOTE thread but only a DISCUSS thread. > > > > Thanks, > > Quanlong > > > > [1] > > > > > https://lists.apache.org/thread.html/r91b070c2ddfbdc00b316791611b23816991c68fb0afefd1e18c21c26%40%3Cuser.impala.apache.org%3E > > >
