This is an automated email from the ASF dual-hosted git repository. nic pushed a change to branch 2.6.x-hadoop3.1 in repository https://gitbox.apache.org/repos/asf/kylin.git.
discard d554905 Upgrade tomcat vertion to 8.5.51 discard d00933d CDH60 "bin/find-hbase-dependency.sh" can not find hbase dependency as expected omit 49f4ee1 [maven-release-plugin] prepare release kylin-2.6.5 omit e741e2a Backport HBASE-22887 to Kylin HFileOutputFormat3 omit aec95c8 Remove useless import omit 63236cc [maven-release-plugin] prepare release kylin-2.6.4 omit b07764b remove htable toUpperCase, for HBase tableName is case sensitive omit 2e69f86 [maven-release-plugin] prepare release kylin-2.6.3 omit bf803cf fix beeline meta data parser on partition information omit e5859d7 KYLIN-2565 Fix use of HBaseAdmin omit 5a11a0b KYLIN-3537 omit fb7a6cf KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT add ae0f31e KYLIN-4314 extend intersect_count and add intersect_value UDAF add 3c79862 KYLIN-4046 Refine JDBC Source(source.default=8) add 091f252 upgrade tomcat to 7.0.100 add 5985dbe KYLIN-4390 Update tomcat to 7.0.100, update server.xml and web.xml add 3ffd971 KYLIN-4370 Fix "Table or view not found" error when build cube with spark for JDBC source at step "Build cube by Layer" add 7198656 KYLIN-4132 Kylin needn't use "org.apache.directory.api.util.Strings" to import extra dependency add 5882f16 KYLIN-4400: use client in config to submit sql in system-cube.sh add 9c87a29 KYLIN-4426 Refine CliCommandExecutor add 4364584 use system level KylinConfig for migration add 897aa10 use cube config when uhc step enabled add ef81029 KYLIN-4379: use config overwrite for all MR job add f003efa Check partitionDesc for null value before use it add bf156a0 KYLIN-3628 Fix the silently swallow legit exceptions and reduce code duplication add e8f05f1 KYLIN-4119 Project ADMIN can not operate the Hybrid model add 2841bb3 KYLIN-4245 SqlConverter returns wrong syntax SQL when SqlParser fails for JDBC source add 50655a4 KYLIN-4438 fix bug: null password may cause RuntimeException when starting up add 579ae97 KYLIN-4354 Prune segment not using given filter when using jdbc preparestatement add 0888c86 KYLIN-4426 CliCommandExecutor add 1258843 KYLIN-4385 HiveSink support object storage add a75fb4c KYLIN-4481 Project-level ACL lookups not working for non-admin SAML-federated users new 75c2987 KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT new 857fc5e KYLIN-3537 new d14c446 KYLIN-2565 Fix use of HBaseAdmin new 4a7943d fix beeline meta data parser on partition information new f97e2e0 [maven-release-plugin] prepare release kylin-2.6.3 new 97d0834 remove htable toUpperCase, for HBase tableName is case sensitive new 064c9f8 [maven-release-plugin] prepare release kylin-2.6.4 new ff3d9a0 Remove useless import new 5790ebc Backport HBASE-22887 to Kylin HFileOutputFormat3 new 73abb41 [maven-release-plugin] prepare release kylin-2.6.5 new a9644d4 CDH60 "bin/find-hbase-dependency.sh" can not find hbase dependency as expected new ec17aec Upgrade tomcat vertion to 8.5.51 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (d554905) \ N -- N -- N refs/heads/2.6.x-hadoop3.1 (ec17aec) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 12 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: build/bin/system-cube.sh | 40 ++- build/deploy/server.xml | 6 +- .../org/apache/kylin/common/KylinConfigBase.java | 4 + .../org/apache/kylin/common/SourceDialect.java | 55 ++-- .../kylin/common/util/CliCommandExecutor.java | 45 ++- .../org/apache/kylin/common/util/EncryptUtil.java | 6 + .../kylin/common/util/CliCommandExecutorTest.java | 51 +++ .../apache/kylin/common/util/EncryptUtilTest.java | 6 + .../java/org/apache/kylin/cube/CubeManager.java | 32 +- .../apache/kylin/cube/common/SegmentPruner.java | 7 +- .../kylin/cube/common/SegmentPrunerTest.java | 26 ++ .../java/org/apache/kylin/job/JoinedFlatTable.java | 4 +- .../BitmapIntersectDistinctCountAggFunc.java | 48 +-- ...gFunc.java => BitmapIntersectValueAggFunc.java} | 56 +--- .../kylin/measure/bitmap/BitmapMeasureType.java | 7 +- .../measure/bitmap/RetentionPartialResult.java | 120 +++++++ .../apache/kylin/metadata/model/PartitionDesc.java | 27 +- .../org/apache/kylin/metadata/model/TblColRef.java | 18 ++ .../DefaultPartitionConditionBuilderTest.java | 8 +- .../storage/gtrecord/GTCubeStorageQueryBase.java | 5 +- .../datasource/framework/conv/SqlConverter.java | 10 +- .../engine/mr/common/MapReduceExecutable.java | 26 +- .../kylin/engine/mr/steps/CreateDictionaryJob.java | 4 +- .../org/apache/kylin/engine/spark/SparkUtil.java | 4 +- .../{query00.sql => query04.sql} | 1 + .../query05.sql} | 10 +- .../kylin/metrics/lib/impl/hive/HiveProducer.java | 110 +++++-- .../rest/security/SAMLUserDetailsService.java | 11 + .../org/apache/kylin/rest/service/CubeService.java | 13 +- .../org/apache/kylin/rest/service/JobService.java | 9 +- .../apache/kylin/rest/service/ProjectService.java | 4 +- server/src/main/resources/kylinMetrics.xml | 7 + server/src/main/webapp/WEB-INF/web.xml | 1 + .../org/apache/kylin/source/jdbc/JdbcDialect.java | 26 -- .../org/apache/kylin/source/jdbc/JdbcExplorer.java | 17 +- .../kylin/source/jdbc/JdbcHiveInputBase.java | 344 +++++++++++++++++++-- .../apache/kylin/source/jdbc/JdbcTableReader.java | 15 +- .../java/org/apache/kylin/source/jdbc/SqlUtil.java | 5 +- .../source/jdbc/extensible/JdbcHiveInputBase.java | 2 +- .../source/jdbc/metadata/DefaultJdbcMetadata.java | 6 +- .../kylin/source/jdbc/metadata/IJdbcMetadata.java | 4 + .../source/jdbc/metadata/JdbcMetadataFactory.java | 16 +- .../source/jdbc/metadata/MySQLJdbcMetadata.java | 6 + .../jdbc/metadata/SQLServerJdbcMetadata.java | 6 + .../apache/kylin/source/jdbc/JdbcExplorerTest.java | 4 +- .../kylin/source/jdbc/JdbcHiveInputBaseTest.java | 68 ++++ .../jdbc/metadata/JdbcMetadataFactoryTest.java | 35 --- webapp/app/js/controllers/cubeSchema.js | 5 - 48 files changed, 992 insertions(+), 348 deletions(-) copy core-job/src/main/java/org/apache/kylin/job/exception/JobException.java => core-common/src/main/java/org/apache/kylin/common/SourceDialect.java (56%) create mode 100644 core-common/src/test/java/org/apache/kylin/common/util/CliCommandExecutorTest.java copy core-metadata/src/main/java/org/apache/kylin/measure/bitmap/{BitmapIntersectDistinctCountAggFunc.java => BitmapIntersectValueAggFunc.java} (52%) create mode 100644 core-metadata/src/main/java/org/apache/kylin/measure/bitmap/RetentionPartialResult.java copy kylin-it/src/test/resources/query/sql_intersect_count/{query00.sql => query04.sql} (93%) copy kylin-it/src/test/resources/query/{sql_limit/query01.sql => sql_intersect_count/query05.sql} (76%) delete mode 100644 source-jdbc/src/main/java/org/apache/kylin/source/jdbc/JdbcDialect.java create mode 100644 source-jdbc/src/test/java/org/apache/kylin/source/jdbc/JdbcHiveInputBaseTest.java delete mode 100644 source-jdbc/src/test/java/org/apache/kylin/source/jdbc/metadata/JdbcMetadataFactoryTest.java