This is an automated email from the ASF dual-hosted git repository. liyang pushed a change to branch sync in repository https://gitbox.apache.org/repos/asf/kylin.git.
from 76dc049 minor, fix DefaultSchedulerTest.testMetaStoreRecover() add a2af43d KYLIN-3205 Allow one column is used for both dimension and precisely count distinct measure add 4a29d92 KYLIN-2929, speed up dump performance, write dump file to disk in lazy way add 61f36a2 APACHE-KYLIN-3235: add null check for SQL add 148f5c6 KYLIN-3069 Add proper time zone support to the WebUI instead of GMT/PST kludge add d4c8fbc KYLIN-3215 add d31a009 KYLIN-3219 add 5bc5e65 KYLIN-2980, Remove getKey/Value setKey/Value from Kylin's Pair. add ff6f6c7 KYLIN-3199 The login dialog should be closed when ldap user with no permission login correctly add ebfce48 KYLIN 3199 code review add eac03cd KYLIN-3214 add c686b84 KYLIN-2999 fix cube auto-migration add 0432487 KYLIN-2999 fix ut add 9347f0b KYLIN-3195 update Billy Liu public keys to KEYS add 0bc0677 update calcite to 1.13.0-r4 add 56ec6af KYLIN-3243 add ce76ed9 KYLIN-3245 Searching cube support fuzzy search add 6a558d8 KYLIN-3241 add d06b72e KYLIN-3131 add bc040a9 Minor, make the sample kylin_streaming_cube be consistent with kylin_sales add 8826e1d KYLIN-3277 Automatically remove the blank at the end of lines in properties files add 46d4f97 KYLIN-3139 - Failure in map-reduce job due to undefined hdp.version variable when using HDP stack and remote HBase cluster add 5075f59 KYLIN-3145 Support Kafka JSON message whose property name includes _ add 01bd0d4 KYLIN-3145 Support Kafka JSON message whose property name includes _ (#4028) add 50435e1 KYLIN-3145 minor, update sample streaming message (#4013) add 0655dbc KYLIN-3223 - Query for the list of hybrid cubes results in NPE add 0550cc3 KYLIN-3247 add d4f9d56 KYLIN-3223 fix compile add 139c303 KYLIN-2884 Add delete segment function for portal add 65c2315 KYLIN-2672 Only clean necessary cache for CubeMigrationCLI add 5cecbce KYLIN-2672 minor code review add 5099066 KYLIN-2672 Add UT add da0e6b0 KYLIN-3242 add c86f30f KYLIN-3239 Refactor the ACL code about checkPermission and hasPermission add 82f76db APACHE-KYLIN-2730: add note for some GeneticAlgorithm related lib files that are modified from https://github.com/apache/commons-math add 3fa11b2 KYLIN-3223 fix adjustment based on new ACL check API added by KYLIN-3239 add 2fd676b KYLIN-3197 When ldap is opened, I use an ignored case user to login, the page does not respond. add 17435fa KYLIN-3224 Make the column label of pushdown same with query result of cube add 24c489a KYLIN-3224 code review This closes #100 add f1e9f18 KYLIN-3135 revert first regex too add 714aee0 revert KYLIN-3197 2fd676b36ec9e0f853d59db31ee62cd90a647641 add e59c33e KYLIN-2960, modify the default LDAP admin group config. add 99d68c8 minor, update README.md add c234f8f add coveralls badge add 519f486 enable coveralls add 3be7af9 Merge pull request #103 from yiming187/travis add 21ef4d6 minor update github scm in pom.xml add 74dff9f KYLIN-3263, bugfix with AbstractExecutable's retry. add 66ea154 Merge pull request #104 from tttMelody/master add 23641a2 KYLIN-2884 Add delete segment function for portal - bug fix add 865e377 Merge pull request #105 from sanjulian/APACHE-KYLIN-2884 add 045b22d KYLIN-3268 Tomcat Security Vulnerability Alert. The version of the tomcat for kylin should upgrade to 7.0.85. add 2b38b3b ignore checkstyle on external htrace add 76934db KYLIN-3265 Add jobSearchMode as a filter condition for jobs api add 31cc006 KYLIN-3265 Add jobSearchMode as a filter condition for jobs UI part add 6afe713 Merge pull request #109 from chenzhx/master add 39ef73c KYLIN-3236 The function 'reGenerateAdvancedDict()' has an error logical judgment, which will cause an exception when you edit the cube. new c5e46bb KYLIN-3234, add a API to ResourceStore that can recursively new d63160d KYLIN-3233, fix CacheController if cacheKey has "/". new 4823d8b KYLIN-3234, add HDFS resource store implementation. new 24d319e KYLIN-3227 Automatically remove the blank at the end of lines in properties files (#4035) new 4b2ead2 Move out the wrong execute metadata to a test folder new c6829f1 Fix unstable ut org.apache.kylin.job.impl.threadpool.DefaultSchedulerTest#testMetaStoreRecover new a040c9a KYLIN-3266 improve kylin CI BuildCubeWithEngine coverage new 31af5c2 bug fix,fix KylinConfig deadlock new 0efcf9c KYLIN-3265 update test case to cover it new 451b7ba KYLIN-3267 MR config override at project/cube level only for mem-hungry build steps new a05a4d0 KYLIN-3251, add a hook that can customize test_case_data and add MetadataCleanupJob UT. The 11 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .travis.yml | 5 +- KEYS | 59 ++++++++ README.md | 3 +- build/bin/sample.sh | 2 + build/conf/kylin_job_conf_inmem.xml | 4 + build/conf/setenv.sh | 18 ++- build/script/download-tomcat.sh | 4 +- .../java/org/apache/kylin/common/KylinConfig.java | 4 +- .../org/apache/kylin/common/KylinConfigBase.java | 31 +++-- .../common/persistence/FileResourceStore.java | 28 +++- .../common/persistence/HDFSResourceStore.java | 36 ++++- .../kylin/common/persistence/ResourceStore.java | 12 +- .../apache/kylin/common/restclient/RestClient.java | 33 ++++- .../java/org/apache/kylin/common/util/Pair.java | 16 --- .../src/main/resources/kylin-defaults.properties | 2 +- .../org/apache/kylin/common/KylinConfigTest.java | 9 ++ .../common/persistence/HDFSResourceStoreTest.java | 77 +++++++++++ .../common/util/LocalFileMetadataTestCase.java | 77 ++++++++--- .../java/org/apache/kylin/cube/CubeManager.java | 3 +- .../cuboid/algorithm/generic/GeneticAlgorithm.java | 2 + .../cuboid/algorithm/generic/lib/BitsMutation.java | 2 + .../cuboid/algorithm/generic/lib/Chromosome.java | 2 + .../algorithm/generic/lib/ChromosomePair.java | 2 + .../algorithm/generic/lib/CrossoverPolicy.java | 2 + .../generic/lib/ElitisticListPopulation.java | 2 + .../cube/cuboid/algorithm/generic/lib/Fitness.java | 2 + .../generic/lib/FixedGenerationCount.java | 2 + .../algorithm/generic/lib/ListPopulation.java | 2 + .../algorithm/generic/lib/MutationPolicy.java | 2 + .../algorithm/generic/lib/OnePointCrossover.java | 2 + .../cuboid/algorithm/generic/lib/Population.java | 2 + .../algorithm/generic/lib/SelectionPolicy.java | 2 + .../algorithm/generic/lib/StoppingCondition.java | 2 + .../algorithm/generic/lib/TournamentSelection.java | 2 + .../kylin/cube/model/CubeJoinedFlatTableDesc.java | 4 + .../cube/model/validation/rule/DictionaryRule.java | 6 +- .../apache/kylin/gridtable/GTAggregateScanner.java | 70 ++++++++-- .../kylin/job/execution/AbstractExecutable.java | 32 ++--- .../apache/kylin/job/ExecutableManagerTest.java | 2 +- .../apache/kylin/job/RetryableTestExecutable.java | 50 ------- .../job/impl/threadpool/DefaultSchedulerTest.java | 35 +++-- .../kylin/metadata/TableMetadataManager.java | 12 ++ .../org/apache/kylin/metadata/model/TableDesc.java | 2 +- .../org/apache/kylin/metadata/model/TblColRef.java | 6 + .../kylin/metadata/project/ProjectL2Cache.java | 4 + .../kylin/metadata/project/ProjectManager.java | 6 +- .../org/apache/kylin/metrics/MetricsManager.java | 14 +- .../java/org/apache/kylin/engine/mr/CubingJob.java | 17 ++- .../engine/mr/common/MapReduceExecutable.java | 21 ++- .../engine/mr/common/MapReduceExecutableTest.java | 50 +++++++ .../template/cube_desc/kylin_streaming_cube.json | 4 +- examples/test_case_data/localmeta/kylin.properties | 6 +- examples/test_case_data/sandbox/kylin.properties | 2 +- .../sandbox/kylin_job_conf_inmem.xml | 4 + external/htrace/pom.xml | 1 + .../kylin/provision/BuildCubeWithEngine.java | 75 +++++----- pom.xml | 29 ++-- .../kylin/query/adhoc/PushDownRunnerJdbcImpl.java | 151 ++++++++++++++++++++- .../org/apache/kylin/query/util/QueryUtil.java | 2 +- .../org/apache/kylin/query/util/QueryUtilTest.java | 7 +- .../broadcaster/BroadcasterReceiveServlet.java | 21 ++- .../kylin/rest/controller/AccessController.java | 10 +- .../kylin/rest/controller/CacheController.java | 20 +++ .../kylin/rest/controller/CubeController.java | 18 ++- .../kylin/rest/controller/JobController.java | 14 +- .../kylin/rest/controller/ProjectController.java | 10 +- .../kylin/rest/controller/QueryController.java | 2 +- .../java/org/apache/kylin/rest/msg/Message.java | 4 + ...ybridRequest.java => CubeMigrationRequest.java} | 36 ++--- .../apache/kylin/rest/request/JobListRequest.java | 10 ++ .../rest/security/LDAPAuthoritiesPopulator.java | 1 + .../apache/kylin/rest/service/CacheService.java | 34 ++++- .../org/apache/kylin/rest/service/CubeService.java | 82 +++++------ .../apache/kylin/rest/service/HybridService.java | 53 +++++--- .../org/apache/kylin/rest/service/JobService.java | 48 ++++--- .../apache/kylin/rest/service/ModelService.java | 20 ++- .../apache/kylin/rest/service/ProjectService.java | 10 +- .../apache/kylin/rest/service/QueryService.java | 76 +++++------ .../org/apache/kylin/rest/util/AclEvaluate.java | 78 +++++++---- .../kylin/rest/controller/CacheControllerTest.java | 54 +++++++- .../kylin/rest/controller/CubeControllerTest.java | 2 +- .../kylin/rest/controller/JobControllerTest.java | 21 ++- .../kylin/rest/service/AdminServiceTest.java | 3 +- .../apache/kylin/rest/service/JobServiceTest.java | 12 +- .../execute/d9a2b721-9916-4607-8047-148ceb2473b1 | 0 .../apache/kylin/source/kafka/StreamingParser.java | 6 +- .../kylin/source/kafka/TimedJsonStreamParser.java | 47 +++++-- .../source/kafka/util/KafkaSampleProducer.java | 1 + .../source/kafka/TimedJsonStreamParserTest.java | 36 ++++- source-kafka/src/test/resources/message.json | 2 +- .../kylin/storage/hbase/HBaseResourceStore.java | 24 ++-- .../org/apache/kylin/tool/CubeMigrationCLI.java | 28 ++-- .../org/apache/kylin/tool/MetadataCleanupJob.java | 56 ++++---- .../tool/metrics/systemcube/CubeDescCreator.java | 8 +- .../apache/kylin/tool/MetadataCleanupJobTest.java | 76 +++++++++++ .../src/test/resources/test_meta}/UUID | Bin .../test_meta/cube/ci_inner_join_cube.json | 60 ++++++++ .../test_meta}/cube_desc/ci_inner_join_cube.json | 0 .../04b6db34-b243-4780-855a-4c7ea4cee817.seq | Bin 0 -> 2605183 bytes .../NAME/b58ce89d-3df6-46d1-8cff-2a9cfc8b7510.dict | Bin 0 -> 823 bytes .../NAME/64ca8fea-b859-4e63-aea3-bfb4c6ee0c9d.dict | Bin 0 -> 844 bytes .../execute/d861b8b7-c773-47ab-bb1e-c8782ae8d930 | 41 ++++++ .../d861b8b7-c773-47ab-bb1e-c8782ae8d930 | 13 ++ .../d861b8b7-c773-47ab-bb1e-c8782ae8d930-00 | 13 ++ .../d861b8b7-c773-47ab-bb1e-c8782ae8d930-01 | 13 ++ .../src/test/resources/test_meta/kylin.properties | 0 .../test_meta}/model_desc/ci_inner_join_model.json | 0 .../test/resources/test_meta/project/default.json | 35 +++++ .../test_meta}/table/DEFAULT.TEST_ACCOUNT.json | 0 .../table/DEFAULT.TEST_CATEGORY_GROUPINGS.json | 0 .../test_meta}/table/DEFAULT.TEST_COUNTRY.json | 0 .../test_meta}/table/DEFAULT.TEST_KYLIN_FACT.json | 0 .../test_meta}/table/DEFAULT.TEST_ORDER.json | 0 .../test_meta}/table/EDW.TEST_CAL_DT.json | 0 .../test_meta}/table/EDW.TEST_SELLER_TYPE_DIM.json | 0 .../resources/test_meta}/table/EDW.TEST_SITES.json | 0 .../92456efe-9b79-4385-a5a3-e7f37b677bf7.snapshot | Bin 0 -> 16063 bytes .../7ecdb07b-a8d0-49d8-892b-fe2dd75512ca.snapshot | Bin 0 -> 16061 bytes webapp/app/js/controllers/cubeAdvanceSetting.js | 9 +- webapp/app/js/controllers/cubeEdit.js | 15 +- webapp/app/js/controllers/cubes.js | 72 +++++++++- webapp/app/js/controllers/job.js | 5 +- webapp/app/js/controllers/sourceMeta.js | 11 +- webapp/app/js/filters/filter.js | 42 ++---- webapp/app/js/model/cubeDescModel.js | 16 ++- webapp/app/js/model/jobConfig.js | 5 + webapp/app/js/model/jobListModel.js | 2 + webapp/app/js/services/cubes.js | 1 + webapp/app/js/services/kylinProperties.js | 3 + webapp/app/js/services/users.js | 15 +- webapp/app/partials/common/access.html | 18 +-- .../cube_delete_segment.html} | 49 +++---- webapp/app/partials/cubes/cube_detail.html | 4 +- webapp/app/partials/cubes/cubes.html | 9 +- webapp/app/partials/jobs/jobList.html | 5 +- webapp/app/partials/query/query.html | 2 +- 136 files changed, 1792 insertions(+), 654 deletions(-) create mode 100644 core-common/src/test/java/org/apache/kylin/common/persistence/HDFSResourceStoreTest.java delete mode 100644 core-job/src/test/java/org/apache/kylin/job/RetryableTestExecutable.java create mode 100644 engine-mr/src/test/java/org/apache/kylin/engine/mr/common/MapReduceExecutableTest.java copy server-base/src/main/java/org/apache/kylin/rest/request/{HybridRequest.java => CubeMigrationRequest.java} (66%) rename {examples/test_case_data/localmeta => server/src/test/resources/ut_meta/broken_executable}/execute/d9a2b721-9916-4607-8047-148ceb2473b1 (100%) create mode 100644 tool/src/test/java/org/apache/kylin/tool/MetadataCleanupJobTest.java copy {examples/test_case_data/localmeta => tool/src/test/resources/test_meta}/UUID (100%) create mode 100644 tool/src/test/resources/test_meta/cube/ci_inner_join_cube.json copy {examples/test_case_data/localmeta => tool/src/test/resources/test_meta}/cube_desc/ci_inner_join_cube.json (100%) create mode 100644 tool/src/test/resources/test_meta/cube_statistics/kylin_sales_cube/04b6db34-b243-4780-855a-4c7ea4cee817.seq create mode 100644 tool/src/test/resources/test_meta/dict/DEFAULT.KYLIN_COUNTRY/NAME/b58ce89d-3df6-46d1-8cff-2a9cfc8b7510.dict create mode 100644 tool/src/test/resources/test_meta/dict/DEFAULT.TEST_COUNTRY/NAME/64ca8fea-b859-4e63-aea3-bfb4c6ee0c9d.dict create mode 100644 tool/src/test/resources/test_meta/execute/d861b8b7-c773-47ab-bb1e-c8782ae8d930 create mode 100644 tool/src/test/resources/test_meta/execute_output/d861b8b7-c773-47ab-bb1e-c8782ae8d930 create mode 100644 tool/src/test/resources/test_meta/execute_output/d861b8b7-c773-47ab-bb1e-c8782ae8d930-00 create mode 100644 tool/src/test/resources/test_meta/execute_output/d861b8b7-c773-47ab-bb1e-c8782ae8d930-01 copy engine-mr/src/test/resources/multi_file_empty_file/empty.txt => tool/src/test/resources/test_meta/kylin.properties (100%) copy {examples/test_case_data/localmeta => tool/src/test/resources/test_meta}/model_desc/ci_inner_join_model.json (100%) create mode 100644 tool/src/test/resources/test_meta/project/default.json copy {examples/test_case_data/localmeta => tool/src/test/resources/test_meta}/table/DEFAULT.TEST_ACCOUNT.json (100%) copy {examples/test_case_data/localmeta => tool/src/test/resources/test_meta}/table/DEFAULT.TEST_CATEGORY_GROUPINGS.json (100%) copy {examples/test_case_data/localmeta => tool/src/test/resources/test_meta}/table/DEFAULT.TEST_COUNTRY.json (100%) copy {examples/test_case_data/localmeta => tool/src/test/resources/test_meta}/table/DEFAULT.TEST_KYLIN_FACT.json (100%) copy {examples/test_case_data/localmeta => tool/src/test/resources/test_meta}/table/DEFAULT.TEST_ORDER.json (100%) copy {examples/test_case_data/localmeta => tool/src/test/resources/test_meta}/table/EDW.TEST_CAL_DT.json (100%) copy {examples/test_case_data/localmeta => tool/src/test/resources/test_meta}/table/EDW.TEST_SELLER_TYPE_DIM.json (100%) copy {examples/test_case_data/localmeta => tool/src/test/resources/test_meta}/table/EDW.TEST_SITES.json (100%) create mode 100644 tool/src/test/resources/test_meta/table_snapshot/DEFAULT.KYLIN_COUNTRY/92456efe-9b79-4385-a5a3-e7f37b677bf7.snapshot create mode 100644 tool/src/test/resources/test_meta/table_snapshot/DEFAULT.TEST_COUNTRY/7ecdb07b-a8d0-49d8-892b-fe2dd75512ca.snapshot copy webapp/app/partials/{jobs/job_refresh.html => cubes/cube_delete_segment.html} (59%) -- To stop receiving notification emails like this one, please contact liy...@apache.org.