[drill] branch master updated (dc865e8 -> f3d6b69)
This is an automated email from the ASF dual-hosted git repository. arina pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/drill.git. from dc865e8 DRILL-7271: Refactor Metadata interfaces and classes to contain all needed information for the File based Metastore new e8d9b0a DRILL-6711: Use jitpack repository for Drill Calcite project artifacts instead of repository.mapr.com new f3d6b69 DRILL-7310: Move schema-related classes from exec module to be able to use them in metastore module The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: common/pom.xml | 2 +- contrib/storage-hive/core/pom.xml | 14 +++- contrib/storage-hive/hive-exec-shade/pom.xml | 4 +- docs/dev/Calcite.md| 26 ++ exec/java-exec/pom.xml | 25 +- .../exec/physical/rowSet/impl/ColumnBuilder.java | 13 +-- .../drill/exec/record/BatchSchemaBuilder.java | 57 + .../org/apache/drill/exec/record/SchemaUtil.java | 11 +++ .../store/parquet/BaseParquetMetadataProvider.java | 5 +- .../store/parquet/ParquetTableMetadataUtils.java | 4 +- .../java/org/apache/drill/TestFunctionsQuery.java | 7 +- .../java/org/apache/drill/TestStarQueries.java | 19 +++-- .../test/java/org/apache/drill/TestUnionAll.java | 7 +- .../java/org/apache/drill/TestUnionDistinct.java | 7 +- .../java/org/apache/drill/TestUntypedNull.java | 19 +++-- .../org/apache/drill/exec/TestEmptyInputSql.java | 61 +- .../drill/exec/cache/TestBatchSerialization.java | 31 --- .../drill/exec/fn/impl/TestCastFunctions.java | 7 +- .../impl/agg/TestStreamingAggEmitOutcome.java | 2 - .../physical/impl/join/TestHashJoinAdvanced.java | 7 +- .../physical/impl/join/TestHashJoinOutcome.java| 4 +- .../impl/protocol/TestOperatorRecordBatch.java | 32 +--- .../impl/scan/BaseScanOperatorExecTest.java| 5 +- .../physical/impl/scan/TestFileScanFramework.java | 30 --- .../physical/impl/scan/TestScanBatchWriters.java | 6 +- .../impl/scan/TestScanOperExecSmoothing.java | 5 +- .../impl/scan/TestScanOrchestratorEarlySchema.java | 24 +++--- .../impl/scan/TestScanOrchestratorLateSchema.java | 5 +- .../impl/scan/TestScanOrchestratorMetadata.java| 17 ++-- .../scan/project/TestConstantColumnLoader.java | 10 +-- .../impl/scan/project/TestRowBatchMerger.java | 46 +-- .../impl/svremover/AbstractGenericCopierTest.java | 7 +- .../physical/impl/validate/TestBatchValidator.java | 42 +- .../exec/physical/impl/xsort/TestExternalSort.java | 26 +++--- .../physical/impl/xsort/managed/TestCopier.java| 7 +- .../impl/xsort/managed/TestShortArrays.java| 6 +- .../physical/impl/xsort/managed/TestSortImpl.java | 3 +- .../physical/impl/xsort/managed/TestSorter.java| 14 ++-- .../impl/TestResultSetLoaderOmittedValues.java | 5 +- .../rowSet/impl/TestResultSetLoaderProjection.java | 13 ++- .../rowSet/impl/TestResultSetSchemaChange.java | 20 +++-- .../drill/exec/physical/unit/TestMiniPlan.java | 19 +++-- .../exec/physical/unit/TestNullInputMiniPlan.java | 69 ++-- .../drill/exec/record/TestRecordBatchSizer.java| 95 +++--- .../drill/exec/record/TestVectorContainer.java | 13 +-- .../exec/record/metadata/TestTupleSchema.java | 6 +- .../apache/drill/exec/record/vector/TestLoad.java | 76 +++-- .../drill/exec/store/TestImplicitFileColumns.java | 19 +++-- .../drill/exec/store/httpd/TestHTTPDLogReader.java | 6 +- .../apache/drill/exec/store/log/TestLogReader.java | 54 ++-- .../store/parquet/TestParquetMetadataCache.java| 9 +- .../java/org/apache/drill/test/ClientFixture.java | 7 +- .../java/org/apache/drill/test/ExampleTest.java| 6 +- .../rowSet/test/TestRepeatedListAccessors.java | 21 +++-- .../test/rowSet/test/TestVariantAccessors.java | 5 +- exec/jdbc-all/pom.xml | 8 +- exec/vector/pom.xml| 21 + .../record/metadata/schema/parser/SchemaLexer.g4 | 0 .../record/metadata/schema/parser/SchemaParser.g4 | 0 .../record/metadata/AbstractColumnMetadata.java| 0 .../drill/exec/record/metadata/ColumnBuilder.java | 0 .../drill/exec/record/metadata/MapBuilder.java | 0 .../exec/record/metadata/MapColumnMetadata.java| 0 .../drill/exec/record/metadata/MetadataUtils.java | 45 -- .../record/metadata/PrimitiveColumnMetadata.java | 6 +- .../exec/record/metadata/RepeatedListBuilder.java | 0 .../metadata/RepeatedListColumnMetadata.java | 0
[drill] 01/02: DRILL-6711: Use jitpack repository for Drill Calcite project artifacts instead of repository.mapr.com
This is an automated email from the ASF dual-hosted git repository. arina pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/drill.git commit e8d9b0ae6253db10fa5c2e8b5aeb4eecb3a1feb9 Author: Volodymyr Vysotskyi AuthorDate: Mon Jun 24 14:52:59 2019 +0300 DRILL-6711: Use jitpack repository for Drill Calcite project artifacts instead of repository.mapr.com closes #1815 --- common/pom.xml | 2 +- contrib/storage-hive/core/pom.xml| 14 ++- contrib/storage-hive/hive-exec-shade/pom.xml | 4 ++-- docs/dev/Calcite.md | 26 + exec/java-exec/pom.xml | 4 ++-- exec/jdbc-all/pom.xml| 8 +++ logical/pom.xml | 2 +- pom.xml | 35 +++- 8 files changed, 57 insertions(+), 38 deletions(-) diff --git a/common/pom.xml b/common/pom.xml index 8c71404..8c9593c 100644 --- a/common/pom.xml +++ b/common/pom.xml @@ -46,7 +46,7 @@ - org.apache.calcite + com.github.vvysotskyi.drill-calcite calcite-core diff --git a/contrib/storage-hive/core/pom.xml b/contrib/storage-hive/core/pom.xml index 9912b83..88003ae 100644 --- a/contrib/storage-hive/core/pom.xml +++ b/contrib/storage-hive/core/pom.xml @@ -96,7 +96,7 @@ - org.apache.calcite + com.github.vvysotskyi.drill-calcite calcite-core @@ -150,6 +150,18 @@ test + org.apache.calcite + calcite-core + + + org.apache.calcite + calcite-linq4j + + + org.apache.calcite + calcite-druid + + commons-logging commons-logging diff --git a/contrib/storage-hive/hive-exec-shade/pom.xml b/contrib/storage-hive/hive-exec-shade/pom.xml index a767000..4e79444 100644 --- a/contrib/storage-hive/hive-exec-shade/pom.xml +++ b/contrib/storage-hive/hive-exec-shade/pom.xml @@ -65,8 +65,8 @@ calcite-core - org.apache.calcite - calcite-avatica + org.apache.calcite.avatica + avatica org.apache.calcite diff --git a/docs/dev/Calcite.md b/docs/dev/Calcite.md new file mode 100644 index 000..39d5fe4 --- /dev/null +++ b/docs/dev/Calcite.md @@ -0,0 +1,26 @@ +# Drill-specific commits in Apache Calcite + +Currently, Drill uses Apache Calcite with additional changes, required for Drill. All the commits were left after +update from Calcite `1.4.0` to Calcite `1.15.0` and weren't merged to the Calcite's master yet since there is no consensus on them in Calcite community. + +List of Jiras with Drill-specific commits: + +|Jira|Summary|The reason why it wasn't merged| +||---|---| +|[CALCITE-2018](https://issues.apache.org/jira/browse/CALCITE-2018)|Queries failed with AssertionError: rel has lower cost than best cost of subset|Pull request with the fix was created ([PR-552](https://github.com/apache/calcite/pull/552)), but [CALCITE-2166](https://issues.apache.org/jira/browse/CALCITE-2166) which blocks it was found and is not resolved yet.| +|[CALCITE-2087](https://issues.apache.org/jira/browse/CALCITE-2087)|Add new method to ViewExpander interface to allow passing SchemaPlus.|Pull request into Apache Calcite was created, but it was declined. See conversation in Jira.| +|[CALCITE-1178](https://issues.apache.org/jira/browse/CALCITE-1178)|Allow SqlBetweenOperator to compare DATE and TIMESTAMP|SQL spec does not allow to compare datetime types if they have different ``s. Therefore Calcite community won’t accept these changes. Similar issues were reported in [CALCITE-2829](https://issues.apache.org/jira/browse/CALCITE-2829) and in [CALCITE-2745](https://issues.apache.org/jira/browse/CALCITE-2745).| + +# Drill-Calcite repository + +Repository with source code is placed [here](https://github.com/vvysotskyi/drill-calcite). For backward +compatibility, a couple of previous Drill Calcite branches were pushed into this repo. + +Drill committers who need write permissions to the repository, should notify its owner. + +# Process of updating Calcite version + +- Push required changes to the existing branch, or create new branch. *Though this repository contains Drill specific commits, it is forbidden to add additional specific commits which were not merged to Apache Calcite master if it wasn't discussed in Drill community first.* +- The last commit must be a commit which updates the version number. +- Create and push tag for commit with the version update. Tag name should match the version, for example, `1.18.0-drill-r0`, `1.18.0-drill-r1`, `1.18.0-drill-r2` and so on. +- Bump-up Drill Calcite version in Drill pom.xml file. \ No newline at end of file diff --git
