[jira] [Reopened] (DRILL-8309) Upgrade slf4j to 2.0.x
[ https://issues.apache.org/jira/browse/DRILL-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton reopened DRILL-8309: - > Upgrade slf4j to 2.0.x > -- > > Key: DRILL-8309 > URL: https://issues.apache.org/jira/browse/DRILL-8309 > Project: Apache Drill > Issue Type: Improvement >Affects Versions: 1.20.2 >Reporter: PJ Fanning >Assignee: James Turton >Priority: Minor > Fix For: 1.21.0 > > > In the process of upgrading the logging libraries, a number of other > dependencies changes were made in the effort to deal with old versions of > slf4j brought in by data dependencies. > - logback 1.2.11 → 1.4.5. > - log4j 2.18.0 → 2.19.0. > - slf4j 1.7.26 → 2.0.6. > - avatica → avatica-core > - snappy-java removed > - avro 1.110 → 1.11.1 > - de.huxhorn.lilith.logback.appender.multiplex-classic 0.9.44 → 8.3.0 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (DRILL-8309) Upgrade slf4j to 2.0.x
[ https://issues.apache.org/jira/browse/DRILL-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton updated DRILL-8309: Description: In the process of upgrading the logging libraries, a number of other dependency changes were made in the effort to deal with old versions of slf4j brought in by fat jars. - logback 1.2.11 → 1.4.5. - log4j 2.18.0 → 2.19.0. - slf4j 1.7.26 → 2.0.6. - avatica → avatica-core - snappy-java removed - avro 1.110 → 1.11.1 - de.huxhorn.lilith.logback.appender.multiplex-classic 0.9.44 → 8.3.0 was: In the process of upgrading the logging libraries, a number of other dependencies changes were made in the effort to deal with old versions of slf4j brought in by data dependencies. - logback 1.2.11 → 1.4.5. - log4j 2.18.0 → 2.19.0. - slf4j 1.7.26 → 2.0.6. - avatica → avatica-core - snappy-java removed - avro 1.110 → 1.11.1 - de.huxhorn.lilith.logback.appender.multiplex-classic 0.9.44 → 8.3.0 > Upgrade slf4j to 2.0.x > -- > > Key: DRILL-8309 > URL: https://issues.apache.org/jira/browse/DRILL-8309 > Project: Apache Drill > Issue Type: Improvement >Affects Versions: 1.20.2 >Reporter: PJ Fanning >Assignee: James Turton >Priority: Minor > Fix For: 1.21.0 > > > In the process of upgrading the logging libraries, a number of other > dependency changes were made in the effort to deal with old versions of slf4j > brought in by fat jars. > - logback 1.2.11 → 1.4.5. > - log4j 2.18.0 → 2.19.0. > - slf4j 1.7.26 → 2.0.6. > - avatica → avatica-core > - snappy-java removed > - avro 1.110 → 1.11.1 > - de.huxhorn.lilith.logback.appender.multiplex-classic 0.9.44 → 8.3.0 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8309) Upgrade slf4j to 2.0.x
[ https://issues.apache.org/jira/browse/DRILL-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8309. --- Resolution: Fixed > Upgrade slf4j to 2.0.x > -- > > Key: DRILL-8309 > URL: https://issues.apache.org/jira/browse/DRILL-8309 > Project: Apache Drill > Issue Type: Improvement >Affects Versions: 1.20.2 >Reporter: PJ Fanning >Assignee: James Turton >Priority: Minor > Fix For: 1.21.0 > > > In the process of upgrading the logging libraries, a number of other > dependency changes were made in the effort to deal with old versions of slf4j > brought in by fat jars. > - logback 1.2.11 → 1.4.5. > - log4j 2.18.0 → 2.19.0. > - slf4j 1.7.26 → 2.0.6. > - avatica → avatica-core > - snappy-java removed > - avro 1.110 → 1.11.1 > - de.huxhorn.lilith.logback.appender.multiplex-classic 0.9.44 → 8.3.0 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (DRILL-8309) Upgrade slf4j to 2.0.x
[ https://issues.apache.org/jira/browse/DRILL-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton updated DRILL-8309: Description: In the process of upgrading the logging libraries, a number of other dependencies changes were made in the effort to deal with old versions of slf4j brought in by data dependencies. - logback 1.2.11 → 1.4.5. - log4j 2.18.0 → 2.19.0. - slf4j 1.7.26 → 2.0.6. - avatica → avatica-core - snappy-java removed - avro 1.110 → 1.11.1 - de.huxhorn.lilith.logback.appender.multiplex-classic 0.9.44 → 8.3.0 was: * logback 1.2.11 → 1.4.5. * log4j 2.18.0 → 2.19.0. * slf4j 1.7.26 → 2.0.6. > Upgrade slf4j to 2.0.x > -- > > Key: DRILL-8309 > URL: https://issues.apache.org/jira/browse/DRILL-8309 > Project: Apache Drill > Issue Type: Improvement >Affects Versions: 1.20.2 >Reporter: PJ Fanning >Assignee: James Turton >Priority: Minor > Fix For: 1.21.0 > > > In the process of upgrading the logging libraries, a number of other > dependencies changes were made in the effort to deal with old versions of > slf4j brought in by data dependencies. > - logback 1.2.11 → 1.4.5. > - log4j 2.18.0 → 2.19.0. > - slf4j 1.7.26 → 2.0.6. > - avatica → avatica-core > - snappy-java removed > - avro 1.110 → 1.11.1 > - de.huxhorn.lilith.logback.appender.multiplex-classic 0.9.44 → 8.3.0 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8309) Upgrade slf4j to 2.0.x
[ https://issues.apache.org/jira/browse/DRILL-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8309. --- Resolution: Fixed > Upgrade slf4j to 2.0.x > -- > > Key: DRILL-8309 > URL: https://issues.apache.org/jira/browse/DRILL-8309 > Project: Apache Drill > Issue Type: Improvement >Affects Versions: 1.20.2 >Reporter: PJ Fanning >Assignee: James Turton >Priority: Minor > Fix For: 1.21.0 > > > In the process of upgrading the logging libraries, a number of other > dependencies changes were made in the effort to deal with old versions of > slf4j brought in by data dependencies. > - logback 1.2.11 → 1.4.5. > - log4j 2.18.0 → 2.19.0. > - slf4j 1.7.26 → 2.0.6. > - avatica → avatica-core > - snappy-java removed > - avro 1.110 → 1.11.1 > - de.huxhorn.lilith.logback.appender.multiplex-classic 0.9.44 → 8.3.0 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (DRILL-8309) Upgrade slf4j to 2.0.x
[ https://issues.apache.org/jira/browse/DRILL-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton updated DRILL-8309: Priority: Minor (was: Major) > Upgrade slf4j to 2.0.x > -- > > Key: DRILL-8309 > URL: https://issues.apache.org/jira/browse/DRILL-8309 > Project: Apache Drill > Issue Type: Improvement >Affects Versions: 1.20.2 >Reporter: PJ Fanning >Assignee: James Turton >Priority: Minor > Fix For: 1.21.0 > > > * logback 1.2.11 → 1.4.5. > * log4j 2.18.0 → 2.19.0. > * slf4j 1.7.26 → 2.0.6. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (DRILL-8309) Upgrade slf4j to 2.0.x
[ https://issues.apache.org/jira/browse/DRILL-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17686165#comment-17686165 ] ASF GitHub Bot commented on DRILL-8309: --- jnturton commented on PR #2750: URL: https://github.com/apache/drill/pull/2750#issuecomment-1423573873 @pjfanning the upgrade wasn't as smooth as it looks, I fought with it for hours. I should have left this PR in draft before retiring yesterday because I did want to come back and expand my commentary. The seemingly unrelated upgrades and removals came from my chasing after fat jars that bundle slf4j < 2.0 (and were breaking this upgrade). In the end it was the refactoring of the Avatica dependency that really counted. > Upgrade slf4j to 2.0.x > -- > > Key: DRILL-8309 > URL: https://issues.apache.org/jira/browse/DRILL-8309 > Project: Apache Drill > Issue Type: Improvement >Affects Versions: 1.20.2 >Reporter: PJ Fanning >Assignee: James Turton >Priority: Major > Fix For: 1.21.0 > > > * logback 1.2.11 → 1.4.5. > * log4j 2.18.0 → 2.19.0. > * slf4j 1.7.26 → 2.0.6. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (DRILL-8309) Upgrade slf4j to 2.0.x
[ https://issues.apache.org/jira/browse/DRILL-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17686157#comment-17686157 ] ASF GitHub Bot commented on DRILL-8309: --- cgivre merged PR #2750: URL: https://github.com/apache/drill/pull/2750 > Upgrade slf4j to 2.0.x > -- > > Key: DRILL-8309 > URL: https://issues.apache.org/jira/browse/DRILL-8309 > Project: Apache Drill > Issue Type: Improvement >Affects Versions: 1.20.2 >Reporter: PJ Fanning >Assignee: James Turton >Priority: Major > Fix For: 1.21.0 > > > * logback 1.2.11 → 1.4.5. > * log4j 2.18.0 → 2.19.0. > * slf4j 1.7.26 → 2.0.6. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (DRILL-8396) Update checkstyle version
[ https://issues.apache.org/jira/browse/DRILL-8396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17686154#comment-17686154 ] ASF GitHub Bot commented on DRILL-8396: --- cgivre merged PR #2751: URL: https://github.com/apache/drill/pull/2751 > Update checkstyle version > - > > Key: DRILL-8396 > URL: https://issues.apache.org/jira/browse/DRILL-8396 > Project: Apache Drill > Issue Type: Task >Reporter: Vova Vysotskyi >Assignee: Vova Vysotskyi >Priority: Minor > > Update com.puppycrawl.tools:checkstyle version to the latest one. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (DRILL-7722) CREATE VIEW with LATERAL UNNEST creates an invalid view
[
https://issues.apache.org/jira/browse/DRILL-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17686139#comment-17686139
]
ASF GitHub Bot commented on DRILL-7722:
---
cgivre commented on PR #2083:
URL: https://github.com/apache/drill/pull/2083#issuecomment-1423478202
The underlying issue was fixed in https://github.com/apache/drill/pull/2602.
> CREATE VIEW with LATERAL UNNEST creates an invalid view
> ---
>
> Key: DRILL-7722
> URL: https://issues.apache.org/jira/browse/DRILL-7722
> Project: Apache Drill
> Issue Type: Bug
> Components: SQL Parser
>Affects Versions: 1.17.0
>Reporter: Matevž Bradač
>Assignee: Vova Vysotskyi
>Priority: Blocker
>
> Creating a view from a query containing LATERAL UNNEST results in a view that
> cannot be parsed by the engine. The generated view contains superfluous
> parentheses, thus the failed parsing.
> {code:bash|title=a simple JSON database}
> $ cat /tmp/t.json
> [{"name": "item_1", "related": ["id1"]}, {"name": "item_2", "related":
> ["id1", "id2"]}, {"name": "item_3", "related": ["id2"]}]
> {code}
> {code:SQL|title=drill query, working}
> SELECT
> item.name,
> relations.*
> FROM dfs.tmp.`t.json` item
> JOIN LATERAL(
> SELECT * FROM UNNEST(item.related) i(rels)
> ) relations
> ON TRUE
> name rels
> 0 item_1 id1
> 1 item_2 id1
> 2 item_2 id2
> 3 item_3 id2
> {code}
> {code:SQL|title=create a drill view from the above query}
> CREATE VIEW dfs.tmp.unnested_view AS
> SELECT
> item.name,
> relations.*
> FROM dfs.tmp.`t.json` item
> JOIN LATERAL(
> SELECT * FROM UNNEST(item.related) i(rels)
> ) relations
> ON TRUE
> {code}
> {code:bash|title=contents of view file}
> # note the extra parentheses near LATERAL and FROM
> $ cat /tmp/unnested_view.view.drill
> {
> "name" : "unnested_view",
> "sql" : "SELECT `item`.`name`, `relations`.*\nFROM `dfs`.`tmp`.`t.json` AS
> `item`\nINNER JOIN LATERAL((SELECT *\nFROM (UNNEST(`item`.`related`)) AS `i`
> (`rels`))) AS `relations` ON TRUE",
> "fields" : [ {
> "name" : "name",
> "type" : "ANY",
> "isNullable" : true
> }, {
> "name" : "rels",
> "type" : "ANY",
> "isNullable" : true
> } ],
> "workspaceSchemaPath" : [ ]
> }
> {code}
> {code:SQL|title=query the view}
> SELECT * FROM dfs.tmp.unnested_view
> PARSE ERROR: Failure parsing a view your query is dependent upon.
> SQL Query: SELECT `item`.`name`, `relations`.*
> FROM `dfs`.`tmp`.`t.json` AS `item`
> INNER JOIN LATERAL((SELECT *
> FROM (UNNEST(`item`.`related`)) AS `i` (`rels`))) AS `relations` ON TRUE
> ^
> [Error Id: fd816a27-c2c5-4c2a-b6bf-173ab37eb693 ]
> {code}
> If the view is "fixed" by editing the generated JSON and removing the extra
> parentheses, e.g.
> {code:bash|title=fixed view}
> $ cat /tmp/fixed_unnested_view.view.drill
> {
> "name" : "fixed_unnested_view",
> "sql" : "SELECT `item`.`name`, `relations`.*\nFROM `dfs`.`tmp`.`t.json` AS
> `item`\nINNER JOIN LATERAL(SELECT *\nFROM UNNEST(`item`.`related`) AS `i`
> (`rels`)) AS `relations` ON TRUE",
> "fields" : [ {
> "name" : "name",
> "type" : "ANY",
> "isNullable" : true
> }, {
> "name" : "rels",
> "type" : "ANY",
> "isNullable" : true
> } ],
> "workspaceSchemaPath" : [ ]
> }
> {code}
> then querying works as expected:
> {code:sql|title=fixed view query}
> SELECT * FROM dfs.tmp.fixed_unnested_view
> name rels
> 0 item_1 id1
> 1 item_2 id1
> 2 item_2 id2
> 3 item_3 id2
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (DRILL-7722) CREATE VIEW with LATERAL UNNEST creates an invalid view
[
https://issues.apache.org/jira/browse/DRILL-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17686140#comment-17686140
]
ASF GitHub Bot commented on DRILL-7722:
---
cgivre closed pull request #2083: DRILL-7722: Add reproducer unit test
URL: https://github.com/apache/drill/pull/2083
> CREATE VIEW with LATERAL UNNEST creates an invalid view
> ---
>
> Key: DRILL-7722
> URL: https://issues.apache.org/jira/browse/DRILL-7722
> Project: Apache Drill
> Issue Type: Bug
> Components: SQL Parser
>Affects Versions: 1.17.0
>Reporter: Matevž Bradač
>Assignee: Vova Vysotskyi
>Priority: Blocker
>
> Creating a view from a query containing LATERAL UNNEST results in a view that
> cannot be parsed by the engine. The generated view contains superfluous
> parentheses, thus the failed parsing.
> {code:bash|title=a simple JSON database}
> $ cat /tmp/t.json
> [{"name": "item_1", "related": ["id1"]}, {"name": "item_2", "related":
> ["id1", "id2"]}, {"name": "item_3", "related": ["id2"]}]
> {code}
> {code:SQL|title=drill query, working}
> SELECT
> item.name,
> relations.*
> FROM dfs.tmp.`t.json` item
> JOIN LATERAL(
> SELECT * FROM UNNEST(item.related) i(rels)
> ) relations
> ON TRUE
> name rels
> 0 item_1 id1
> 1 item_2 id1
> 2 item_2 id2
> 3 item_3 id2
> {code}
> {code:SQL|title=create a drill view from the above query}
> CREATE VIEW dfs.tmp.unnested_view AS
> SELECT
> item.name,
> relations.*
> FROM dfs.tmp.`t.json` item
> JOIN LATERAL(
> SELECT * FROM UNNEST(item.related) i(rels)
> ) relations
> ON TRUE
> {code}
> {code:bash|title=contents of view file}
> # note the extra parentheses near LATERAL and FROM
> $ cat /tmp/unnested_view.view.drill
> {
> "name" : "unnested_view",
> "sql" : "SELECT `item`.`name`, `relations`.*\nFROM `dfs`.`tmp`.`t.json` AS
> `item`\nINNER JOIN LATERAL((SELECT *\nFROM (UNNEST(`item`.`related`)) AS `i`
> (`rels`))) AS `relations` ON TRUE",
> "fields" : [ {
> "name" : "name",
> "type" : "ANY",
> "isNullable" : true
> }, {
> "name" : "rels",
> "type" : "ANY",
> "isNullable" : true
> } ],
> "workspaceSchemaPath" : [ ]
> }
> {code}
> {code:SQL|title=query the view}
> SELECT * FROM dfs.tmp.unnested_view
> PARSE ERROR: Failure parsing a view your query is dependent upon.
> SQL Query: SELECT `item`.`name`, `relations`.*
> FROM `dfs`.`tmp`.`t.json` AS `item`
> INNER JOIN LATERAL((SELECT *
> FROM (UNNEST(`item`.`related`)) AS `i` (`rels`))) AS `relations` ON TRUE
> ^
> [Error Id: fd816a27-c2c5-4c2a-b6bf-173ab37eb693 ]
> {code}
> If the view is "fixed" by editing the generated JSON and removing the extra
> parentheses, e.g.
> {code:bash|title=fixed view}
> $ cat /tmp/fixed_unnested_view.view.drill
> {
> "name" : "fixed_unnested_view",
> "sql" : "SELECT `item`.`name`, `relations`.*\nFROM `dfs`.`tmp`.`t.json` AS
> `item`\nINNER JOIN LATERAL(SELECT *\nFROM UNNEST(`item`.`related`) AS `i`
> (`rels`)) AS `relations` ON TRUE",
> "fields" : [ {
> "name" : "name",
> "type" : "ANY",
> "isNullable" : true
> }, {
> "name" : "rels",
> "type" : "ANY",
> "isNullable" : true
> } ],
> "workspaceSchemaPath" : [ ]
> }
> {code}
> then querying works as expected:
> {code:sql|title=fixed view query}
> SELECT * FROM dfs.tmp.fixed_unnested_view
> name rels
> 0 item_1 id1
> 1 item_2 id1
> 2 item_2 id2
> 3 item_3 id2
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (DRILL-8396) Update checkstyle version
[ https://issues.apache.org/jira/browse/DRILL-8396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17686115#comment-17686115 ] ASF GitHub Bot commented on DRILL-8396: --- vvysotskyi opened a new pull request, #2751: URL: https://github.com/apache/drill/pull/2751 # [DRILL-8396](https://issues.apache.org/jira/browse/DRILL-8396): Update checkstyle version ## Description Update checkstyle version to the latest one ## Documentation NA ## Testing Unit tests pass > Update checkstyle version > - > > Key: DRILL-8396 > URL: https://issues.apache.org/jira/browse/DRILL-8396 > Project: Apache Drill > Issue Type: Task >Reporter: Vova Vysotskyi >Assignee: Vova Vysotskyi >Priority: Minor > > Update com.puppycrawl.tools:checkstyle version to the latest one. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (DRILL-8396) Update checkstyle version
Vova Vysotskyi created DRILL-8396: - Summary: Update checkstyle version Key: DRILL-8396 URL: https://issues.apache.org/jira/browse/DRILL-8396 Project: Apache Drill Issue Type: Task Reporter: Vova Vysotskyi Assignee: Vova Vysotskyi Update com.puppycrawl.tools:checkstyle version to the latest one. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (DRILL-8395) Add Support for INSERT and Drop Table to GoogleSheets Plugin
[ https://issues.apache.org/jira/browse/DRILL-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17686099#comment-17686099 ] ASF GitHub Bot commented on DRILL-8395: --- cgivre merged PR #2748: URL: https://github.com/apache/drill/pull/2748 > Add Support for INSERT and Drop Table to GoogleSheets Plugin > > > Key: DRILL-8395 > URL: https://issues.apache.org/jira/browse/DRILL-8395 > Project: Apache Drill > Issue Type: Improvement > Components: Storage - GoogleSheets >Affects Versions: 1.20.3 >Reporter: Charles Givre >Assignee: Charles Givre >Priority: Major > Fix For: 1.21.0 > > > This PR adds support for INSERT queries which allow a user to append data to > an existing GoogleSheets tab. It also: > * Adds support for DROP TABLE queries which were not implemented > * Modifies CTAS queries so that if a user executes a CTAS query with a file > token, Drill will add a new tab to an existing document, but if the user > executes a CTAS with a file name, it will create an entirely new document. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (DRILL-8379) Update Calcite to 1.33.0
[ https://issues.apache.org/jira/browse/DRILL-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685882#comment-17685882 ] ASF GitHub Bot commented on DRILL-8379: --- cgivre merged PR #2749: URL: https://github.com/apache/drill/pull/2749 > Update Calcite to 1.33.0 > > > Key: DRILL-8379 > URL: https://issues.apache.org/jira/browse/DRILL-8379 > Project: Apache Drill > Issue Type: Task >Reporter: Vova Vysotskyi >Assignee: Vova Vysotskyi >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (DRILL-8379) Update Calcite to 1.33.0
[
https://issues.apache.org/jira/browse/DRILL-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685824#comment-17685824
]
ASF GitHub Bot commented on DRILL-8379:
---
vvysotskyi commented on code in PR #2749:
URL: https://github.com/apache/drill/pull/2749#discussion_r1099920934
##
exec/java-exec/src/test/java/org/apache/drill/exec/sql/TestAnalyze.java:
##
@@ -332,7 +332,7 @@ public void testUseStatistics() throws Exception {
query = " select emp.employee_id from dfs.tmp.employeeUseStat emp join
dfs.tmp.departmentUseStat dept"
+ " on emp.department_id = dept.department_id "
+ " group by emp.employee_id";
- String[] expectedPlan8 = {"HashAgg\\(group=\\[\\{0\\}\\]\\).*rowcount =
730.2832515526484,.*",
+ String[] expectedPlan8 = {"HashAgg\\(group=\\[\\{0\\}\\]\\).*rowcount =
730.2832515526.*",
Review Comment:
Calcite has slightly updated the formula to calculate it. I have removed
these digits to avoid failures for further potential updates.
> Update Calcite to 1.33.0
>
>
> Key: DRILL-8379
> URL: https://issues.apache.org/jira/browse/DRILL-8379
> Project: Apache Drill
> Issue Type: Task
>Reporter: Vova Vysotskyi
>Assignee: Vova Vysotskyi
>Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (DRILL-8379) Update Calcite to 1.33.0
[
https://issues.apache.org/jira/browse/DRILL-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685820#comment-17685820
]
ASF GitHub Bot commented on DRILL-8379:
---
jnturton commented on code in PR #2749:
URL: https://github.com/apache/drill/pull/2749#discussion_r1099912943
##
exec/java-exec/src/test/java/org/apache/drill/exec/sql/TestAnalyze.java:
##
@@ -332,7 +332,7 @@ public void testUseStatistics() throws Exception {
query = " select emp.employee_id from dfs.tmp.employeeUseStat emp join
dfs.tmp.departmentUseStat dept"
+ " on emp.department_id = dept.department_id "
+ " group by emp.employee_id";
- String[] expectedPlan8 = {"HashAgg\\(group=\\[\\{0\\}\\]\\).*rowcount =
730.2832515526484,.*",
+ String[] expectedPlan8 = {"HashAgg\\(group=\\[\\{0\\}\\]\\).*rowcount =
730.2832515526.*",
Review Comment:
Did we drop the last three digits here to prevent spurious test failures
resulting from rounding errors?
> Update Calcite to 1.33.0
>
>
> Key: DRILL-8379
> URL: https://issues.apache.org/jira/browse/DRILL-8379
> Project: Apache Drill
> Issue Type: Task
>Reporter: Vova Vysotskyi
>Assignee: Vova Vysotskyi
>Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Closed] (DRILL-8179) Convert LTSV Format Plugin to EVF2
[ https://issues.apache.org/jira/browse/DRILL-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8179. --- Resolution: Fixed > Convert LTSV Format Plugin to EVF2 > -- > > Key: DRILL-8179 > URL: https://issues.apache.org/jira/browse/DRILL-8179 > Project: Apache Drill > Issue Type: Improvement >Affects Versions: 1.20.1 >Reporter: Jingchuan Hu >Assignee: Charles Givre >Priority: Major > Fix For: 1.21.0 > > > Get authorized by Charles, continue the conversion from LTSV to EVF2 directly. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8290) Early exit from recursive file listing for LIMIT 0 queries
[ https://issues.apache.org/jira/browse/DRILL-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8290. --- Resolution: Fixed > Early exit from recursive file listing for LIMIT 0 queries > -- > > Key: DRILL-8290 > URL: https://issues.apache.org/jira/browse/DRILL-8290 > Project: Apache Drill > Issue Type: Improvement > Components: Query Planning & Optimization >Affects Versions: 1.20.2 >Reporter: James Turton >Assignee: James Turton >Priority: Minor > Fix For: 1.21.0 > > > The existing LIMIT 0 query optimisations do not prevent a query run against > the top of a deep DFS directory tree from recursively listing FileStatuses > for everything within it using a pool of worker threads. This Issue proposes > a new optimisation whereby such queries will recurse into the directory tree > on a single thread that returns as soon as any single FileStatus has been > obtained. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (DRILL-8290) Early exit from recursive file listing for LIMIT 0 queries
[ https://issues.apache.org/jira/browse/DRILL-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton updated DRILL-8290: Summary: Early exit from recursive file listing for LIMIT 0 queries (was: Short cut recursive file listings for LIMIT 0 queries) > Early exit from recursive file listing for LIMIT 0 queries > -- > > Key: DRILL-8290 > URL: https://issues.apache.org/jira/browse/DRILL-8290 > Project: Apache Drill > Issue Type: Improvement > Components: Query Planning & Optimization >Affects Versions: 1.20.2 >Reporter: James Turton >Assignee: James Turton >Priority: Minor > Fix For: 1.21.0 > > > The existing LIMIT 0 query optimisations do not prevent a query run against > the top of a deep DFS directory tree from recursively listing FileStatuses > for everything within it using a pool of worker threads. This Issue proposes > a new optimisation whereby such queries will recurse into the directory tree > on a single thread that returns as soon as any single FileStatus has been > obtained. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8299) HashMap key type mismatch in MetadataContext
[
https://issues.apache.org/jira/browse/DRILL-8299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
James Turton closed DRILL-8299.
---
Resolution: Fixed
> HashMap key type mismatch in MetadataContext
>
>
> Key: DRILL-8299
> URL: https://issues.apache.org/jira/browse/DRILL-8299
> Project: Apache Drill
> Issue Type: Bug
>Affects Versions: 1.20.2
>Reporter: PJ Fanning
>Assignee: James Turton
>Priority: Minor
> Fix For: 1.21.0
>
>
> The dirModifCheckMap used in this lookup is keyed using a HDFS Path instance,
> not a string, so this code is not going to work:
> {code:java}
> public boolean getStatus(String dir) {
> if (dirModifCheckMap.containsKey(dir)) {
> return dirModifCheckMap.get(dir);
> }
> return false;
> }
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (DRILL-8309) Upgrade slf4j to 2.0.x
[ https://issues.apache.org/jira/browse/DRILL-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton updated DRILL-8309: Description: * logback 1.2.11 → 1.4.5. * log4j 2.18.0 → 2.19.0. * slf4j 1.7.26 → 2.0.6. was: * logback 1.2.11 -> 1.4.5. * log4j 2.18.0 -> 2.19.0. * slf4j 1.7.26 -> 2.0.6. > Upgrade slf4j to 2.0.x > -- > > Key: DRILL-8309 > URL: https://issues.apache.org/jira/browse/DRILL-8309 > Project: Apache Drill > Issue Type: Improvement >Affects Versions: 1.20.2 >Reporter: PJ Fanning >Assignee: James Turton >Priority: Major > Fix For: 1.21.0 > > > * logback 1.2.11 → 1.4.5. > * log4j 2.18.0 → 2.19.0. > * slf4j 1.7.26 → 2.0.6. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (DRILL-8309) Upgrade slf4j to 2.0.x
[ https://issues.apache.org/jira/browse/DRILL-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685769#comment-17685769 ] ASF GitHub Bot commented on DRILL-8309: --- jnturton opened a new pull request, #2750: URL: https://github.com/apache/drill/pull/2750 # [DRILL-8309](https://issues.apache.org/jira/browse/DRILL-8309): Upgrade slf4j to 2.0.x ## Description - logback 1.2.11 -> 1.4.5. - log4j 2.18.0 -> 2.19.0. - slf4j 1.7.26 -> 2.0.6. ## Documentation N/A ## Testing Run embedded Drill and check its log output. > Upgrade slf4j to 2.0.x > -- > > Key: DRILL-8309 > URL: https://issues.apache.org/jira/browse/DRILL-8309 > Project: Apache Drill > Issue Type: Improvement >Affects Versions: 1.20.2 >Reporter: PJ Fanning >Assignee: James Turton >Priority: Major > Fix For: 1.21.0 > > > * logback 1.2.11 -> 1.4.5. > * log4j 2.18.0 -> 2.19.0. > * slf4j 1.7.26 -> 2.0.6. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (DRILL-8309) Upgrade slf4j to 2.0.x
[ https://issues.apache.org/jira/browse/DRILL-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton updated DRILL-8309: Description: * logback 1.2.11 -> 1.4.5. * log4j 2.18.0 -> 2.19.0. * slf4j 1.7.26 -> 2.0.6. was: log4j 2.19.0 and logback 2.19.0 support slf4j 2.0.1 > Upgrade slf4j to 2.0.x > -- > > Key: DRILL-8309 > URL: https://issues.apache.org/jira/browse/DRILL-8309 > Project: Apache Drill > Issue Type: Improvement >Affects Versions: 1.20.2 >Reporter: PJ Fanning >Assignee: James Turton >Priority: Major > Fix For: 1.21.0 > > > * logback 1.2.11 -> 1.4.5. > * log4j 2.18.0 -> 2.19.0. > * slf4j 1.7.26 -> 2.0.6. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (DRILL-8309) Upgrade slf4j to 2.0.x
[ https://issues.apache.org/jira/browse/DRILL-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton reassigned DRILL-8309: --- Assignee: James Turton > Upgrade slf4j to 2.0.x > -- > > Key: DRILL-8309 > URL: https://issues.apache.org/jira/browse/DRILL-8309 > Project: Apache Drill > Issue Type: Improvement >Affects Versions: 1.20.2 >Reporter: PJ Fanning >Assignee: James Turton >Priority: Major > Fix For: 1.21.0 > > > log4j 2.19.0 and logback 2.19.0 support slf4j 2.0.1 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (DRILL-8309) Upgrade slf4j to 2.0.x
[ https://issues.apache.org/jira/browse/DRILL-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton updated DRILL-8309: Summary: Upgrade slf4j to 2.0.x (was: Upgrade slf4j to 2.0.1) > Upgrade slf4j to 2.0.x > -- > > Key: DRILL-8309 > URL: https://issues.apache.org/jira/browse/DRILL-8309 > Project: Apache Drill > Issue Type: Improvement >Affects Versions: 1.20.2 >Reporter: PJ Fanning >Priority: Major > Fix For: 1.21.0 > > > log4j 2.19.0 and logback 2.19.0 support slf4j 2.0.1 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8340) Add Additional Date Manipulation Functions (Part 1)
[ https://issues.apache.org/jira/browse/DRILL-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8340. --- Resolution: Fixed > Add Additional Date Manipulation Functions (Part 1) > --- > > Key: DRILL-8340 > URL: https://issues.apache.org/jira/browse/DRILL-8340 > Project: Apache Drill > Issue Type: Improvement > Components: Functions - Drill >Affects Versions: 1.20.2 >Reporter: Charles Givre >Assignee: Charles Givre >Priority: Major > Fix For: 1.21.0 > > > This PR adds several utility functions to facilitate working with dates and > times. These are modeled after the date/time functionality in MySQL. > Specifically this adds: > * YEARWEEK(): Returns an int of year week. IE (202002) > * TIME_STAMP(): Converts most anything that looks like a date > string into a timestamp. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8354) Add IS_EMPTY Function.
[ https://issues.apache.org/jira/browse/DRILL-8354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8354. --- Resolution: Fixed > Add IS_EMPTY Function. > -- > > Key: DRILL-8354 > URL: https://issues.apache.org/jira/browse/DRILL-8354 > Project: Apache Drill > Issue Type: Improvement > Components: Functions - Drill >Affects Versions: 1.20.2 >Reporter: Charles Givre >Assignee: Charles Givre >Priority: Major > Fix For: 1.21.0 > > > When analyzing data, there is currently no single function to evaluate > whether a given field is empty. With scalar fields, this can be accomplished > with the `IS NOT NULL` operator, but with complex fields, this is more > challenging as complex fields are never null. > This PR adds a UDF called IS_EMPTY() which accepts any type of field and > returns true if the field does not contain data. > > In the case of scalar fields, if the field is `null` this returns true. In > the case of complex fields, which can never be `null`, in the case of lists, > the function returns true if the list is empty. In the case of maps, it > returns true if all of the map's fields are unpopulated. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8356) Add File Name to GoogleSheets Plugin
[ https://issues.apache.org/jira/browse/DRILL-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8356. --- Resolution: Fixed > Add File Name to GoogleSheets Plugin > > > Key: DRILL-8356 > URL: https://issues.apache.org/jira/browse/DRILL-8356 > Project: Apache Drill > Issue Type: Improvement > Components: Storage - GoogleSheets >Affects Versions: 1.21.0 >Reporter: Charles Givre >Assignee: Charles Givre >Priority: Minor > Fix For: 1.21.0 > > > GoogleSheets uses tokens to identify the individual files. These tokens are > not human readable and will make it difficult for a user to know which file > they are accessing. > This PR adds a metadata field called `_title` which identifies the document > they are working with. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8357) Add new config options to the Splunk storage plugin
[
https://issues.apache.org/jira/browse/DRILL-8357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
James Turton closed DRILL-8357.
---
Resolution: Fixed
> Add new config options to the Splunk storage plugin
> ---
>
> Key: DRILL-8357
> URL: https://issues.apache.org/jira/browse/DRILL-8357
> Project: Apache Drill
> Issue Type: Improvement
> Components: Storage - Other
>Affects Versions: 1.20.2
>Reporter: James Turton
>Assignee: James Turton
>Priority: Minor
> Fix For: 1.21.0
>
>
> The following five new options can be added to the Splunk storage config.
> {code:java}
> // Whether the Splunk client will validates the server's SSL cert.
> private final boolean validateCertificates;
> // The application context of the service.
> private final String app;
> // The owner context of the service.
> private final String owner;
> // A Splunk authentication token to use for the session.
> private final String token;
> // A valid login cookie.
> private final String cookie;{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Closed] (DRILL-8359) Add mount and unmount command support to the filesystem plugin
[
https://issues.apache.org/jira/browse/DRILL-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
James Turton closed DRILL-8359.
---
Resolution: Fixed
> Add mount and unmount command support to the filesystem plugin
> --
>
> Key: DRILL-8359
> URL: https://issues.apache.org/jira/browse/DRILL-8359
> Project: Apache Drill
> Issue Type: Improvement
> Components: Storage - File
>Affects Versions: 1.20.2
>Reporter: James Turton
>Assignee: James Turton
>Priority: Minor
> Fix For: 1.21.0
>
>
> This Jira proposes optional mount and unmount commands in the filesystem
> plugin with the goal of enabling the dynamic definition of filesystem mounts
> in the storage configuration. It is mainly anticpiated that network and cloud
> filesystems that have FUSE drivers (sshfs, davfs, rclone, ...) will be used
> in this way but local device mounts and image/loop device mounts (ISO, IMG,
> squashfs, etc.) might also be of interest. Filesystems that can be mounted in
> this way become queryable by Drill cluster without burden of dedicated
> storage plugin development.
> The provided commands are executed in their own processes by the host OS and
> run under the OS user that is running the Drill JVM. The mount command will
> be executed when an enabled plugin is initialised (something that is done
> lazily) and whenever it transitions from disabled to enabled. The provided
> unmount command will be executed whenever a plugin transitions from enabled
> to disabled and when the Drillbit shuts down while the plugin has been
> initialised and is enabled.
> Example using udisks on Linux to mount and unmount an image of an ext4
> filesystem.
> {code:java}
> {
> "type" : "file",
> "connection" : "file:///",
> "mountCommand" : [ "sh", "-c", "udisksctl loop-setup -f /tmp/test.img &&
> udisksctl mount -b /dev/loop0" ],
> "unmountCommand" : [ "sh", "-c", "udisksctl unmount -b /dev/loop0 &&
> udisksctl loop-delete -b /dev/loop0" ],
> "workspaces" : {
> ...{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Closed] (DRILL-8362) upgrade excel-streaming-reader v4.0.5
[ https://issues.apache.org/jira/browse/DRILL-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8362. --- Resolution: Fixed > upgrade excel-streaming-reader v4.0.5 > - > > Key: DRILL-8362 > URL: https://issues.apache.org/jira/browse/DRILL-8362 > Project: Apache Drill > Issue Type: Task >Reporter: PJ Fanning >Assignee: PJ Fanning >Priority: Major > > A few small issues have been fixed -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8360) Add Provided Schema for XML Reader
[ https://issues.apache.org/jira/browse/DRILL-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8360. --- Resolution: Fixed > Add Provided Schema for XML Reader > -- > > Key: DRILL-8360 > URL: https://issues.apache.org/jira/browse/DRILL-8360 > Project: Apache Drill > Issue Type: Improvement > Components: Format - XML >Affects Versions: 1.20.2 >Reporter: Charles Givre >Assignee: Charles Givre >Priority: Major > Fix For: 1.21.0 > > > The XML reader does not support provisioned schema. This PR adds that > support. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (DRILL-8362) upgrade excel-streaming-reader v4.0.5
[ https://issues.apache.org/jira/browse/DRILL-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton reassigned DRILL-8362: --- Assignee: PJ Fanning > upgrade excel-streaming-reader v4.0.5 > - > > Key: DRILL-8362 > URL: https://issues.apache.org/jira/browse/DRILL-8362 > Project: Apache Drill > Issue Type: Task >Reporter: PJ Fanning >Assignee: PJ Fanning >Priority: Major > > A few small issues have been fixed -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8368) Update Yauaa to 7.9.0
[ https://issues.apache.org/jira/browse/DRILL-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8368. --- Resolution: Fixed > Update Yauaa to 7.9.0 > - > > Key: DRILL-8368 > URL: https://issues.apache.org/jira/browse/DRILL-8368 > Project: Apache Drill > Issue Type: Improvement >Reporter: Niels Basjes >Assignee: Niels Basjes >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8363) upgrade postgresql to 42.4.3 due to security issue
[ https://issues.apache.org/jira/browse/DRILL-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8363. --- Resolution: Fixed > upgrade postgresql to 42.4.3 due to security issue > -- > > Key: DRILL-8363 > URL: https://issues.apache.org/jira/browse/DRILL-8363 > Project: Apache Drill > Issue Type: Task > Components: Storage - JDBC >Reporter: PJ Fanning >Assignee: PJ Fanning >Priority: Major > > https://github.com/advisories/GHSA-562r-vg33-8x8h -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (DRILL-8367) Fix all plugins and file system impls that load query data into heap mem
[ https://issues.apache.org/jira/browse/DRILL-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton updated DRILL-8367: Fix Version/s: Future (was: 1.21.0) > Fix all plugins and file system impls that load query data into heap mem > > > Key: DRILL-8367 > URL: https://issues.apache.org/jira/browse/DRILL-8367 > Project: Apache Drill > Issue Type: Improvement >Affects Versions: 1.20.2 >Reporter: James Turton >Assignee: James Turton >Priority: Minor > Fix For: Future > > > A number of storage plugins, format plugins and file system implementations > load query data into heap memory. We should firstly avoid extraneous > buffering entirely and secondly use direct memory when buffering is not > extraneous. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8364) Add Support for OAuth Enabled File Systems
[ https://issues.apache.org/jira/browse/DRILL-8364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8364. --- Resolution: Fixed > Add Support for OAuth Enabled File Systems > -- > > Key: DRILL-8364 > URL: https://issues.apache.org/jira/browse/DRILL-8364 > Project: Apache Drill > Issue Type: Improvement > Components: Storage - File >Affects Versions: 1.20.2 >Reporter: Charles Givre >Assignee: Charles Givre >Priority: Major > Fix For: 1.21.0 > > > Currently Drill supports reading from file systems such as HDFS, S3 and > others that use token based authentication. This PR extends Drill's plugin > architecture so that Drill can connect with other file systems which use > OAuth 2.0 for authentication. > This PR also adds support for Drill to query Box. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (DRILL-8363) upgrade postgresql to 42.4.3 due to security issue
[ https://issues.apache.org/jira/browse/DRILL-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton reassigned DRILL-8363: --- Assignee: PJ Fanning (was: James Turton) > upgrade postgresql to 42.4.3 due to security issue > -- > > Key: DRILL-8363 > URL: https://issues.apache.org/jira/browse/DRILL-8363 > Project: Apache Drill > Issue Type: Task > Components: Storage - JDBC >Reporter: PJ Fanning >Assignee: PJ Fanning >Priority: Major > > https://github.com/advisories/GHSA-562r-vg33-8x8h -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (DRILL-8363) upgrade postgresql to 42.4.3 due to security issue
[ https://issues.apache.org/jira/browse/DRILL-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton reassigned DRILL-8363: --- Assignee: James Turton > upgrade postgresql to 42.4.3 due to security issue > -- > > Key: DRILL-8363 > URL: https://issues.apache.org/jira/browse/DRILL-8363 > Project: Apache Drill > Issue Type: Task > Components: Storage - JDBC >Reporter: PJ Fanning >Assignee: James Turton >Priority: Major > > https://github.com/advisories/GHSA-562r-vg33-8x8h -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8371) Add Write/Append Capability to Splunk Plugin
[ https://issues.apache.org/jira/browse/DRILL-8371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8371. --- > Add Write/Append Capability to Splunk Plugin > > > Key: DRILL-8371 > URL: https://issues.apache.org/jira/browse/DRILL-8371 > Project: Apache Drill > Issue Type: Improvement > Components: Storage - Splunk >Affects Versions: 1.20.2 >Reporter: Charles Givre >Assignee: Charles Givre >Priority: Major > Fix For: 1.21.0 > > > While Drill can currently read from Splunk indexes, it cannot write to them > or create them. This proposed PR adds support for CTAS queries for Splunk as > well as INSERT and DROP TABLE. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (DRILL-8374) Set the Drill development version to 1.21.0-SNAPSHOT
[ https://issues.apache.org/jira/browse/DRILL-8374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton updated DRILL-8374: Affects Version/s: 1.21.0 (was: 1.20.1) > Set the Drill development version to 1.21.0-SNAPSHOT > > > Key: DRILL-8374 > URL: https://issues.apache.org/jira/browse/DRILL-8374 > Project: Apache Drill > Issue Type: Task >Affects Versions: 1.21.0 >Reporter: James Turton >Assignee: James Turton >Priority: Trivial > Fix For: 1.21.0 > > > Changes the Maven version numbers in the Drill master branch from 2.0.0 to > 1.21.0. Discussion in the Drill mailing list established that the project > would prefer to do a release in the near future than to wait to build up a > changset for which a version jump to 2.0 would be appropriate. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8374) Set the Drill development version to 1.21.0-SNAPSHOT
[ https://issues.apache.org/jira/browse/DRILL-8374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8374. --- Resolution: Done > Set the Drill development version to 1.21.0-SNAPSHOT > > > Key: DRILL-8374 > URL: https://issues.apache.org/jira/browse/DRILL-8374 > Project: Apache Drill > Issue Type: Task >Affects Versions: 1.21.0 >Reporter: James Turton >Assignee: James Turton >Priority: Trivial > Fix For: 1.21.0 > > > Changes the Maven version numbers in the Drill master branch from 2.0.0 to > 1.21.0. Discussion in the Drill mailing list established that the project > would prefer to do a release in the near future than to wait to build up a > changset for which a version jump to 2.0 would be appropriate. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (DRILL-8374) Set the Drill development version to 1.21.0-SNAPSHOT
[ https://issues.apache.org/jira/browse/DRILL-8374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton updated DRILL-8374: Fix Version/s: 1.21.0 (was: Future) > Set the Drill development version to 1.21.0-SNAPSHOT > > > Key: DRILL-8374 > URL: https://issues.apache.org/jira/browse/DRILL-8374 > Project: Apache Drill > Issue Type: Task >Affects Versions: 1.20.1 >Reporter: James Turton >Assignee: James Turton >Priority: Trivial > Fix For: 1.21.0 > > > Changes the Maven version numbers in the Drill master branch from 2.0.0 to > 1.21.0. Discussion in the Drill mailing list established that the project > would prefer to do a release in the near future than to wait to build up a > changset for which a version jump to 2.0 would be appropriate. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (DRILL-8374) Set the Drill development version to 1.21.0-SNAPSHOT
[ https://issues.apache.org/jira/browse/DRILL-8374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton updated DRILL-8374: Affects Version/s: 1.20.1 (was: 1.21.0) > Set the Drill development version to 1.21.0-SNAPSHOT > > > Key: DRILL-8374 > URL: https://issues.apache.org/jira/browse/DRILL-8374 > Project: Apache Drill > Issue Type: Task >Affects Versions: 1.20.1 >Reporter: James Turton >Assignee: James Turton >Priority: Trivial > Fix For: Future > > > Changes the Maven version numbers in the Drill master branch from 2.0.0 to > 1.21.0. Discussion in the Drill mailing list established that the project > would prefer to do a release in the near future than to wait to build up a > changset for which a version jump to 2.0 would be appropriate. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (DRILL-8374) Set the Drill development version to 1.21.0-SNAPSHOT
[ https://issues.apache.org/jira/browse/DRILL-8374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton updated DRILL-8374: Fix Version/s: Future (was: 1.21.0) > Set the Drill development version to 1.21.0-SNAPSHOT > > > Key: DRILL-8374 > URL: https://issues.apache.org/jira/browse/DRILL-8374 > Project: Apache Drill > Issue Type: Task >Affects Versions: 1.21.0 >Reporter: James Turton >Assignee: James Turton >Priority: Trivial > Fix For: Future > > > Changes the Maven version numbers in the Drill master branch from 2.0.0 to > 1.21.0. Discussion in the Drill mailing list established that the project > would prefer to do a release in the near future than to wait to build up a > changset for which a version jump to 2.0 would be appropriate. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (DRILL-8376) Add Distribution UDFs
[ https://issues.apache.org/jira/browse/DRILL-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton updated DRILL-8376: Fix Version/s: 1.21.0 > Add Distribution UDFs > - > > Key: DRILL-8376 > URL: https://issues.apache.org/jira/browse/DRILL-8376 > Project: Apache Drill > Issue Type: Improvement > Components: Functions - Drill >Affects Versions: 1.21.0 >Reporter: Charles Givre >Assignee: Charles Givre >Priority: Minor > Fix For: 1.21.0 > > > Add `width_bucket`, `pearson_correlation` and `kendall_correlation` to Drill -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8376) Add Distribution UDFs
[ https://issues.apache.org/jira/browse/DRILL-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8376. --- > Add Distribution UDFs > - > > Key: DRILL-8376 > URL: https://issues.apache.org/jira/browse/DRILL-8376 > Project: Apache Drill > Issue Type: Improvement > Components: Functions - Drill >Affects Versions: 1.21.0 >Reporter: Charles Givre >Assignee: Charles Givre >Priority: Minor > Fix For: 1.21.0 > > > Add `width_bucket`, `pearson_correlation` and `kendall_correlation` to Drill -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8378) Support doing Maven releases using modern JDKs
[
https://issues.apache.org/jira/browse/DRILL-8378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
James Turton closed DRILL-8378.
---
Resolution: Fixed
> Support doing Maven releases using modern JDKs
> --
>
> Key: DRILL-8378
> URL: https://issues.apache.org/jira/browse/DRILL-8378
> Project: Apache Drill
> Issue Type: Improvement
> Components: Tools, Build & Test
>Affects Versions: 1.20.2
>Reporter: James Turton
>Assignee: James Turton
>Priority: Minor
> Fix For: 1.21.0
>
>
> While DRILL-8113 enabled the building of Drill using a modern JDK, more work
> is required to enable a Maven release of Drill using a modern JDK. Presently,
> the Maven Release Plugin will fail on Javadoc generation when run with a
> newer JDK while it succeeds with JDK 8. The failures are due to dependencies
> missing from the Maven Javadoc Plugin's config which I assume get treated
> with a more lenient "warn and skip" policy in the javadoc tool shipped with
> JDK 8 but cause errors in newer JDKs (in my case OpenJDK 17).{-}{-}
> In particular, the presence of the sourcepath property in the javadoc
> plugin's config in the root pom causes the default javadoc:javadoc goal to
> try to generate docs for our src/test packages. Unlike the
> javadoc:test-javadoc, the javadoc:javadoc goal does not inherit dependencies
> declared with test scope.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Closed] (DRILL-8384) Add Format Plugin for Microsoft Access
[ https://issues.apache.org/jira/browse/DRILL-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8384. --- > Add Format Plugin for Microsoft Access > -- > > Key: DRILL-8384 > URL: https://issues.apache.org/jira/browse/DRILL-8384 > Project: Apache Drill > Issue Type: Improvement > Components: Format - MS Access >Affects Versions: 1.21.0 >Reporter: Charles Givre >Assignee: Charles Givre >Priority: Major > Fix For: 1.21.0 > > > Shockingly, MS Access is still in widespread use. This plugin enables Drill > to read MS Access files. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8387) Add Support for User Translation to ElasticSearch Plugin
[ https://issues.apache.org/jira/browse/DRILL-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8387. --- Resolution: Fixed > Add Support for User Translation to ElasticSearch Plugin > > > Key: DRILL-8387 > URL: https://issues.apache.org/jira/browse/DRILL-8387 > Project: Apache Drill > Issue Type: Improvement > Components: Storage - ElasticSearch >Affects Versions: 1.20.3 >Reporter: Charles Givre >Assignee: Charles Givre >Priority: Major > Fix For: 1.21.0 > > > Add support for user translation to ElasticSearch. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8386) Add Support for User Translation for Cassandra
[ https://issues.apache.org/jira/browse/DRILL-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8386. --- Resolution: Fixed > Add Support for User Translation for Cassandra > -- > > Key: DRILL-8386 > URL: https://issues.apache.org/jira/browse/DRILL-8386 > Project: Apache Drill > Issue Type: Improvement > Components: Storage - Cassandra >Affects Versions: 1.20.3 >Reporter: Charles Givre >Assignee: Charles Givre >Priority: Major > Fix For: 1.21.0 > > > Adds support for user translation to the Cassandra plugin. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (DRILL-8390) Minor Improvements to PDF Reader
[ https://issues.apache.org/jira/browse/DRILL-8390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton updated DRILL-8390: Affects Version/s: 1.21.0 > Minor Improvements to PDF Reader > > > Key: DRILL-8390 > URL: https://issues.apache.org/jira/browse/DRILL-8390 > Project: Apache Drill > Issue Type: Improvement > Components: Format - PDF >Affects Versions: 1.21.0 >Reporter: Charles Givre >Assignee: Charles Givre >Priority: Major > > This PR makes some minor improvements to the PDF reader including: > * Fixes a minor bug where certain configurations the first row of data was > skipped > * Fixes a minor bug where empty tables were causing crashes with the > spreadsheet extraction algorithm was used > * Adds a table_count metadata field > * Adds a table_index metadata field to reflect the current table. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8390) Minor Improvements to PDF Reader
[ https://issues.apache.org/jira/browse/DRILL-8390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8390. --- Resolution: Fixed > Minor Improvements to PDF Reader > > > Key: DRILL-8390 > URL: https://issues.apache.org/jira/browse/DRILL-8390 > Project: Apache Drill > Issue Type: Improvement > Components: Format - PDF >Reporter: Charles Givre >Assignee: Charles Givre >Priority: Major > > This PR makes some minor improvements to the PDF reader including: > * Fixes a minor bug where certain configurations the first row of data was > skipped > * Fixes a minor bug where empty tables were causing crashes with the > spreadsheet extraction algorithm was used > * Adds a table_count metadata field > * Adds a table_index metadata field to reflect the current table. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8391) Set autocomplete="off" on the password field of web UI login forms
[
https://issues.apache.org/jira/browse/DRILL-8391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
James Turton closed DRILL-8391.
---
Resolution: Fixed
> Set autocomplete="off" on the password field of web UI login forms
> --
>
> Key: DRILL-8391
> URL: https://issues.apache.org/jira/browse/DRILL-8391
> Project: Apache Drill
> Issue Type: Improvement
> Components: Web Server
>Affects Versions: 1.20.3
>Reporter: James Turton
>Assignee: James Turton
>Priority: Trivial
> Fix For: 1.21.0
>
>
> In order to avoid triggering security scanners it is necessary to set
> autocomplete = "off" on the password field in the web UI login form. This
> change probably has no real world security benefit because
> {quote}Even without a master password, in-browser password management is
> generally seen as a net gain for security. Since users do not have to
> remember passwords that the browser stores for them, they are able to choose
> stronger passwords than they would otherwise.
> For this reason, many modern browsers do not support {{autocomplete="off"}}
> for login fields:
> {quote}
> *
>
> {quote}If a site sets {{autocomplete="off"}} for a
> [{{}}|https://developer.mozilla.org/en-US/docs/Web/HTML/Element/form],
> and the form includes username and password input fields, then the browser
> still offers to remember this login, and if the user agrees, the browser will
> autofill those fields the next time the user visits the page.
> {quote} *
> {quote}If a site sets {{autocomplete="off"}} for username and password
> [{{}}|https://developer.mozilla.org/en-US/docs/Web/HTML/Element/input]
> fields, then the browser still offers to remember this login, and if the user
> agrees, the browser will autofill those fields the next time the user visits
> the page
> {quote}
> Excerpt taken from [this Mozilla Developer Network
> page|https://developer.mozilla.org/en-US/docs/Web/Security/Securing_your_site/Turning_off_form_autocompletion].
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Closed] (DRILL-8392) Empty Tables Causes Index Out of Bounds Exception on PDF Reader
[ https://issues.apache.org/jira/browse/DRILL-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8392. --- Resolution: Fixed > Empty Tables Causes Index Out of Bounds Exception on PDF Reader > --- > > Key: DRILL-8392 > URL: https://issues.apache.org/jira/browse/DRILL-8392 > Project: Apache Drill > Issue Type: Bug > Components: Format - PDF >Affects Versions: 1.20.3 >Reporter: Charles Givre >Assignee: Charles Givre >Priority: Minor > Fix For: 1.21.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (DRILL-8390) Minor Improvements to PDF Reader
[ https://issues.apache.org/jira/browse/DRILL-8390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton updated DRILL-8390: Fix Version/s: 1.21.0 > Minor Improvements to PDF Reader > > > Key: DRILL-8390 > URL: https://issues.apache.org/jira/browse/DRILL-8390 > Project: Apache Drill > Issue Type: Improvement > Components: Format - PDF >Affects Versions: 1.21.0 >Reporter: Charles Givre >Assignee: Charles Givre >Priority: Major > Fix For: 1.21.0 > > > This PR makes some minor improvements to the PDF reader including: > * Fixes a minor bug where certain configurations the first row of data was > skipped > * Fixes a minor bug where empty tables were causing crashes with the > spreadsheet extraction algorithm was used > * Adds a table_count metadata field > * Adds a table_index metadata field to reflect the current table. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Reopened] (DRILL-8390) Minor Improvements to PDF Reader
[ https://issues.apache.org/jira/browse/DRILL-8390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton reopened DRILL-8390: - > Minor Improvements to PDF Reader > > > Key: DRILL-8390 > URL: https://issues.apache.org/jira/browse/DRILL-8390 > Project: Apache Drill > Issue Type: Improvement > Components: Format - PDF >Reporter: Charles Givre >Assignee: Charles Givre >Priority: Major > > This PR makes some minor improvements to the PDF reader including: > * Fixes a minor bug where certain configurations the first row of data was > skipped > * Fixes a minor bug where empty tables were causing crashes with the > spreadsheet extraction algorithm was used > * Adds a table_count metadata field > * Adds a table_index metadata field to reflect the current table. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (DRILL-8390) Minor Improvements to PDF Reader
[ https://issues.apache.org/jira/browse/DRILL-8390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Turton closed DRILL-8390. --- Resolution: Fixed > Minor Improvements to PDF Reader > > > Key: DRILL-8390 > URL: https://issues.apache.org/jira/browse/DRILL-8390 > Project: Apache Drill > Issue Type: Improvement > Components: Format - PDF >Affects Versions: 1.21.0 >Reporter: Charles Givre >Assignee: Charles Givre >Priority: Major > Fix For: 1.21.0 > > > This PR makes some minor improvements to the PDF reader including: > * Fixes a minor bug where certain configurations the first row of data was > skipped > * Fixes a minor bug where empty tables were causing crashes with the > spreadsheet extraction algorithm was used > * Adds a table_count metadata field > * Adds a table_index metadata field to reflect the current table. -- This message was sent by Atlassian Jira (v8.20.10#820010)
