Hi Igor,
Thanks! I should have remembered that bit of SQL.
Yes, if we can generalize `DESCRIBE`, we could create another path of some kind
through the plugins that say, "return schema, not data."
Then, for the HDF5 use case we could have:
DESCRIBE TABLE `dfs`.`myFile.hdf5` -- returns schema
paul-rogers commented on issue #1978: DRILL-7578: HDF5 Metadata Queries Fail
with Large Files
URL: https://github.com/apache/drill/pull/1978#issuecomment-587322871
@cgivre, one more design-level comment about this particular file format.
You've mentioned several times that HDF5 is "a file
Hello Paul,
Seems like we simply need to improve our DESCRIBE [1] table functionality.
[1] https://drill.apache.org/docs/describe/
Thanks,
Igor
On Tue, Feb 18, 2020 at 9:23 AM Paul Rogers
wrote:
> Hi All,
>
> Charles has a little PR, #1978, that adds a convenient feature to his
> HDF5 format
Hi All,
Charles has a little PR, #1978, that adds a convenient feature to his HDF5
format reader: the ability to query the schema of the file. (It seems that HDF5
is a bit like a zip file: it contains a set of files. Unlike zip, each file is
a data set with a schema.) Charles added a clever wa
paul-rogers commented on a change in pull request #1978: DRILL-7578: HDF5
Metadata Queries Fail with Large Files
URL: https://github.com/apache/drill/pull/1978#discussion_r380488669
##
File path:
contrib/format-hdf5/src/main/java/org/apache/drill/exec/store/hdf5/HDF5BatchReader.jav
paul-rogers commented on a change in pull request #1978: DRILL-7578: HDF5
Metadata Queries Fail with Large Files
URL: https://github.com/apache/drill/pull/1978#discussion_r380490693
##
File path:
contrib/format-hdf5/src/test/java/org/apache/drill/exec/store/hdf5/TestHDF5Format.java
paul-rogers commented on a change in pull request #1978: DRILL-7578: HDF5
Metadata Queries Fail with Large Files
URL: https://github.com/apache/drill/pull/1978#discussion_r380487624
##
File path:
contrib/format-hdf5/src/main/java/org/apache/drill/exec/store/hdf5/HDF5BatchReader.jav
paul-rogers commented on a change in pull request #1987: DRILL-7589: Set
temporary tests folder for UDF_DIRECTORY_LOCAL, fix allocators closing in
BloomFilterTest, fix permissions issue for TestGracefulShutdown tests
URL: https://github.com/apache/drill/pull/1987#discussion_r380481139
#
paul-rogers commented on a change in pull request #1987: DRILL-7589: Set
temporary tests folder for UDF_DIRECTORY_LOCAL, fix allocators closing in
BloomFilterTest, fix permissions issue for TestGracefulShutdown tests
URL: https://github.com/apache/drill/pull/1987#discussion_r380479013
#
paul-rogers commented on a change in pull request #1987: DRILL-7589: Set
temporary tests folder for UDF_DIRECTORY_LOCAL, fix allocators closing in
BloomFilterTest, fix permissions issue for TestGracefulShutdown tests
URL: https://github.com/apache/drill/pull/1987#discussion_r380485944
#
paul-rogers commented on a change in pull request #1987: DRILL-7589: Set
temporary tests folder for UDF_DIRECTORY_LOCAL, fix allocators closing in
BloomFilterTest, fix permissions issue for TestGracefulShutdown tests
URL: https://github.com/apache/drill/pull/1987#discussion_r380485298
#
paul-rogers commented on a change in pull request #1987: DRILL-7589: Set
temporary tests folder for UDF_DIRECTORY_LOCAL, fix allocators closing in
BloomFilterTest, fix permissions issue for TestGracefulShutdown tests
URL: https://github.com/apache/drill/pull/1987#discussion_r380476183
#
paul-rogers commented on a change in pull request #1987: DRILL-7589: Set
temporary tests folder for UDF_DIRECTORY_LOCAL, fix allocators closing in
BloomFilterTest, fix permissions issue for TestGracefulShutdown tests
URL: https://github.com/apache/drill/pull/1987#discussion_r380485678
#
paul-rogers commented on issue #1971: DRILL-7572: JSON structure parser
URL: https://github.com/apache/drill/pull/1971#issuecomment-587300916
@vvysotskyi, thanks for pointing out the question; I missed it when reading
the code comments.
Looked at `CountingJsonReader`. Looks like crea
paul-rogers opened a new pull request #1988: DRILL-7590: Refactor plugin
registry
URL: https://github.com/apache/drill/pull/1988
Performs a thorough "spring cleaning" of the storage plugin registry to
prepare it to add a proper plugin API.
This is a complex PR with lots going on.
cgivre commented on issue #1978: DRILL-7578: HDF5 Metadata Queries Fail with
Large Files
URL: https://github.com/apache/drill/pull/1978#issuecomment-587259759
@paul-rogers @vvysotskyi
See above comment. I removed the config option and added logger warnings if
the data is truncated. A
vvysotskyi opened a new pull request #1987: DRILL-7589: Set temporary tests
folder for UDF_DIRECTORY_LOCAL, fix allocators closing in BloomFilterTest, fix
permissions issue for TestGracefulShutdown tests
URL: https://github.com/apache/drill/pull/1987
# [DRILL-7589](https://issues.apache.or
Paul Rogers created DRILL-7590:
--
Summary: Refactor plugin registry
Key: DRILL-7590
URL: https://issues.apache.org/jira/browse/DRILL-7590
Project: Apache Drill
Issue Type: Improvement
Affects
Vova Vysotskyi created DRILL-7589:
-
Summary: TestDynamicUDFSupport fails on GitHub Actions
Key: DRILL-7589
URL: https://issues.apache.org/jira/browse/DRILL-7589
Project: Apache Drill
Issue Ty
vvysotskyi commented on issue #1984: DRILL-7586: drill-hive-exec-shaded
contains commons-lang3 version 3.1
URL: https://github.com/apache/drill/pull/1984#issuecomment-587094713
@oleg-zinovev, thanks for the PR and making changes. Could you please also
update your commit message to reflect
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380192497
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380218259
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380209257
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380210657
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r379576801
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380229001
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380275860
##
File path:
_docs/performance-tuning/drill-metastore/030-drill-iceberg-metastore.md
##
@@ -0,0 +1,69 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r379568993
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380209127
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380230120
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380276160
##
File path:
_docs/performance-tuning/drill-metastore/030-drill-iceberg-metastore.md
##
@@ -0,0 +1,69 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380146051
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380164420
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380209529
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380250105
##
File path:
_docs/performance-tuning/drill-metastore/030-drill-iceberg-metastore.md
##
@@ -0,0 +1,69 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380159080
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r379573331
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380278702
##
File path:
_docs/performance-tuning/drill-metastore/030-drill-iceberg-metastore.md
##
@@ -0,0 +1,69 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380199004
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380241423
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380164542
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380270959
##
File path:
_docs/performance-tuning/drill-metastore/030-drill-iceberg-metastore.md
##
@@ -0,0 +1,69 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380199229
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380219490
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r379567240
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r379576091
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380244476
##
File path:
_docs/performance-tuning/drill-metastore/030-drill-iceberg-metastore.md
##
@@ -0,0 +1,69 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r379556928
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r374778009
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r380159969
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r379541595
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r37466
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r379551973
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r379573563
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r379569561
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r379534144
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r379543295
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r379521993
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi commented on a change in pull request #1953: Add docs for Drill
Metastore
URL: https://github.com/apache/drill/pull/1953#discussion_r379543754
##
File path:
_docs/performance-tuning/drill-metastore/010-using-drill-metastore.md
##
@@ -0,0 +1,408 @@
+---
+title:
vvysotskyi opened a new pull request #1986: Additional changes for Drill
Metastore docs
URL: https://github.com/apache/drill/pull/1986
Changes after code review for https://github.com/apache/drill/pull/1953
This is an automat
vvysotskyi commented on issue #1985: DRILL-7565: ANALYZE TABLE ... REFRESH
METADATA does not work for empty Parquet files
URL: https://github.com/apache/drill/pull/1985#issuecomment-587039702
@KazydubB, thanks for the review, I have made requested changes.
-
vvysotskyi commented on a change in pull request #1985: DRILL-7565: ANALYZE
TABLE ... REFRESH METADATA does not work for empty Parquet files
URL: https://github.com/apache/drill/pull/1985#discussion_r380237113
##
File path:
exec/java-exec/src/main/java/org/apache/drill/exec/physica
vvysotskyi commented on a change in pull request #1985: DRILL-7565: ANALYZE
TABLE ... REFRESH METADATA does not work for empty Parquet files
URL: https://github.com/apache/drill/pull/1985#discussion_r380236720
##
File path:
exec/java-exec/src/main/java/org/apache/drill/exec/metasto
KazydubB commented on a change in pull request #1985: DRILL-7565: ANALYZE TABLE
... REFRESH METADATA does not work for empty Parquet files
URL: https://github.com/apache/drill/pull/1985#discussion_r380227482
##
File path:
exec/java-exec/src/main/java/org/apache/drill/exec/metastore
KazydubB commented on a change in pull request #1985: DRILL-7565: ANALYZE TABLE
... REFRESH METADATA does not work for empty Parquet files
URL: https://github.com/apache/drill/pull/1985#discussion_r380231898
##
File path:
exec/java-exec/src/main/java/org/apache/drill/exec/physical/
vvysotskyi commented on a change in pull request #1984: DRILL-7586:
drill-hive-exec-shaded contains commons-lang3 version 3.1
URL: https://github.com/apache/drill/pull/1984#discussion_r380155881
##
File path: contrib/storage-hive/hive-exec-shade/pom.xml
##
@@ -158,6 +158,8
KazydubB commented on a change in pull request #1974: DRILL-7574: Generalize
the projection parser
URL: https://github.com/apache/drill/pull/1974#discussion_r380154237
##
File path:
exec/java-exec/src/main/java/org/apache/drill/exec/physical/resultSet/project/RequestedColumn.java
oleg-zinovev commented on issue #1984: DRILL-7586: drill-hive-exec-shaded
contains commons-lang3 version 3.1
URL: https://github.com/apache/drill/pull/1984#issuecomment-586964736
I can not reproduce the error on any version of JDK
---
vvysotskyi commented on a change in pull request #1985: DRILL-7565: ANALYZE
TABLE ... REFRESH METADATA does not work for empty Parquet files
URL: https://github.com/apache/drill/pull/1985#discussion_r380128666
##
File path:
exec/java-exec/src/main/java/org/apache/drill/exec/planner
vvysotskyi commented on a change in pull request #1985: DRILL-7565: ANALYZE
TABLE ... REFRESH METADATA does not work for empty Parquet files
URL: https://github.com/apache/drill/pull/1985#discussion_r380124653
##
File path:
exec/java-exec/src/main/java/org/apache/drill/exec/physica
vvysotskyi commented on a change in pull request #1985: DRILL-7565: ANALYZE
TABLE ... REFRESH METADATA does not work for empty Parquet files
URL: https://github.com/apache/drill/pull/1985#discussion_r380077493
##
File path:
exec/java-exec/src/main/java/org/apache/drill/exec/ExecCon
vvysotskyi commented on a change in pull request #1985: DRILL-7565: ANALYZE
TABLE ... REFRESH METADATA does not work for empty Parquet files
URL: https://github.com/apache/drill/pull/1985#discussion_r380128453
##
File path:
exec/java-exec/src/main/java/org/apache/drill/exec/physica
vvysotskyi commented on a change in pull request #1985: DRILL-7565: ANALYZE
TABLE ... REFRESH METADATA does not work for empty Parquet files
URL: https://github.com/apache/drill/pull/1985#discussion_r380081293
##
File path:
exec/java-exec/src/main/java/org/apache/drill/exec/metasto
73 matches
Mail list logo
