[
https://issues.apache.org/jira/browse/DRILL-8005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17429637#comment-17429637
]
ASF GitHub Bot commented on DRILL-8005:
---------------------------------------
luocooong commented on a change in pull request #2327:
URL: https://github.com/apache/drill/pull/2327#discussion_r730233364
##########
File path:
contrib/storage-jdbc/src/test/java/org/apache/drill/exec/store/jdbc/TestJdbcWriterWithH2.java
##########
@@ -370,22 +372,73 @@ public void testWithArrayField() throws Exception {
}
}
+ @Test
+ public void testWithLargeFile() throws Exception {
+ String query = "CREATE TABLE h2.tmp.`drill_h2_test`.`t2`
(id,first_name,last_name,email,gender,ip_address) AS " +
+ "SELECT id,first_name,last_name,email,gender,ip_address FROM
cp.`csv/large_csv.csvh`";
+ QuerySummary insertResults = queryBuilder().sql(query).run();
+ assertTrue(insertResults.succeeded());
+
+ query = "SELECT COUNT(*) FROM h2.tmp.`drill_h2_test`.`t2`";
+ long rowCount = queryBuilder().sql(query).singletonLong();
+ assertEquals(6000, rowCount);
+
+ // Now drop the table
+ String dropQuery = "DROP TABLE h2.tmp.`drill_h2_test`.`t2`";
+ QuerySummary dropResults = queryBuilder().sql(dropQuery).run();
+ assertTrue(dropResults.succeeded());
+ }
+
+ @Test
+ @Ignore("This is a slow test. Please run manually.")
Review comment:
Thanks for the explanation.
##########
File path:
contrib/storage-jdbc/src/test/java/org/apache/drill/exec/store/jdbc/TestJdbcWriterWithPostgres.java
##########
@@ -210,6 +216,40 @@ public void testWithLargeFile() throws Exception {
assertTrue(dropResults.succeeded());
}
+ @Test
+ @Ignore("This is a slow test. Please run manually.")
+ public void testWithReallyLongFile() throws Exception {
+ Path generatedFile = null;
+ try {
+ generatedFile =
JdbcTestUtils.generateCsvFile("csv/very_large_file.csvh", 10, 100000);
Review comment:
As an option, can we compress the csvh file to tar.gz format then read
it ? Just to reduce the size of code base.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@drill.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Add Writer to JDBC Storage Plugin
> ---------------------------------
>
> Key: DRILL-8005
> URL: https://issues.apache.org/jira/browse/DRILL-8005
> Project: Apache Drill
> Issue Type: Improvement
> Components: Storage - JDBC
> Affects Versions: 1.19.0
> Reporter: Charles Givre
> Assignee: Charles Givre
> Priority: Major
> Fix For: 1.20.0
>
>
> Current implementation of Drill only allows writing to file systems. This
> issue proposes extending the JDBC plugin to allow writing to JDBC data
> sources. This will do so by implementing:
> CREATE TABLE AS
> DROP TABLE
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
