Change in asterixdb[master]: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate...
Jenkins has posted comments on this change. ( https://asterix-gerrit.ics.uci.edu/3437 ) Change subject: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate parallelism .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-asterix-app/6318/ (7/16) -- To view, visit https://asterix-gerrit.ics.uci.edu/3437 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 Gerrit-Change-Number: 3437 Gerrit-PatchSet: 2 Gerrit-Owner: Hussain Towaileb Gerrit-Reviewer: Anon. E. Moose (1000171) Gerrit-Reviewer: Jenkins Gerrit-Comment-Date: Sun, 16 Jun 2019 15:44:03 + Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate...
Jenkins has posted comments on this change. ( https://asterix-gerrit.ics.uci.edu/3437 ) Change subject: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate parallelism .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-cancellation-test/5969/ (12/16) -- To view, visit https://asterix-gerrit.ics.uci.edu/3437 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 Gerrit-Change-Number: 3437 Gerrit-PatchSet: 2 Gerrit-Owner: Hussain Towaileb Gerrit-Reviewer: Anon. E. Moose (1000171) Gerrit-Reviewer: Jenkins Gerrit-Comment-Date: Sun, 16 Jun 2019 15:44:12 + Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate...
Jenkins has posted comments on this change. ( https://asterix-gerrit.ics.uci.edu/3437 ) Change subject: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate parallelism .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-no-installer-app/6108/ (10/16) -- To view, visit https://asterix-gerrit.ics.uci.edu/3437 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 Gerrit-Change-Number: 3437 Gerrit-PatchSet: 2 Gerrit-Owner: Hussain Towaileb Gerrit-Reviewer: Anon. E. Moose (1000171) Gerrit-Reviewer: Jenkins Gerrit-Comment-Date: Sun, 16 Jun 2019 15:44:08 + Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate...
Jenkins has posted comments on this change. ( https://asterix-gerrit.ics.uci.edu/3437 ) Change subject: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate parallelism .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-ensure-ancestor/3953/ (9/16) -- To view, visit https://asterix-gerrit.ics.uci.edu/3437 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 Gerrit-Change-Number: 3437 Gerrit-PatchSet: 2 Gerrit-Owner: Hussain Towaileb Gerrit-Reviewer: Anon. E. Moose (1000171) Gerrit-Reviewer: Jenkins Gerrit-Comment-Date: Sun, 16 Jun 2019 15:44:07 + Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate...
Jenkins has posted comments on this change. ( https://asterix-gerrit.ics.uci.edu/3437 ) Change subject: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate parallelism .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-ssl-compression/724/ (8/16) -- To view, visit https://asterix-gerrit.ics.uci.edu/3437 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 Gerrit-Change-Number: 3437 Gerrit-PatchSet: 2 Gerrit-Owner: Hussain Towaileb Gerrit-Reviewer: Anon. E. Moose (1000171) Gerrit-Reviewer: Jenkins Gerrit-Comment-Date: Sun, 16 Jun 2019 15:44:05 + Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate...
Jenkins has posted comments on this change. ( https://asterix-gerrit.ics.uci.edu/3437 ) Change subject: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate parallelism .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-source-format/5928/ (14/16) -- To view, visit https://asterix-gerrit.ics.uci.edu/3437 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 Gerrit-Change-Number: 3437 Gerrit-PatchSet: 2 Gerrit-Owner: Hussain Towaileb Gerrit-Reviewer: Anon. E. Moose (1000171) Gerrit-Reviewer: Jenkins Gerrit-Comment-Date: Sun, 16 Jun 2019 15:44:16 + Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate...
Jenkins has posted comments on this change. ( https://asterix-gerrit.ics.uci.edu/3437 ) Change subject: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate parallelism .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app-sql-execution/5947/ (11/16) -- To view, visit https://asterix-gerrit.ics.uci.edu/3437 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 Gerrit-Change-Number: 3437 Gerrit-PatchSet: 2 Gerrit-Owner: Hussain Towaileb Gerrit-Reviewer: Anon. E. Moose (1000171) Gerrit-Reviewer: Jenkins Gerrit-Comment-Date: Sun, 16 Jun 2019 15:44:10 + Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate...
Jenkins has posted comments on this change. ( https://asterix-gerrit.ics.uci.edu/3437 ) Change subject: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate parallelism .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/11438/ (15/16) -- To view, visit https://asterix-gerrit.ics.uci.edu/3437 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 Gerrit-Change-Number: 3437 Gerrit-PatchSet: 2 Gerrit-Owner: Hussain Towaileb Gerrit-Reviewer: Anon. E. Moose (1000171) Gerrit-Reviewer: Jenkins Gerrit-Comment-Date: Sun, 16 Jun 2019 15:44:19 + Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate...
Jenkins has posted comments on this change. ( https://asterix-gerrit.ics.uci.edu/3437 ) Change subject: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate parallelism .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-spidersilk-tests/885/ (13/16) -- To view, visit https://asterix-gerrit.ics.uci.edu/3437 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 Gerrit-Change-Number: 3437 Gerrit-PatchSet: 2 Gerrit-Owner: Hussain Towaileb Gerrit-Reviewer: Anon. E. Moose (1000171) Gerrit-Reviewer: Jenkins Gerrit-Comment-Date: Sun, 16 Jun 2019 15:44:15 + Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate...
Jenkins has posted comments on this change. ( https://asterix-gerrit.ics.uci.edu/3437 ) Change subject: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate parallelism .. Patch Set 2: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/8724/ -- To view, visit https://asterix-gerrit.ics.uci.edu/3437 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 Gerrit-Change-Number: 3437 Gerrit-PatchSet: 2 Gerrit-Owner: Hussain Towaileb Gerrit-Reviewer: Anon. E. Moose (1000171) Gerrit-Reviewer: Jenkins Gerrit-Comment-Date: Sun, 16 Jun 2019 15:45:20 + Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate...
Jenkins has posted comments on this change. ( https://asterix-gerrit.ics.uci.edu/3437 ) Change subject: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate parallelism .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-verify-txnlog/1125/ (6/16) -- To view, visit https://asterix-gerrit.ics.uci.edu/3437 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 Gerrit-Change-Number: 3437 Gerrit-PatchSet: 2 Gerrit-Owner: Hussain Towaileb Gerrit-Reviewer: Anon. E. Moose (1000171) Gerrit-Reviewer: Jenkins Gerrit-Comment-Date: Sun, 16 Jun 2019 15:44:02 + Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate...
Jenkins has posted comments on this change. ( https://asterix-gerrit.ics.uci.edu/3437 ) Change subject: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate parallelism .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-stabilization-f69489-compat/1219/ (5/16) -- To view, visit https://asterix-gerrit.ics.uci.edu/3437 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 Gerrit-Change-Number: 3437 Gerrit-PatchSet: 2 Gerrit-Owner: Hussain Towaileb Gerrit-Reviewer: Anon. E. Moose (1000171) Gerrit-Reviewer: Jenkins Gerrit-Comment-Date: Sun, 16 Jun 2019 15:44:02 + Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate...
Jenkins has posted comments on this change. ( https://asterix-gerrit.ics.uci.edu/3437 ) Change subject: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate parallelism .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-source-assemblies/6168/ (2/16) -- To view, visit https://asterix-gerrit.ics.uci.edu/3437 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 Gerrit-Change-Number: 3437 Gerrit-PatchSet: 2 Gerrit-Owner: Hussain Towaileb Gerrit-Reviewer: Anon. E. Moose (1000171) Gerrit-Reviewer: Jenkins Gerrit-Comment-Date: Sun, 16 Jun 2019 15:44:00 + Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate...
Jenkins has posted comments on this change. ( https://asterix-gerrit.ics.uci.edu/3437 ) Change subject: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate parallelism .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-sonar/9904/ (3/16) -- To view, visit https://asterix-gerrit.ics.uci.edu/3437 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 Gerrit-Change-Number: 3437 Gerrit-PatchSet: 2 Gerrit-Owner: Hussain Towaileb Gerrit-Reviewer: Anon. E. Moose (1000171) Gerrit-Reviewer: Jenkins Gerrit-Comment-Date: Sun, 16 Jun 2019 15:44:00 + Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate...
Jenkins has posted comments on this change. ( https://asterix-gerrit.ics.uci.edu/3437 ) Change subject: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate parallelism .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-verify-storage/6529/ (4/16) -- To view, visit https://asterix-gerrit.ics.uci.edu/3437 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 Gerrit-Change-Number: 3437 Gerrit-PatchSet: 2 Gerrit-Owner: Hussain Towaileb Gerrit-Reviewer: Anon. E. Moose (1000171) Gerrit-Reviewer: Jenkins Gerrit-Comment-Date: Sun, 16 Jun 2019 15:44:01 + Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate...
Jenkins has posted comments on this change. ( https://asterix-gerrit.ics.uci.edu/3437 ) Change subject: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate parallelism .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/hyracks-gerrit/5865/ (1/16) -- To view, visit https://asterix-gerrit.ics.uci.edu/3437 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 Gerrit-Change-Number: 3437 Gerrit-PatchSet: 2 Gerrit-Owner: Hussain Towaileb Gerrit-Reviewer: Anon. E. Moose (1000171) Gerrit-Reviewer: Jenkins Gerrit-Comment-Date: Sun, 16 Jun 2019 15:44:00 + Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate...
Hello Anon. E. Moose (1000171), Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/3437 to look at the new patch set (#2). Change subject: [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate parallelism .. [ASTERIXDB-2593][FUN] TPC-DS support generating all tables + activate parallelism - user model changes: yes - user can call the tpcds_datagen() by passing only the scaling factor, and that will automatically generate all the tables. - storage format changes: no - interface changes: no Details: - Added support to a second version of the tpcds_datagen() function to take only a single parameter that will result in generating the data for all the tables in one go. The user now can generate the data for a single table at a time, or all the tables in one go. - Overridden the behavior for activating the parallelism. Before, the library wouldn't activate parallelism unless the tables are big, and the number of data generated per table is over 1,000,000. With this change, the parallelism is always activated, regardless of the table size or the data size being generated. - Added a new test, TPCExecutionTest, to execute the long tests for the TPC. Some of the TPC tests take longer than 5 minutes to finish and could result in high usage of disk space. Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 --- M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/FunctionRewriter.java R asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/TPCDSAllTablesDataGeneratorDatasource.java C asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/TPCDSAllTablesDataGeneratorRewriter.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/TPCDSDataGeneratorFunction.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/TPCDSDataGeneratorReader.java C asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/TPCDSSingleTableDataGeneratorDatasource.java R asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/TPCDSSingleTableDataGeneratorRewriter.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/util/MetadataBuiltinFunctions.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/api/common/AsterixHyracksIntegrationUtil.java A asterixdb/asterix-app/src/test/java/org/apache/asterix/test/runtime/TPCExecutionTest.java A asterixdb/asterix-app/src/test/resources/runtimets/only_tpc.xml R asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/datagen_sf_1_all_tables_1/datagen_sf_1_all_tables_1.1.query.sqlpp A asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/datagen_sf_1_all_tables_2/datagen_sf_1_all_tables_2.1.query.sqlpp R asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/datagen_sf_1_all_tables_1/datagen_sf_1_all_tables_1.1.adm A asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/datagen_sf_1_all_tables_2/datagen_sf_1_all_tables_2.1.adm M asterixdb/asterix-app/src/test/resources/runtimets/testsuite_sqlpp.xml A asterixdb/asterix-app/src/test/resources/runtimets/testsuite_tpc.xml M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/declared/FunctionDataSource.java 18 files changed, 560 insertions(+), 154 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/37/3437/2 -- To view, visit https://asterix-gerrit.ics.uci.edu/3437 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 Gerrit-Change-Number: 3437 Gerrit-PatchSet: 2 Gerrit-Owner: Hussain Towaileb Gerrit-Reviewer: Anon. E. Moose (1000171) Gerrit-Reviewer: Jenkins
