[ 
https://issues.apache.org/jira/browse/ASTERIXDB-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16874821#comment-16874821
 ] 

ASF subversion and git services commented on ASTERIXDB-2593:
------------------------------------------------------------

Commit c71173d12335a41e6a9b8e4ca8b8d435bad22b5e in asterixdb's branch 
refs/heads/master from Hussain Towaileb
[ https://gitbox.apache.org/repos/asf?p=asterixdb.git;h=c71173d ]

[ASTERIXDB-2593][FUN] TPC-DS always parallelize + gen all tables

- user model changes: yes
  - user can call the tpcds_datagen() by passing only the scaling
    factor, and that will automatically generate all the tables.
- storage format changes: no
- interface changes: no

Details:
- Added support to a second version of the tpcds_datagen()
function to take only a single parameter that will result in
generating the data for all the tables in one go. The user
now can generate the data for a single table at a time, or
all the tables in one go.
- Overridden the behavior for activating the parallelism.
Before, the library wouldn't activate parallelism unless
the tables are big, and the number of data generated per
table is over 1,000,000. With this change, the parallelism
is always activated, regardless of the table size or the
data size being generated.
- Added a new test, TPCExecutionTest, to execute the long
tests for the TPC. Some of the TPC tests take longer than
5 minutes to finish and could result in high usage of
disk space.

Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486
Reviewed-on: https://asterix-gerrit.ics.uci.edu/3437
Sonar-Qube: Jenkins <jenk...@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenk...@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenk...@fulliautomatix.ics.uci.edu>
Reviewed-by: Murtadha Hubail <mhub...@apache.org>


> TPC-DS second version of datagen to generate all tables
> -------------------------------------------------------
>
>                 Key: ASTERIXDB-2593
>                 URL: https://issues.apache.org/jira/browse/ASTERIXDB-2593
>             Project: Apache AsterixDB
>          Issue Type: Task
>          Components: FUN - Functions
>    Affects Versions: 0.9.4
>            Reporter: Hussain Towaileb
>            Assignee: Hussain Towaileb
>            Priority: Major
>             Fix For: 0.9.5
>
>
> Create another version of the tpcds_datagen() to take a single parameter, the 
> scaling factor, this version will automatically generate the data for all the 
> tables at the specified scaling factor.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to