[
https://issues.apache.org/jira/browse/IGNITE-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16377107#comment-16377107
]
ASF GitHub Bot commented on IGNITE-7531:
----------------------------------------
GitHub user pavel-kuznetsov opened a pull request:
https://github.com/apache/ignite/pull/3571
IGNITE-7531: Implemented copy, insert, batched insert benchmarks
https://issues.apache.org/jira/browse/IGNITE-7531
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gridgain/apache-ignite IGNITE-7531
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/ignite/pull/3571.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3571
----
commit 4b2078a06230b921e19e9ac6912d93f48adae037
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-07T14:39:18Z
IGNITE-7253: Implemented total time probe
commit ef4ac90ffa1141e80462aea7b6024477583e52b0
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-08T16:12:59Z
IGNITE-7253: Implemented simple insert benchmark for upload
commit 31056439f36b5ffeebd45f2140c3750afb9a104e
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-09T18:58:50Z
IGNITE-7253: Assert results of TotalTimeProbe is correct
commit d6e1e3f7d76cf612574d5b7e756fd01d0c161c90
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-09T18:59:47Z
IGNITE-7253: Batch insert upload benchmark draft
commit 5175d69e5cbb6bc050dd87ccc213d526a40d61fa
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-09T19:01:15Z
IGNITE-7253: Add missed configs for upload benchmarks
commit 53e3e58f69261361f7d50695f72aa42c91bfcbd7
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-12T11:11:34Z
IGNITE-7253: add batch size parameter (sqlRange);
renamed total size parameter (sqlRange -> range)
commit 998c8f44a432f92c595d37ccacd160d007048311
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-12T16:01:32Z
IGNITE-7253: moved queries to separated class; changed table schema
commit 400f564c011362acf151ecdc304ab5a021a69be6
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-12T18:47:46Z
IGNITE-7253: renamed configuration names
commit 8727fc47e8dd7796e3df5e070bd9890708664e66
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-13T14:10:24Z
Merge remote-tracking branch 'origin/master' into IGNITE-7531
commit 056e97c512ac35ef826eddcb360dd97bf41917be
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-13T15:27:12Z
IGNITE-7253: added init method, added comment
commit eae7018b17f7dfc626b7159a38afcf95ac585913
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-14T11:39:15Z
IGNITE-7253: added csv copy benchmark, updated comments
commit 3029cb55faeddcb4fa940a9f1592653d90853b7d
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-14T14:56:54Z
IGNITE-7253: use full sync and 10M inserts, added configuration for csv
benchmark
commit f1f2f53837e52f4ca5400c94f8131878724419f5
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-14T16:21:57Z
Merge remote-tracking branch 'origin/master' into IGNITE-7531
commit e1a91f9547c82ac622a2392e4b352de82d062d67
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-15T14:31:58Z
IGNITE-7253: Don't place csv file in tmpfs; Added comments
commit 8ae1e8b95a7d4beb58af25bb08d26c60dfb7c6f2
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-15T14:33:27Z
IGNITE-7253: Create table using thin driver
commit db68c889f9673543508f75b1d3470cbf6869f37f
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-15T14:44:53Z
Merge remote-tracking branch 'origin/master' into IGNITE-7531
brings fixes for COPY command can't find table
commit 801cb9c6293308508c5929096ad5448e8c20fdff
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-15T17:06:55Z
IGNITE-7253: updated configuration
commit b834f43bcdcaa08d501a512bc1d74974e82e7331
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-20T11:22:32Z
IGNITE-7253: added persistence config;
added activation in base class
commit 0250b365384cab0ad8fdd581c6c7d6286f823aed
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-20T12:08:43Z
IGNITE-7253: added combo configurations
commit 2b798df53160b66fc1e83708169349520b029f81
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-20T12:10:09Z
IGNITE-7253: cosmetic changes
commit 934ea7275fc54b3f0e98665e3325b97aa6ce23bf
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-20T13:52:42Z
IGNITE-7253: force drop and create table before test
commit 2a1580c88bcec009773c9aa9f5ae4c7b10767a9f
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-20T18:45:13Z
IGNITE-7253: option to temporally disable wall while uploading;
fixed configuration
commit 7194461a25c1dfa4da37b8030f1a434395418849
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-21T15:03:28Z
Merge remote-tracking branch 'origin/master' into IGNITE-7531
commit e28f2ab9d53e4f53aa4266ece7d81b74bd5bf0cd
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-21T15:06:56Z
IGNITE-7253: added warmup logging
commit 8f950ff1fbf2b37c4288d4e357f32cdb29dc927b
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-23T19:38:34Z
IGNITE-7253: Sql data streamer support for upload benchmarks
commit 30bfbfa7cae4382d7f7c176506079932695f3a99
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-24T20:14:47Z
Merge remote-tracking branch 'origin/master' into IGNITE-7531
commit fdb3b2d3ee266153d6ccd4ef849f7a4e28dce7df
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-26T12:16:58Z
IGNITE-7253: assert table size in tear down
commit ac9050289b35b8bfe354befcb1c8a30215f49407
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-26T12:19:25Z
IGNITE-7253: aded single insert benchmark, fixed jdbc params
commit 2bbacde02719b64b41734b623e6c01bc51014ad8
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-26T15:23:44Z
IGNITE-7253: support of multiply jdbc params
commit 261b19dc02aa601be8fd161d94e7e676f6501fef
Author: Pavel Kuznetsov <palmihal@...>
Date: 2018-02-26T16:08:55Z
IGNITE-7253: Updated javadoc
----
> SQL: Create data load benchmarks
> --------------------------------
>
> Key: IGNITE-7531
> URL: https://issues.apache.org/jira/browse/IGNITE-7531
> Project: Ignite
> Issue Type: Task
> Components: sql, yardstick
> Reporter: Vladimir Ozerov
> Assignee: Pavel Kuznetsov
> Priority: Major
> Fix For: 2.5
>
>
> We need to implement a set of data loading benchmarks to better understand
> how fast Ignite is able to consume data. This task consists of two steps:
> 1) Extend Yardstick capabilities
> 2) Create set of benchmarks
> 1) Yardstick
> Data load benchmark should be executed in single-shot mode: only one
> iteration, only total execution time is needed, start callback for setup and
> warmup, stop callback for cleanup.
> Currently Yardstick cannot do that, so we need to extend it. Possibly, we can
> control this through new {{boolean BenchmarkDriver.isSingleShot()}} method.
> 2) Benchmarks
> At first let's focus on thin JDBC driver. The following cases should be
> executed:
> 2.1) Normal INSERT
> 2.2) Batched INSERT
> 2.3) Streaming INSERT (when IGNITE-7253 is ready)
> 2.4) P. 1-3 with and without dynamically disabled WAL (ALTER TABLE ...
> NOLOGGING)
> 2.5) P. 1-3 with additional indexes - either created before data load on
> empty table, or after load on table with data.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
