[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15207770#comment-15207770 ] Stefania commented on CASSANDRA-11053: -- CI looks good, ready to commit. Merge information a few

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15207669#comment-15207669 ] Stefania commented on CASSANDRA-11053: -- Thank you Adam. I've rebased, squashed and restarted CI.

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205629#comment-15205629 ] Stefania commented on CASSANDRA-11053: -- Thank you for the review, I've applied all 3 suggestions

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204297#comment-15204297 ] Adam Holmberg commented on CASSANDRA-11053: --- A few comments on review: It is not clear to

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201477#comment-15201477 ] Adam Holmberg commented on CASSANDRA-11053: --- Planning to look at it today. > COPY FROM on

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201120#comment-15201120 ] Stefania commented on CASSANDRA-11053: -- [~aholmber] the patch is ready, are you still available

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201500#comment-15201500 ] Jeremiah Jordan commented on CASSANDRA-11053: - Didn't review the code, but this does fix

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179075#comment-15179075 ] Stefania commented on CASSANDRA-11053: -- Thank you, CI results are clean. This patch is ready

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15178132#comment-15178132 ] Adam Holmberg commented on CASSANDRA-11053: --- +1 @28f7713 > COPY FROM on large datasets:

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15177280#comment-15177280 ] Stefania commented on CASSANDRA-11053: -- One more test timing out, fix is

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15177068#comment-15177068 ] Stefania commented on CASSANDRA-11053: -- Thank you for the latest review. Unfortunately there

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15176106#comment-15176106 ] Adam Holmberg commented on CASSANDRA-11053: --- +1 @2aff646, 8c798c2 Sorry I missed the date

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15174969#comment-15174969 ] Stefania commented on CASSANDRA-11053: -- The problem on Windows should be fixed now, I've

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15173201#comment-15173201 ] Stefania commented on CASSANDRA-11053: -- Thank you for your latest comments and for introducing

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15172187#comment-15172187 ] Adam Holmberg commented on CASSANDRA-11053: --- Just a couple other minor comments:

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15172106#comment-15172106 ] Adam Holmberg commented on CASSANDRA-11053: ---

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15171292#comment-15171292 ] Stefania commented on CASSANDRA-11053: -- bq. I've asked offline regarding the target version,

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169899#comment-15169899 ] Adam Holmberg commented on CASSANDRA-11053: --- bq. The performance of COPY TO for a benchmark

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168411#comment-15168411 ] Stefania commented on CASSANDRA-11053: -- bq. {{del cassandra.deserializers.DesBytesType}} causes

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1516#comment-1516 ] Adam Holmberg commented on CASSANDRA-11053: --- bq. At least for the time being I decided to

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166414#comment-15166414 ] Stefania commented on CASSANDRA-11053: -- bq. Can you help me understand what the issue was? It

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15165662#comment-15165662 ] Adam Holmberg commented on CASSANDRA-11053: --- Just starting on this. There are a lot of

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15162800#comment-15162800 ] Stefania commented on CASSANDRA-11053: -- The ticket is ready for review [~aholmber]. The patch:

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156755#comment-15156755 ] Stefania commented on CASSANDRA-11053: -- bq. I would like to repeat the tests on an AWS instance

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154987#comment-15154987 ] Adam Holmberg commented on CASSANDRA-11053: --- Curious, with the introduction of Cython, are

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154980#comment-15154980 ] Adam Holmberg commented on CASSANDRA-11053: --- I have visited message coalescing in the

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150253#comment-15150253 ] Stefania commented on CASSANDRA-11053: -- Here are the latest results: ||MODULE

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148394#comment-15148394 ] Stefania commented on CASSANDRA-11053: -- I have experimented with CPU affinity by pinning each

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15147601#comment-15147601 ] Jonathan Ellis commented on CASSANDRA-11053: bq. I feel that we are reaching a point

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144508#comment-15144508 ] Stefania commented on CASSANDRA-11053: -- Here are the latest results: ||MODULE

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144509#comment-15144509 ] Stefania commented on CASSANDRA-11053: -- It is fine now thanks, see details below. > COPY FROM

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15143179#comment-15143179 ] Jonathan Ellis commented on CASSANDRA-11053: bq. We still also have an issue with real

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133899#comment-15133899 ] Stefania commented on CASSANDRA-11053: -- I've made some small optimizations and I've cythonized

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15130041#comment-15130041 ] Stefania commented on CASSANDRA-11053: -- I've repeated the benchmark after performing the

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15130553#comment-15130553 ] Brian Hess commented on CASSANDRA-11053: - [~Stefania] - I believe that is the correct

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131446#comment-15131446 ] Stefania commented on CASSANDRA-11053: -- Could you check the ctool invocations in

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127864#comment-15127864 ] Stefania commented on CASSANDRA-11053: -- Reading from standard input and parameters like

[jira] [Commented] (CASSANDRA-11053) COPY FROM on large datasets: fix progress report and debug performance

[ https://issues.apache.org/jira/browse/CASSANDRA-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127990#comment-15127990 ] Stefania commented on CASSANDRA-11053: -- Another approach I am looking at is to continue reading