[jira] [Commented] (CASSANDRA-14826) cassandra spinning forever on 1 thread while initializing keyspace
[ https://issues.apache.org/jira/browse/CASSANDRA-14826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16651656#comment-16651656 ] Marcus Eriksson commented on CASSANDRA-14826: - yeah it is obviously inefficient, but when you say "forever", you actually mean that it takes a long time? > cassandra spinning forever on 1 thread while initializing keyspace > -- > > Key: CASSANDRA-14826 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14826 > Project: Cassandra > Issue Type: Bug >Reporter: ingard mevåg >Priority: Major > Attachments: Screen Shot 2018-10-16 at 14.51.27.png > > > When starting cassandra 3.0.17 it takes a long time to initialize a keyspace. > top shows 1 thread spinning at 100% cpu. Thread dump shows: > {code:java} > "main" - Thread t@1 > java.lang.Thread.State: RUNNABLE > at java.util.TimSort.mergeHi(TimSort.java:850) > at java.util.TimSort.mergeAt(TimSort.java:516) > at java.util.TimSort.mergeCollapse(TimSort.java:441) > at java.util.TimSort.sort(TimSort.java:245) > at java.util.Arrays.sort(Arrays.java:1512) > at java.util.ArrayList.sort(ArrayList.java:1454) > at java.util.Collections.sort(Collections.java:175) > at > org.apache.cassandra.db.compaction.LeveledManifest.canAddSSTable(LeveledManifest.java:243) > at > org.apache.cassandra.db.compaction.LeveledManifest.add(LeveledManifest.java:146) > - locked (a > org.apache.cassandra.db.compaction.LeveledManifest) > at > org.apache.cassandra.db.compaction.LeveledCompactionStrategy.addSSTable(LeveledCompactionStrategy.java:298) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.startup(CompactionStrategyManager.java:135) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.reload(CompactionStrategyManager.java:187) > - locked <742bfce7> (a > org.apache.cassandra.db.compaction.CompactionStrategyManager) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.(CompactionStrategyManager.java:75) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:408) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:363) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:579) > - locked <4e4f20d2> (a java.lang.Class) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:556) > at org.apache.cassandra.db.Keyspace.initCf(Keyspace.java:368) > at org.apache.cassandra.db.Keyspace.(Keyspace.java:305) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:129) > - locked <5318346c> (a java.lang.Class) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:106) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:262) > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:569) > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:697) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-14826) cassandra spinning forever on 1 thread while initializing keyspace
[ https://issues.apache.org/jira/browse/CASSANDRA-14826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16651666#comment-16651666 ] ingard mevåg commented on CASSANDRA-14826: -- [~krummas] yes. Sorry - bad wording. More specifically I was waiting 1 hour and 6 minutes when restarting a node today. > cassandra spinning forever on 1 thread while initializing keyspace > -- > > Key: CASSANDRA-14826 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14826 > Project: Cassandra > Issue Type: Bug >Reporter: ingard mevåg >Priority: Major > Attachments: Screen Shot 2018-10-16 at 14.51.27.png > > > When starting cassandra 3.0.17 it takes a long time to initialize a keyspace. > top shows 1 thread spinning at 100% cpu. Thread dump shows: > {code:java} > "main" - Thread t@1 > java.lang.Thread.State: RUNNABLE > at java.util.TimSort.mergeHi(TimSort.java:850) > at java.util.TimSort.mergeAt(TimSort.java:516) > at java.util.TimSort.mergeCollapse(TimSort.java:441) > at java.util.TimSort.sort(TimSort.java:245) > at java.util.Arrays.sort(Arrays.java:1512) > at java.util.ArrayList.sort(ArrayList.java:1454) > at java.util.Collections.sort(Collections.java:175) > at > org.apache.cassandra.db.compaction.LeveledManifest.canAddSSTable(LeveledManifest.java:243) > at > org.apache.cassandra.db.compaction.LeveledManifest.add(LeveledManifest.java:146) > - locked (a > org.apache.cassandra.db.compaction.LeveledManifest) > at > org.apache.cassandra.db.compaction.LeveledCompactionStrategy.addSSTable(LeveledCompactionStrategy.java:298) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.startup(CompactionStrategyManager.java:135) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.reload(CompactionStrategyManager.java:187) > - locked <742bfce7> (a > org.apache.cassandra.db.compaction.CompactionStrategyManager) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.(CompactionStrategyManager.java:75) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:408) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:363) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:579) > - locked <4e4f20d2> (a java.lang.Class) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:556) > at org.apache.cassandra.db.Keyspace.initCf(Keyspace.java:368) > at org.apache.cassandra.db.Keyspace.(Keyspace.java:305) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:129) > - locked <5318346c> (a java.lang.Class) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:106) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:262) > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:569) > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:697) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-14826) cassandra spinning forever on 1 thread while initializing keyspace
[ https://issues.apache.org/jira/browse/CASSANDRA-14826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16651670#comment-16651670 ] Marcus Eriksson commented on CASSANDRA-14826: - [~ingard] how many sstables do you have? > cassandra spinning forever on 1 thread while initializing keyspace > -- > > Key: CASSANDRA-14826 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14826 > Project: Cassandra > Issue Type: Bug >Reporter: ingard mevåg >Priority: Major > Attachments: Screen Shot 2018-10-16 at 14.51.27.png > > > When starting cassandra 3.0.17 it takes a long time to initialize a keyspace. > top shows 1 thread spinning at 100% cpu. Thread dump shows: > {code:java} > "main" - Thread t@1 > java.lang.Thread.State: RUNNABLE > at java.util.TimSort.mergeHi(TimSort.java:850) > at java.util.TimSort.mergeAt(TimSort.java:516) > at java.util.TimSort.mergeCollapse(TimSort.java:441) > at java.util.TimSort.sort(TimSort.java:245) > at java.util.Arrays.sort(Arrays.java:1512) > at java.util.ArrayList.sort(ArrayList.java:1454) > at java.util.Collections.sort(Collections.java:175) > at > org.apache.cassandra.db.compaction.LeveledManifest.canAddSSTable(LeveledManifest.java:243) > at > org.apache.cassandra.db.compaction.LeveledManifest.add(LeveledManifest.java:146) > - locked (a > org.apache.cassandra.db.compaction.LeveledManifest) > at > org.apache.cassandra.db.compaction.LeveledCompactionStrategy.addSSTable(LeveledCompactionStrategy.java:298) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.startup(CompactionStrategyManager.java:135) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.reload(CompactionStrategyManager.java:187) > - locked <742bfce7> (a > org.apache.cassandra.db.compaction.CompactionStrategyManager) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.(CompactionStrategyManager.java:75) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:408) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:363) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:579) > - locked <4e4f20d2> (a java.lang.Class) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:556) > at org.apache.cassandra.db.Keyspace.initCf(Keyspace.java:368) > at org.apache.cassandra.db.Keyspace.(Keyspace.java:305) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:129) > - locked <5318346c> (a java.lang.Class) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:106) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:262) > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:569) > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:697) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-14826) cassandra spinning forever on 1 thread while initializing keyspace
[ https://issues.apache.org/jira/browse/CASSANDRA-14826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16651728#comment-16651728 ] ingard mevåg commented on CASSANDRA-14826: -- [~krummas] $ /bin/ls |grep Data.db|wc -l 122133 > cassandra spinning forever on 1 thread while initializing keyspace > -- > > Key: CASSANDRA-14826 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14826 > Project: Cassandra > Issue Type: Bug >Reporter: ingard mevåg >Priority: Major > Attachments: Screen Shot 2018-10-16 at 14.51.27.png > > > When starting cassandra 3.0.17 it takes a long time to initialize a keyspace. > top shows 1 thread spinning at 100% cpu. Thread dump shows: > {code:java} > "main" - Thread t@1 > java.lang.Thread.State: RUNNABLE > at java.util.TimSort.mergeHi(TimSort.java:850) > at java.util.TimSort.mergeAt(TimSort.java:516) > at java.util.TimSort.mergeCollapse(TimSort.java:441) > at java.util.TimSort.sort(TimSort.java:245) > at java.util.Arrays.sort(Arrays.java:1512) > at java.util.ArrayList.sort(ArrayList.java:1454) > at java.util.Collections.sort(Collections.java:175) > at > org.apache.cassandra.db.compaction.LeveledManifest.canAddSSTable(LeveledManifest.java:243) > at > org.apache.cassandra.db.compaction.LeveledManifest.add(LeveledManifest.java:146) > - locked (a > org.apache.cassandra.db.compaction.LeveledManifest) > at > org.apache.cassandra.db.compaction.LeveledCompactionStrategy.addSSTable(LeveledCompactionStrategy.java:298) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.startup(CompactionStrategyManager.java:135) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.reload(CompactionStrategyManager.java:187) > - locked <742bfce7> (a > org.apache.cassandra.db.compaction.CompactionStrategyManager) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.(CompactionStrategyManager.java:75) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:408) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:363) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:579) > - locked <4e4f20d2> (a java.lang.Class) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:556) > at org.apache.cassandra.db.Keyspace.initCf(Keyspace.java:368) > at org.apache.cassandra.db.Keyspace.(Keyspace.java:305) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:129) > - locked <5318346c> (a java.lang.Class) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:106) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:262) > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:569) > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:697) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-14826) cassandra spinning forever on 1 thread while initializing keyspace
[ https://issues.apache.org/jira/browse/CASSANDRA-14826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16651742#comment-16651742 ] Marcus Eriksson commented on CASSANDRA-14826: - wow, do you have {{sstable_size_in_mb}} at 160? that would make it 20TB of data? > cassandra spinning forever on 1 thread while initializing keyspace > -- > > Key: CASSANDRA-14826 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14826 > Project: Cassandra > Issue Type: Bug >Reporter: ingard mevåg >Priority: Major > Attachments: Screen Shot 2018-10-16 at 14.51.27.png > > > When starting cassandra 3.0.17 it takes a long time to initialize a keyspace. > top shows 1 thread spinning at 100% cpu. Thread dump shows: > {code:java} > "main" - Thread t@1 > java.lang.Thread.State: RUNNABLE > at java.util.TimSort.mergeHi(TimSort.java:850) > at java.util.TimSort.mergeAt(TimSort.java:516) > at java.util.TimSort.mergeCollapse(TimSort.java:441) > at java.util.TimSort.sort(TimSort.java:245) > at java.util.Arrays.sort(Arrays.java:1512) > at java.util.ArrayList.sort(ArrayList.java:1454) > at java.util.Collections.sort(Collections.java:175) > at > org.apache.cassandra.db.compaction.LeveledManifest.canAddSSTable(LeveledManifest.java:243) > at > org.apache.cassandra.db.compaction.LeveledManifest.add(LeveledManifest.java:146) > - locked (a > org.apache.cassandra.db.compaction.LeveledManifest) > at > org.apache.cassandra.db.compaction.LeveledCompactionStrategy.addSSTable(LeveledCompactionStrategy.java:298) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.startup(CompactionStrategyManager.java:135) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.reload(CompactionStrategyManager.java:187) > - locked <742bfce7> (a > org.apache.cassandra.db.compaction.CompactionStrategyManager) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.(CompactionStrategyManager.java:75) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:408) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:363) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:579) > - locked <4e4f20d2> (a java.lang.Class) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:556) > at org.apache.cassandra.db.Keyspace.initCf(Keyspace.java:368) > at org.apache.cassandra.db.Keyspace.(Keyspace.java:305) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:129) > - locked <5318346c> (a java.lang.Class) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:106) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:262) > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:569) > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:697) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-14826) cassandra spinning forever on 1 thread while initializing keyspace
[ https://issues.apache.org/jira/browse/CASSANDRA-14826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16651772#comment-16651772 ] ingard mevåg commented on CASSANDRA-14826: -- Correct > cassandra spinning forever on 1 thread while initializing keyspace > -- > > Key: CASSANDRA-14826 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14826 > Project: Cassandra > Issue Type: Bug >Reporter: ingard mevåg >Priority: Major > Attachments: Screen Shot 2018-10-16 at 14.51.27.png > > > When starting cassandra 3.0.17 it takes a long time to initialize a keyspace. > top shows 1 thread spinning at 100% cpu. Thread dump shows: > {code:java} > "main" - Thread t@1 > java.lang.Thread.State: RUNNABLE > at java.util.TimSort.mergeHi(TimSort.java:850) > at java.util.TimSort.mergeAt(TimSort.java:516) > at java.util.TimSort.mergeCollapse(TimSort.java:441) > at java.util.TimSort.sort(TimSort.java:245) > at java.util.Arrays.sort(Arrays.java:1512) > at java.util.ArrayList.sort(ArrayList.java:1454) > at java.util.Collections.sort(Collections.java:175) > at > org.apache.cassandra.db.compaction.LeveledManifest.canAddSSTable(LeveledManifest.java:243) > at > org.apache.cassandra.db.compaction.LeveledManifest.add(LeveledManifest.java:146) > - locked (a > org.apache.cassandra.db.compaction.LeveledManifest) > at > org.apache.cassandra.db.compaction.LeveledCompactionStrategy.addSSTable(LeveledCompactionStrategy.java:298) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.startup(CompactionStrategyManager.java:135) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.reload(CompactionStrategyManager.java:187) > - locked <742bfce7> (a > org.apache.cassandra.db.compaction.CompactionStrategyManager) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.(CompactionStrategyManager.java:75) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:408) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:363) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:579) > - locked <4e4f20d2> (a java.lang.Class) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:556) > at org.apache.cassandra.db.Keyspace.initCf(Keyspace.java:368) > at org.apache.cassandra.db.Keyspace.(Keyspace.java:305) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:129) > - locked <5318346c> (a java.lang.Class) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:106) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:262) > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:569) > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:697) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-14826) cassandra spinning forever on 1 thread while initializing keyspace
[ https://issues.apache.org/jira/browse/CASSANDRA-14826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652988#comment-16652988 ] Kurt Greaves commented on CASSANDRA-14826: -- Cassandra doesn't do a great job of supporting such dense nodes. You probably want to add more nodes... > cassandra spinning forever on 1 thread while initializing keyspace > -- > > Key: CASSANDRA-14826 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14826 > Project: Cassandra > Issue Type: Bug >Reporter: ingard mevåg >Assignee: Marcus Eriksson >Priority: Major > Attachments: Screen Shot 2018-10-16 at 14.51.27.png > > > When starting cassandra 3.0.17 it takes a long time to initialize a keyspace. > top shows 1 thread spinning at 100% cpu. Thread dump shows: > {code:java} > "main" - Thread t@1 > java.lang.Thread.State: RUNNABLE > at java.util.TimSort.mergeHi(TimSort.java:850) > at java.util.TimSort.mergeAt(TimSort.java:516) > at java.util.TimSort.mergeCollapse(TimSort.java:441) > at java.util.TimSort.sort(TimSort.java:245) > at java.util.Arrays.sort(Arrays.java:1512) > at java.util.ArrayList.sort(ArrayList.java:1454) > at java.util.Collections.sort(Collections.java:175) > at > org.apache.cassandra.db.compaction.LeveledManifest.canAddSSTable(LeveledManifest.java:243) > at > org.apache.cassandra.db.compaction.LeveledManifest.add(LeveledManifest.java:146) > - locked (a > org.apache.cassandra.db.compaction.LeveledManifest) > at > org.apache.cassandra.db.compaction.LeveledCompactionStrategy.addSSTable(LeveledCompactionStrategy.java:298) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.startup(CompactionStrategyManager.java:135) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.reload(CompactionStrategyManager.java:187) > - locked <742bfce7> (a > org.apache.cassandra.db.compaction.CompactionStrategyManager) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.(CompactionStrategyManager.java:75) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:408) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:363) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:579) > - locked <4e4f20d2> (a java.lang.Class) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:556) > at org.apache.cassandra.db.Keyspace.initCf(Keyspace.java:368) > at org.apache.cassandra.db.Keyspace.(Keyspace.java:305) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:129) > - locked <5318346c> (a java.lang.Class) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:106) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:262) > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:569) > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:697) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-14826) cassandra spinning forever on 1 thread while initializing keyspace
[ https://issues.apache.org/jira/browse/CASSANDRA-14826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653500#comment-16653500 ] ingard mevåg commented on CASSANDRA-14826: -- [~KurtG] yeah sure. In this case we won't add any more nodes, and it works ok for the use case, but what should be improved is the single threaded whatever-is-going-on that takes over 1 hour on startup :) > cassandra spinning forever on 1 thread while initializing keyspace > -- > > Key: CASSANDRA-14826 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14826 > Project: Cassandra > Issue Type: Bug >Reporter: ingard mevåg >Assignee: Marcus Eriksson >Priority: Major > Attachments: Screen Shot 2018-10-16 at 14.51.27.png > > > When starting cassandra 3.0.17 it takes a long time to initialize a keyspace. > top shows 1 thread spinning at 100% cpu. Thread dump shows: > {code:java} > "main" - Thread t@1 > java.lang.Thread.State: RUNNABLE > at java.util.TimSort.mergeHi(TimSort.java:850) > at java.util.TimSort.mergeAt(TimSort.java:516) > at java.util.TimSort.mergeCollapse(TimSort.java:441) > at java.util.TimSort.sort(TimSort.java:245) > at java.util.Arrays.sort(Arrays.java:1512) > at java.util.ArrayList.sort(ArrayList.java:1454) > at java.util.Collections.sort(Collections.java:175) > at > org.apache.cassandra.db.compaction.LeveledManifest.canAddSSTable(LeveledManifest.java:243) > at > org.apache.cassandra.db.compaction.LeveledManifest.add(LeveledManifest.java:146) > - locked (a > org.apache.cassandra.db.compaction.LeveledManifest) > at > org.apache.cassandra.db.compaction.LeveledCompactionStrategy.addSSTable(LeveledCompactionStrategy.java:298) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.startup(CompactionStrategyManager.java:135) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.reload(CompactionStrategyManager.java:187) > - locked <742bfce7> (a > org.apache.cassandra.db.compaction.CompactionStrategyManager) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.(CompactionStrategyManager.java:75) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:408) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:363) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:579) > - locked <4e4f20d2> (a java.lang.Class) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:556) > at org.apache.cassandra.db.Keyspace.initCf(Keyspace.java:368) > at org.apache.cassandra.db.Keyspace.(Keyspace.java:305) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:129) > - locked <5318346c> (a java.lang.Class) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:106) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:262) > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:569) > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:697) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-14826) cassandra spinning forever on 1 thread while initializing keyspace
[ https://issues.apache.org/jira/browse/CASSANDRA-14826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16694797#comment-16694797 ] ingard mevåg commented on CASSANDRA-14826: -- [~krummas] Thanks for the work so far :) I'll try to make time to test this properly next week > cassandra spinning forever on 1 thread while initializing keyspace > -- > > Key: CASSANDRA-14826 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14826 > Project: Cassandra > Issue Type: Bug > Components: Lifecycle >Reporter: ingard mevåg >Assignee: Marcus Eriksson >Priority: Major > Fix For: 3.0.x, 3.11.x, 4.x > > Attachments: Screen Shot 2018-10-16 at 14.51.27.png > > > When starting cassandra 3.0.17 it takes a long time to initialize a keyspace. > top shows 1 thread spinning at 100% cpu. Thread dump shows: > {code:java} > "main" - Thread t@1 > java.lang.Thread.State: RUNNABLE > at java.util.TimSort.mergeHi(TimSort.java:850) > at java.util.TimSort.mergeAt(TimSort.java:516) > at java.util.TimSort.mergeCollapse(TimSort.java:441) > at java.util.TimSort.sort(TimSort.java:245) > at java.util.Arrays.sort(Arrays.java:1512) > at java.util.ArrayList.sort(ArrayList.java:1454) > at java.util.Collections.sort(Collections.java:175) > at > org.apache.cassandra.db.compaction.LeveledManifest.canAddSSTable(LeveledManifest.java:243) > at > org.apache.cassandra.db.compaction.LeveledManifest.add(LeveledManifest.java:146) > - locked (a > org.apache.cassandra.db.compaction.LeveledManifest) > at > org.apache.cassandra.db.compaction.LeveledCompactionStrategy.addSSTable(LeveledCompactionStrategy.java:298) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.startup(CompactionStrategyManager.java:135) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.reload(CompactionStrategyManager.java:187) > - locked <742bfce7> (a > org.apache.cassandra.db.compaction.CompactionStrategyManager) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.(CompactionStrategyManager.java:75) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:408) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:363) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:579) > - locked <4e4f20d2> (a java.lang.Class) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:556) > at org.apache.cassandra.db.Keyspace.initCf(Keyspace.java:368) > at org.apache.cassandra.db.Keyspace.(Keyspace.java:305) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:129) > - locked <5318346c> (a java.lang.Class) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:106) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:262) > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:569) > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:697) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-14826) cassandra spinning forever on 1 thread while initializing keyspace
[ https://issues.apache.org/jira/browse/CASSANDRA-14826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16707187#comment-16707187 ] ingard mevåg commented on CASSANDRA-14826: -- [~krummas] Hi. I'm ready to test the patch, but tbh I can't find a build anywhere and the tests failed? > cassandra spinning forever on 1 thread while initializing keyspace > -- > > Key: CASSANDRA-14826 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14826 > Project: Cassandra > Issue Type: Bug > Components: Lifecycle >Reporter: ingard mevåg >Assignee: Marcus Eriksson >Priority: Major > Fix For: 3.0.x, 3.11.x, 4.x > > Attachments: Screen Shot 2018-10-16 at 14.51.27.png > > > When starting cassandra 3.0.17 it takes a long time to initialize a keyspace. > top shows 1 thread spinning at 100% cpu. Thread dump shows: > {code:java} > "main" - Thread t@1 > java.lang.Thread.State: RUNNABLE > at java.util.TimSort.mergeHi(TimSort.java:850) > at java.util.TimSort.mergeAt(TimSort.java:516) > at java.util.TimSort.mergeCollapse(TimSort.java:441) > at java.util.TimSort.sort(TimSort.java:245) > at java.util.Arrays.sort(Arrays.java:1512) > at java.util.ArrayList.sort(ArrayList.java:1454) > at java.util.Collections.sort(Collections.java:175) > at > org.apache.cassandra.db.compaction.LeveledManifest.canAddSSTable(LeveledManifest.java:243) > at > org.apache.cassandra.db.compaction.LeveledManifest.add(LeveledManifest.java:146) > - locked (a > org.apache.cassandra.db.compaction.LeveledManifest) > at > org.apache.cassandra.db.compaction.LeveledCompactionStrategy.addSSTable(LeveledCompactionStrategy.java:298) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.startup(CompactionStrategyManager.java:135) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.reload(CompactionStrategyManager.java:187) > - locked <742bfce7> (a > org.apache.cassandra.db.compaction.CompactionStrategyManager) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.(CompactionStrategyManager.java:75) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:408) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:363) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:579) > - locked <4e4f20d2> (a java.lang.Class) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:556) > at org.apache.cassandra.db.Keyspace.initCf(Keyspace.java:368) > at org.apache.cassandra.db.Keyspace.(Keyspace.java:305) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:129) > - locked <5318346c> (a java.lang.Class) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:106) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:262) > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:569) > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:697) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-14826) cassandra spinning forever on 1 thread while initializing keyspace
[ https://issues.apache.org/jira/browse/CASSANDRA-14826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16707197#comment-16707197 ] Marcus Eriksson commented on CASSANDRA-14826: - [~ingard] none of the failures look related (and at least a few have been fixed since the tests were run) I was hoping you had a staging environment or similar where you could manually build and try it out > cassandra spinning forever on 1 thread while initializing keyspace > -- > > Key: CASSANDRA-14826 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14826 > Project: Cassandra > Issue Type: Bug > Components: Lifecycle >Reporter: ingard mevåg >Assignee: Marcus Eriksson >Priority: Major > Fix For: 3.0.x, 3.11.x, 4.x > > Attachments: Screen Shot 2018-10-16 at 14.51.27.png > > > When starting cassandra 3.0.17 it takes a long time to initialize a keyspace. > top shows 1 thread spinning at 100% cpu. Thread dump shows: > {code:java} > "main" - Thread t@1 > java.lang.Thread.State: RUNNABLE > at java.util.TimSort.mergeHi(TimSort.java:850) > at java.util.TimSort.mergeAt(TimSort.java:516) > at java.util.TimSort.mergeCollapse(TimSort.java:441) > at java.util.TimSort.sort(TimSort.java:245) > at java.util.Arrays.sort(Arrays.java:1512) > at java.util.ArrayList.sort(ArrayList.java:1454) > at java.util.Collections.sort(Collections.java:175) > at > org.apache.cassandra.db.compaction.LeveledManifest.canAddSSTable(LeveledManifest.java:243) > at > org.apache.cassandra.db.compaction.LeveledManifest.add(LeveledManifest.java:146) > - locked (a > org.apache.cassandra.db.compaction.LeveledManifest) > at > org.apache.cassandra.db.compaction.LeveledCompactionStrategy.addSSTable(LeveledCompactionStrategy.java:298) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.startup(CompactionStrategyManager.java:135) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.reload(CompactionStrategyManager.java:187) > - locked <742bfce7> (a > org.apache.cassandra.db.compaction.CompactionStrategyManager) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.(CompactionStrategyManager.java:75) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:408) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:363) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:579) > - locked <4e4f20d2> (a java.lang.Class) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:556) > at org.apache.cassandra.db.Keyspace.initCf(Keyspace.java:368) > at org.apache.cassandra.db.Keyspace.(Keyspace.java:305) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:129) > - locked <5318346c> (a java.lang.Class) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:106) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:262) > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:569) > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:697) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-14826) cassandra spinning forever on 1 thread while initializing keyspace
[ https://issues.apache.org/jira/browse/CASSANDRA-14826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16707261#comment-16707261 ] ingard mevåg commented on CASSANDRA-14826: -- [~krummas] The results are in : [Mon Dec 3 15:07:46 2018] Out of memory: Kill process 14400 (java) score 526 or sacrifice child :( > cassandra spinning forever on 1 thread while initializing keyspace > -- > > Key: CASSANDRA-14826 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14826 > Project: Cassandra > Issue Type: Bug > Components: Lifecycle >Reporter: ingard mevåg >Assignee: Marcus Eriksson >Priority: Major > Fix For: 3.0.x, 3.11.x, 4.x > > Attachments: Screen Shot 2018-10-16 at 14.51.27.png > > > When starting cassandra 3.0.17 it takes a long time to initialize a keyspace. > top shows 1 thread spinning at 100% cpu. Thread dump shows: > {code:java} > "main" - Thread t@1 > java.lang.Thread.State: RUNNABLE > at java.util.TimSort.mergeHi(TimSort.java:850) > at java.util.TimSort.mergeAt(TimSort.java:516) > at java.util.TimSort.mergeCollapse(TimSort.java:441) > at java.util.TimSort.sort(TimSort.java:245) > at java.util.Arrays.sort(Arrays.java:1512) > at java.util.ArrayList.sort(ArrayList.java:1454) > at java.util.Collections.sort(Collections.java:175) > at > org.apache.cassandra.db.compaction.LeveledManifest.canAddSSTable(LeveledManifest.java:243) > at > org.apache.cassandra.db.compaction.LeveledManifest.add(LeveledManifest.java:146) > - locked (a > org.apache.cassandra.db.compaction.LeveledManifest) > at > org.apache.cassandra.db.compaction.LeveledCompactionStrategy.addSSTable(LeveledCompactionStrategy.java:298) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.startup(CompactionStrategyManager.java:135) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.reload(CompactionStrategyManager.java:187) > - locked <742bfce7> (a > org.apache.cassandra.db.compaction.CompactionStrategyManager) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.(CompactionStrategyManager.java:75) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:408) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:363) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:579) > - locked <4e4f20d2> (a java.lang.Class) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:556) > at org.apache.cassandra.db.Keyspace.initCf(Keyspace.java:368) > at org.apache.cassandra.db.Keyspace.(Keyspace.java:305) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:129) > - locked <5318346c> (a java.lang.Class) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:106) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:262) > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:569) > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:697) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-14826) cassandra spinning forever on 1 thread while initializing keyspace
[ https://issues.apache.org/jira/browse/CASSANDRA-14826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16707276#comment-16707276 ] Marcus Eriksson commented on CASSANDRA-14826: - [~ingard] how far did it get in the cassandra logs? > cassandra spinning forever on 1 thread while initializing keyspace > -- > > Key: CASSANDRA-14826 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14826 > Project: Cassandra > Issue Type: Bug > Components: Lifecycle >Reporter: ingard mevåg >Assignee: Marcus Eriksson >Priority: Major > Fix For: 3.0.x, 3.11.x, 4.x > > Attachments: Screen Shot 2018-10-16 at 14.51.27.png > > > When starting cassandra 3.0.17 it takes a long time to initialize a keyspace. > top shows 1 thread spinning at 100% cpu. Thread dump shows: > {code:java} > "main" - Thread t@1 > java.lang.Thread.State: RUNNABLE > at java.util.TimSort.mergeHi(TimSort.java:850) > at java.util.TimSort.mergeAt(TimSort.java:516) > at java.util.TimSort.mergeCollapse(TimSort.java:441) > at java.util.TimSort.sort(TimSort.java:245) > at java.util.Arrays.sort(Arrays.java:1512) > at java.util.ArrayList.sort(ArrayList.java:1454) > at java.util.Collections.sort(Collections.java:175) > at > org.apache.cassandra.db.compaction.LeveledManifest.canAddSSTable(LeveledManifest.java:243) > at > org.apache.cassandra.db.compaction.LeveledManifest.add(LeveledManifest.java:146) > - locked (a > org.apache.cassandra.db.compaction.LeveledManifest) > at > org.apache.cassandra.db.compaction.LeveledCompactionStrategy.addSSTable(LeveledCompactionStrategy.java:298) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.startup(CompactionStrategyManager.java:135) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.reload(CompactionStrategyManager.java:187) > - locked <742bfce7> (a > org.apache.cassandra.db.compaction.CompactionStrategyManager) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.(CompactionStrategyManager.java:75) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:408) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:363) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:579) > - locked <4e4f20d2> (a java.lang.Class) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:556) > at org.apache.cassandra.db.Keyspace.initCf(Keyspace.java:368) > at org.apache.cassandra.db.Keyspace.(Keyspace.java:305) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:129) > - locked <5318346c> (a java.lang.Class) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:106) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:262) > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:569) > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:697) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-14826) cassandra spinning forever on 1 thread while initializing keyspace
[ https://issues.apache.org/jira/browse/CASSANDRA-14826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16707308#comment-16707308 ] ingard mevåg commented on CASSANDRA-14826: -- I tried to stop and start it a few more times. I'm not sure what caused the OOM at first, but the 2 more tries works just fine and the startup time is pretty good :) INFO [main] 2018-12-03 15:31:19,841 YamlConfigurationLoader.java:85 - Configuration location: file:/etc/cassandra/cassandra.yaml . . INFO [Thread-7] 2018-12-03 15:33:26,403 ThriftServer.java:136 - Listening for thrift clients... so I'd say great success :) [~krummas] > cassandra spinning forever on 1 thread while initializing keyspace > -- > > Key: CASSANDRA-14826 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14826 > Project: Cassandra > Issue Type: Bug > Components: Lifecycle >Reporter: ingard mevåg >Assignee: Marcus Eriksson >Priority: Major > Fix For: 3.0.x, 3.11.x, 4.x > > Attachments: Screen Shot 2018-10-16 at 14.51.27.png > > > When starting cassandra 3.0.17 it takes a long time to initialize a keyspace. > top shows 1 thread spinning at 100% cpu. Thread dump shows: > {code:java} > "main" - Thread t@1 > java.lang.Thread.State: RUNNABLE > at java.util.TimSort.mergeHi(TimSort.java:850) > at java.util.TimSort.mergeAt(TimSort.java:516) > at java.util.TimSort.mergeCollapse(TimSort.java:441) > at java.util.TimSort.sort(TimSort.java:245) > at java.util.Arrays.sort(Arrays.java:1512) > at java.util.ArrayList.sort(ArrayList.java:1454) > at java.util.Collections.sort(Collections.java:175) > at > org.apache.cassandra.db.compaction.LeveledManifest.canAddSSTable(LeveledManifest.java:243) > at > org.apache.cassandra.db.compaction.LeveledManifest.add(LeveledManifest.java:146) > - locked (a > org.apache.cassandra.db.compaction.LeveledManifest) > at > org.apache.cassandra.db.compaction.LeveledCompactionStrategy.addSSTable(LeveledCompactionStrategy.java:298) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.startup(CompactionStrategyManager.java:135) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.reload(CompactionStrategyManager.java:187) > - locked <742bfce7> (a > org.apache.cassandra.db.compaction.CompactionStrategyManager) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.(CompactionStrategyManager.java:75) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:408) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:363) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:579) > - locked <4e4f20d2> (a java.lang.Class) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:556) > at org.apache.cassandra.db.Keyspace.initCf(Keyspace.java:368) > at org.apache.cassandra.db.Keyspace.(Keyspace.java:305) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:129) > - locked <5318346c> (a java.lang.Class) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:106) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:262) > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:569) > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:697) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-14826) cassandra spinning forever on 1 thread while initializing keyspace
[ https://issues.apache.org/jira/browse/CASSANDRA-14826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16707344#comment-16707344 ] Marcus Eriksson commented on CASSANDRA-14826: - [~ingard] cool, thanks for testing, I'll get it reviewed and committed > cassandra spinning forever on 1 thread while initializing keyspace > -- > > Key: CASSANDRA-14826 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14826 > Project: Cassandra > Issue Type: Bug > Components: Lifecycle >Reporter: ingard mevåg >Assignee: Marcus Eriksson >Priority: Major > Fix For: 3.0.x, 3.11.x, 4.x > > Attachments: Screen Shot 2018-10-16 at 14.51.27.png > > > When starting cassandra 3.0.17 it takes a long time to initialize a keyspace. > top shows 1 thread spinning at 100% cpu. Thread dump shows: > {code:java} > "main" - Thread t@1 > java.lang.Thread.State: RUNNABLE > at java.util.TimSort.mergeHi(TimSort.java:850) > at java.util.TimSort.mergeAt(TimSort.java:516) > at java.util.TimSort.mergeCollapse(TimSort.java:441) > at java.util.TimSort.sort(TimSort.java:245) > at java.util.Arrays.sort(Arrays.java:1512) > at java.util.ArrayList.sort(ArrayList.java:1454) > at java.util.Collections.sort(Collections.java:175) > at > org.apache.cassandra.db.compaction.LeveledManifest.canAddSSTable(LeveledManifest.java:243) > at > org.apache.cassandra.db.compaction.LeveledManifest.add(LeveledManifest.java:146) > - locked (a > org.apache.cassandra.db.compaction.LeveledManifest) > at > org.apache.cassandra.db.compaction.LeveledCompactionStrategy.addSSTable(LeveledCompactionStrategy.java:298) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.startup(CompactionStrategyManager.java:135) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.reload(CompactionStrategyManager.java:187) > - locked <742bfce7> (a > org.apache.cassandra.db.compaction.CompactionStrategyManager) > at > org.apache.cassandra.db.compaction.CompactionStrategyManager.(CompactionStrategyManager.java:75) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:408) > at > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:363) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:579) > - locked <4e4f20d2> (a java.lang.Class) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:556) > at org.apache.cassandra.db.Keyspace.initCf(Keyspace.java:368) > at org.apache.cassandra.db.Keyspace.(Keyspace.java:305) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:129) > - locked <5318346c> (a java.lang.Class) > at org.apache.cassandra.db.Keyspace.open(Keyspace.java:106) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:262) > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:569) > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:697) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org