Re: Error during startup - java.lang.OutOfMemoryError: unable to create new native thread

[srmore]

Was too fast on the send button, sorry.
The thing I wanted to add was the

pending signals (-i) 515038

that looks odd to me, could that be related.



On Thu, Sep 19, 2013 at 4:53 PM, srmore  wrote:

>
> I hit this issue again today and looks like changing -Xss option does not
> work :(
> I am on 1.0.11 (I know its old, we are upgrading to 1.2.9 right now) and
> have about 800-900GB of data. I can see cassandra is spending a lot of time
> reading the data files before it quits with  "java.lang.OutOfMemoryError:
> unable to create new native thread" error.
>
> My hard and soft limits seems to be ok as well
> Datastax recommends [1]
>
> * soft nofile 32768
> * hard nofile 32768
>
>
> and I have
> hardnofile 65536
> softnofile 65536
>
> My ulimit -u output is 515038 (which again should be sufficient)
>
> complete output
>
> ulimit -a
> core file size  (blocks, -c)0
> data seg size   (kbytes, -d)  unlimited
> scheduling priority (-e) 0
> file size   (blocks, -f) unlimited
> pending signals (-i) 515038
> max locked memory   (kbytes, -l) 32
> max memory size (kbytes, -m) unlimited
> open files  (-n) 1024
> pipe size(512 bytes, -p) 8
> POSIX message queues (bytes, -q) 819200
> real-time priority  (-r) 0
> stack size  (kbytes, -s) 10240
> cpu time   (seconds, -t) unlimited
> max user processes  (-u) 515038
> virtual memory  (kbytes, -v) unlimited
> file locks  (-x) unlimited
>
>
>
>
> Has anyone run into this ?
>
> [1] http://www.datastax.com/docs/1.1/troubleshooting/index
>
> On Wed, Sep 11, 2013 at 8:47 AM, srmore  wrote:
>
>> Thanks Viktor,
>>
>>
>> - check (cassandra-env.sh) -Xss size, you may need to increase it for
>> your JVM;
>>
>> This seems to have done the trick !
>>
>> Thanks !
>>
>>
>> On Tue, Sep 10, 2013 at 12:46 AM, Viktor Jevdokimov <
>> viktor.jevdoki...@adform.com> wrote:
>>
>>>  For start:
>>>
>>> - check (cassandra-env.sh) -Xss size, you may need to increase it for
>>> your JVM;
>>>
>>> - check (cassandra-env.sh) -Xms and -Xmx size, you may need to increase
>>> it for your data load/bloom filter/index sizes.
>>>
>>> ** **
>>>
>>> ** **
>>>
>>> ** **
>>>Best regards / Pagarbiai
>>> *Viktor Jevdokimov*
>>> Senior Developer
>>>
>>>  [image: Adform News] 
>>>
>>> *Visit us at Dmexco: *Hall 6 Stand B-52
>>> September 18-19 Cologne, Germany
>>> Email: viktor.jevdoki...@adform.com
>>> Phone: +370 5 212 3063, Fax +370 5 261 0453
>>> J. Jasinskio 16C, LT-03163 Vilnius, Lithuania
>>> Follow us on Twitter: @adforminsider
>>> Take a ride with Adform's Rich Media 
>>> Suite
>>>  [image: Dmexco 2013] 
>>>
>>> Disclaimer: The information contained in this message and attachments is
>>> intended solely for the attention and use of the named addressee and may be
>>> confidential. If you are not the intended recipient, you are reminded that
>>> the information remains the property of the sender. You must not use,
>>> disclose, distribute, copy, print or rely on this e-mail. If you have
>>> received this message in error, please contact the sender immediately and
>>> irrevocably delete this message and any copies.
>>>
>>> *From:* srmore [mailto:comom...@gmail.com]
>>> *Sent:* Tuesday, September 10, 2013 6:16 AM
>>> *To:* user@cassandra.apache.org
>>> *Subject:* Error during startup - java.lang.OutOfMemoryError: unable to
>>> create new native thread [heur]
>>>
>>> ** **
>>>
>>>
>>> I have a 5 node cluster with a load of around 300GB each. A node went
>>> down and does not come up. I can see the following exception in the logs.
>>>
>>> ERROR [main] 2013-09-09 21:50:56,117 AbstractCassandraDaemon.java (line
>>> 139) Fatal exception in thread Thread[main,5,main]
>>> java.lang.OutOfMemoryError: unable to create new native thread
>>> at java.lang.Thread.start0(Native Method)
>>> at java.lang.Thread.start(Thread.java:640)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor.addIfUnderCorePoolSize(ThreadPoolExecutor.java:703)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor.prestartAllCoreThreads(ThreadPoolExecutor.java:1392)
>>> at
>>> org.apache.cassandra.concurrent.JMXEnabledThreadPoolExecutor.(JMXEnabledThreadPoolExecutor.java:77)
>>> at
>>> org.apache.cassandra.concurrent.JMXEnabledThreadPoolExecutor.(JMXEnabledThreadPoolExecutor.java:65)
>>> at
>>> org.apache.cassandra.concurrent.JMXConfigurableThreadPoolExecutor.(JMXConfigurableThreadPoolExecutor.java:34)
>>> at
>>> org.apache.cassandra.concurrent.StageManager.multiThreadedConfigurableStage(StageManager.java:68)
>>> at
>>> org.apache.cassandra.concurrent.StageManager.(StageManager.java:42)
>>> at
>>>

Re: Error during startup - java.lang.OutOfMemoryError: unable to create new native thread

[srmore]

I hit this issue again today and looks like changing -Xss option does not
work :(
I am on 1.0.11 (I know its old, we are upgrading to 1.2.9 right now) and
have about 800-900GB of data. I can see cassandra is spending a lot of time
reading the data files before it quits with  "java.lang.OutOfMemoryError:
unable to create new native thread" error.

My hard and soft limits seems to be ok as well
Datastax recommends [1]

* soft nofile 32768
* hard nofile 32768


and I have
hardnofile 65536
softnofile 65536

My ulimit -u output is 515038 (which again should be sufficient)

complete output

ulimit -a
core file size  (blocks, -c)0
data seg size   (kbytes, -d)  unlimited
scheduling priority (-e) 0
file size   (blocks, -f) unlimited
pending signals (-i) 515038
max locked memory   (kbytes, -l) 32
max memory size (kbytes, -m) unlimited
open files  (-n) 1024
pipe size(512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority  (-r) 0
stack size  (kbytes, -s) 10240
cpu time   (seconds, -t) unlimited
max user processes  (-u) 515038
virtual memory  (kbytes, -v) unlimited
file locks  (-x) unlimited




Has anyone run into this ?

[1] http://www.datastax.com/docs/1.1/troubleshooting/index

On Wed, Sep 11, 2013 at 8:47 AM, srmore  wrote:

> Thanks Viktor,
>
>
> - check (cassandra-env.sh) -Xss size, you may need to increase it for your
> JVM;
>
> This seems to have done the trick !
>
> Thanks !
>
>
> On Tue, Sep 10, 2013 at 12:46 AM, Viktor Jevdokimov <
> viktor.jevdoki...@adform.com> wrote:
>
>>  For start:
>>
>> - check (cassandra-env.sh) -Xss size, you may need to increase it for
>> your JVM;
>>
>> - check (cassandra-env.sh) -Xms and -Xmx size, you may need to increase
>> it for your data load/bloom filter/index sizes.
>>
>> ** **
>>
>> ** **
>>
>> ** **
>>Best regards / Pagarbiai
>> *Viktor Jevdokimov*
>> Senior Developer
>>
>>  [image: Adform News] 
>>
>> *Visit us at Dmexco: *Hall 6 Stand B-52
>> September 18-19 Cologne, Germany
>> Email: viktor.jevdoki...@adform.com
>> Phone: +370 5 212 3063, Fax +370 5 261 0453
>> J. Jasinskio 16C, LT-03163 Vilnius, Lithuania
>> Follow us on Twitter: @adforminsider
>> Take a ride with Adform's Rich Media Suite
>>  [image: Dmexco 2013] 
>>
>> Disclaimer: The information contained in this message and attachments is
>> intended solely for the attention and use of the named addressee and may be
>> confidential. If you are not the intended recipient, you are reminded that
>> the information remains the property of the sender. You must not use,
>> disclose, distribute, copy, print or rely on this e-mail. If you have
>> received this message in error, please contact the sender immediately and
>> irrevocably delete this message and any copies.
>>
>> *From:* srmore [mailto:comom...@gmail.com]
>> *Sent:* Tuesday, September 10, 2013 6:16 AM
>> *To:* user@cassandra.apache.org
>> *Subject:* Error during startup - java.lang.OutOfMemoryError: unable to
>> create new native thread [heur]
>>
>> ** **
>>
>>
>> I have a 5 node cluster with a load of around 300GB each. A node went
>> down and does not come up. I can see the following exception in the logs.
>>
>> ERROR [main] 2013-09-09 21:50:56,117 AbstractCassandraDaemon.java (line
>> 139) Fatal exception in thread Thread[main,5,main]
>> java.lang.OutOfMemoryError: unable to create new native thread
>> at java.lang.Thread.start0(Native Method)
>> at java.lang.Thread.start(Thread.java:640)
>> at
>> java.util.concurrent.ThreadPoolExecutor.addIfUnderCorePoolSize(ThreadPoolExecutor.java:703)
>> at
>> java.util.concurrent.ThreadPoolExecutor.prestartAllCoreThreads(ThreadPoolExecutor.java:1392)
>> at
>> org.apache.cassandra.concurrent.JMXEnabledThreadPoolExecutor.(JMXEnabledThreadPoolExecutor.java:77)
>> at
>> org.apache.cassandra.concurrent.JMXEnabledThreadPoolExecutor.(JMXEnabledThreadPoolExecutor.java:65)
>> at
>> org.apache.cassandra.concurrent.JMXConfigurableThreadPoolExecutor.(JMXConfigurableThreadPoolExecutor.java:34)
>> at
>> org.apache.cassandra.concurrent.StageManager.multiThreadedConfigurableStage(StageManager.java:68)
>> at
>> org.apache.cassandra.concurrent.StageManager.(StageManager.java:42)
>> at
>> org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:344)
>> at
>> org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:173)**
>> **
>>
>> ** **
>>
>> The *ulimit -u* output is
>> *515042*
>>
>> Which is far more than what is recommended [1] (10240) and I am skeptical
>> to set it to unlimited as recommended here [2]
>>
>> Any pointers as to wh

Re: Error during startup - java.lang.OutOfMemoryError: unable to create new native thread

[srmore]

Thanks Viktor,

- check (cassandra-env.sh) -Xss size, you may need to increase it for your
JVM;

This seems to have done the trick !

Thanks !


On Tue, Sep 10, 2013 at 12:46 AM, Viktor Jevdokimov <
viktor.jevdoki...@adform.com> wrote:

>  For start:
>
> - check (cassandra-env.sh) -Xss size, you may need to increase it for your
> JVM;
>
> - check (cassandra-env.sh) -Xms and -Xmx size, you may need to increase it
> for your data load/bloom filter/index sizes.
>
> ** **
>
> ** **
>
> ** **
>Best regards / Pagarbiai
> *Viktor Jevdokimov*
> Senior Developer
>
>  [image: Adform News] 
>
> *Visit us at Dmexco: *Hall 6 Stand B-52
> September 18-19 Cologne, Germany
> Email: viktor.jevdoki...@adform.com
> Phone: +370 5 212 3063, Fax +370 5 261 0453
> J. Jasinskio 16C, LT-03163 Vilnius, Lithuania
> Follow us on Twitter: @adforminsider 
> Take a ride with Adform's Rich Media Suite
>  [image: Dmexco 2013] 
>
> Disclaimer: The information contained in this message and attachments is
> intended solely for the attention and use of the named addressee and may be
> confidential. If you are not the intended recipient, you are reminded that
> the information remains the property of the sender. You must not use,
> disclose, distribute, copy, print or rely on this e-mail. If you have
> received this message in error, please contact the sender immediately and
> irrevocably delete this message and any copies.
>
> *From:* srmore [mailto:comom...@gmail.com]
> *Sent:* Tuesday, September 10, 2013 6:16 AM
> *To:* user@cassandra.apache.org
> *Subject:* Error during startup - java.lang.OutOfMemoryError: unable to
> create new native thread [heur]
>
> ** **
>
>
> I have a 5 node cluster with a load of around 300GB each. A node went down
> and does not come up. I can see the following exception in the logs.
>
> ERROR [main] 2013-09-09 21:50:56,117 AbstractCassandraDaemon.java (line
> 139) Fatal exception in thread Thread[main,5,main]
> java.lang.OutOfMemoryError: unable to create new native thread
> at java.lang.Thread.start0(Native Method)
> at java.lang.Thread.start(Thread.java:640)
> at
> java.util.concurrent.ThreadPoolExecutor.addIfUnderCorePoolSize(ThreadPoolExecutor.java:703)
> at
> java.util.concurrent.ThreadPoolExecutor.prestartAllCoreThreads(ThreadPoolExecutor.java:1392)
> at
> org.apache.cassandra.concurrent.JMXEnabledThreadPoolExecutor.(JMXEnabledThreadPoolExecutor.java:77)
> at
> org.apache.cassandra.concurrent.JMXEnabledThreadPoolExecutor.(JMXEnabledThreadPoolExecutor.java:65)
> at
> org.apache.cassandra.concurrent.JMXConfigurableThreadPoolExecutor.(JMXConfigurableThreadPoolExecutor.java:34)
> at
> org.apache.cassandra.concurrent.StageManager.multiThreadedConfigurableStage(StageManager.java:68)
> at
> org.apache.cassandra.concurrent.StageManager.(StageManager.java:42)
> at
> org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:344)
> at
> org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:173)***
> *
>
> ** **
>
> The *ulimit -u* output is
> *515042*
>
> Which is far more than what is recommended [1] (10240) and I am skeptical
> to set it to unlimited as recommended here [2]
>
> Any pointers as to what could be the issue and how to get the node up.
>
>
>
>
> [1]
> http://www.datastax.com/documentation/cassandra/1.2/webhelp/index.html?pagename=docs&version=1.2&file=install/recommended_settings#cassandra/install/installRecommendSettings.html
>
> [2]
> http://mail-archives.apache.org/mod_mbox/cassandra-user/201303.mbox/%3CCAPqEvGE474Omea1BFLJ6U_pbAkOwWxk=dwo35_pc-atwb4_...@mail.gmail.com%3E
> 
>
> Thanks !
>
<><>

RE: Error during startup - java.lang.OutOfMemoryError: unable to create new native thread

[Viktor Jevdokimov]

For start:
- check (cassandra-env.sh) -Xss size, you may need to increase it for your JVM;
- check (cassandra-env.sh) -Xms and -Xmx size, you may need to increase it for 
your data load/bloom filter/index sizes.



Best regards / Pagarbiai
Viktor Jevdokimov
Senior Developer


[Adform News] 

Visit us at Dmexco: Hall 6 Stand B-52
September 18-19 Cologne, Germany


Email: viktor.jevdoki...@adform.com
Phone: +370 5 212 3063, Fax +370 5 261 0453
J. Jasinskio 16C, LT-03163 Vilnius, Lithuania
Follow us on Twitter: @adforminsider
Take a ride with Adform's Rich Media Suite

[Dmexco 2013] 


Disclaimer: The information contained in this message and attachments is 
intended solely for the attention and use of the named addressee and may be 
confidential. If you are not the intended recipient, you are reminded that the 
information remains the property of the sender. You must not use, disclose, 
distribute, copy, print or rely on this e-mail. If you have received this 
message in error, please contact the sender immediately and irrevocably delete 
this message and any copies.

From: srmore [mailto:comom...@gmail.com]
Sent: Tuesday, September 10, 2013 6:16 AM
To: user@cassandra.apache.org
Subject: Error during startup - java.lang.OutOfMemoryError: unable to create 
new native thread [heur]


I have a 5 node cluster with a load of around 300GB each. A node went down and 
does not come up. I can see the following exception in the logs.

ERROR [main] 2013-09-09 21:50:56,117 AbstractCassandraDaemon.java (line 139) 
Fatal exception in thread Thread[main,5,main]
java.lang.OutOfMemoryError: unable to create new native thread
at java.lang.Thread.start0(Native Method)
at java.lang.Thread.start(Thread.java:640)
at 
java.util.concurrent.ThreadPoolExecutor.addIfUnderCorePoolSize(ThreadPoolExecutor.java:703)
at 
java.util.concurrent.ThreadPoolExecutor.prestartAllCoreThreads(ThreadPoolExecutor.java:1392)
at 
org.apache.cassandra.concurrent.JMXEnabledThreadPoolExecutor.(JMXEnabledThreadPoolExecutor.java:77)
at 
org.apache.cassandra.concurrent.JMXEnabledThreadPoolExecutor.(JMXEnabledThreadPoolExecutor.java:65)
at 
org.apache.cassandra.concurrent.JMXConfigurableThreadPoolExecutor.(JMXConfigurableThreadPoolExecutor.java:34)
at 
org.apache.cassandra.concurrent.StageManager.multiThreadedConfigurableStage(StageManager.java:68)
at 
org.apache.cassandra.concurrent.StageManager.(StageManager.java:42)
at 
org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:344)
at 
org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:173)

The ulimit -u output is
515042
Which is far more than what is recommended [1] (10240) and I am skeptical to 
set it to unlimited as recommended here [2]
Any pointers as to what could be the issue and how to get the node up.



[1] 
http://www.datastax.com/documentation/cassandra/1.2/webhelp/index.html?pagename=docs&version=1.2&file=install/recommended_settings#cassandra/install/installRecommendSettings.html

[2] 
http://mail-archives.apache.org/mod_mbox/cassandra-user/201303.mbox/%3CCAPqEvGE474Omea1BFLJ6U_pbAkOwWxk=dwo35_pc-atwb4_...@mail.gmail.com%3E
Thanks !
<><>

Re: Error during startup

[David Boxenhorn]

We didn't change partitioners.

Maybe we did some other stupid thing, but not that one.


On Wed, Jun 2, 2010 at 8:52 PM, Gary Dusbabek  wrote:

> I was able to reproduce the error by staring up a node using
> RandomPartioner, kill it, switch to OrderPreservingPartitioner,
> restart, kill, switch back to RandomPartitioner, BANG!
>
> So it looks like you tinkered with the partitioner at some point.
> This has the unfortunate effect of corrupting your system table.  I'm
> trying to figure out a way to detect this and abort before data is
> overwritten.
>
> Gary.
>
>
> On Sun, May 30, 2010 at 06:49, David Boxenhorn  wrote:
> > I deleted the system/LocationInfo files, and now everything works.
> >
> > Yay! (...what happened?)
> >
> > On Sun, May 30, 2010 at 4:18 PM, David Boxenhorn 
> wrote:
> >>
> >> I'm getting an "Expected both token and generation columns; found
> >> ColumnFamily" error during startup can anyone tell me what it is?
> Details
> >> below.
> >>
> >> Starting Cassandra Server
> >> Listening for transport dt_socket at address: 
> >>  INFO 16:14:33,459 Auto DiskAccessMode determined to be standard
> >>  INFO 16:14:33,615 Sampling index for
> >> C:\var\lib\cassandra\data\system\LocationInfo-1-Data.db
> >>  INFO 16:14:33,631 Removing orphan
> >> C:\var\lib\cassandra\data\Lookin2\Users-tmp-27-Index.db
> >>  INFO 16:14:33,631 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Users-19-Data.db
> >>  INFO 16:14:33,662 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Users-18-Data.db
> >>  INFO 16:14:33,818 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Users-20-Data.db
> >>  INFO 16:14:33,850 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Users-21-Data.db
> >>  INFO 16:14:33,865 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Users-22-Data.db
> >>  INFO 16:14:33,881 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-580-Data.db
> >>  INFO 16:14:33,896 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-672-Data.db
> >>  INFO 16:14:33,912 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-681-Data.db
> >>  INFO 16:14:33,912 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-691-Data.db
> >>  INFO 16:14:33,928 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-696-Data.db
> >>  INFO 16:14:33,943 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Attractions-17-Data.db
> >>  INFO 16:14:34,006 Sampling index for
> >>
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestTrendsetterIdx-5-Data.db
> >>  INFO 16:14:34,006 Sampling index for
> >>
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestTrendsetterIdx-6-Data.db
> >>  INFO 16:14:34,021 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-29-Data.db
> >>  INFO 16:14:34,350 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-51-Data.db
> >>  INFO 16:14:34,693 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-72-Data.db
> >>  INFO 16:14:35,021 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-77-Data.db
> >>  INFO 16:14:35,225 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-78-Data.db
> >>  INFO 16:14:35,350 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-79-Data.db
> >>  INFO 16:14:35,459 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-80-Data.db
> >>  INFO 16:14:35,459 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Taxonomy-1-Data.db
> >>  INFO 16:14:35,475 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Taxonomy-2-Data.db
> >>  INFO 16:14:35,475 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Content-30-Data.db
> >>  INFO 16:14:35,631 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Content-35-Data.db
> >>  INFO 16:14:35,771 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Content-40-Data.db
> >>  INFO 16:14:35,959 Compacting
> >>
> [org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-19-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-20-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-21-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-22-Data.db')]
> >> ERROR 16:14:35,975 Exception encountered during startup.
> >> java.lang.RuntimeException: Expected both token and generation columns;
> >> found ColumnFamily(LocationInfo [Generation:false:4...@4,])
> >> at
> >> org.apache.cassandra.db.SystemTable.initMetadata(SystemTable.java:159)
> >> at
> >>
> org.apache.cassandra.service.StorageService.initServer(StorageService.java:305)
> >> at
> >>
> org.apache.cassandra.thrift.CassandraDaemon.setup(Cassand

Re: Error during startup

[Gary Dusbabek]

I was able to reproduce the error by staring up a node using
RandomPartioner, kill it, switch to OrderPreservingPartitioner,
restart, kill, switch back to RandomPartitioner, BANG!

So it looks like you tinkered with the partitioner at some point.
This has the unfortunate effect of corrupting your system table.  I'm
trying to figure out a way to detect this and abort before data is
overwritten.

Gary.


On Sun, May 30, 2010 at 06:49, David Boxenhorn  wrote:
> I deleted the system/LocationInfo files, and now everything works.
>
> Yay! (...what happened?)
>
> On Sun, May 30, 2010 at 4:18 PM, David Boxenhorn  wrote:
>>
>> I'm getting an "Expected both token and generation columns; found
>> ColumnFamily" error during startup can anyone tell me what it is? Details
>> below.
>>
>> Starting Cassandra Server
>> Listening for transport dt_socket at address: 
>>  INFO 16:14:33,459 Auto DiskAccessMode determined to be standard
>>  INFO 16:14:33,615 Sampling index for
>> C:\var\lib\cassandra\data\system\LocationInfo-1-Data.db
>>  INFO 16:14:33,631 Removing orphan
>> C:\var\lib\cassandra\data\Lookin2\Users-tmp-27-Index.db
>>  INFO 16:14:33,631 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Users-19-Data.db
>>  INFO 16:14:33,662 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Users-18-Data.db
>>  INFO 16:14:33,818 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Users-20-Data.db
>>  INFO 16:14:33,850 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Users-21-Data.db
>>  INFO 16:14:33,865 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Users-22-Data.db
>>  INFO 16:14:33,881 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-580-Data.db
>>  INFO 16:14:33,896 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-672-Data.db
>>  INFO 16:14:33,912 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-681-Data.db
>>  INFO 16:14:33,912 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-691-Data.db
>>  INFO 16:14:33,928 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-696-Data.db
>>  INFO 16:14:33,943 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Attractions-17-Data.db
>>  INFO 16:14:34,006 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestTrendsetterIdx-5-Data.db
>>  INFO 16:14:34,006 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestTrendsetterIdx-6-Data.db
>>  INFO 16:14:34,021 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-29-Data.db
>>  INFO 16:14:34,350 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-51-Data.db
>>  INFO 16:14:34,693 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-72-Data.db
>>  INFO 16:14:35,021 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-77-Data.db
>>  INFO 16:14:35,225 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-78-Data.db
>>  INFO 16:14:35,350 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-79-Data.db
>>  INFO 16:14:35,459 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-80-Data.db
>>  INFO 16:14:35,459 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Taxonomy-1-Data.db
>>  INFO 16:14:35,475 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Taxonomy-2-Data.db
>>  INFO 16:14:35,475 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Content-30-Data.db
>>  INFO 16:14:35,631 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Content-35-Data.db
>>  INFO 16:14:35,771 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Content-40-Data.db
>>  INFO 16:14:35,959 Compacting
>> [org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-19-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-20-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-21-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-22-Data.db')]
>> ERROR 16:14:35,975 Exception encountered during startup.
>> java.lang.RuntimeException: Expected both token and generation columns;
>> found ColumnFamily(LocationInfo [Generation:false:4...@4,])
>>     at
>> org.apache.cassandra.db.SystemTable.initMetadata(SystemTable.java:159)
>>     at
>> org.apache.cassandra.service.StorageService.initServer(StorageService.java:305)
>>     at
>> org.apache.cassandra.thrift.CassandraDaemon.setup(CassandraDaemon.java:99)
>>     at
>> org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:177)
>> Exception encountered during startup.
>>
>
>

Re: Error during startup

[David Boxenhorn]

Thanks!

On Tue, Jun 1, 2010 at 9:09 AM, Jonathan Ellis  wrote:

> Created https://issues.apache.org/jira/browse/CASSANDRA-1146
>
> On Tue, Jun 1, 2010 at 12:46 AM, David Boxenhorn 
> wrote:
> > 0.6.2
> >
> > On Mon, May 31, 2010 at 9:50 PM, Jonathan Ellis 
> wrote:
> >>
> >> What version of Cassandra was this?
> >>
> >> On Sun, May 30, 2010 at 8:49 AM, David Boxenhorn 
> >> wrote:
> >> > I deleted the system/LocationInfo files, and now everything works.
> >> >
> >> > Yay! (...what happened?)
> >> >
> >> > On Sun, May 30, 2010 at 4:18 PM, David Boxenhorn 
> >> > wrote:
> >> >>
> >> >> I'm getting an "Expected both token and generation columns; found
> >> >> ColumnFamily" error during startup can anyone tell me what it is?
> >> >> Details
> >> >> below.
> >> >>
> >> >> Starting Cassandra Server
> >> >> Listening for transport dt_socket at address: 
> >> >>  INFO 16:14:33,459 Auto DiskAccessMode determined to be standard
> >> >>  INFO 16:14:33,615 Sampling index for
> >> >> C:\var\lib\cassandra\data\system\LocationInfo-1-Data.db
> >> >>  INFO 16:14:33,631 Removing orphan
> >> >> C:\var\lib\cassandra\data\Lookin2\Users-tmp-27-Index.db
> >> >>  INFO 16:14:33,631 Sampling index for
> >> >> C:\var\lib\cassandra\data\Lookin2\Users-19-Data.db
> >> >>  INFO 16:14:33,662 Sampling index for
> >> >> C:\var\lib\cassandra\data\Lookin2\Users-18-Data.db
> >> >>  INFO 16:14:33,818 Sampling index for
> >> >> C:\var\lib\cassandra\data\Lookin2\Users-20-Data.db
> >> >>  INFO 16:14:33,850 Sampling index for
> >> >> C:\var\lib\cassandra\data\Lookin2\Users-21-Data.db
> >> >>  INFO 16:14:33,865 Sampling index for
> >> >> C:\var\lib\cassandra\data\Lookin2\Users-22-Data.db
> >> >>  INFO 16:14:33,881 Sampling index for
> >> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-580-Data.db
> >> >>  INFO 16:14:33,896 Sampling index for
> >> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-672-Data.db
> >> >>  INFO 16:14:33,912 Sampling index for
> >> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-681-Data.db
> >> >>  INFO 16:14:33,912 Sampling index for
> >> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-691-Data.db
> >> >>  INFO 16:14:33,928 Sampling index for
> >> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-696-Data.db
> >> >>  INFO 16:14:33,943 Sampling index for
> >> >> C:\var\lib\cassandra\data\Lookin2\Attractions-17-Data.db
> >> >>  INFO 16:14:34,006 Sampling index for
> >> >>
> >> >>
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestTrendsetterIdx-5-Data.db
> >> >>  INFO 16:14:34,006 Sampling index for
> >> >>
> >> >>
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestTrendsetterIdx-6-Data.db
> >> >>  INFO 16:14:34,021 Sampling index for
> >> >>
> >> >>
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-29-Data.db
> >> >>  INFO 16:14:34,350 Sampling index for
> >> >>
> >> >>
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-51-Data.db
> >> >>  INFO 16:14:34,693 Sampling index for
> >> >>
> >> >>
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-72-Data.db
> >> >>  INFO 16:14:35,021 Sampling index for
> >> >>
> >> >>
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-77-Data.db
> >> >>  INFO 16:14:35,225 Sampling index for
> >> >>
> >> >>
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-78-Data.db
> >> >>  INFO 16:14:35,350 Sampling index for
> >> >>
> >> >>
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-79-Data.db
> >> >>  INFO 16:14:35,459 Sampling index for
> >> >>
> >> >>
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-80-Data.db
> >> >>  INFO 16:14:35,459 Sampling index for
> >> >> C:\var\lib\cassandra\data\Lookin2\Taxonomy-1-Data.db
> >> >>  INFO 16:14:35,475 Sampling index for
> >> >> C:\var\lib\cassandra\data\Lookin2\Taxonomy-2-Data.db
> >> >>  INFO 16:14:35,475 Sampling index for
> >> >> C:\var\lib\cassandra\data\Lookin2\Content-30-Data.db
> >> >>  INFO 16:14:35,631 Sampling index for
> >> >> C:\var\lib\cassandra\data\Lookin2\Content-35-Data.db
> >> >>  INFO 16:14:35,771 Sampling index for
> >> >> C:\var\lib\cassandra\data\Lookin2\Content-40-Data.db
> >> >>  INFO 16:14:35,959 Compacting
> >> >>
> >> >>
> [org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-19-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-20-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-21-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-22-Data.db')]
> >> >> ERROR 16:14:35,975 Exception encountered during startup.
> >> >> java.lang.RuntimeException: Expected both token and generation
> columns;
> >> >> found ColumnFamily(LocationInfo [Generation:false:4...@4,])
> >> >> at
> >> >>
> org.apache.cassandra.db.SystemTable.initMetadata(SystemTable.java:159)
> >> >> at
> >> >>
> >> >>
> org.apache.cassandra.service.StorageService.initServer

Re: Error during startup

[Jonathan Ellis]

Created https://issues.apache.org/jira/browse/CASSANDRA-1146

On Tue, Jun 1, 2010 at 12:46 AM, David Boxenhorn  wrote:
> 0.6.2
>
> On Mon, May 31, 2010 at 9:50 PM, Jonathan Ellis  wrote:
>>
>> What version of Cassandra was this?
>>
>> On Sun, May 30, 2010 at 8:49 AM, David Boxenhorn 
>> wrote:
>> > I deleted the system/LocationInfo files, and now everything works.
>> >
>> > Yay! (...what happened?)
>> >
>> > On Sun, May 30, 2010 at 4:18 PM, David Boxenhorn 
>> > wrote:
>> >>
>> >> I'm getting an "Expected both token and generation columns; found
>> >> ColumnFamily" error during startup can anyone tell me what it is?
>> >> Details
>> >> below.
>> >>
>> >> Starting Cassandra Server
>> >> Listening for transport dt_socket at address: 
>> >>  INFO 16:14:33,459 Auto DiskAccessMode determined to be standard
>> >>  INFO 16:14:33,615 Sampling index for
>> >> C:\var\lib\cassandra\data\system\LocationInfo-1-Data.db
>> >>  INFO 16:14:33,631 Removing orphan
>> >> C:\var\lib\cassandra\data\Lookin2\Users-tmp-27-Index.db
>> >>  INFO 16:14:33,631 Sampling index for
>> >> C:\var\lib\cassandra\data\Lookin2\Users-19-Data.db
>> >>  INFO 16:14:33,662 Sampling index for
>> >> C:\var\lib\cassandra\data\Lookin2\Users-18-Data.db
>> >>  INFO 16:14:33,818 Sampling index for
>> >> C:\var\lib\cassandra\data\Lookin2\Users-20-Data.db
>> >>  INFO 16:14:33,850 Sampling index for
>> >> C:\var\lib\cassandra\data\Lookin2\Users-21-Data.db
>> >>  INFO 16:14:33,865 Sampling index for
>> >> C:\var\lib\cassandra\data\Lookin2\Users-22-Data.db
>> >>  INFO 16:14:33,881 Sampling index for
>> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-580-Data.db
>> >>  INFO 16:14:33,896 Sampling index for
>> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-672-Data.db
>> >>  INFO 16:14:33,912 Sampling index for
>> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-681-Data.db
>> >>  INFO 16:14:33,912 Sampling index for
>> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-691-Data.db
>> >>  INFO 16:14:33,928 Sampling index for
>> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-696-Data.db
>> >>  INFO 16:14:33,943 Sampling index for
>> >> C:\var\lib\cassandra\data\Lookin2\Attractions-17-Data.db
>> >>  INFO 16:14:34,006 Sampling index for
>> >>
>> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestTrendsetterIdx-5-Data.db
>> >>  INFO 16:14:34,006 Sampling index for
>> >>
>> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestTrendsetterIdx-6-Data.db
>> >>  INFO 16:14:34,021 Sampling index for
>> >>
>> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-29-Data.db
>> >>  INFO 16:14:34,350 Sampling index for
>> >>
>> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-51-Data.db
>> >>  INFO 16:14:34,693 Sampling index for
>> >>
>> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-72-Data.db
>> >>  INFO 16:14:35,021 Sampling index for
>> >>
>> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-77-Data.db
>> >>  INFO 16:14:35,225 Sampling index for
>> >>
>> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-78-Data.db
>> >>  INFO 16:14:35,350 Sampling index for
>> >>
>> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-79-Data.db
>> >>  INFO 16:14:35,459 Sampling index for
>> >>
>> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-80-Data.db
>> >>  INFO 16:14:35,459 Sampling index for
>> >> C:\var\lib\cassandra\data\Lookin2\Taxonomy-1-Data.db
>> >>  INFO 16:14:35,475 Sampling index for
>> >> C:\var\lib\cassandra\data\Lookin2\Taxonomy-2-Data.db
>> >>  INFO 16:14:35,475 Sampling index for
>> >> C:\var\lib\cassandra\data\Lookin2\Content-30-Data.db
>> >>  INFO 16:14:35,631 Sampling index for
>> >> C:\var\lib\cassandra\data\Lookin2\Content-35-Data.db
>> >>  INFO 16:14:35,771 Sampling index for
>> >> C:\var\lib\cassandra\data\Lookin2\Content-40-Data.db
>> >>  INFO 16:14:35,959 Compacting
>> >>
>> >> [org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-19-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-20-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-21-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-22-Data.db')]
>> >> ERROR 16:14:35,975 Exception encountered during startup.
>> >> java.lang.RuntimeException: Expected both token and generation columns;
>> >> found ColumnFamily(LocationInfo [Generation:false:4...@4,])
>> >>     at
>> >> org.apache.cassandra.db.SystemTable.initMetadata(SystemTable.java:159)
>> >>     at
>> >>
>> >> org.apache.cassandra.service.StorageService.initServer(StorageService.java:305)
>> >>     at
>> >>
>> >> org.apache.cassandra.thrift.CassandraDaemon.setup(CassandraDaemon.java:99)
>> >>     at
>> >>
>> >> org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:177)
>> >> Exception encountered during startup.
>> >>
>> >
>> >
>>
>>
>>

Re: Error during startup

[David Boxenhorn]

0.6.2

On Mon, May 31, 2010 at 9:50 PM, Jonathan Ellis  wrote:

> What version of Cassandra was this?
>
> On Sun, May 30, 2010 at 8:49 AM, David Boxenhorn 
> wrote:
> > I deleted the system/LocationInfo files, and now everything works.
> >
> > Yay! (...what happened?)
> >
> > On Sun, May 30, 2010 at 4:18 PM, David Boxenhorn 
> wrote:
> >>
> >> I'm getting an "Expected both token and generation columns; found
> >> ColumnFamily" error during startup can anyone tell me what it is?
> Details
> >> below.
> >>
> >> Starting Cassandra Server
> >> Listening for transport dt_socket at address: 
> >>  INFO 16:14:33,459 Auto DiskAccessMode determined to be standard
> >>  INFO 16:14:33,615 Sampling index for
> >> C:\var\lib\cassandra\data\system\LocationInfo-1-Data.db
> >>  INFO 16:14:33,631 Removing orphan
> >> C:\var\lib\cassandra\data\Lookin2\Users-tmp-27-Index.db
> >>  INFO 16:14:33,631 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Users-19-Data.db
> >>  INFO 16:14:33,662 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Users-18-Data.db
> >>  INFO 16:14:33,818 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Users-20-Data.db
> >>  INFO 16:14:33,850 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Users-21-Data.db
> >>  INFO 16:14:33,865 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Users-22-Data.db
> >>  INFO 16:14:33,881 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-580-Data.db
> >>  INFO 16:14:33,896 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-672-Data.db
> >>  INFO 16:14:33,912 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-681-Data.db
> >>  INFO 16:14:33,912 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-691-Data.db
> >>  INFO 16:14:33,928 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-696-Data.db
> >>  INFO 16:14:33,943 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Attractions-17-Data.db
> >>  INFO 16:14:34,006 Sampling index for
> >>
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestTrendsetterIdx-5-Data.db
> >>  INFO 16:14:34,006 Sampling index for
> >>
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestTrendsetterIdx-6-Data.db
> >>  INFO 16:14:34,021 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-29-Data.db
> >>  INFO 16:14:34,350 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-51-Data.db
> >>  INFO 16:14:34,693 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-72-Data.db
> >>  INFO 16:14:35,021 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-77-Data.db
> >>  INFO 16:14:35,225 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-78-Data.db
> >>  INFO 16:14:35,350 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-79-Data.db
> >>  INFO 16:14:35,459 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-80-Data.db
> >>  INFO 16:14:35,459 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Taxonomy-1-Data.db
> >>  INFO 16:14:35,475 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Taxonomy-2-Data.db
> >>  INFO 16:14:35,475 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Content-30-Data.db
> >>  INFO 16:14:35,631 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Content-35-Data.db
> >>  INFO 16:14:35,771 Sampling index for
> >> C:\var\lib\cassandra\data\Lookin2\Content-40-Data.db
> >>  INFO 16:14:35,959 Compacting
> >>
> [org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-19-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-20-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-21-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-22-Data.db')]
> >> ERROR 16:14:35,975 Exception encountered during startup.
> >> java.lang.RuntimeException: Expected both token and generation columns;
> >> found ColumnFamily(LocationInfo [Generation:false:4...@4,])
> >> at
> >> org.apache.cassandra.db.SystemTable.initMetadata(SystemTable.java:159)
> >> at
> >>
> org.apache.cassandra.service.StorageService.initServer(StorageService.java:305)
> >> at
> >>
> org.apache.cassandra.thrift.CassandraDaemon.setup(CassandraDaemon.java:99)
> >> at
> >>
> org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:177)
> >> Exception encountered during startup.
> >>
> >
> >
>
>
>
> --
> Jonathan Ellis
> Project Chair, Apache Cassandra
> co-founder of Riptano, the source for professional Cassandra support
> http://riptano.com
>

Re: Error during startup

[Jonathan Ellis]

What version of Cassandra was this?

On Sun, May 30, 2010 at 8:49 AM, David Boxenhorn  wrote:
> I deleted the system/LocationInfo files, and now everything works.
>
> Yay! (...what happened?)
>
> On Sun, May 30, 2010 at 4:18 PM, David Boxenhorn  wrote:
>>
>> I'm getting an "Expected both token and generation columns; found
>> ColumnFamily" error during startup can anyone tell me what it is? Details
>> below.
>>
>> Starting Cassandra Server
>> Listening for transport dt_socket at address: 
>>  INFO 16:14:33,459 Auto DiskAccessMode determined to be standard
>>  INFO 16:14:33,615 Sampling index for
>> C:\var\lib\cassandra\data\system\LocationInfo-1-Data.db
>>  INFO 16:14:33,631 Removing orphan
>> C:\var\lib\cassandra\data\Lookin2\Users-tmp-27-Index.db
>>  INFO 16:14:33,631 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Users-19-Data.db
>>  INFO 16:14:33,662 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Users-18-Data.db
>>  INFO 16:14:33,818 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Users-20-Data.db
>>  INFO 16:14:33,850 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Users-21-Data.db
>>  INFO 16:14:33,865 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Users-22-Data.db
>>  INFO 16:14:33,881 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-580-Data.db
>>  INFO 16:14:33,896 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-672-Data.db
>>  INFO 16:14:33,912 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-681-Data.db
>>  INFO 16:14:33,912 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-691-Data.db
>>  INFO 16:14:33,928 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-696-Data.db
>>  INFO 16:14:33,943 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Attractions-17-Data.db
>>  INFO 16:14:34,006 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestTrendsetterIdx-5-Data.db
>>  INFO 16:14:34,006 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestTrendsetterIdx-6-Data.db
>>  INFO 16:14:34,021 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-29-Data.db
>>  INFO 16:14:34,350 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-51-Data.db
>>  INFO 16:14:34,693 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-72-Data.db
>>  INFO 16:14:35,021 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-77-Data.db
>>  INFO 16:14:35,225 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-78-Data.db
>>  INFO 16:14:35,350 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-79-Data.db
>>  INFO 16:14:35,459 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-80-Data.db
>>  INFO 16:14:35,459 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Taxonomy-1-Data.db
>>  INFO 16:14:35,475 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Taxonomy-2-Data.db
>>  INFO 16:14:35,475 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Content-30-Data.db
>>  INFO 16:14:35,631 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Content-35-Data.db
>>  INFO 16:14:35,771 Sampling index for
>> C:\var\lib\cassandra\data\Lookin2\Content-40-Data.db
>>  INFO 16:14:35,959 Compacting
>> [org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-19-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-20-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-21-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-22-Data.db')]
>> ERROR 16:14:35,975 Exception encountered during startup.
>> java.lang.RuntimeException: Expected both token and generation columns;
>> found ColumnFamily(LocationInfo [Generation:false:4...@4,])
>>     at
>> org.apache.cassandra.db.SystemTable.initMetadata(SystemTable.java:159)
>>     at
>> org.apache.cassandra.service.StorageService.initServer(StorageService.java:305)
>>     at
>> org.apache.cassandra.thrift.CassandraDaemon.setup(CassandraDaemon.java:99)
>>     at
>> org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:177)
>> Exception encountered during startup.
>>
>
>



-- 
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of Riptano, the source for professional Cassandra support
http://riptano.com

Re: Error during startup

[David Boxenhorn]

I deleted the system/LocationInfo files, and now everything works.

Yay! (...what happened?)

On Sun, May 30, 2010 at 4:18 PM, David Boxenhorn  wrote:

> I'm getting an "Expected both token and generation columns; found
> ColumnFamily" error during startup can anyone tell me what it is? Details
> below.
>
> Starting Cassandra Server
> Listening for transport dt_socket at address: 
>  INFO 16:14:33,459 Auto DiskAccessMode determined to be standard
>  INFO 16:14:33,615 Sampling index for
> C:\var\lib\cassandra\data\system\LocationInfo-1-Data.db
>  INFO 16:14:33,631 Removing orphan
> C:\var\lib\cassandra\data\Lookin2\Users-tmp-27-Index.db
>  INFO 16:14:33,631 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\Users-19-Data.db
>  INFO 16:14:33,662 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\Users-18-Data.db
>  INFO 16:14:33,818 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\Users-20-Data.db
>  INFO 16:14:33,850 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\Users-21-Data.db
>  INFO 16:14:33,865 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\Users-22-Data.db
>  INFO 16:14:33,881 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-580-Data.db
>  INFO 16:14:33,896 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-672-Data.db
>  INFO 16:14:33,912 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-681-Data.db
>  INFO 16:14:33,912 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-691-Data.db
>  INFO 16:14:33,928 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestIdx-696-Data.db
>  INFO 16:14:33,943 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\Attractions-17-Data.db
>  INFO 16:14:34,006 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestTrendsetterIdx-5-Data.db
>  INFO 16:14:34,006 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestTrendsetterIdx-6-Data.db
>  INFO 16:14:34,021 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-29-Data.db
>  INFO 16:14:34,350 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-51-Data.db
>  INFO 16:14:34,693 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-72-Data.db
>  INFO 16:14:35,021 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-77-Data.db
>  INFO 16:14:35,225 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-78-Data.db
>  INFO 16:14:35,350 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-79-Data.db
>  INFO 16:14:35,459 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\GeoSiteInterestPeerGroupIdx-80-Data.db
>  INFO 16:14:35,459 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\Taxonomy-1-Data.db
>  INFO 16:14:35,475 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\Taxonomy-2-Data.db
>  INFO 16:14:35,475 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\Content-30-Data.db
>  INFO 16:14:35,631 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\Content-35-Data.db
>  INFO 16:14:35,771 Sampling index for
> C:\var\lib\cassandra\data\Lookin2\Content-40-Data.db
>  INFO 16:14:35,959 Compacting
> [org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-19-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-20-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-21-Data.db'),org.apache.cassandra.io.SSTableReader(path='C:\var\lib\cassandra\data\Lookin2\Users-22-Data.db')]
> ERROR 16:14:35,975 Exception encountered during startup.
> java.lang.RuntimeException: Expected both token and generation columns;
> found ColumnFamily(LocationInfo [Generation:false:4...@4,])
> at
> org.apache.cassandra.db.SystemTable.initMetadata(SystemTable.java:159)
> at
> org.apache.cassandra.service.StorageService.initServer(StorageService.java:305)
> at
> org.apache.cassandra.thrift.CassandraDaemon.setup(CassandraDaemon.java:99)
> at
> org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:177)
> Exception encountered during startup.
>
>