That directory is being created automatically every time I start elasticsearch.
[root@254020-web1 programs]# service elasticsearch stop Stopping elasticsearch: [ OK ] [root@254020-web1 programs]# ls elasticsearch-1.2.1 [root@254020-web1 programs]# rm -rf * [root@254020-web1 programs]# ls [root@254020-web1 programs]# service elasticsearch start Starting elasticsearch: [ OK ] [root@254020-web1 programs]# ls [root@254020-web1 programs]# tail /var/log/elasticsearch/elasticsearch.log at sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:176) at java.nio.channels.FileChannel.open(FileChannel.java:287) at java.nio.channels.FileChannel.open(FileChannel.java:334) at org.apache.lucene.store.MMapDirectory.openInput(MMapDirectory.java:193) at org.apache.lucene.store.FilterDirectory.openInput(FilterDirectory.java:80) at org.elasticsearch.index.store.Store.openInputRaw(Store.java:319) at org.elasticsearch.indices.recovery.RecoverySource$1$1.run(RecoverySource.java:189) ... 3 more [2014-06-12 02:48:40,299][WARN ][cluster.action.shard ] [Doctor Faustus] [blurays][2] sending failed shard for [blurays][2], node[Vf24wKzHSNuEXJCL-rEFDQ], [R], s[INITIALIZING], indexUUID [z6lXF3L0S1KwwNZUUaiKsw], reason [Failed to start shard, message [RecoveryFailedException[[blurays][2]: Recovery failed from [Stilt-Man][mxmoAlTaTkClmfpImcpb1A][254020-web1.8coupons.com][inet[/ 192.168.100.218:9301]] into [Doctor Faustus][Vf24wKzHSNuEXJCL-rEFDQ][ 254020-web1.8coupons.com][inet[/192.168.100.218:9300]]]; nested: RemoteTransportException[[Stilt-Man][inet[/192.168.100.218:9301]][index/shard/recovery/startRecovery]]; nested: RecoveryEngineException[[blurays][2] Phase[1] Execution failed]; nested: RecoverFilesRecoveryException[[blurays][2] Failed to transfer [4] files with total size of [6.6kb]]; nested: NoSuchFileException[/home/programs/elasticsearch-1.2.1/data/elasticsearch/nodes/1/indices/blurays/2/index/_ 0.si]; ]] [2014-06-12 02:48:40,299][WARN ][cluster.action.shard ] [Doctor Faustus] [blurays][3] sending failed shard for [blurays][3], node[Vf24wKzHSNuEXJCL-rEFDQ], [R], s[INITIALIZING], indexUUID [z6lXF3L0S1KwwNZUUaiKsw], reason [Failed to start shard, message [RecoveryFailedException[[blurays][3]: Recovery failed from [Stilt-Man][mxmoAlTaTkClmfpImcpb1A][254020-web1.8coupons.com][inet[/ 192.168.100.218:9301]] into [Doctor Faustus][Vf24wKzHSNuEXJCL-rEFDQ][ 254020-web1.8coupons.com][inet[/192.168.100.218:9300]]]; nested: RemoteTransportException[[Stilt-Man][inet[/192.168.100.218:9301]][index/shard/recovery/startRecovery]]; nested: RecoveryEngineException[[blurays][3] Phase[1] Execution failed]; nested: RecoverFilesRecoveryException[[blurays][3] Failed to transfer [1] files with total size of [71b]]; nested: NoSuchFileException[/home/programs/elasticsearch-1.2.1/data/elasticsearch/nodes/1/indices/blurays/3/index/segments_1]; ]] [root@254020-web1 programs]# ls elasticsearch-1.2.1 [root@254020-web1 programs]# On Thu, Jun 12, 2014 at 9:36 AM, Mark Walkom <ma...@campaignmonitor.com> wrote: > Why does it mention this path /home/programs/elasticsearch-1.2.1/ > data/elasticsearch/nodes/1/indices/blurays/3/index/segments_1 > > Regards, > Mark Walkom > > Infrastructure Engineer > Campaign Monitor > email: ma...@campaignmonitor.com > web: www.campaignmonitor.com > > > On 12 June 2014 16:33, Sebastian Okser <sok...@gmail.com> wrote: > >> I don't see data, but I see it searching for the shards in the log files. >> Other functionality regarding the JDBC rivers don't seem to be working >> either in 1.2.1, but its extremely hard to debug those issues when my log >> files are constantly being filled with the following every minute or so. >> >> [root@254020-web1 home]# tail /var/log/elasticsearch/elasticsearch.log >> at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) >> at >> sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:176) >> at java.nio.channels.FileChannel.open(FileChannel.java:287) >> at java.nio.channels.FileChannel.open(FileChannel.java:334) >> at org.apache.lucene.store.MMapDirectory.openInput(MMapDirectory.java:193) >> at >> org.apache.lucene.store.FilterDirectory.openInput(FilterDirectory.java:80) >> at org.elasticsearch.index.store.Store.openInputRaw(Store.java:319) >> at >> org.elasticsearch.indices.recovery.RecoverySource$1$1.run(RecoverySource.java:189) >> ... 3 more >> [2014-06-12 02:30:01,513][WARN ][cluster.action.shard ] [Metalhead] >> [blurays][3] sending failed shard for [blurays][3], >> node[UqeMw_y7RN-FQ3tuBNEdng], [R], s[INITIALIZING], indexUUID >> [z6lXF3L0S1KwwNZUUaiKsw], reason [Failed to start shard, message >> [RecoveryFailedException[[blurays][3]: Recovery failed from >> [Stilt-Man][mxmoAlTaTkClmfpImcpb1A][254020-web1.8coupons.com][inet[/ >> 192.168.100.218:9301]] into [Metalhead][UqeMw_y7RN-FQ3tuBNEdng][ >> 254020-web1.8coupons.com][inet[/192.168.100.218:9300]]]; nested: >> RemoteTransportException[[Stilt-Man][inet[/192.168.100.218:9301]][index/shard/recovery/startRecovery]]; >> nested: RecoveryEngineException[[blurays][3] Phase[1] Execution failed]; >> nested: RecoverFilesRecoveryException[[blurays][3] Failed to transfer [1] >> files with total size of [71b]]; nested: >> NoSuchFileException[/home/programs/elasticsearch-1.2.1/data/elasticsearch/nodes/1/indices/blurays/3/index/segments_1]; >> ]] >> [root@254020-web1 home]# >> >> >> On Thu, Jun 12, 2014 at 9:27 AM, Mark Walkom <ma...@campaignmonitor.com> >> wrote: >> >>> Just to clarify, is it just the directory that appears again at >>> /var/lib/elasticsearch/elasticsearch/nodes/0/indices, or are you saying >>> the indexed data in the shards is reappearing as well? >>> >>> Regards, >>> Mark Walkom >>> >>> Infrastructure Engineer >>> Campaign Monitor >>> email: ma...@campaignmonitor.com >>> web: www.campaignmonitor.com >>> >>> >>> On 12 June 2014 16:24, Sebastian Okser <sok...@gmail.com> wrote: >>> >>>> Neither have data directories. I also deleted all files I could find >>>> located at /var/lib/elasticsearch including >>>> /var/lib/elasticsearch/elasticsearch/nodes/0/indices, /etc/elasticsearch, >>>> their parent directories and every other directory I could find. I then >>>> again reinstalled and the data again appears at >>>> /var/lib/elasticsearch/elasticsearch/nodes/0/indices. >>>> >>>> [root@254020-web1 home]# ls /usr/local/share/elasticsearch >>>> >>>> ls: /usr/local/share/elasticsearch: No such file or directory >>>> >>>> [root@254020-web1 home]# ls /usr/share/elasticsearch/ >>>> >>>> LICENSE.txt NOTICE.txt README.textile bin lib plugins >>>> >>>> >>>> On Thu, Jun 12, 2014 at 9:12 AM, Mark Walkom <ma...@campaignmonitor.com >>>> > wrote: >>>> >>>>> You may have a data directory under /usr/local/share/elasticsearch, or >>>>> under /usr/share/elasticsearch, if it's there and you don't want the data, >>>>> delete them. >>>>> >>>>> Regards, >>>>> Mark Walkom >>>>> >>>>> Infrastructure Engineer >>>>> Campaign Monitor >>>>> email: ma...@campaignmonitor.com >>>>> web: www.campaignmonitor.com >>>>> >>>>> >>>>> On 12 June 2014 16:10, Sebastian Okser <sok...@gmail.com> wrote: >>>>> >>>>>> I should add that I have also tried uninstalling the RPM and >>>>>> reinstalling it. I used rpm -e elasticsearch-1.2.1 for the uninstall. >>>>>> >>>>>> >>>>>> On Thu, Jun 12, 2014 at 9:09 AM, Sebastian Okser <sok...@gmail.com> >>>>>> wrote: >>>>>> >>>>>>> I originally installed it with: >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> cd ~ >>>>>>> wget >>>>>>> https://github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.9.tar.gz >>>>>>> -O elasticsearch.tar.gz >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> tar -xf elasticsearch.tar.gz >>>>>>> rm elasticsearch.tar.gz >>>>>>> mv elasticsearch-* elasticsearch >>>>>>> sudo mv elasticsearch /usr/local/share >>>>>>> >>>>>>> curl -L >>>>>>> http://github.com/elasticsearch/elasticsearch-servicewrapper/tarball/master >>>>>>> | tar -xz >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> mv *servicewrapper*/service /usr/local/share/elasticsearch/bin/ >>>>>>> rm -Rf *servicewrapper* >>>>>>> sudo /usr/local/share/elasticsearch/bin/service/elasticsearch install >>>>>>> sudo /etc/init.d/elasticsearch start >>>>>>> >>>>>>> >>>>>>> I then deleted all of these directories using rm -rf as specified in >>>>>>> past messages. I then reinstalled it using an RPM using: >>>>>>> >>>>>>> rpm -Uvh elasticsearch-1.2.1.noarch.rpm >>>>>>> >>>>>>> It seems to me that there must be some hidden place where it is >>>>>>> storing all of the settings. Thanks! >>>>>>> >>>>>>> >>>>>>> On Thu, Jun 12, 2014 at 9:04 AM, Mark Walkom < >>>>>>> ma...@campaignmonitor.com> wrote: >>>>>>> >>>>>>>> Is it a single node cluster? >>>>>>>> >>>>>>>> Howe are you installing things; deb, rpm, zip? >>>>>>>> How are you uninstalling it? >>>>>>>> Exact commands for the above will be helpful :) >>>>>>>> >>>>>>>> Regards, >>>>>>>> Mark Walkom >>>>>>>> >>>>>>>> Infrastructure Engineer >>>>>>>> Campaign Monitor >>>>>>>> email: ma...@campaignmonitor.com >>>>>>>> web: www.campaignmonitor.com >>>>>>>> >>>>>>>> >>>>>>>> On 12 June 2014 16:00, Sebastian Okser <sok...@gmail.com> wrote: >>>>>>>> >>>>>>>>> I should add that I want to do a 100% clean install it keeps >>>>>>>>> trying to initiate a recovery which is creating problems. >>>>>>>>> >>>>>>>>> >>>>>>>>> On Thu, Jun 12, 2014 at 8:42 AM, Sebastian Okser <sok...@gmail.com >>>>>>>>> > wrote: >>>>>>>>> >>>>>>>>>> I tried deleting the directories an reinstalling but somehow it >>>>>>>>>> keeps loading in my old environment even when I try to rm -rf the >>>>>>>>>> directories after shutting down the server? Where is elasticsearch >>>>>>>>>> hiding >>>>>>>>>> these files? >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Wed, Jun 11, 2014 at 7:41 PM, Ivan Brusic <i...@brusic.com> >>>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>>> Regarding your problem, are you perhaps running into the fact >>>>>>>>>>> that dynamic scripts are now disabled by default since 1.2? >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-scripting.html#_enabling_dynamic_scripting >>>>>>>>>>> >>>>>>>>>>> In terms of deleting the existing version, it all depends on how >>>>>>>>>>> you installed Elasticsearch. If you did not override the defaults >>>>>>>>>>> for the >>>>>>>>>>> various directories, you can just delete the directory. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/setup-dir-layout.html#setup-dir-layout >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> Ivan >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Wed, Jun 11, 2014 at 12:51 AM, John <sok...@gmail.com> wrote: >>>>>>>>>>> >>>>>>>>>>>> I recently upgraded to elasticsearch 1.2.1 and have since seen >>>>>>>>>>>> most of my scripts stop working. Nothing seems to work properly >>>>>>>>>>>> and I think >>>>>>>>>>>> I may have messed up during the upgrade. How can I properly delete >>>>>>>>>>>> elasticsearch and all associated data so I can reinstall it from >>>>>>>>>>>> scratch >>>>>>>>>>>> (all data, indices, etc removed). >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>>> Google Groups "elasticsearch" group. >>>>>>>>>>>> To unsubscribe from this group and stop receiving emails from >>>>>>>>>>>> it, send an email to elasticsearch+unsubscr...@googlegroups.com >>>>>>>>>>>> . >>>>>>>>>>>> >>>>>>>>>>>> To view this discussion on the web visit >>>>>>>>>>>> https://groups.google.com/d/msgid/elasticsearch/b7ca9761-05e7-4e24-b287-f98bbaeb4713%40googlegroups.com >>>>>>>>>>>> <https://groups.google.com/d/msgid/elasticsearch/b7ca9761-05e7-4e24-b287-f98bbaeb4713%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>>>>>>>> . >>>>>>>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> You received this message because you are subscribed to a topic >>>>>>>>>>> in the Google Groups "elasticsearch" group. >>>>>>>>>>> To unsubscribe from this topic, visit >>>>>>>>>>> https://groups.google.com/d/topic/elasticsearch/6YzVfTg-4ng/unsubscribe >>>>>>>>>>> . >>>>>>>>>>> To unsubscribe from this group and all its topics, send an email >>>>>>>>>>> to elasticsearch+unsubscr...@googlegroups.com. >>>>>>>>>>> To view this discussion on the web visit >>>>>>>>>>> https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQAkb1XiEK7umZReNyPiQ-uE3YGhReUivPOdKcSbz81VuA%40mail.gmail.com >>>>>>>>>>> <https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQAkb1XiEK7umZReNyPiQ-uE3YGhReUivPOdKcSbz81VuA%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>>>>> . >>>>>>>>>>> >>>>>>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>> -- >>>>>>>>> You received this message because you are subscribed to the Google >>>>>>>>> Groups "elasticsearch" group. >>>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>>> send an email to elasticsearch+unsubscr...@googlegroups.com. >>>>>>>>> To view this discussion on the web visit >>>>>>>>> https://groups.google.com/d/msgid/elasticsearch/CAPrW28-9O%2B_gomzyDymGEPpsL%2B--que7AhQr3sUODEGOZuPC6w%40mail.gmail.com >>>>>>>>> <https://groups.google.com/d/msgid/elasticsearch/CAPrW28-9O%2B_gomzyDymGEPpsL%2B--que7AhQr3sUODEGOZuPC6w%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>>> . >>>>>>>>> >>>>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> You received this message because you are subscribed to a topic in >>>>>>>> the Google Groups "elasticsearch" group. >>>>>>>> To unsubscribe from this topic, visit >>>>>>>> https://groups.google.com/d/topic/elasticsearch/6YzVfTg-4ng/unsubscribe >>>>>>>> . >>>>>>>> To unsubscribe from this group and all its topics, send an email to >>>>>>>> elasticsearch+unsubscr...@googlegroups.com. >>>>>>>> To view this discussion on the web visit >>>>>>>> https://groups.google.com/d/msgid/elasticsearch/CAEM624ZfPSOc7GGteX6SYv03n5i5UTV9zHaTC%3D5WDBEDd0MGWQ%40mail.gmail.com >>>>>>>> <https://groups.google.com/d/msgid/elasticsearch/CAEM624ZfPSOc7GGteX6SYv03n5i5UTV9zHaTC%3D5WDBEDd0MGWQ%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>> . >>>>>>>> >>>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>>> >>>>>>> >>>>>>> >>>>>> -- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "elasticsearch" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to elasticsearch+unsubscr...@googlegroups.com. >>>>>> To view this discussion on the web visit >>>>>> https://groups.google.com/d/msgid/elasticsearch/CAPrW28_DNmoQJ5KonPMgnwH6QJ1eZvT6j4gXHUkgCa4_iBTUBA%40mail.gmail.com >>>>>> <https://groups.google.com/d/msgid/elasticsearch/CAPrW28_DNmoQJ5KonPMgnwH6QJ1eZvT6j4gXHUkgCa4_iBTUBA%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>> . >>>>>> >>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>> >>>>> >>>>> -- >>>>> You received this message because you are subscribed to a topic in the >>>>> Google Groups "elasticsearch" group. >>>>> To unsubscribe from this topic, visit >>>>> https://groups.google.com/d/topic/elasticsearch/6YzVfTg-4ng/unsubscribe >>>>> . >>>>> To unsubscribe from this group and all its topics, send an email to >>>>> elasticsearch+unsubscr...@googlegroups.com. >>>>> To view this discussion on the web visit >>>>> https://groups.google.com/d/msgid/elasticsearch/CAEM624Yk2KN95ErhTy9gX-ZTJWpfwo7YYDvGmA72ceTm_QrNAQ%40mail.gmail.com >>>>> <https://groups.google.com/d/msgid/elasticsearch/CAEM624Yk2KN95ErhTy9gX-ZTJWpfwo7YYDvGmA72ceTm_QrNAQ%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>> . >>>>> >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "elasticsearch" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to elasticsearch+unsubscr...@googlegroups.com. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/elasticsearch/CAPrW28-HT8BBkA8ZkkZgcKit7rsk5NBBuZXtJmN3G4PhhvY5Aw%40mail.gmail.com >>>> <https://groups.google.com/d/msgid/elasticsearch/CAPrW28-HT8BBkA8ZkkZgcKit7rsk5NBBuZXtJmN3G4PhhvY5Aw%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>> . >>>> >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> -- >>> You received this message because you are subscribed to a topic in the >>> Google Groups "elasticsearch" group. >>> To unsubscribe from this topic, visit >>> https://groups.google.com/d/topic/elasticsearch/6YzVfTg-4ng/unsubscribe. >>> To unsubscribe from this group and all its topics, send an email to >>> elasticsearch+unsubscr...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/elasticsearch/CAEM624aY%3D_FJAh-FhSJRSTKPAB_6brdMhnSzQBRwaJWQe56dpA%40mail.gmail.com >>> <https://groups.google.com/d/msgid/elasticsearch/CAEM624aY%3D_FJAh-FhSJRSTKPAB_6brdMhnSzQBRwaJWQe56dpA%40mail.gmail.com?utm_medium=email&utm_source=footer> >>> . >>> >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to elasticsearch+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/CAPrW289L4z8kT01N4kPX4Gs0Y1PO9%2Bp88VMP_QP-3Ppiawd2wQ%40mail.gmail.com >> <https://groups.google.com/d/msgid/elasticsearch/CAPrW289L4z8kT01N4kPX4Gs0Y1PO9%2Bp88VMP_QP-3Ppiawd2wQ%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> >> For more options, visit https://groups.google.com/d/optout. >> > > -- > You received this message because you are subscribed to a topic in the > Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit > https://groups.google.com/d/topic/elasticsearch/6YzVfTg-4ng/unsubscribe. > To unsubscribe from this group and all its topics, send an email to > elasticsearch+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/CAEM624ZuysNAkgb5ynMPG%3DhwJDiBaz35y8TBHvPOJ2mUDWHBvQ%40mail.gmail.com > <https://groups.google.com/d/msgid/elasticsearch/CAEM624ZuysNAkgb5ynMPG%3DhwJDiBaz35y8TBHvPOJ2mUDWHBvQ%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAPrW2899OWfMFYsAHzyhYo6uP%3DHjXS5HmBmnwGu7QpLhEwY5XA%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
