Hi, I'm new in Solr. I tried to store the solr data in A distributed filesystem (Hadoop in this case). I'm following this tutorial https://cwiki.apache.org/confluence/display/solr/Running+Solr+on+HDFS but i have a problem when i set this field -Dsolr.data.dir=hdfs://host:port/path Which is the configuration? I put: host -> the master hadoop host port -> 9000 path -> solr
i created the folder solr on hdfs and I setting the permission to 777 but i have this error in my log: ERROR - 2013-12-13 09:49:13.065; org.apache.solr.core.CoreContainer; Unable to create core: collection1 org.apache.solr.common.SolrException: Problem creating directory: hdfs://master:9000/solr at org.apache.solr.core.SolrCore.<init>(SolrCore.java:835) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:629) at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:622) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:657) at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:364) at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:356) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) Caused by: java.lang.RuntimeException: Problem creating directory: hdfs://master:9000/solr at org.apache.solr.store.hdfs.HdfsDirectory.<init>(HdfsDirectory.java:66) at org.apache.solr.core.HdfsDirectoryFactory.create(HdfsDirectoryFactory.java:154) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:350) at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:256) at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:469) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:759) ... 13 more Caused by: java.io.IOException: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Message missing required fields: callId, status; Host Details : local host is: "master-VirtualBox/127.0.1.1"; destination host is: "master":9000; at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:761) at org.apache.hadoop.ipc.Client.call(Client.java:1239) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202) at com.sun.proxy.$Proxy9.getFileInfo(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83) at com.sun.proxy.$Proxy9.getFileInfo(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:630) at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1559) at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:811) at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1345) at org.apache.solr.store.hdfs.HdfsDirectory.<init>(HdfsDirectory.java:61) ... 18 more Caused by: com.google.protobuf.InvalidProtocolBufferException: Message missing required fields: callId, status at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81) at org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.buildParsed(RpcPayloadHeaderProtos.java:1094) at org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.access$1300(RpcPayloadHeaderProtos.java:1028) at org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcPayloadHeaderProtos.java:986) at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:946) at org.apache.hadoop.ipc.Client$Connection.run(Client.java:844) ERROR - 2013-12-13 09:49:13.114; org.apache.solr.common.SolrException; null:org.apache.solr.common.SolrException: Unable to create core: collection1 at org.apache.solr.core.CoreContainer.recordAndThrow(CoreContainer.java:1150) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:666) at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:364) at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:356) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) Caused by: org.apache.solr.common.SolrException: Problem creating directory: hdfs://master:9000/solr at org.apache.solr.core.SolrCore.<init>(SolrCore.java:835) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:629) at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:622) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:657) ... 10 more Caused by: java.lang.RuntimeException: Problem creating directory: hdfs://master:9000/solr at org.apache.solr.store.hdfs.HdfsDirectory.<init>(HdfsDirectory.java:66) at org.apache.solr.core.HdfsDirectoryFactory.create(HdfsDirectoryFactory.java:154) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:350) at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:256) at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:469) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:759) ... 13 more Caused by: java.io.IOException: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Message missing required fields: callId, status; Host Details : local host is: "master-VirtualBox/127.0.1.1"; destination host is: "master":9000; at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:761) at org.apache.hadoop.ipc.Client.call(Client.java:1239) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202) at com.sun.proxy.$Proxy9.getFileInfo(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83) at com.sun.proxy.$Proxy9.getFileInfo(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:630) at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1559) at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:811) at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1345) at org.apache.solr.store.hdfs.HdfsDirectory.<init>(HdfsDirectory.java:61) ... 18 more Caused by: com.google.protobuf.InvalidProtocolBufferException: Message missing required fields: callId, status at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81) at org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.buildParsed(RpcPayloadHeaderProtos.java:1094) at org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.access$1300(RpcPayloadHeaderProtos.java:1028) at org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcPayloadHeaderProtos.java:986) at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:946) at org.apache.hadoop.ipc.Client$Connection.run(Client.java:844) Any ideas? Thanks Danilo -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-4-0-on-hadoop-2-2-0-tp4106551.html Sent from the Solr - User mailing list archive at Nabble.com.