Hi SolrTeam,
I see session exipre and my solr index fails.
please help me here, my infra details are shared below
I have total 3 compute
nodes[pcam-stg-app-02,pcam-stg-app-03,pcam-stg-app-04]
1) 3 nodes are running with zoo1, zoo2, zoo3 instances
/apps/scm-core/zookeeper/zkData/zkData1/myid value 1
/apps/scm-core/zookeeper/zkData/zkData2/myid value 2
/apps/scm-core/zookeeper/zkData/zkData3/myid value 3
zoo1.cfg my setup
tickTime=2000
initLimit=5
syncLimit=2
dataDir=/apps/scm-core/zookeeper/zkData/zkData1
clientPort=2181
server.1=pcam-stg-app-01:2888:3888
server.2=pcam-stg-app-02:2888:3888
server.3=pcam-stg-app-03:2888:3888
server.4=pcam-stg-app-04:2888:3888
dataLogDir=/apps/scm-core/zookeeper/zkLogData/zkLogData1
# Default 64M, changed to 128M, represented in KiloBytes
preAllocSize=131072
# Default : 100000
snapCount=100
globalOutstandingLimit=1000
maxClientCnxns=100
autopurge.snapRetainCount=3
autopurge.purgeInterval=23
minSessionTimeout=40000
maxSessionTimeout=300000
[zk: pcam-stg-app-02:2181(CONNECTED) 0] ls /
[zookeeper, solr]
[zk: pcam-stg-app-02:2181(CONNECTED) 1] ls /solr
[configs, overseer, aliases.json, live_nodes, collections, overseer_elect,
security.json, clusterstate.json]
2) 2 nodes are running solrcloud
pcam-stg-app-03: solr port 8983, solr port 8984
pcam-stg-app-04: solr port 8983, solr port 8984
Config upload to zookeeper
server/scripts/cloud-scripts/zkcli.sh -zkhost
pcam-stg-app-02:2181,pcam-stg-app-03:2181,pcam-stg-app-04:2181/solr \
-cmd upconfig -confname scdata -confdir
/apps/scm-core/solr/solr-6.1.0/server/solr/configsets/data_driven_schema_configs/conf
Collection creation url:
http://pcam-stg-app-03:8983/solr/admin/collections?action=CREATE&name=scdata_test&numShards=2&replicationFactor=2&maxShardsPerNode=2&createNodeSet=pcam-stg-app-03:8983_solr,pcam-stg-app-03:8984_solr,pcam-stg-app-04:8983_solr,pcam-stg-app-04:8984_solr&collection.configName=scdata
solrj client
String zkHosts =
"pcam-stg-app-02:2181,pcam-stg-app-03:2181,pcam-stg-app-04:2181/solr";
CloudSolrClient solrClient = new
CloudSolrClient.Builder().withZkHost(zkHosts).build();
solrClient.setDefaultCollection("scdata_test");
solrClient.setParallelUpdates(true);
List<SolrInputDocument> cpnSpendSavingsList = new ArrayList<>();
i have done data setter to cpnSpendSavingsList
solrClient.addBeans(cpnSpendSavingsList);
solrClient.commit();
SessionExpire Error for the collections
Why this SessionExpire error comes when i start bulk insert/update to solr
org.apache.solr.common.SolrException: Could not load collection from ZK:
scdata_test
at
org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1047)
at
org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:610)
at
org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:211)
at
org.apache.solr.common.cloud.ClusterState.hasCollection(ClusterState.java:113)
at
org.apache.solr.client.solrj.impl.CloudSolrClient.getCollectionNames(CloudSolrClient.java:1239)
at
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:961)
at
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:934)
at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:106)
at
org.apache.solr.client.solrj.SolrClient.addBeans(SolrClient.java:357)
at
org.apache.solr.client.solrj.SolrClient.addBeans(SolrClient.java:329)
at
com.cisco.pcam.spark.stream.HiveDataProcessStream.main(HiveDataProcessStream.java:165)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:664)
at
org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:169)
at
org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:192)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:111)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException:
KeeperErrorCode = Session expired for /collections/scdata_test/state.json
