Thanks, Yury. Indeed that is the issue. Joel, is that something expected behavior or should i create a JIRA?
Thanks, Susheel On Wed, Jun 14, 2017 at 12:16 PM, Yury Kats <yuryk...@yahoo.com.invalid> wrote: > I have seen this with very few indexed documents and multiple shards. > In such a case, some shards may not have any documents, and when the query > happens to hit such a shard, it does not find the fields it's looking for > and turns this into "column not found". If you resubmit the query and hit > a different shards (with docs), the query will succeed. > > On 6/14/2017 11:42 AM, Susheel Kumar wrote: > > Yes, Joel. Kind of every other command runs into this issue. I just > > executed below queries and 3 of them failed while 1 succeeded. I just > > have 6 documents ingested and no further indexing going on. Let me know > > what else to look for the state of index. > > > > > > ➜ solr-6.6.0 curl --data-urlencode 'stmt=SELECT sr_sv_userFirstName as > > firstName, sr_sv_userLastName as lastName FROM collection1 ORDEr BY > > dv_sv_userLastName LIMIT 15' > > http://server17:8984/solr/collection1/sql\?aggregationMode\=facet > > > > > > {"result-set":{"docs":[{"EXCEPTION":"Failed to execute sqlQuery 'SELECT > > sr_sv_userFirstName as firstName, sr_sv_userLastName as lastName FROM > > collection1 ORDEr BY dv_sv_userLastName LIMIT 15' against JDBC connection > > 'jdbc:calcitesolr:'.\nError while executing SQL \"SELECT > > sr_sv_userFirstName as firstName, sr_sv_userLastName as lastName FROM > > collection1 ORDEr BY dv_sv_userLastName LIMIT 15\": From line 1, column 9 > > to line 1, column 27: Column 'sr_sv_userFirstName' not found in any > > table","EOF":true,"RESPONSE_TIME":85}]}} > > > > > > ➜ solr-6.6.0 curl --data-urlencode 'stmt=SELECT sr_sv_userFirstName as > > firstName, sr_sv_userLastName as lastName FROM collection1 ORDEr BY > > dv_sv_userLastName LIMIT 15' > > http://server17:8984/solr/collection1/sql\?aggregationMode\=facet > > > > > > {"result-set":{"docs":[{"firstName":"Thiago","lastName" > :"Diego"},{"firstName":"John","lastName":"Jagger"},{" > firstName":"John","lastName":"Jagger"},{"firstName":"John"," > lastName":"Johny"},{"firstName":"Isabel","lastName" > :"Margret"},{"firstName":"Isabel","lastName":"Margret"}, > {"EOF":true,"RESPONSE_TIME":241}]}} > > > > > > ➜ solr-6.6.0 curl --data-urlencode 'stmt=SELECT sr_sv_userFirstName as > > firstName, sr_sv_userLastName as lastName FROM collection1 ORDEr BY > > dv_sv_userLastName LIMIT 15' > > http://server17:8984/solr/collection1/sql\?aggregationMode\=facet > > > > > > > > {"result-set":{"docs":[{"EXCEPTION":"Failed to execute sqlQuery 'SELECT > > sr_sv_userFirstName as firstName, sr_sv_userLastName as lastName FROM > > collection1 ORDEr BY dv_sv_userLastName LIMIT 15' against JDBC connection > > 'jdbc:calcitesolr:'.\nError while executing SQL \"SELECT > > sr_sv_userFirstName as firstName, sr_sv_userLastName as lastName FROM > > collection1 ORDEr BY dv_sv_userLastName LIMIT 15\": From line 1, column 9 > > to line 1, column 27: Column 'sr_sv_userFirstName' not found in any > > table","EOF":true,"RESPONSE_TIME":87}]}} > > > > On Wed, Jun 14, 2017 at 11:18 AM, Joel Bernstein <joels...@gmail.com> > wrote: > > > >> Are you able to reproduce the error, or is it just appearing in the > logs? > >> > >> Do you know the state of index when it's occurring? > >> > >> Joel Bernstein > >> http://joelsolr.blogspot.com/ > >> > >> On Wed, Jun 14, 2017 at 11:09 AM, Susheel Kumar <susheel2...@gmail.com> > >> wrote: > >> > >>> I have setup Solr-6.6-0 on local (local ZK and Solr) and then on > servers > >> (3 > >>> ZK and 2 machines, 2 shards) and on both the env, i see this > >> intermittent > >>> error "column not found". The same query works sometime and other time > >>> fails. > >>> > >>> Is that a bug or am I missing something... > >>> > >>> > >>> Console > >>> === > >>> > >>> -> solr-6.6.0 curl --data-urlencode 'stmt=SELECT dv_sv_userFirstName > as > >>> firstName, dv_sv_userLastName as lastName FROM collection1 ORDEr BY > >>> dv_sv_userLastName LIMIT 15' > >>> http://server17:8984/solr/collection1/sql\?aggregationMode\=facet > >>> > >>> {"result-set":{"docs":[{"EXCEPTION":"Failed to execute sqlQuery > 'SELECT > >>> dv_sv_userFirstName as firstName, dv_sv_userLastName as lastName FROM > >>> collection1 ORDEr BY dv_sv_userLastName LIMIT 15' against JDBC > connection > >>> 'jdbc:calcitesolr:'.\nError while executing SQL \"SELECT > >>> dv_sv_userFirstName as firstName, dv_sv_userLastName as lastName FROM > >>> collection1 ORDEr BY dv_sv_userLastName LIMIT 15\": From line 1, > column 9 > >>> to line 1, column 27: Column 'dv_sv_userFirstName' not found in any > >>> table","EOF":true,"RESPONSE_TIME":78}]}} > >>> > >>> ➜ solr-6.6.0 curl --data-urlencode 'stmt=SELECT dv_sv_userFirstName > as > >>> firstName, dv_sv_userLastName as lastName FROM collection1 ORDEr BY > >>> dv_sv_userLastName LIMIT 15' > >>> http://server17:8984/solr/collection1/sql\?aggregationMode\=facet > >>> > >>> {"result-set":{"docs":[{"EXCEPTION":"Failed to execute sqlQuery > 'SELECT > >>> dv_sv_userFirstName as firstName, dv_sv_userLastName as lastName FROM > >>> collection1 ORDEr BY dv_sv_userLastName LIMIT 15' against JDBC > connection > >>> 'jdbc:calcitesolr:'.\nError while executing SQL \"SELECT > >>> dv_sv_userFirstName as firstName, dv_sv_userLastName as lastName FROM > >>> collection1 ORDEr BY dv_sv_userLastName LIMIT 15\": From line 1, > column 9 > >>> to line 1, column 27: Column 'dv_sv_userFirstName' not found in any > >>> table","EOF":true,"RESPONSE_TIME":92}]}} > >>> > >>> ➜ solr-6.6.0 curl --data-urlencode 'stmt=SELECT dv_sv_userFirstName > as > >>> firstName, dv_sv_userLastName as lastName FROM collection1 ORDEr BY > >>> dv_sv_userLastName LIMIT 15' > >>> http://server17:8984/solr/collection1/sql\?aggregationMode\=facet > >>> > >>> {"result-set":{"docs":[{"firstName":"Thiago","lastName" > >>> :"Diego"},{"firstName":"John","lastName":"Jagger"},{" > >>> firstName":"John","lastName":"Jagger"},{"firstName":"John"," > >>> lastName":"Johny"},{"firstName":"Isabel","lastName" > >>> :"Margret"},{"firstName":"Isabel","lastName":"Margret"}, > >>> {"EOF":true,"RESPONSE_TIME":191}]}} > >>> > >>> ➜ solr-6.6.0 curl --data-urlencode 'stmt=SELECT dv_sv_userFirstName > as > >>> firstName, dv_sv_userLastName as lastName FROM collection1 ORDEr BY > >>> dv_sv_userLastName LIMIT 15' > >>> http://server17:8984/solr/collection1/sql\?aggregationMode\=facet > >>> > >>> {"result-set":{"docs":[{"EXCEPTION":"Failed to execute sqlQuery > 'SELECT > >>> dv_sv_userFirstName as firstName, dv_sv_userLastName as lastName FROM > >>> collection1 ORDEr BY dv_sv_userLastName LIMIT 15' against JDBC > connection > >>> 'jdbc:calcitesolr:'.\nError while executing SQL \"SELECT > >>> dv_sv_userFirstName as firstName, dv_sv_userLastName as lastName FROM > >>> collection1 ORDEr BY dv_sv_userLastName LIMIT 15\": From line 1, > column 9 > >>> to line 1, column 27: Column 'dv_sv_userFirstName' not found in any > >>> table","EOF":true,"RESPONSE_TIME":83}]}} > >>> > >>> ➜ solr-6.6.0 > >>> > >>> > >>> solr.log entry > >>> === > >>> > >>> 2017-06-14 14:57:29.624 ERROR (qtp834133664-17) [c:collection1 s:shard1 > >>> r:core_node1 x:collection1_shard1_replica1] o.a.c.r.CalciteException > >>> org.apache.calcite.sql.validate.SqlValidatorException: Column > >>> 'dv_sv_userFirstName' not found in any table > >>> 2017-06-14 14:57:29.625 ERROR (qtp834133664-17) [c:collection1 s:shard1 > >>> r:core_node1 x:collection1_shard1_replica1] o.a.c.r.CalciteException > >>> org.apache.calcite.runtime.CalciteContextException: From line 1, > column > >> 9 > >>> to line 1, column 27: Column 'dv_sv_userFirstName' not found in any > table > >>> 2017-06-14 14:57:29.628 ERROR (qtp834133664-17) [c:collection1 s:shard1 > >>> r:core_node1 x:collection1_shard1_replica1] > o.a.s.c.s.i.s.ExceptionStream > >>> java.io.IOException: Failed to execute sqlQuery 'SELECT > >>> dv_sv_userFirstName as firstName, dv_sv_userLastName as lastName FROM > >>> collection1 ORDEr BY dv_sv_userLastName LIMIT 15' against JDBC > connection > >>> 'jdbc:calcitesolr:'. > >>> Error while executing SQL "SELECT dv_sv_userFirstName as firstName, > >>> dv_sv_userLastName as lastName FROM collection1 ORDEr BY > >> dv_sv_userLastName > >>> LIMIT 15": From line 1, column 9 to line 1, column 27: Column > >>> 'dv_sv_userFirstName' not found in any table > >>> at > >>> org.apache.solr.client.solrj.io.stream.JDBCStream.open( > >>> JDBCStream.java:216) > >>> at > >>> org.apache.solr.client.solrj.io.stream.ExceptionStream. > >>> open(ExceptionStream.java:51) > >>> at > >>> org.apache.solr.handler.StreamHandler$TimerStream. > >>> open(StreamHandler.java:535) > >>> at > >>> org.apache.solr.client.solrj.io.stream.TupleStream. > >>> writeMap(TupleStream.java:78) > >>> at > >>> org.apache.solr.response.JSONWriter.writeMap( > >> JSONResponseWriter.java:547) > >>> at > >>> org.apache.solr.response.TextResponseWriter.writeVal( > >>> TextResponseWriter.java:193) > >>> at > >>> org.apache.solr.response.JSONWriter.writeNamedListAsMapWithDups( > >>> JSONResponseWriter.java:209) > >>> at > >>> org.apache.solr.response.JSONWriter.writeNamedList( > >>> JSONResponseWriter.java:325) > >>> at > >>> org.apache.solr.response.JSONWriter.writeResponse( > >>> JSONResponseWriter.java:120) > >>> at > >>> org.apache.solr.response.JSONResponseWriter.write( > >>> JSONResponseWriter.java:71) > >>> at > >>> org.apache.solr.response.QueryResponseWriterUtil.writeQueryResponse( > >>> QueryResponseWriterUtil.java:65) > >>> at > >>> org.apache.solr.servlet.HttpSolrCall.writeResponse( > >> HttpSolrCall.java:809) > >>> at org.apache.solr.servlet.HttpSolrCall.call( > >>> HttpSolrCall.java:538) > >>> at > >>> org.apache.solr.servlet.SolrDispatchFilter.doFilter( > >>> SolrDispatchFilter.java:361) > >>> at > >>> org.apache.solr.servlet.SolrDispatchFilter.doFilter( > >>> SolrDispatchFilter.java:305) > >>> at > >>> org.eclipse.jetty.servlet.ServletHandler$CachedChain. > >>> doFilter(ServletHandler.java:1691) > >>> at > >>> org.eclipse.jetty.servlet.ServletHandler.doHandle( > >> ServletHandler.java:582) > >>> at > >>> org.eclipse.jetty.server.handler.ScopedHandler.handle( > >>> ScopedHandler.java:143) > >>> at > >>> org.eclipse.jetty.security.SecurityHandler.handle( > >>> SecurityHandler.java:548) > >>> at > >>> org.eclipse.jetty.server.session.SessionHandler. > >>> doHandle(SessionHandler.java:226) > >>> at > >>> org.eclipse.jetty.server.handler.ContextHandler. > >>> doHandle(ContextHandler.java:1180) > >>> at > >>> org.eclipse.jetty.servlet.ServletHandler.doScope( > >> ServletHandler.java:512) > >>> at > >>> org.eclipse.jetty.server.session.SessionHandler. > >>> doScope(SessionHandler.java:185) > >>> at > >>> org.eclipse.jetty.server.handler.ContextHandler. > >>> doScope(ContextHandler.java:1112) > >>> at > >>> org.eclipse.jetty.server.handler.ScopedHandler.handle( > >>> ScopedHandler.java:141) > >>> at > >>> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle( > >>> ContextHandlerCollection.java:213) > >>> at > >>> org.eclipse.jetty.server.handler.HandlerCollection. > >>> handle(HandlerCollection.java:119) > >>> at > >>> org.eclipse.jetty.server.handler.HandlerWrapper.handle( > >>> HandlerWrapper.java:134) > >>> at > >>> org.eclipse.jetty.rewrite.handler.RewriteHandler.handle( > >>> RewriteHandler.java:335) > >>> at > >>> org.eclipse.jetty.server.handler.HandlerWrapper.handle( > >>> HandlerWrapper.java:134) > >>> at org.eclipse.jetty.server.Server.handle(Server.java:534) > >>> at org.eclipse.jetty.server.HttpChannel.handle( > >>> HttpChannel.java:320) > >>> at > >>> org.eclipse.jetty.server.HttpConnection.onFillable( > >>> HttpConnection.java:251) > >>> at > >>> org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded( > >>> AbstractConnection.java:273) > >>> at org.eclipse.jetty.io.FillInterest.fillable( > >>> FillInterest.java:95) > >>> at > >>> org.eclipse.jetty.io.SelectChannelEndPoint$2.run( > >>> SelectChannelEndPoint.java:93) > >>> at > >>> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume. > >>> executeProduceConsume(ExecuteProduceConsume.java:303) > >>> at > >>> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume. > >>> produceConsume(ExecuteProduceConsume.java:148) > >>> at > >>> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run( > >>> ExecuteProduceConsume.java:136) > >>> at > >>> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob( > >>> QueuedThreadPool.java:671) > >>> at > >>> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run( > >>> QueuedThreadPool.java:589) > >>> at java.lang.Thread.run(Thread.java:745) > >>> Caused by: java.sql.SQLException: Error while executing SQL "SELECT > >>> dv_sv_userFirstName as firstName, dv_sv_userLastName as lastName FROM > >>> collection1 ORDEr BY dv_sv_userLastName LIMIT 15": From line 1, column > 9 > >> to > >>> line 1, column 27: Column 'dv_sv_userFirstName' not found in any table > >>> at org.apache.calcite.avatica.Helper.createException(Helper. > >>> java:56) > >>> at org.apache.calcite.avatica.Helper.createException(Helper. > >>> java:41) > >>> at > >>> org.apache.calcite.avatica.AvaticaStatement.executeInternal( > >>> AvaticaStatement.java:156) > >>> at > >>> org.apache.calcite.avatica.AvaticaStatement.executeQuery( > >>> AvaticaStatement.java:218) > >>> at > >>> org.apache.solr.client.solrj.io.stream.JDBCStream.open( > >>> JDBCStream.java:214) > >>> ... 41 more > >>> Caused by: org.apache.calcite.runtime.CalciteContextException: From > line > >>> 1, > >>> column 9 to line 1, column 27: Column 'dv_sv_userFirstName' not found > in > >>> any table > >>> at sun.reflect.NativeConstructorAccessorImpl. > newInstance0(Native > >>> Method) > >>> at > >>> sun.reflect.NativeConstructorAccessorImpl.newInstance( > >>> NativeConstructorAccessorImpl.java:62) > >>> at > >>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance( > >>> DelegatingConstructorAccessorImpl.java:45) > >>> at java.lang.reflect.Constructor.newInstance(Constructor.java: > >> 423) > >>> at > >>> org.apache.calcite.runtime.Resources$ExInstWithCause.ex( > >>> Resources.java:463) > >>> > >> > > > >
