Created JIRA https://issues.apache.org/jira/browse/SOLR-10890
Thank you. On Wed, Jun 14, 2017 at 1:59 PM, Joel Bernstein <joels...@gmail.com> wrote: > Let's create a jira for this. > > Joel Bernstein > http://joelsolr.blogspot.com/ > > On Wed, Jun 14, 2017 at 12:26 PM, Susheel Kumar <susheel2...@gmail.com> > wrote: > > > Thanks, Yury. Indeed that is the issue. > > > > Joel, is that something expected behavior or should i create a JIRA? > > > > Thanks, > > Susheel > > > > On Wed, Jun 14, 2017 at 12:16 PM, Yury Kats <yuryk...@yahoo.com.invalid> > > wrote: > > > > > I have seen this with very few indexed documents and multiple shards. > > > In such a case, some shards may not have any documents, and when the > > query > > > happens to hit such a shard, it does not find the fields it's looking > for > > > and turns this into "column not found". If you resubmit the query and > hit > > > a different shards (with docs), the query will succeed. > > > > > > On 6/14/2017 11:42 AM, Susheel Kumar wrote: > > > > Yes, Joel. Kind of every other command runs into this issue. I just > > > > executed below queries and 3 of them failed while 1 succeeded. I > just > > > > have 6 documents ingested and no further indexing going on. Let me > > know > > > > what else to look for the state of index. > > > > > > > > > > > > ➜ solr-6.6.0 curl --data-urlencode 'stmt=SELECT sr_sv_userFirstName > > as > > > > firstName, sr_sv_userLastName as lastName FROM collection1 ORDEr BY > > > > dv_sv_userLastName LIMIT 15' > > > > http://server17:8984/solr/collection1/sql\?aggregationMode\=facet > > > > > > > > > > > > {"result-set":{"docs":[{"EXCEPTION":"Failed to execute sqlQuery > > 'SELECT > > > > sr_sv_userFirstName as firstName, sr_sv_userLastName as lastName > FROM > > > > collection1 ORDEr BY dv_sv_userLastName LIMIT 15' against JDBC > > connection > > > > 'jdbc:calcitesolr:'.\nError while executing SQL \"SELECT > > > > sr_sv_userFirstName as firstName, sr_sv_userLastName as lastName > FROM > > > > collection1 ORDEr BY dv_sv_userLastName LIMIT 15\": From line 1, > > column 9 > > > > to line 1, column 27: Column 'sr_sv_userFirstName' not found in any > > > > table","EOF":true,"RESPONSE_TIME":85}]}} > > > > > > > > > > > > ➜ solr-6.6.0 curl --data-urlencode 'stmt=SELECT sr_sv_userFirstName > > as > > > > firstName, sr_sv_userLastName as lastName FROM collection1 ORDEr BY > > > > dv_sv_userLastName LIMIT 15' > > > > http://server17:8984/solr/collection1/sql\?aggregationMode\=facet > > > > > > > > > > > > {"result-set":{"docs":[{"firstName":"Thiago","lastName" > > > :"Diego"},{"firstName":"John","lastName":"Jagger"},{" > > > firstName":"John","lastName":"Jagger"},{"firstName":"John"," > > > lastName":"Johny"},{"firstName":"Isabel","lastName" > > > :"Margret"},{"firstName":"Isabel","lastName":"Margret"}, > > > {"EOF":true,"RESPONSE_TIME":241}]}} > > > > > > > > > > > > ➜ solr-6.6.0 curl --data-urlencode 'stmt=SELECT sr_sv_userFirstName > > as > > > > firstName, sr_sv_userLastName as lastName FROM collection1 ORDEr BY > > > > dv_sv_userLastName LIMIT 15' > > > > http://server17:8984/solr/collection1/sql\?aggregationMode\=facet > > > > > > > > > > > > > > > > {"result-set":{"docs":[{"EXCEPTION":"Failed to execute sqlQuery > > 'SELECT > > > > sr_sv_userFirstName as firstName, sr_sv_userLastName as lastName > FROM > > > > collection1 ORDEr BY dv_sv_userLastName LIMIT 15' against JDBC > > connection > > > > 'jdbc:calcitesolr:'.\nError while executing SQL \"SELECT > > > > sr_sv_userFirstName as firstName, sr_sv_userLastName as lastName > FROM > > > > collection1 ORDEr BY dv_sv_userLastName LIMIT 15\": From line 1, > > column 9 > > > > to line 1, column 27: Column 'sr_sv_userFirstName' not found in any > > > > table","EOF":true,"RESPONSE_TIME":87}]}} > > > > > > > > On Wed, Jun 14, 2017 at 11:18 AM, Joel Bernstein <joels...@gmail.com > > > > > wrote: > > > > > > > >> Are you able to reproduce the error, or is it just appearing in the > > > logs? > > > >> > > > >> Do you know the state of index when it's occurring? > > > >> > > > >> Joel Bernstein > > > >> http://joelsolr.blogspot.com/ > > > >> > > > >> On Wed, Jun 14, 2017 at 11:09 AM, Susheel Kumar < > > susheel2...@gmail.com> > > > >> wrote: > > > >> > > > >>> I have setup Solr-6.6-0 on local (local ZK and Solr) and then on > > > servers > > > >> (3 > > > >>> ZK and 2 machines, 2 shards) and on both the env, i see this > > > >> intermittent > > > >>> error "column not found". The same query works sometime and other > > time > > > >>> fails. > > > >>> > > > >>> Is that a bug or am I missing something... > > > >>> > > > >>> > > > >>> Console > > > >>> === > > > >>> > > > >>> -> solr-6.6.0 curl --data-urlencode 'stmt=SELECT > dv_sv_userFirstName > > > as > > > >>> firstName, dv_sv_userLastName as lastName FROM collection1 ORDEr BY > > > >>> dv_sv_userLastName LIMIT 15' > > > >>> http://server17:8984/solr/collection1/sql\?aggregationMode\=facet > > > >>> > > > >>> {"result-set":{"docs":[{"EXCEPTION":"Failed to execute sqlQuery > > > 'SELECT > > > >>> dv_sv_userFirstName as firstName, dv_sv_userLastName as lastName > > FROM > > > >>> collection1 ORDEr BY dv_sv_userLastName LIMIT 15' against JDBC > > > connection > > > >>> 'jdbc:calcitesolr:'.\nError while executing SQL \"SELECT > > > >>> dv_sv_userFirstName as firstName, dv_sv_userLastName as lastName > > FROM > > > >>> collection1 ORDEr BY dv_sv_userLastName LIMIT 15\": From line 1, > > > column 9 > > > >>> to line 1, column 27: Column 'dv_sv_userFirstName' not found in any > > > >>> table","EOF":true,"RESPONSE_TIME":78}]}} > > > >>> > > > >>> ➜ solr-6.6.0 curl --data-urlencode 'stmt=SELECT > dv_sv_userFirstName > > > as > > > >>> firstName, dv_sv_userLastName as lastName FROM collection1 ORDEr BY > > > >>> dv_sv_userLastName LIMIT 15' > > > >>> http://server17:8984/solr/collection1/sql\?aggregationMode\=facet > > > >>> > > > >>> {"result-set":{"docs":[{"EXCEPTION":"Failed to execute sqlQuery > > > 'SELECT > > > >>> dv_sv_userFirstName as firstName, dv_sv_userLastName as lastName > > FROM > > > >>> collection1 ORDEr BY dv_sv_userLastName LIMIT 15' against JDBC > > > connection > > > >>> 'jdbc:calcitesolr:'.\nError while executing SQL \"SELECT > > > >>> dv_sv_userFirstName as firstName, dv_sv_userLastName as lastName > > FROM > > > >>> collection1 ORDEr BY dv_sv_userLastName LIMIT 15\": From line 1, > > > column 9 > > > >>> to line 1, column 27: Column 'dv_sv_userFirstName' not found in any > > > >>> table","EOF":true,"RESPONSE_TIME":92}]}} > > > >>> > > > >>> ➜ solr-6.6.0 curl --data-urlencode 'stmt=SELECT > dv_sv_userFirstName > > > as > > > >>> firstName, dv_sv_userLastName as lastName FROM collection1 ORDEr BY > > > >>> dv_sv_userLastName LIMIT 15' > > > >>> http://server17:8984/solr/collection1/sql\?aggregationMode\=facet > > > >>> > > > >>> {"result-set":{"docs":[{"firstName":"Thiago","lastName" > > > >>> :"Diego"},{"firstName":"John","lastName":"Jagger"},{" > > > >>> firstName":"John","lastName":"Jagger"},{"firstName":"John"," > > > >>> lastName":"Johny"},{"firstName":"Isabel","lastName" > > > >>> :"Margret"},{"firstName":"Isabel","lastName":"Margret"}, > > > >>> {"EOF":true,"RESPONSE_TIME":191}]}} > > > >>> > > > >>> ➜ solr-6.6.0 curl --data-urlencode 'stmt=SELECT > dv_sv_userFirstName > > > as > > > >>> firstName, dv_sv_userLastName as lastName FROM collection1 ORDEr BY > > > >>> dv_sv_userLastName LIMIT 15' > > > >>> http://server17:8984/solr/collection1/sql\?aggregationMode\=facet > > > >>> > > > >>> {"result-set":{"docs":[{"EXCEPTION":"Failed to execute sqlQuery > > > 'SELECT > > > >>> dv_sv_userFirstName as firstName, dv_sv_userLastName as lastName > > FROM > > > >>> collection1 ORDEr BY dv_sv_userLastName LIMIT 15' against JDBC > > > connection > > > >>> 'jdbc:calcitesolr:'.\nError while executing SQL \"SELECT > > > >>> dv_sv_userFirstName as firstName, dv_sv_userLastName as lastName > > FROM > > > >>> collection1 ORDEr BY dv_sv_userLastName LIMIT 15\": From line 1, > > > column 9 > > > >>> to line 1, column 27: Column 'dv_sv_userFirstName' not found in any > > > >>> table","EOF":true,"RESPONSE_TIME":83}]}} > > > >>> > > > >>> ➜ solr-6.6.0 > > > >>> > > > >>> > > > >>> solr.log entry > > > >>> === > > > >>> > > > >>> 2017-06-14 14:57:29.624 ERROR (qtp834133664-17) [c:collection1 > > s:shard1 > > > >>> r:core_node1 x:collection1_shard1_replica1] > o.a.c.r.CalciteException > > > >>> org.apache.calcite.sql.validate.SqlValidatorException: Column > > > >>> 'dv_sv_userFirstName' not found in any table > > > >>> 2017-06-14 14:57:29.625 ERROR (qtp834133664-17) [c:collection1 > > s:shard1 > > > >>> r:core_node1 x:collection1_shard1_replica1] > o.a.c.r.CalciteException > > > >>> org.apache.calcite.runtime.CalciteContextException: From line 1, > > > column > > > >> 9 > > > >>> to line 1, column 27: Column 'dv_sv_userFirstName' not found in any > > > table > > > >>> 2017-06-14 14:57:29.628 ERROR (qtp834133664-17) [c:collection1 > > s:shard1 > > > >>> r:core_node1 x:collection1_shard1_replica1] > > > o.a.s.c.s.i.s.ExceptionStream > > > >>> java.io.IOException: Failed to execute sqlQuery 'SELECT > > > >>> dv_sv_userFirstName as firstName, dv_sv_userLastName as lastName > > FROM > > > >>> collection1 ORDEr BY dv_sv_userLastName LIMIT 15' against JDBC > > > connection > > > >>> 'jdbc:calcitesolr:'. > > > >>> Error while executing SQL "SELECT dv_sv_userFirstName as > firstName, > > > >>> dv_sv_userLastName as lastName FROM collection1 ORDEr BY > > > >> dv_sv_userLastName > > > >>> LIMIT 15": From line 1, column 9 to line 1, column 27: Column > > > >>> 'dv_sv_userFirstName' not found in any table > > > >>> at > > > >>> org.apache.solr.client.solrj.io.stream.JDBCStream.open( > > > >>> JDBCStream.java:216) > > > >>> at > > > >>> org.apache.solr.client.solrj.io.stream.ExceptionStream. > > > >>> open(ExceptionStream.java:51) > > > >>> at > > > >>> org.apache.solr.handler.StreamHandler$TimerStream. > > > >>> open(StreamHandler.java:535) > > > >>> at > > > >>> org.apache.solr.client.solrj.io.stream.TupleStream. > > > >>> writeMap(TupleStream.java:78) > > > >>> at > > > >>> org.apache.solr.response.JSONWriter.writeMap( > > > >> JSONResponseWriter.java:547) > > > >>> at > > > >>> org.apache.solr.response.TextResponseWriter.writeVal( > > > >>> TextResponseWriter.java:193) > > > >>> at > > > >>> org.apache.solr.response.JSONWriter.writeNamedListAsMapWithDups( > > > >>> JSONResponseWriter.java:209) > > > >>> at > > > >>> org.apache.solr.response.JSONWriter.writeNamedList( > > > >>> JSONResponseWriter.java:325) > > > >>> at > > > >>> org.apache.solr.response.JSONWriter.writeResponse( > > > >>> JSONResponseWriter.java:120) > > > >>> at > > > >>> org.apache.solr.response.JSONResponseWriter.write( > > > >>> JSONResponseWriter.java:71) > > > >>> at > > > >>> org.apache.solr.response.QueryResponseWriterUtil. > writeQueryResponse( > > > >>> QueryResponseWriterUtil.java:65) > > > >>> at > > > >>> org.apache.solr.servlet.HttpSolrCall.writeResponse( > > > >> HttpSolrCall.java:809) > > > >>> at org.apache.solr.servlet.HttpSolrCall.call( > > > >>> HttpSolrCall.java:538) > > > >>> at > > > >>> org.apache.solr.servlet.SolrDispatchFilter.doFilter( > > > >>> SolrDispatchFilter.java:361) > > > >>> at > > > >>> org.apache.solr.servlet.SolrDispatchFilter.doFilter( > > > >>> SolrDispatchFilter.java:305) > > > >>> at > > > >>> org.eclipse.jetty.servlet.ServletHandler$CachedChain. > > > >>> doFilter(ServletHandler.java:1691) > > > >>> at > > > >>> org.eclipse.jetty.servlet.ServletHandler.doHandle( > > > >> ServletHandler.java:582) > > > >>> at > > > >>> org.eclipse.jetty.server.handler.ScopedHandler.handle( > > > >>> ScopedHandler.java:143) > > > >>> at > > > >>> org.eclipse.jetty.security.SecurityHandler.handle( > > > >>> SecurityHandler.java:548) > > > >>> at > > > >>> org.eclipse.jetty.server.session.SessionHandler. > > > >>> doHandle(SessionHandler.java:226) > > > >>> at > > > >>> org.eclipse.jetty.server.handler.ContextHandler. > > > >>> doHandle(ContextHandler.java:1180) > > > >>> at > > > >>> org.eclipse.jetty.servlet.ServletHandler.doScope( > > > >> ServletHandler.java:512) > > > >>> at > > > >>> org.eclipse.jetty.server.session.SessionHandler. > > > >>> doScope(SessionHandler.java:185) > > > >>> at > > > >>> org.eclipse.jetty.server.handler.ContextHandler. > > > >>> doScope(ContextHandler.java:1112) > > > >>> at > > > >>> org.eclipse.jetty.server.handler.ScopedHandler.handle( > > > >>> ScopedHandler.java:141) > > > >>> at > > > >>> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle( > > > >>> ContextHandlerCollection.java:213) > > > >>> at > > > >>> org.eclipse.jetty.server.handler.HandlerCollection. > > > >>> handle(HandlerCollection.java:119) > > > >>> at > > > >>> org.eclipse.jetty.server.handler.HandlerWrapper.handle( > > > >>> HandlerWrapper.java:134) > > > >>> at > > > >>> org.eclipse.jetty.rewrite.handler.RewriteHandler.handle( > > > >>> RewriteHandler.java:335) > > > >>> at > > > >>> org.eclipse.jetty.server.handler.HandlerWrapper.handle( > > > >>> HandlerWrapper.java:134) > > > >>> at org.eclipse.jetty.server.Server.handle(Server.java:534) > > > >>> at org.eclipse.jetty.server.HttpChannel.handle( > > > >>> HttpChannel.java:320) > > > >>> at > > > >>> org.eclipse.jetty.server.HttpConnection.onFillable( > > > >>> HttpConnection.java:251) > > > >>> at > > > >>> org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded( > > > >>> AbstractConnection.java:273) > > > >>> at org.eclipse.jetty.io.FillInterest.fillable( > > > >>> FillInterest.java:95) > > > >>> at > > > >>> org.eclipse.jetty.io.SelectChannelEndPoint$2.run( > > > >>> SelectChannelEndPoint.java:93) > > > >>> at > > > >>> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume. > > > >>> executeProduceConsume(ExecuteProduceConsume.java:303) > > > >>> at > > > >>> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume. > > > >>> produceConsume(ExecuteProduceConsume.java:148) > > > >>> at > > > >>> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run( > > > >>> ExecuteProduceConsume.java:136) > > > >>> at > > > >>> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob( > > > >>> QueuedThreadPool.java:671) > > > >>> at > > > >>> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run( > > > >>> QueuedThreadPool.java:589) > > > >>> at java.lang.Thread.run(Thread.java:745) > > > >>> Caused by: java.sql.SQLException: Error while executing SQL "SELECT > > > >>> dv_sv_userFirstName as firstName, dv_sv_userLastName as lastName > > FROM > > > >>> collection1 ORDEr BY dv_sv_userLastName LIMIT 15": From line 1, > > column > > > 9 > > > >> to > > > >>> line 1, column 27: Column 'dv_sv_userFirstName' not found in any > > table > > > >>> at org.apache.calcite.avatica. > Helper.createException(Helper. > > > >>> java:56) > > > >>> at org.apache.calcite.avatica. > Helper.createException(Helper. > > > >>> java:41) > > > >>> at > > > >>> org.apache.calcite.avatica.AvaticaStatement.executeInternal( > > > >>> AvaticaStatement.java:156) > > > >>> at > > > >>> org.apache.calcite.avatica.AvaticaStatement.executeQuery( > > > >>> AvaticaStatement.java:218) > > > >>> at > > > >>> org.apache.solr.client.solrj.io.stream.JDBCStream.open( > > > >>> JDBCStream.java:214) > > > >>> ... 41 more > > > >>> Caused by: org.apache.calcite.runtime.CalciteContextException: > From > > > line > > > >>> 1, > > > >>> column 9 to line 1, column 27: Column 'dv_sv_userFirstName' not > found > > > in > > > >>> any table > > > >>> at sun.reflect.NativeConstructorAccessorImpl. > > > newInstance0(Native > > > >>> Method) > > > >>> at > > > >>> sun.reflect.NativeConstructorAccessorImpl.newInstance( > > > >>> NativeConstructorAccessorImpl.java:62) > > > >>> at > > > >>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance( > > > >>> DelegatingConstructorAccessorImpl.java:45) > > > >>> at java.lang.reflect.Constructor. > > newInstance(Constructor.java: > > > >> 423) > > > >>> at > > > >>> org.apache.calcite.runtime.Resources$ExInstWithCause.ex( > > > >>> Resources.java:463) > > > >>> > > > >> > > > > > > > > > > > > >
