[
https://issues.apache.org/jira/browse/CARBONDATA-666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15842468#comment-15842468
]
Pallavi Singh edited comment on CARBONDATA-666 at 1/27/17 9:57 AM:
-------------------------------------------------------------------
I tried to run the following query with two logical operators and it seems to
be working fine:
select * from uniqdata where integer_column1 IN(159,17,4) OR cust_id NOT
IN(9158,9016,9003) AND cust_name IN ('CUST_NAME_00003 ','CUST_NAME_00016') ;
and it gives me the following result set :
+----------+------------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+
| cust_id | cust_name | active_emui_version | dob
| doj | bigint_column1 | bigint_column2 |
decimal_column1 | decimal_column2 | double_column1 |
double_column2 | integer_column1 |
+----------+------------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+
| 9003 | CUST_NAME_00003 | ACTIVE_EMUI_VERSION_00003 | 1970-01-04
01:00:03.0 | 1970-01-04 02:00:03.0 | 123372036857 | -223372036851 |
12345678904.1234000000 | 22345678904.1234000000 | 1.12345674897976E10 |
-1.12345674897976E10 | 4 |
| 9003 | CUST_NAME_00003 | ACTIVE_EMUI_VERSION_00003 | 1970-01-04
01:00:03.0 | 1970-01-04 02:00:03.0 | 123372036857 | -223372036851 |
12345678904.1234000000 | 22345678904.1234000000 | 1.12345674897976E10 |
-1.12345674897976E10 | 4 |
| 9003 | CUST_NAME_00003 | ACTIVE_EMUI_VERSION_00003 | 1970-01-04
01:00:03.0 | 1970-01-04 02:00:03.0 | 123372036857 | -223372036851 |
12345678904.1234000000 | 22345678904.1234000000 | 1.12345674897976E10 |
-1.12345674897976E10 | 4 |
| 9016 | CUST_NAME_00016 | ACTIVE_EMUI_VERSION_00016 | 1970-01-17
01:00:03.0 | 1970-01-17 02:00:03.0 | 123372036870 | -223372036838 |
12345678917.1234000000 | 22345678917.1234000000 | 1.12345674897976E10 |
-1.12345674897976E10 | 17 |
| 9016 | CUST_NAME_00016 | ACTIVE_EMUI_VERSION_00016 | 1970-01-17
01:00:03.0 | 1970-01-17 02:00:03.0 | 123372036870 | -223372036838 |
12345678917.1234000000 | 22345678917.1234000000 | 1.12345674897976E10 |
-1.12345674897976E10 | 17 |
| 9016 | CUST_NAME_00016 | ACTIVE_EMUI_VERSION_00016 | 1970-01-17
01:00:03.0 | 1970-01-17 02:00:03.0 | 123372036870 | -223372036838 |
12345678917.1234000000 | 22345678917.1234000000 | 1.12345674897976E10 |
-1.12345674897976E10 | 17 |
| 9158 | CUST_NAME_00158 | ACTIVE_EMUI_VERSION_00158 | 1970-06-08
01:00:03.0 | 1970-06-08 02:00:03.0 | 123372037012 | -223372036696 |
12345679059.1234000000 | 22345679059.1234000000 | 1.12345674897976E10 |
-1.12345674897976E10 | 159 |
| 9158 | CUST_NAME_00158 | ACTIVE_EMUI_VERSION_00158 | 1970-06-08
01:00:03.0 | 1970-06-08 02:00:03.0 | 123372037012 | -223372036696 |
12345679059.1234000000 | 22345679059.1234000000 | 1.12345674897976E10 |
-1.12345674897976E10 | 159 |
| 9158 | CUST_NAME_00158 | ACTIVE_EMUI_VERSION_00158 | 1970-06-08
01:00:03.0 | 1970-06-08 02:00:03.0 | 123372037012 | -223372036696 |
12345679059.1234000000 | 22345679059.1234000000 | 1.12345674897976E10 |
-1.12345674897976E10 | 159 |
+----------+------------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+
If you still encounter the problem. Please describe the entire scenario with
attached csv.
was (Author: pallavisingh_09):
I tried to run the following query with two logical operators and it seems to
be working fine:
select * from uniqdata where integer_column1 IN(159,17,4) OR cust_id NOT
IN(9158,9016,9003) AND cust_name IN ('CUST_NAME_00003 ','CUST_NAME_00016') ;
and it gives me the following result set :
+----------+------------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+
| cust_id | cust_name | active_emui_version | dob
| doj | bigint_column1 | bigint_column2 |
decimal_column1 | decimal_column2 | double_column1 |
double_column2 | integer_column1 |
+----------+------------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+
| 9003 | CUST_NAME_00003 | ACTIVE_EMUI_VERSION_00003 | 1970-01-04
01:00:03.0 | 1970-01-04 02:00:03.0 | 123372036857 | -223372036851 |
12345678904.1234000000 | 22345678904.1234000000 | 1.12345674897976E10 |
-1.12345674897976E10 | 4 |
| 9003 | CUST_NAME_00003 | ACTIVE_EMUI_VERSION_00003 | 1970-01-04
01:00:03.0 | 1970-01-04 02:00:03.0 | 123372036857 | -223372036851 |
12345678904.1234000000 | 22345678904.1234000000 | 1.12345674897976E10 |
-1.12345674897976E10 | 4 |
| 9003 | CUST_NAME_00003 | ACTIVE_EMUI_VERSION_00003 | 1970-01-04
01:00:03.0 | 1970-01-04 02:00:03.0 | 123372036857 | -223372036851 |
12345678904.1234000000 | 22345678904.1234000000 | 1.12345674897976E10 |
-1.12345674897976E10 | 4 |
| 9016 | CUST_NAME_00016 | ACTIVE_EMUI_VERSION_00016 | 1970-01-17
01:00:03.0 | 1970-01-17 02:00:03.0 | 123372036870 | -223372036838 |
12345678917.1234000000 | 22345678917.1234000000 | 1.12345674897976E10 |
-1.12345674897976E10 | 17 |
| 9016 | CUST_NAME_00016 | ACTIVE_EMUI_VERSION_00016 | 1970-01-17
01:00:03.0 | 1970-01-17 02:00:03.0 | 123372036870 | -223372036838 |
12345678917.1234000000 | 22345678917.1234000000 | 1.12345674897976E10 |
-1.12345674897976E10 | 17 |
| 9016 | CUST_NAME_00016 | ACTIVE_EMUI_VERSION_00016 | 1970-01-17
01:00:03.0 | 1970-01-17 02:00:03.0 | 123372036870 | -223372036838 |
12345678917.1234000000 | 22345678917.1234000000 | 1.12345674897976E10 |
-1.12345674897976E10 | 17 |
| 9158 | CUST_NAME_00158 | ACTIVE_EMUI_VERSION_00158 | 1970-06-08
01:00:03.0 | 1970-06-08 02:00:03.0 | 123372037012 | -223372036696 |
12345679059.1234000000 | 22345679059.1234000000 | 1.12345674897976E10 |
-1.12345674897976E10 | 159 |
| 9158 | CUST_NAME_00158 | ACTIVE_EMUI_VERSION_00158 | 1970-06-08
01:00:03.0 | 1970-06-08 02:00:03.0 | 123372037012 | -223372036696 |
12345679059.1234000000 | 22345679059.1234000000 | 1.12345674897976E10 |
-1.12345674897976E10 | 159 |
| 9158 | CUST_NAME_00158 | ACTIVE_EMUI_VERSION_00158 | 1970-06-08
01:00:03.0 | 1970-06-08 02:00:03.0 | 123372037012 | -223372036696 |
12345679059.1234000000 | 22345679059.1234000000 | 1.12345674897976E10 |
-1.12345674897976E10 | 159 |
+----------+------------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+
> Select Query fails with NullPoint exception if using 2 or more logical
> operators
> --------------------------------------------------------------------------------
>
> Key: CARBONDATA-666
> URL: https://issues.apache.org/jira/browse/CARBONDATA-666
> Project: CarbonData
> Issue Type: Bug
> Affects Versions: 1.0.0-incubating
> Environment: Spark 1.6
> Reporter: Ramakrishna
> Priority: Minor
>
> select * from communication.flow_carbon where cus_ac = '6222621350672465397'
> and txn_bk IN ('00000000000', '00000000001','00000000002') OR own_bk IN
> ('00000000124','00000000175','00000000034','00000000231','00000000167','00000000182','00000000206')
> limit 10;
> Error: org.apache.spark.SparkException: Job aborted due to stage failure:
> Task 0 in stage 0.0 failed 4 times, most recent failure: Lost task 0.3 in
> stage 0.0 (TID 3, linux-79): java.lang.RuntimeException:
> java.util.concurrent.ExecutionException: java.lang.NullPointerException
> at
> org.apache.carbondata.scan.result.iterator.DetailQueryResultIterator.next(DetailQueryResultIterator.java:65)
> at
> org.apache.carbondata.scan.result.iterator.DetailQueryResultIterator.next(DetailQueryResultIterator.java:35)
> at
> org.apache.carbondata.scan.result.iterator.ChunkRowIterator.<init>(ChunkRowIterator.java:43)
> at
> org.apache.carbondata.hadoop.CarbonRecordReader.initialize(CarbonRecordReader.java:81)
> at
> org.apache.carbondata.spark.rdd.CarbonScanRDD.compute(CarbonScanRDD.scala:194)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
> at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
> at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
> at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
> at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
> at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
> at org.apache.spark.scheduler.Task.run(Task.scala:89)
> at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:227)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.util.concurrent.ExecutionException:
> java.lang.NullPointerException
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> at java.util.concurrent.FutureTask.get(FutureTask.java:192)
> at
> org.apache.carbondata.scan.result.iterator.DetailQueryResultIterator.next(DetailQueryResultIterator.java:52)
> ... 24 more
> Caused by: java.lang.NullPointerException
> at
> org.apache.carbondata.scan.result.AbstractScannedResult.getDictionaryKeyIntegerArray(AbstractScannedResult.java:186)
> at
> org.apache.carbondata.scan.result.impl.FilterQueryScannedResult.getDictionaryKeyIntegerArray(FilterQueryScannedResult.java:53)
> at
> org.apache.carbondata.scan.collector.impl.DictionaryBasedResultCollector.collectData(DictionaryBasedResultCollector.java:111)
> at
> org.apache.carbondata.scan.processor.impl.DataBlockIteratorImpl.next(DataBlockIteratorImpl.java:52)
> at
> org.apache.carbondata.scan.processor.impl.DataBlockIteratorImpl.next(DataBlockIteratorImpl.java:33)
> at
> org.apache.carbondata.scan.result.iterator.DetailQueryResultIterator$1.call(DetailQueryResultIterator.java:78)
> at
> org.apache.carbondata.scan.result.iterator.DetailQueryResultIterator$1.call(DetailQueryResultIterator.java:72)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> ... 3 more
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
