[
https://issues.apache.org/jira/browse/DRILL-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180621#comment-14180621
]
Hanifi Gunes edited comment on DRILL-1435 at 10/22/14 10:10 PM:
----------------------------------------------------------------
This patch does the following: ensure producer consumer returns the last batch
indicator & prevent blocking/leaking producer & consumer threads; fix
concurrency issues that drives sqlline & drillbit hanging
was (Author: hgunes):
ensure producer consumer returns the last batch indicator & prevent
blocking/leaking producer & consumer threads; fix concurrency issues that
drives sqlline & drillbit hanging
> sqlline hangs when query a text file with limit
> -----------------------------------------------
>
> Key: DRILL-1435
> URL: https://issues.apache.org/jira/browse/DRILL-1435
> Project: Apache Drill
> Issue Type: Bug
> Components: Functions - Drill
> Affects Versions: 0.6.0
> Reporter: Chun Chang
> Assignee: Hanifi Gunes
> Priority: Critical
> Fix For: 0.7.0
>
> Attachments: DRILL-1435.1.patch.txt
>
>
> code base
> #Fri Sep 12 14:08:02 PDT 2014
> git.commit.id.abbrev=9e16466
> When I query a psv file with limit, sqlline frequently hangs. It sometimes
> comes back after a while but most of the time, it just hangs. When it hangs,
> I saw the InterruptedException in drill bit.log.
> 11:43:23.238 [ce3297e2-8238-4f05-968f-e96550d23b10:frag:0:0 - Producer
> Thread] ERROR o.a.drill.exec.ops.FragmentContext - Fragment Context received
> failure.
> java.lang.InterruptedException: null
> at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
> ~[na:1.7.0_45]
> at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2052)
> ~[na:1.7.0_45]
> at
> java.util.concurrent.LinkedBlockingDeque.putLast(LinkedBlockingDeque.java:393)
> ~[na:1.7.0_45]
> at
> java.util.concurrent.LinkedBlockingDeque.put(LinkedBlockingDeque.java:647)
> ~[na:1.7.0_45]
> at
> org.apache.drill.exec.physical.impl.producer.ProducerConsumerBatch$Producer.run(ProducerConsumerBatch.java:140)
>
> ~[drill-java-exec-0.6.0-incubating-SNAPSHOT-rebuffed.jar:0.6.0-incubating-SNAPSHOT]
> at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
> sqlline just hangs:
> 0: jdbc:drill:schema=dfs> select * from `tpcds/p1/store_sales.parquet` limit
> 1;
> +-----------------+-----------------+------------+----------------+-------------+-------------+------------+-------------+-------------+------------------+-------------+-------------------+---------------+----------------+---------------------+--------------------+-----------------------+-------------------+------------+---------------+-------------+---------------------+---------------+
> | ss_sold_date_sk | ss_sold_time_sk | ss_item_sk | ss_customer_sk |
> ss_cdemo_sk | ss_hdemo_sk | ss_addr_sk | ss_store_sk | ss_promo_sk |
> ss_ticket_number | ss_quantity | ss_wholesale_cost | ss_list_price |
> ss_sales_price | ss_ext_discount_amt | ss_ext_sales_price |
> ss_ext_wholesale_cost | ss_ext_list_price | ss_ext_tax | ss_coupon_amt |
> ss_net_paid | ss_net_paid_inc_tax | ss_net_profit |
> +-----------------+-----------------+------------+----------------+-------------+-------------+------------+-------------+-------------+------------------+-------------+-------------------+---------------+----------------+---------------------+--------------------+-----------------------+-------------------+------------+---------------+-------------+---------------------+---------------+
> | 2452603 | 71996 | 2739 | 59832 | 1659109
> | 4339 | 13616 | 2 | 180 | 167289 |
> 60 | 80.79 | 147.03 | 89.68 | 2206.12
> | 5380.8 | 4847.4 | 8821.8 |
> 222.22 | 2206.12 | 3174.68 | 3396.9 | -1672.72
> |
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
