[jira] [Commented] (DRILL-2606) Casting a column from hbase to boolean after a join with parquet makes DRILL unresponsive
[
https://issues.apache.org/jira/browse/DRILL-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14496294#comment-14496294
]
Venki Korukanti commented on DRILL-2606:
bq.1. Could you add a more general test case as well where we are casting to a
boolean type with exchanges in the plan, this would also test the
deserialization logic.
patch v2 adds one more test case
bq. 2. In the castBit (cast from varchar to boolean) function should we use
equalsIgnoreCase?
This seems like a bug in cast function implementation. Will log a separate JIRA.
> Casting a column from hbase to boolean after a join with parquet makes DRILL
> unresponsive
> -
>
> Key: DRILL-2606
> URL: https://issues.apache.org/jira/browse/DRILL-2606
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Flow
>Affects Versions: 0.8.0
>Reporter: Rahul Challapalli
>Assignee: Venki Korukanti
>Priority: Critical
> Fix For: 0.9.0
>
> Attachments: DRILL-2606-1.patch, DRILL-2606-2.patch, dataload.hql,
> error.log, fewtypes_null.parquet, fewtypes_null_hbase.tbl
>
>
> Small scale repro without HBase:
> {code}
> alter session set `planner.slice_target`=1;
> select cast(cast(bool_col as varchar(100)) as boolean) from
> dfs.`/Users/hadoop/Downloads/fewtypes_null.parquet` order by int_col;
> {code}
> git.commit.id.abbrev=4d398ed
> The below query never returns and causes Sqlline to hang. DRILL also becomes
> unresponsive after executing this query. So I have to restart drill for
> sqlline to even come up.
> {code}
> select cast(cast(o.types.bool_col as varchar(100)) as boolean) bool_col
> from dfs.`cross-sources`.`fewtypes_null.parquet` p
> inner join hbase.fewtypes_null o
> on p.int_col = cast(cast(o.types.int_col as varchar(100)) as int)
> {code}
> This issue is similar to DRILL-2605. However in this case I did not use a
> view and some this causes drill/sqlline to become unresponsive where in
> DRILL-2605 we just get back an error.
> I attached the data files, data loading script, and the error log. Let me
> know if you need anything else.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (DRILL-2606) Casting a column from hbase to boolean after a join with parquet makes DRILL unresponsive
[
https://issues.apache.org/jira/browse/DRILL-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495694#comment-14495694
]
Mehant Baid commented on DRILL-2606:
+1. Minor comments
1. Could you add a more general test case as well where we are casting to a
boolean type with exchanges in the plan, this would also test the
deserialization logic.
2. In the castBit (cast from varchar to boolean) function should we use
equalsIgnoreCase?
> Casting a column from hbase to boolean after a join with parquet makes DRILL
> unresponsive
> -
>
> Key: DRILL-2606
> URL: https://issues.apache.org/jira/browse/DRILL-2606
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Flow
>Affects Versions: 0.8.0
>Reporter: Rahul Challapalli
>Assignee: Venki Korukanti
>Priority: Critical
> Fix For: 0.9.0
>
> Attachments: DRILL-2606-1.patch, dataload.hql, error.log,
> fewtypes_null.parquet, fewtypes_null_hbase.tbl
>
>
> Small scale repro without HBase:
> {code}
> alter session set `planner.slice_target`=1;
> select cast(cast(bool_col as varchar(100)) as boolean) from
> dfs.`/Users/hadoop/Downloads/fewtypes_null.parquet` order by int_col;
> {code}
> git.commit.id.abbrev=4d398ed
> The below query never returns and causes Sqlline to hang. DRILL also becomes
> unresponsive after executing this query. So I have to restart drill for
> sqlline to even come up.
> {code}
> select cast(cast(o.types.bool_col as varchar(100)) as boolean) bool_col
> from dfs.`cross-sources`.`fewtypes_null.parquet` p
> inner join hbase.fewtypes_null o
> on p.int_col = cast(cast(o.types.int_col as varchar(100)) as int)
> {code}
> This issue is similar to DRILL-2605. However in this case I did not use a
> view and some this causes drill/sqlline to become unresponsive where in
> DRILL-2605 we just get back an error.
> I attached the data files, data loading script, and the error log. Let me
> know if you need anything else.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (DRILL-2606) Casting a column from hbase to boolean after a join with parquet makes DRILL unresponsive
[
https://issues.apache.org/jira/browse/DRILL-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495686#comment-14495686
]
Jacques Nadeau commented on DRILL-2606:
---
LGTM +1
> Casting a column from hbase to boolean after a join with parquet makes DRILL
> unresponsive
> -
>
> Key: DRILL-2606
> URL: https://issues.apache.org/jira/browse/DRILL-2606
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Flow
>Affects Versions: 0.8.0
>Reporter: Rahul Challapalli
>Assignee: Venki Korukanti
>Priority: Critical
> Fix For: 0.9.0
>
> Attachments: DRILL-2606-1.patch, dataload.hql, error.log,
> fewtypes_null.parquet, fewtypes_null_hbase.tbl
>
>
> Small scale repro without HBase:
> {code}
> alter session set `planner.slice_target`=1;
> select cast(cast(bool_col as varchar(100)) as boolean) from
> dfs.`/Users/hadoop/Downloads/fewtypes_null.parquet` order by int_col;
> {code}
> git.commit.id.abbrev=4d398ed
> The below query never returns and causes Sqlline to hang. DRILL also becomes
> unresponsive after executing this query. So I have to restart drill for
> sqlline to even come up.
> {code}
> select cast(cast(o.types.bool_col as varchar(100)) as boolean) bool_col
> from dfs.`cross-sources`.`fewtypes_null.parquet` p
> inner join hbase.fewtypes_null o
> on p.int_col = cast(cast(o.types.int_col as varchar(100)) as int)
> {code}
> This issue is similar to DRILL-2605. However in this case I did not use a
> view and some this causes drill/sqlline to become unresponsive where in
> DRILL-2605 we just get back an error.
> I attached the data files, data loading script, and the error log. Let me
> know if you need anything else.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (DRILL-2606) Casting a column from hbase to boolean after a join with parquet makes DRILL unresponsive
[
https://issues.apache.org/jira/browse/DRILL-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14494795#comment-14494795
]
Sudheesh Katkam commented on DRILL-2606:
Adding to Chris' comment, jackson is unable to parse an expression in
fragment_json (part of PlanFragment) because 'BIT' is not a recognized token in
ExprParser.java
This line in ControlHandlerImpl.java throws the exception:
{code}
final FragmentRoot rootOperator =
drillbitContext.getPlanReader().readFragmentOperator(fragment.getFragmentJson());
{code}
{code}
...
org.apache.drill.common.exceptions.ExpressionParsingException: Expression has
syntax error! line 1:65:no viable alternative at input 'BIT'
at
org.apache.drill.common.expression.parser.ExprParser.displayRecognitionError(ExprParser.java:168)
...
{code}
> Casting a column from hbase to boolean after a join with parquet makes DRILL
> unresponsive
> -
>
> Key: DRILL-2606
> URL: https://issues.apache.org/jira/browse/DRILL-2606
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Flow
>Affects Versions: 0.8.0
>Reporter: Rahul Challapalli
>Assignee: Sudheesh Katkam
>Priority: Critical
> Fix For: 0.9.0
>
> Attachments: dataload.hql, error.log, fewtypes_null.parquet,
> fewtypes_null_hbase.tbl
>
>
> git.commit.id.abbrev=4d398ed
> The below query never returns and causes Sqlline to hang. DRILL also becomes
> unresponsive after executing this query. So I have to restart drill for
> sqlline to even come up.
> {code}
> select cast(cast(o.types.bool_col as varchar(100)) as boolean) bool_col
> from dfs.`cross-sources`.`fewtypes_null.parquet` p
> inner join hbase.fewtypes_null o
> on p.int_col = cast(cast(o.types.int_col as varchar(100)) as int)
> {code}
> This issue is similar to DRILL-2605. However in this case I did not use a
> view and some this causes drill/sqlline to become unresponsive where in
> DRILL-2605 we just get back an error.
> I attached the data files, data loading script, and the error log. Let me
> know if you need anything else.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (DRILL-2606) Casting a column from hbase to boolean after a join with parquet makes DRILL unresponsive
[
https://issues.apache.org/jira/browse/DRILL-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390868#comment-14390868
]
Chris Westin commented on DRILL-2606:
-
>From the log, it looks like a remote fragment has trouble deserializing its
>instructions.
> Casting a column from hbase to boolean after a join with parquet makes DRILL
> unresponsive
> -
>
> Key: DRILL-2606
> URL: https://issues.apache.org/jira/browse/DRILL-2606
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Flow
>Affects Versions: 0.8.0
>Reporter: Rahul Challapalli
>Assignee: Sudheesh Katkam
>Priority: Critical
> Fix For: 0.9.0
>
> Attachments: dataload.hql, error.log, fewtypes_null.parquet,
> fewtypes_null_hbase.tbl
>
>
> git.commit.id.abbrev=4d398ed
> The below query never returns and causes Sqlline to hang. DRILL also becomes
> unresponsive after executing this query. So I have to restart drill for
> sqlline to even come up.
> {code}
> select cast(cast(o.types.bool_col as varchar(100)) as boolean) bool_col
> from dfs.`cross-sources`.`fewtypes_null.parquet` p
> inner join hbase.fewtypes_null o
> on p.int_col = cast(cast(o.types.int_col as varchar(100)) as int)
> {code}
> This issue is similar to DRILL-2605. However in this case I did not use a
> view and some this causes drill/sqlline to become unresponsive where in
> DRILL-2605 we just get back an error.
> I attached the data files, data loading script, and the error log. Let me
> know if you need anything else.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (DRILL-2606) Casting a column from hbase to boolean after a join with parquet makes DRILL unresponsive
[
https://issues.apache.org/jira/browse/DRILL-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14384301#comment-14384301
]
Rahul Challapalli commented on DRILL-2606:
--
FYI : I have kill the drillbit manually as stopping it through the shell script
did not work as well
> Casting a column from hbase to boolean after a join with parquet makes DRILL
> unresponsive
> -
>
> Key: DRILL-2606
> URL: https://issues.apache.org/jira/browse/DRILL-2606
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Flow, Storage - HBase
>Reporter: Rahul Challapalli
>Assignee: Chris Westin
>Priority: Critical
> Attachments: dataload.hql, error.log, fewtypes_null.parquet,
> fewtypes_null_hbase.tbl
>
>
> git.commit.id.abbrev=4d398ed
> The below query never returns and causes Sqlline to hang. DRILL also becomes
> unresponsive after executing this query. So I have to restart drill for
> sqlline to even come up.
> {code}
> select cast(cast(o.types.bool_col as varchar(100)) as boolean) bool_col
> from dfs.`cross-sources`.`fewtypes_null.parquet` p
> inner join hbase.fewtypes_null o
> on p.int_col = cast(cast(o.types.int_col as varchar(100)) as int)
> {code}
> This issue is similar to DRILL-2605. However in this case I did not use a
> view and some this causes drill/sqlline to become unresponsive where in
> DRILL-2605 we just get back an error.
> I attached the data files, data loading script, and the error log. Let me
> know if you need anything else.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
