[
https://issues.apache.org/jira/browse/DRILL-487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13960914#comment-13960914
]
Aman Sinha commented on DRILL-487:
----------------------------------
Submitted patch with the following fixes:
- Setup mappings appropriately for MergeJoin's compare functions.
- Throw exception instead of assert when no join conditions are present
otherwise if assertions are not enabled (which is the case with SqlLine), the
execution continues until we encounter the code compilation error.
- (Re) Enable PushFilterPastJoinRule (not sure why this was disabled).
Without this rule, only JOIN..ON clause would get the proper join conditions.
If the join conditions were present in the WHERE clause, it was not getting
pushed to the join.
> Joining across different data sources throw 'schema change' exception
> ---------------------------------------------------------------------
>
> Key: DRILL-487
> URL: https://issues.apache.org/jira/browse/DRILL-487
> Project: Apache Drill
> Issue Type: Bug
> Reporter: Neeraja
> Assignee: Aman Sinha
> Priority: Critical
> Attachments:
> 0001-Fix-Drill-487.-Setup-mappings-appropriately-for-comp.patch
>
>
> Cross data source queries are throwing exception. Examples include between a
> file and Hive table, a hive table and HBase table, 2 files of different
> formats.
> Here is a simple example. I will add more detailed log.
> select c.c_custkey from
> dfs.`/home/mapr/tpch/sf-0.1_tpc-h_DataParquet/customer.parquet` c,
> dfs.`/home/mapr/sample-data/userprofilejson/user1.json` u
> where c.c_custkey = u.id;
> user1.json is below.
> {
> "id":8362,
> "account":
> {
> "name":"Alice",
> "email":"[email protected]"
> },
> "address":
> {
> "street":"123 Ballmer Av",
> "zipcode":"12345",
> "state":"CA"
> }
> }
> Exception:
> message: "Screen received stop request sent. < SchemaChangeException:[
> org.apache.drill.exec.exception.ClassTransformationException: Failure
> generating transformation classes for value: \n \npackage
> org.apache.drill.exec.test.generated;\n\nimport
> org.apache.drill.exec.exception.SchemaChangeException;\nimport
> org.apache.drill.exec.ops.FragmentContext;\nimport
> org.apache.drill.exec.physical.impl.join.JoinStatus;\nimport
> org.apache.drill.exec.record.RecordBatch;\nimport
> org.apache.drill.exec.record.VectorContainer;\nimport
> org.apache.drill.exec.vector.BigIntVector;\nimport
> org.apache.drill.exec.vector.Float8Vector;\nimport
> org.apache.drill.exec.vector.NullableBigIntVector;\nimport
> org.apache.drill.exec.vector.NullableIntVector;\nimport
> org.apache.drill.exec.vector.NullableVarCharVector;\nimport
> org.apache.drill.exec.vector.VarBinaryVector;\n\npublic class
> JoinWorkerGen141 {\n\n JoinStatus status;\n VectorContainer outgoing;\n
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
