[
https://issues.apache.org/jira/browse/TAJO-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14058432#comment-14058432
]
Hudson commented on TAJO-925:
-----------------------------
FAILURE: Integrated in Tajo-master-build #285 (See
[https://builds.apache.org/job/Tajo-master-build/285/])
TAJO-925: Child ExecutionBlock of JOIN node has different number of shuffle
keys. (Hyoungjun Kim via hyunsik) (hyunsik: rev
438010f92bdbde50447d9fbc3438e57ddaff776f)
* tajo-core/src/test/java/org/apache/tajo/engine/query/TestJoinQuery.java
* tajo-core/src/main/java/org/apache/tajo/engine/planner/global/MasterPlan.java
* CHANGES
* tajo-core/src/main/java/org/apache/tajo/master/querymaster/SubQuery.java
* tajo-core/src/main/java/org/apache/tajo/master/querymaster/Query.java
*
tajo-core/src/main/java/org/apache/tajo/engine/planner/global/ExecutionBlockCursor.java
> Child ExecutionBlock of JOIN node has different number of shuffle keys.
> -----------------------------------------------------------------------
>
> Key: TAJO-925
> URL: https://issues.apache.org/jira/browse/TAJO-925
> Project: Tajo
> Issue Type: Bug
> Reporter: Hyoungjun Kim
> Assignee: Hyoungjun Kim
> Priority: Minor
> Fix For: 0.9.0
>
>
> If both sides of a join node is not SCAN but SUBQUERY, each node has
> different number shuffle keys.
> In that case JOIN query returns a wrong result. I tested with the below test
> code.
> {code}
> @Test
> public void testJoinWithDifferentShuffleKey() throws Exception {
> KeyValueSet tableOptions = new KeyValueSet();
> tableOptions.put(StorageConstants.CSVFILE_DELIMITER,
> StorageConstants.DEFAULT_FIELD_DELIMITER);
> tableOptions.put(StorageConstants.CSVFILE_NULL, "\\\\N");
> Schema schema = new Schema();
> schema.addColumn("id", Type.INT4);
> schema.addColumn("name", Type.TEXT);
> List<String> data = new ArrayList<String>();
> int bytes = 0;
> for (int i = 0; i < 1000000; i++) {
> String row = i + "|" + i +
> "name012345678901234567890123456789012345678901234567890";
> bytes += row.getBytes().length;
> data.add(row);
> if (bytes > 2 * 1024 * 1024) {
> break;
> }
> }
> TajoTestingCluster.createTable("large_table", schema, tableOptions,
> data.toArray(new String[]{}));
> int originConfValue =
> conf.getIntVar(ConfVars.DIST_QUERY_JOIN_PARTITION_VOLUME);
>
> testingCluster.setAllTajoDaemonConfValue(ConfVars.DIST_QUERY_JOIN_PARTITION_VOLUME.varname,
> "1");
> ResultSet res = executeString(
> "select count(b.id) " +
> "from (select id, count(*) as cnt from large_table group by id) a " +
> "left outer join (select id, count(*) as cnt from large_table where
> id < 200 group by id) b " +
> "on a.id = b.id"
> );
> try {
> String expected =
> "?count\n" +
> "-------------------------------\n" +
> "200\n";
> assertEquals(expected, resultSetToString(res));
> } finally {
>
> testingCluster.setAllTajoDaemonConfValue(ConfVars.DIST_QUERY_JOIN_PARTITION_VOLUME.varname,
> "" + originConfValue);
> cleanupQuery(res);
> executeString("DROP TABLE large_table PURGE").close();
> }
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
