Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Jianfeng Jia (Code Review)
Jianfeng Jia has posted comments on this change.

Change subject: Fulltext search initial implementation
..


Patch Set 5:

(1 comment)

https://asterix-gerrit.ics.uci.edu/#/c/989/5/asterixdb/asterix-doc/src/site/markdown/aql/manual.md
File asterixdb/asterix-doc/src/site/markdown/aql/manual.md:

Line 720: `rtree` for spatial data, and `keyword`, `ngram`, and `fulltext` for 
textual (string) data.
what is the different between `keyword` and `fulltext`?


-- 
To view, visit https://asterix-gerrit.ics.uci.edu/989
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
Gerrit-PatchSet: 5
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: Yes


Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Fulltext search initial implementation
..


Patch Set 9: Integration-Tests-1

Integration Tests Failed

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/147/ : 
UNSTABLE

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/989
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
Gerrit-PatchSet: 9
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Fulltext search initial implementation
..


Patch Set 9:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/147/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/989
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
Gerrit-PatchSet: 9
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Fulltext search initial implementation
..


Patch Set 9:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/989
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
Gerrit-PatchSet: 9
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Fulltext search initial implementation
..


Patch Set 9:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/1981/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/989
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
Gerrit-PatchSet: 9
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Taewoo Kim (Code Review)
Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/989

to look at the new patch set (#9).

Change subject: Fulltext search initial implementation
..

Fulltext search initial implementation

 - Supports Fulltext search using XQuery syntax
 - Keyword level AND or OR search is possible
 - Changed a function name: contains -> string-contains to remove any confusion

Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/operators/physical/InvertedIndexPOperator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/AnalysisUtil.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushLimitIntoOrderByRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AbstractIntroduceAccessMethodRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodJobGenParams.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodUtils.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/IntroduceJoinAccessMethodRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/IntroduceLSMComponentFilterRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/InvertedIndexAccessMethod.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/InvertedIndexJobGenParams.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/OptimizableFuncExpr.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/AqlExpressionToPlanTranslator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/AqlPlusExpressionToPlanTranslator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/LangExpressionToPlanTranslator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/util/FunctionCollection.java
M asterixdb/asterix-algebra/src/main/javacc/AQLPlus.jj
M asterixdb/asterix-app/data/csv/fragile_02.adm
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-1/dataset_with_meta-1.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-2/dataset_with_meta-2.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-3/dataset_with_meta-3.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-4/dataset_with_meta-4.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-5/dataset_with_meta-5.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-6/dataset_with_meta-6.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-7/dataset_with_meta-6.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_1/issue_251_dataset_hint_1.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_2/issue_251_dataset_hint_2.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_3/issue_251_dataset_hint_3.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_4/issue_251_dataset_hint_4.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_251_dataset_hint_error_1.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_251_dataset_hint_error_1/issue_251_dataset_hint_error_1.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_251_dataset_hint_error_2.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_251_dataset_hint_error_2/issue_251_dataset_hint_error_2.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_255_create_feed_error/issue_255_create_feed_error.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/nontagged/tpch/local/closedtables-q9.aql
M 
asterixdb/asterix-app/src/test/resources/nontagged/tpch/local/opentables-q9.aql
M asterixdb/asterix-app/src/test/resources/optimizerts/queries/count-tweets.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-basic/ngram-contains-panic.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-basic/ngram-contains.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-basic/word-contains.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-join/ngram-contains.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/invert

Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Fulltext search initial implementation
..


Patch Set 8: Integration-Tests-1

Integration Tests Failed

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/146/ : 
UNSTABLE

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/989
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Fulltext search initial implementation
..


Patch Set 8:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/146/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/989
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Fulltext search initial implementation
..


Patch Set 8:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/989
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Fulltext search initial implementation
..


Patch Set 8:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/1980/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/989
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Taewoo Kim (Code Review)
Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/989

to look at the new patch set (#8).

Change subject: Fulltext search initial implementation
..

Fulltext search initial implementation

 - Supports Fulltext search using XQuery syntax
 - Keyword level AND or OR search is possible
 - Changed a function name: contains -> string-contains to remove any confusion

Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/operators/physical/InvertedIndexPOperator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/AnalysisUtil.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushLimitIntoOrderByRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AbstractIntroduceAccessMethodRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodJobGenParams.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodUtils.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/IntroduceJoinAccessMethodRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/IntroduceLSMComponentFilterRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/InvertedIndexAccessMethod.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/InvertedIndexJobGenParams.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/OptimizableFuncExpr.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/AqlExpressionToPlanTranslator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/AqlPlusExpressionToPlanTranslator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/LangExpressionToPlanTranslator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/util/FunctionCollection.java
M asterixdb/asterix-algebra/src/main/javacc/AQLPlus.jj
M asterixdb/asterix-app/data/csv/fragile_02.adm
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-1/dataset_with_meta-1.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-2/dataset_with_meta-2.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-3/dataset_with_meta-3.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-4/dataset_with_meta-4.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-5/dataset_with_meta-5.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-6/dataset_with_meta-6.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-7/dataset_with_meta-6.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_1/issue_251_dataset_hint_1.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_2/issue_251_dataset_hint_2.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_3/issue_251_dataset_hint_3.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_4/issue_251_dataset_hint_4.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_251_dataset_hint_error_1.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_251_dataset_hint_error_1/issue_251_dataset_hint_error_1.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_251_dataset_hint_error_2.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_251_dataset_hint_error_2/issue_251_dataset_hint_error_2.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_255_create_feed_error/issue_255_create_feed_error.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/nontagged/tpch/local/closedtables-q9.aql
M 
asterixdb/asterix-app/src/test/resources/nontagged/tpch/local/opentables-q9.aql
M asterixdb/asterix-app/src/test/resources/optimizerts/queries/count-tweets.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-basic/ngram-contains-panic.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-basic/ngram-contains.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-basic/word-contains.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-join/ngram-contains.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/invert

Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Fulltext search initial implementation
..


Patch Set 7: Integration-Tests-1

Integration Tests Failed

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/145/ : 
UNSTABLE

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/989
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Fulltext search initial implementation
..


Patch Set 7:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/145/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/989
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Fulltext search initial implementation
..


Patch Set 7:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/989
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Fulltext search initial implementation
..


Patch Set 7:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/1979/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/989
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Taewoo Kim (Code Review)
Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/989

to look at the new patch set (#7).

Change subject: Fulltext search initial implementation
..

Fulltext search initial implementation

 - Supports Fulltext search using XQuery syntax
 - Keyword level AND or OR search is possible
 - Changed a function name: contains -> string-contains to remove any confusion

Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/operators/physical/InvertedIndexPOperator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/AnalysisUtil.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushLimitIntoOrderByRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AbstractIntroduceAccessMethodRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodJobGenParams.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodUtils.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/IntroduceJoinAccessMethodRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/IntroduceLSMComponentFilterRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/InvertedIndexAccessMethod.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/InvertedIndexJobGenParams.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/OptimizableFuncExpr.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/AqlExpressionToPlanTranslator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/AqlPlusExpressionToPlanTranslator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/LangExpressionToPlanTranslator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/util/FunctionCollection.java
M asterixdb/asterix-algebra/src/main/javacc/AQLPlus.jj
M asterixdb/asterix-app/data/csv/fragile_02.adm
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-1/dataset_with_meta-1.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-2/dataset_with_meta-2.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-3/dataset_with_meta-3.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-4/dataset_with_meta-4.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-5/dataset_with_meta-5.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-6/dataset_with_meta-6.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-7/dataset_with_meta-6.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_1/issue_251_dataset_hint_1.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_2/issue_251_dataset_hint_2.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_3/issue_251_dataset_hint_3.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_4/issue_251_dataset_hint_4.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_251_dataset_hint_error_1.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_251_dataset_hint_error_1/issue_251_dataset_hint_error_1.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_251_dataset_hint_error_2.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_251_dataset_hint_error_2/issue_251_dataset_hint_error_2.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_255_create_feed_error/issue_255_create_feed_error.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/nontagged/tpch/local/closedtables-q9.aql
M 
asterixdb/asterix-app/src/test/resources/nontagged/tpch/local/opentables-q9.aql
M asterixdb/asterix-app/src/test/resources/optimizerts/queries/count-tweets.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-basic/ngram-contains-panic.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-basic/ngram-contains.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-basic/word-contains.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-join/ngram-contains.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/invert

Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Fulltext search initial implementation
..


Patch Set 6: Integration-Tests-1

Integration Tests Failed

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/144/ : 
UNSTABLE

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/989
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


[jira] [Updated] (ASTERIXDB-1393) Initiate Datetime without sec causes IndexOutOfBoundsException

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1393:
-
Assignee: Xikui Wang

> Initiate Datetime without sec causes IndexOutOfBoundsException
> --
>
> Key: ASTERIXDB-1393
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1393
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Data Formats
>Reporter: Xikui Wang
>Assignee: Xikui Wang
>Priority: Trivial
>
> When passing date time value without second, e.g.: 
> datetime("2016-03-04T17:17"), it will cause 
> ArrayIndexOutOfBoundsException:18. The exception happens at 
> {quote}
> at 
> org.apache.asterix.om.base.temporal.ATimeParserFactory.parseTimePart(ATimeParserFactory.java:385)
> {quote}
> I think another exception handler might be better for this scenario.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1532) Need friendlier error msg(s) for open index errors

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1532:
-
Issue Type: Improvement  (was: Bug)

> Need friendlier error msg(s) for open index errors
> --
>
> Key: ASTERIXDB-1532
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1532
> Project: Apache AsterixDB
>  Issue Type: Improvement
>  Components: AsterixDB, Error Reporting, Translator - AQL
> Environment: Very recent binary bits from Apache AsterixDB site
>Reporter: Michael J. Carey
>Priority: Minor
>
> RUN THESE COMMANDS:
> drop dataverse TinySocial if exists;
> create dataverse TinySocial;
> use dataverse TinySocial;
> create type ChirpUserType as { screenName: string }
> create type ChirpMessageType as closed { chirpId: string }
> create type GleambookUserType as { id: int64 }
> create type GleambookMessageType as { messageId: int64 }
> create dataset GleambookUsers(GleambookUserType) primary key id;
> create dataset GleambookMessages(GleambookMessageType) primary key messageId;
> create dataset ChirpUsers(ChirpUserType) primary key screenName;
> create dataset ChirpMessages(ChirpMessageType) primary key chirpId;
> create index gbUserSinceIdx on GleambookUsers(userSince:datetime) enforced;
> create index gbAuthorIdx on GleambookMessages(authorId:int64) type btree 
> enforced;
> create index gbSenderLocIndex on GleambookMessages(senderLocation:point) type 
> rtree enforced;
> create index gbMessageIdx on GleambookMessages(message) type keyword enforced;
> AND YOU'LL GET THIS RESULT:
> Unknown type [message] [AlgebricksException]
> AND IN MY OPINION:
> While 100% accurate, it's really terse - it would be nicer to give an error 
> message such as the following.  (The same will be true for other things that 
> might pop as errors in Algebricks.)
> The data type for indexed field "message" was not specified but is required 
> when specifying an index on a field not included in the dataset schema.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1521) Stored function body stores extra white spaces.

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1521:
-
Assignee: Abdullah Alamoudi

> Stored function body stores extra white spaces.
> ---
>
> Key: ASTERIXDB-1521
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1521
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Abdullah Alamoudi
>Assignee: Abdullah Alamoudi
>Priority: Minor
>
> when a user create a function, we store it exactly as it is.
> For example
> create function test.getFullName($fname,$lname){
> string-concat(
> [$fname,$lname]
> )
> }
> will be stored as 
> string-concat(
> [$fname,$lname]
> )
> while it can be stored as:
> string-concat([$fname,$lname])



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (ASTERIXDB-1521) Stored function body stores extra white spaces.

2016-07-22 Thread Till Westmann (JIRA)

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390445#comment-15390445
 ] 

Till Westmann commented on ASTERIXDB-1521:
--

[~amoudi], I think that you fixed this already. Is that right?

> Stored function body stores extra white spaces.
> ---
>
> Key: ASTERIXDB-1521
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1521
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Abdullah Alamoudi
>Assignee: Abdullah Alamoudi
>Priority: Minor
>
> when a user create a function, we store it exactly as it is.
> For example
> create function test.getFullName($fname,$lname){
> string-concat(
> [$fname,$lname]
> )
> }
> will be stored as 
> string-concat(
> [$fname,$lname]
> )
> while it can be stored as:
> string-concat([$fname,$lname])



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (ASTERIXDB-1460) Global logger level is not respected until Hyracks application starts

2016-07-22 Thread Till Westmann (JIRA)

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390442#comment-15390442
 ] 

Till Westmann commented on ASTERIXDB-1460:
--

[~imaxon], is this fixed?


> Global logger level is not respected until Hyracks application starts
> -
>
> Key: ASTERIXDB-1460
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1460
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Configuration
>Reporter: Murtadha Hubail
>Assignee: Ian Maxon
>Priority: Minor
>
> The global log level that is read from asterix-configuration.xml file is not 
> set until applicationStart() is called on Cluster/NodeControllerService. Any 
> Logger operation before that will be based on the default Logger level value 
> (INFO). To avoid this, the global logger level need to be set at the 
> beginning of the CC/NC process start up.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1414) Insert tweets with existed keys

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1414:
-
Assignee: Xikui Wang

> Insert tweets with existed keys
> ---
>
> Key: ASTERIXDB-1414
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1414
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Feeds
>Reporter: Xikui Wang
>Assignee: Xikui Wang
>Priority: Minor
>
> When using the tweet id as key, some times there will have duplicate key 
> exception that pop up in the terminal. Here is the error message.
> {quote}
> org.apache.asterix.common.exceptions.FrameDataException: 
> org.apache.hyracks.storage.am.common.exceptions.TreeIndexDuplicateKeyException:
>  Failed to insert key since key already exists.
>   at 
> org.apache.asterix.common.dataflow.AsterixLSMInsertDeleteOperatorNodePushable.nextFrame(AsterixLSMInsertDeleteOperatorNodePushable.java:120)
>   at 
> org.apache.asterix.external.feed.dataflow.FeedRuntimeInputHandler.process(FeedRuntimeInputHandler.java:265)
>   at 
> org.apache.asterix.external.feed.dataflow.FeedRuntimeInputHandler.nextFrame(FeedRuntimeInputHandler.java:127)
>   at 
> org.apache.asterix.external.operators.FeedMetaStoreNodePushable.nextFrame(FeedMetaStoreNodePushable.java:176)
>   at org.apache.hyracks.control.nc.Task.pushFrames(Task.java:349)
>   at org.apache.hyracks.control.nc.Task.run(Task.java:297)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   at java.lang.Thread.run(Thread.java:745)
> Caused by: 
> org.apache.hyracks.storage.am.common.exceptions.TreeIndexDuplicateKeyException:
>  Failed to insert key since key already exists.
>   at 
> org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTree.insert(LSMBTree.java:360)
>   at 
> org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTree.modify(LSMBTree.java:333)
>   at 
> org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.modify(LSMHarness.java:353)
>   at 
> org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.forceModify(LSMHarness.java:333)
>   at 
> org.apache.hyracks.storage.am.lsm.common.impls.LSMTreeIndexAccessor.forceInsert(LSMTreeIndexAccessor.java:158)
>   at 
> org.apache.asterix.common.dataflow.AsterixLSMInsertDeleteOperatorNodePushable.nextFrame(AsterixLSMInsertDeleteOperatorNodePushable.java:103)
>   ... 8 more
> {quote}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1460) Global logger level is not respected until Hyracks application starts

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1460:
-
Assignee: Ian Maxon

> Global logger level is not respected until Hyracks application starts
> -
>
> Key: ASTERIXDB-1460
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1460
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Configuration
>Reporter: Murtadha Hubail
>Assignee: Ian Maxon
>Priority: Minor
>
> The global log level that is read from asterix-configuration.xml file is not 
> set until applicationStart() is called on Cluster/NodeControllerService. Any 
> Logger operation before that will be based on the default Logger level value 
> (INFO). To avoid this, the global logger level need to be set at the 
> beginning of the CC/NC process start up.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Change in asterixdb[master]: ASTERIXDB-1154: index-left-outer-join with LIMIT now works.

2016-07-22 Thread Taewoo Kim (Code Review)
Taewoo Kim has abandoned this change.

Change subject: ASTERIXDB-1154: index-left-outer-join with LIMIT now works.
..


Abandoned

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/470
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: abandon
Gerrit-Change-Id: I93591e6cc5aa19751466136a7ecdee871ba67f83
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Ildar Absalyamov 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-Reviewer: Young-Seok Kim 


[jira] [Updated] (ASTERIXDB-1283) Exceptions on stopping NCs are not logged

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1283:
-
Assignee: Murtadha Hubail

> Exceptions on stopping NCs are not logged
> -
>
> Key: ASTERIXDB-1283
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1283
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Hyracks
>Reporter: Murtadha Hubail
>Assignee: Murtadha Hubail
>Priority: Minor
>
> Currently we use Java Logger to log messages and exceptions while stopping 
> NodeControllerService in JVMShutdownHook. Those messages and exceptions are 
> not logged because the JVM will disable all registered loggers with the 
> LogManager before the JVMShutdownHook thread completes execution. Logging 
> those exceptions is important to detect invalid shutdown sequences.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1394) TweetParser can only take dataset with specific fields in specific order

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1394:
-
Assignee: Xikui Wang

> TweetParser can only take dataset with specific fields in specific order
> 
>
> Key: ASTERIXDB-1394
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1394
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Adapters
>Reporter: Xikui Wang
>Assignee: Xikui Wang
>Priority: Minor
>
> The TweetParser can only take dataset definition with specific order as 
> follow:
> {quote}
> create type Tweet if not exists as open\{
> id: string,
> user: TwitterUser,
> latitude:double,
> longitude:double,
> created_at:string,
> message_text:string
> \};
> {quote}
> Different order will cause type cast exception since the order is fixed in 
> code. Also the names of field and number is also fixed, no more or less.
> Also Tweet cannot have extra field, and extra field will cause 
> ArrayIndexOutOfBoundsException in IDataParser.writeRecord



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1375) Revise web UI

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1375:
-
Assignee: Kaveen Rodirgo

> Revise web UI
> -
>
> Key: ASTERIXDB-1375
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1375
> Project: Apache AsterixDB
>  Issue Type: Improvement
>  Components: Web Interface
>Reporter: Ian Maxon
>Assignee: Kaveen Rodirgo
>  Labels: gsoc2016
>
> We have mock-ups and a design for a new web interface, but it needs to 
> actually be prototyped and implemented. The design is here: 
> https://invis.io/MB41MJPKS . 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (ASTERIXDB-1519) Unable to load data from local filesystem

2016-07-22 Thread Till Westmann (JIRA)

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390435#comment-15390435
 ] 

Till Westmann commented on ASTERIXDB-1519:
--

So then this is the expected behavior. An NC can only load local filesystem 
data that is on the same machine. 

> Unable to load data from local filesystem
> -
>
> Key: ASTERIXDB-1519
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1519
> Project: Apache AsterixDB
>  Issue Type: Bug
> Environment: Packaged from source code with latest commit 
> b7551d1a2e3dcaef63a7ccdf3efe18b345685b23
>Reporter: Vignesh Raghunathan
>
> Sample Query:
> use dataverse TinySocial;
> load dataset FacebookUsers using localfs
> (("path"="176.45.33.258:///home/sampuser/fbu.adm"),("format"="adm"));
> where 176.45.33.258 has the cluster controller running
> Result:
> Error
> No node controllers found at the address: 176.45.33.258  [AsterixException]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Fulltext search initial implementation
..


Patch Set 6:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/144/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/989
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


[jira] [Updated] (ASTERIXDB-1510) WARNING!:Node Controller not running at the following nodes

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1510:
-
Assignee: Ian Maxon

> WARNING!:Node Controller not running at the following nodes
> ---
>
> Key: ASTERIXDB-1510
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1510
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Configuration
> Environment: Docker kevincoakley/asterixdb
>Reporter: Aidan Macdonald
>Assignee: Ian Maxon
>
> I get the following error
> {code}
> $ docker exec master /opt/asterixdb/bin/managix describe -n cluster -admin
> INFO: Name:cluster
> Created:Thu Jun 30 00:11:03 UTC 2016
> Web-Url:http://172.17.1.198:19001
> State:ACTIVE
> WARNING!:Node Controller not running at the following nodes
> 172.17.1.200
> 172.17.1.202
> Master node:master:172.17.1.198
> slave0:172.17.1.199
> slave1:172.17.1.200
> slave2:172.17.1.201
> slave3:172.17.1.202
> slave4:172.17.1.203
> slave5:172.17.1.204
> slave6:172.17.1.205
> slave7:172.17.1.206
> {code}
> I am using the following configuration
> {code}
> $ cat clusters/cluster.xml
> 
> 
> /usr/lib/jvm/java-7-openjdk-amd64/jre
> /opt/asterixdb/clusters/local/working_dir/logs
> 
> /opt/asterixdb/clusters/local/working_dir/txnLogs
> storage
> /opt/asterixdb/clusters/local/working_dir
> 
> /opt/asterixdb/clusters/local/working_dir
> true
> 
> 
> master
> 172.17.1.198
> 172.17.1.198
> 1098
> 1099
> 
> 
> slave0172.17.1.199
> slave1172.17.1.200
> slave2172.17.1.201
> slave3172.17.1.202
> slave4172.17.1.203
> slave5172.17.1.204
> slave6172.17.1.205
> slave7172.17.1.206
> 
> {code}
> None of my launch scripts give any errors. Everything looks fine at launch, 
> except that after, a couple nodes die which breaks the web interface.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1452) External data load limited to ~30MB records

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1452:
-
Issue Type: Improvement  (was: Bug)

> External data load limited to ~30MB records
> ---
>
> Key: ASTERIXDB-1452
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1452
> Project: Apache AsterixDB
>  Issue Type: Improvement
>Reporter: Michael Blow
>
> There is a constant 
> (org.apache.asterix.external.util.ExternalDataConstants.MAX_RECORD_SIZE) 
> which limits loaded records to 3200 bytes.  This is not configurable, it 
> is hardcoded.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1447) Need an Abort API

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1447:
-
Issue Type: Improvement  (was: Bug)

> Need an Abort API
> -
>
> Key: ASTERIXDB-1447
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1447
> Project: Apache AsterixDB
>  Issue Type: Improvement
>  Components: AsterixDB, Hyracks
>Reporter: Jianfeng Jia
>
> It is very useful to be able to stop the running task. 
> There is one {{AbortTasksWork}} in Hyracks, but I didn't find it was used. I 
> could be wrong on it. Yet the {{IHyracksClientInterface}} don't have the 
> {{abortJob}} interface.
> Once we have this Hyracks API, we could also add the corresponding RESTFul 
> API for AsterixDB as well. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1451) Upsert: Open Index test fails with duplicate rows in result when VBC page size is reduced

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1451:
-
Assignee: Murtadha Hubail

> Upsert: Open Index test fails with duplicate rows in result when VBC page 
> size is reduced
> -
>
> Key: ASTERIXDB-1451
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1451
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Michael Blow
>Assignee: Murtadha Hubail
>
> To repro:
> - configure storage.memorycomponent.pagesize to 8k, and increase 
> storage.memorycomponent.numpages to 24
> - run asterix-app runtime tests
> - observe failure in open-index test with duplicated rows as shown below.
> $ diff -du 
> src/test/resources/runtimets/results/upsert/open-index/open-index.1.adm 
> rttest/results/upsert/open-index.adm
> --- src/test/resources/runtimets/results/upsert/open-index/open-index.1.adm   
> 2016-04-27 20:40:58.0 -0700
> +++ rttest/results/upsert/open-index.adm  2016-05-16 19:08:57.0 
> -0700
> @@ -1099,11 +1099,15 @@
>  { "o_orderkey": 5927, "o_custkey": 116 }
>  { "o_orderkey": 5952, "o_custkey": 148 }
>  { "o_orderkey": 5955, "o_custkey": 94 }
> +{ "o_orderkey": 5955, "o_custkey": 94 }
> +{ "o_orderkey": 5957, "o_custkey": 89 }
>  { "o_orderkey": 5957, "o_custkey": 89 }
>  { "o_orderkey": 5958, "o_custkey": 115 }
>  { "o_orderkey": 5984, "o_custkey": 70 }
>  { "o_orderkey": 5985, "o_custkey": 143 }
>  { "o_orderkey": 5986, "o_custkey": 115 }
> +{ "o_orderkey": 5986, "o_custkey": 115 }
> +{ "o_orderkey": 5987, "o_custkey": 64 }
>  { "o_orderkey": 5987, "o_custkey": 64 }
>  { "o_orderkey": 10986, "o_custkey": 115 }
>  { "o_orderkey": 10987, "o_custkey": 64 }



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1464) Dealing with InterruptedException in LogManager

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1464:
-
Assignee: Michael Blow

> Dealing with InterruptedException in LogManager
> ---
>
> Key: ASTERIXDB-1464
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1464
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Murtadha Hubail
>Assignee: Michael Blow
>
> Currently, most InterruptedExceptions are ignored in LogManager. This could 
> lead to jobs not aborted in a timely manner when an interrupt is received 
> from the CC. The current behavior on each InterruptedException should be 
> defined and the exceptions should be propagated accordingly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1458) CharArrayRecord does not participate in memory budget

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1458:
-
Assignee: Michael Blow

> CharArrayRecord does not participate in memory budget
> -
>
> Key: ASTERIXDB-1458
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1458
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Michael Blow
>Assignee: Michael Blow
>
> CharArrayRecord allocates memory independently without consulting memory 
> budget.  This could contribute to OutOfMemory condition, especially once the 
> 3200 byte limit is raised/eliminated (see ASTERIXDB-1452)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1290) Index Join Query fails to complete on Single Machine Instance

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1290:
-
Assignee: Murtadha Hubail

> Index Join Query fails to complete on Single Machine Instance
> -
>
> Key: ASTERIXDB-1290
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1290
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Steven Jacobs
>Assignee: Murtadha Hubail
> Attachments: datasets.zip
>
>
> I am having a simple retree index join fail to complete on my machine. Unless 
> I am missing something, it seems that this job shouldn't be big enough to 
> overwhelm my machine, and the error seems to be unrelated to overflows. I am 
> including the AQL, plan, and error trace.
> {noformat}
> drop dataverse channels if exists;
> create dataverse channels;
> use dataverse channels;
> create type UserLocation as closed {
>   recordId: uuid,
>   location: point,
>   user-id: string,
>   timeoffset: float
> }
> create type EmergencyShelter as closed {
>   name: string,
>   location: point
> }
> create type EmergencyReport as closed {
>   reportId: uuid,
>   severity: int,
>   impactZone: circle,
>   timeoffset: float,
>   duration: float,
>   message: string,
>   emergencyType: string
> }
> create dataset UserLocations(UserLocation)
> primary key recordId autogenerated;
> create dataset EmergencyShelters(EmergencyShelter)
> primary key name;
> create dataset EmergencyReports(EmergencyReport)
> primary key reportId autogenerated;
> create index locs on EmergencyReports(impactZone) type rtree;
> load dataset UserLocations using localfs 
> (("path"="asterix_nc1:///Users/stevenjacobs/Desktop/EmergencyDataset/UserLocations.adm"),("format"="adm"));
> load dataset EmergencyShelters using 
> localfs(("path"="asterix_nc1:///Users/stevenjacobs/Desktop/EmergencyDataset/EmergencyShelters.adm"),("format"="adm"));
> load dataset EmergencyReports using 
> localfs(("path"="asterix_nc1:///Users/stevenjacobs/Desktop/EmergencyDataset/EmergencyReports.adm"),("format"="adm"));
> for $report in dataset EmergencyReports
> for $location in dataset UserLocations
> where spatial-intersect($report.impactZone, $location.location)
> return {
>   "message":$report.message,
>   "user at":$location.location,
>   "emergency at":$report.impactZone,
>   "type":$report.emergencyType
> }
> {noformat}
> {noformat}
> distribute result [%0->$$7]
> -- DISTRIBUTE_RESULT  |PARTITIONED|
>   exchange 
>   -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
> project ([$$7])
> -- STREAM_PROJECT  |PARTITIONED|
>   assign [$$7] <- [function-call: asterix:closed-record-constructor, 
> Args:[AString: {message}, function-call: asterix:field-access-by-index, 
> Args:[%0->$$0, AInt32: {5}], AString: {user at}, %0->$$12, AString: 
> {emergency at}, %0->$$13, AString: {type}, function-call: 
> asterix:field-access-by-index, Args:[%0->$$0, AInt32: {6}]]]
>   -- ASSIGN  |PARTITIONED|
> select (function-call: asterix:spatial-intersect, Args:[%0->$$13, 
> %0->$$12])
> -- STREAM_SELECT  |PARTITIONED|
>   assign [$$13] <- [function-call: asterix:field-access-by-index, 
> Args:[%0->$$0, AInt32: {2}]]
>   -- ASSIGN  |PARTITIONED|
> project ([$$0, $$12])
> -- STREAM_PROJECT  |PARTITIONED|
>   exchange 
>   -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
> unnest-map [$$14, $$0] <- function-call: 
> asterix:index-search, Args:[AString: {EmergencyReports}, AInt32: {0}, 
> AString: {channels}, AString: {EmergencyReports}, ABoolean: {true}, ABoolean: 
> {false}, ABoolean: {false}, AInt32: {1}, %0->$$26, AInt32: {1}, %0->$$26, 
> TRUE, TRUE, TRUE]
> -- BTREE_SEARCH  |PARTITIONED|
>   exchange 
>   -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
> order (ASC, %0->$$26) 
> -- STABLE_SORT [$$26(ASC)]  |PARTITIONED|
>   exchange 
>   -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
> project ([$$26, $$12])
> -- STREAM_PROJECT  |PARTITIONED|
>   exchange 
>   -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
> unnest-map [$$22, $$23, $$24, $$25, $$26] <- 
> function-call: asterix:index-search, Args:[AString: {locs}, AInt32: {1}, 
> AString: {channels}, AString: {EmergencyReports}, ABoolean: {true}, ABoolean: 
> {false}, ABoolean: {true}, AInt32: {4}, %0->$$18, %0->$$19, %0->$$20, 
> %0->$$21]
> -- RTREE_SEARCH  |PARTITIONED|
>   exchange 
>   -- BROADCAST_EXCHANGE  |PARTITIONE

[jira] [Updated] (ASTERIXDB-1289) Coordinate generated UUIDs within a cluster

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1289:
-
Priority: Minor  (was: Major)

> Coordinate generated UUIDs within a cluster
> ---
>
> Key: ASTERIXDB-1289
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1289
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Michael Blow
>Assignee: Michael Blow
>Priority: Minor
>   Original Estimate: 6h
>  Remaining Estimate: 6h
>
> UUIDs are generated by Asterix runtime for certain use cases; the uniqueness 
> of the UUIDs relies on series of bytes obtained by SecureRandom on each NC.  
> This could be improved by having the NCs obtain a unique pool from the CC to 
> guarantee cluster-wide uniqueness.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1289) Coordinate generated UUIDs within a cluster

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1289:
-
Assignee: Michael Blow

> Coordinate generated UUIDs within a cluster
> ---
>
> Key: ASTERIXDB-1289
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1289
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Michael Blow
>Assignee: Michael Blow
>   Original Estimate: 6h
>  Remaining Estimate: 6h
>
> UUIDs are generated by Asterix runtime for certain use cases; the uniqueness 
> of the UUIDs relies on series of bytes obtained by SecureRandom on each NC.  
> This could be improved by having the NCs obtain a unique pool from the CC to 
> guarantee cluster-wide uniqueness.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1341) Defer the file path decision into NC

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1341:
-
Assignee: Yingyi Bu

> Defer the file path decision into NC
> 
>
> Key: ASTERIXDB-1341
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1341
> Project: Apache AsterixDB
>  Issue Type: Improvement
>Reporter: Yingyi Bu
>Assignee: Yingyi Bu
>
> Currently, the decision of storage file paths is made within the compiler, 
> e.g., in StoragePathUtil.java. It would be nice to defer the decision to NCs 
> at runtime. In this way, the index search, bulkload, insert/delete will have 
> a fixed degree-of-parallelism but in each NC they take file paths from 
> Dataset/Index lifecycle manager.  
> This will bring in the following benefits:
> 1. the degree of parallelism can be different from the number of file paths 
> that storage-related operators work with;
> 2. it avoids shipping all-file-paths (within the JobSpecification) to every 
> node for a query.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1327) Spatial-intersect between point and circle not working correctly

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1327:
-
Assignee: Jianfeng Jia

> Spatial-intersect between point and circle not working correctly
> 
>
> Key: ASTERIXDB-1327
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1327
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Steven Jacobs
>Assignee: Jianfeng Jia
> Attachments: EmergencyReports.adm, UserLocationsShort.adm
>
>
> The first query returns a large set of results. The second returns nothing
> {noformat}
> for $report in dataset EmergencyReports
> for $location in dataset UserLocations
> where $report.emergencyType = "earthquake"
> let $circle := create-circle($location.location,.1)
> where spatial-intersect($report.impactZone, $circle)
> return {
>   "user at":$location.location,
>   "report at":$report.impactZone
> }
> {noformat}
> {noformat}
> for $report in dataset EmergencyReports
> for $location in dataset UserLocations
> where $report.emergencyType = "earthquake"
> where spatial-intersect($report.impactZone, $location.location)
> return {
>   "user at":$location.location,
>   "report at":$report.impactZone
> }
> {noformat}
> Here are the DDL statements. I will attach the two datasets:
> {noformat}
> drop dataverse channels if exists;
> create dataverse channels;
> use dataverse channels;
> create type UserLocation as closed {
>   recordId: uuid,
>   location: point,
>   user-id: string,
>   timeoffset: float
> }
> create type EmergencyReport as closed {
>   reportId: uuid,
>   severity: int,
>   impactZone: circle,
>   timeoffset: float,
>   duration: float,
>   message: string,
>   emergencyType: string
> }
> create dataset UserLocations(UserLocation)
> primary key recordId autogenerated;
> create dataset EmergencyReports(EmergencyReport)
> primary key reportId autogenerated;
> load dataset UserLocations using localfs 
> (("path"="asterix_nc1:///Users/stevenjacobs/Desktop/EmergencyDataset/UserLocationsShort.adm"),("format"="adm"));
> load dataset EmergencyReports using 
> localfs(("path"="asterix_nc1:///Users/stevenjacobs/Desktop/EmergencyDataset/EmergencyReports.adm"),("format"="adm"));
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1312) Document the Operation/Lock matrix

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1312:
-
Assignee: Abdullah Alamoudi

> Document the Operation/Lock matrix
> --
>
> Key: ASTERIXDB-1312
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1312
> Project: Apache AsterixDB
>  Issue Type: Wish
>  Components: AsterixDB
>Reporter: Abdullah Alamoudi
>Assignee: Abdullah Alamoudi
>
> One of the least documented areas in AsterixDB is lock management. A document 
> showing operation/lock would help a lot in addressing issues related to lock 
> management.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1293) Unable to insert elements of an Ordered list into an Unordered list

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1293:
-
Assignee: Yingyi Bu

> Unable to insert elements of an Ordered list into an Unordered list
> ---
>
> Key: ASTERIXDB-1293
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1293
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Data Formats
>Reporter: Pouria
>Assignee: Yingyi Bu
>
> Data type mismatch makes it impossible to insert elements of an "ordered" 
> list into an "unordered" list.
> Here is an example to reproduce:
> {noformat}
> drop dataverse test if exists;
> create dataverse test;
> use dataverse test;
> create type typeA as {
> id: int64,
> val: {{ int64 }}
> }
> create dataset dsa(typeA) primary key id;
> insert into dataset dsa ( {"id": 1, "val": [10, 20]} );
> {noformat}
> Here is the error:
> {noformat}
> org.apache.hyracks.api.exceptions.HyracksDataException: 
> java.util.concurrent.ExecutionException: 
> org.apache.hyracks.api.exceptions.HyracksDataException: 
> org.apache.hyracks.algebricks.common.exceptions.AlgebricksException: 
> org.apache.asterix.common.exceptions.AsterixException: 
> java.lang.IllegalStateException: type mismatch: missing a required closed 
> field val:typeA_val
>   at 
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:215)
>   at 
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:83)
>   at org.apache.hyracks.control.nc.Task.run(Task.java:258)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   at java.lang.Thread.run(Thread.java:745)
> Caused by: java.util.concurrent.ExecutionException: 
> org.apache.hyracks.api.exceptions.HyracksDataException: 
> org.apache.hyracks.algebricks.common.exceptions.AlgebricksException: 
> org.apache.asterix.common.exceptions.AsterixException: 
> java.lang.IllegalStateException: type mismatch: missing a required closed 
> field val:typeA_val
>   at java.util.concurrent.FutureTask.report(FutureTask.java:122)
>   at java.util.concurrent.FutureTask.get(FutureTask.java:192)
>   at 
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:213)
>   ... 5 more
> Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: 
> org.apache.hyracks.algebricks.common.exceptions.AlgebricksException: 
> org.apache.asterix.common.exceptions.AsterixException: 
> java.lang.IllegalStateException: type mismatch: missing a required closed 
> field val:typeA_val
>   at 
> org.apache.hyracks.algebricks.runtime.operators.std.AssignRuntimeFactory$1.produceTuple(AssignRuntimeFactory.java:159)
>   at 
> org.apache.hyracks.algebricks.runtime.operators.std.AssignRuntimeFactory$1.nextFrame(AssignRuntimeFactory.java:140)
>   at 
> org.apache.hyracks.dataflow.common.comm.io.AbstractFrameAppender.flush(AbstractFrameAppender.java:83)
>   at 
> org.apache.hyracks.algebricks.runtime.operators.std.EmptyTupleSourceRuntimeFactory$1.open(EmptyTupleSourceRuntimeFactory.java:55)
>   at 
> org.apache.hyracks.algebricks.runtime.operators.meta.AlgebricksMetaOperatorDescriptor$1.initialize(AlgebricksMetaOperatorDescriptor.java:109)
>   at 
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$initialize$0(SuperActivityOperatorNodePushable.java:83)
>   at 
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable$1.call(SuperActivityOperatorNodePushable.java:204)
>   at 
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable$1.call(SuperActivityOperatorNodePushable.java:201)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   ... 3 more
> Caused by: 
> org.apache.hyracks.algebricks.common.exceptions.AlgebricksException: 
> org.apache.asterix.common.exceptions.AsterixException: 
> java.lang.IllegalStateException: type mismatch: missing a required closed 
> field val:typeA_val
>   at 
> org.apache.asterix.runtime.evaluators.functions.CastRecordDescriptor$2$1.evaluate(CastRecordDescriptor.java:95)
>   at 
> org.apache.hyracks.algebricks.core.algebra.expressions.LogicalExpressionJobGenToExpressionRuntimeProviderAdapter$ScalarEvaluatorFactoryAdapter$1.evaluate(LogicalExpressionJobGenToExpressionRuntimeProviderAdapter.java:110)
>   at 
> org.apache.hyracks.algebricks.runtime.operators.std.AssignRuntimeFactory$1.produceTuple(AssignRuntimeFactory.java:157)
>   ... 11 more
> C

[jira] [Updated] (ASTERIXDB-1469) Non-metadata node can be bound as metadata node

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1469:
-
Assignee: Ian Maxon

> Non-metadata node can be bound as metadata node 
> 
>
> Key: ASTERIXDB-1469
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1469
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Configuration
>Reporter: Ian Maxon
>Assignee: Ian Maxon
>Priority: Critical
>
> During metadata bootstrap, the value of the metadata node in the Metadata 
> Nodegroup can actually differ from the node that is performing the process.  
> This shouldn't happen unless something is wonky configuration-wise, but this 
> is definitely wrong and should probably throw an error that is more clear 
> than the wronlgly chosen NC being unable to find the metadata index's 
> resource ID whenever a query is submitted. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Change in asterixdb[master]: Support CASE expression in SQL++.

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Support CASE expression in SQL++.
..


Patch Set 4: Integration-Tests+1

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/143/ : 
SUCCESS

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1015
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Id9de7c3df70be43456e38a61ce767cc14f09e661
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


[jira] [Updated] (ASTERIXDB-1469) Non-metadata node can be bound as metadata node

2016-07-22 Thread Till Westmann (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Till Westmann updated ASTERIXDB-1469:
-
Priority: Critical  (was: Major)

> Non-metadata node can be bound as metadata node 
> 
>
> Key: ASTERIXDB-1469
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1469
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Configuration
>Reporter: Ian Maxon
>Priority: Critical
>
> During metadata bootstrap, the value of the metadata node in the Metadata 
> Nodegroup can actually differ from the node that is performing the process.  
> This shouldn't happen unless something is wonky configuration-wise, but this 
> is definitely wrong and should probably throw an error that is more clear 
> than the wronlgly chosen NC being unable to find the metadata index's 
> resource ID whenever a query is submitted. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (ASTERIXDB-1478) using localfs goes wrong

2016-07-22 Thread Till Westmann (JIRA)

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390427#comment-15390427
 ] 

Till Westmann commented on ASTERIXDB-1478:
--

[~maimuderizi] The data should be in the iodevice directories, not in the 
working dir. Did you check those?

> using localfs goes wrong
> 
>
> Key: ASTERIXDB-1478
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1478
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Error Reporting
> Environment: AsterixDB 0.8.9(pulled from github today)
> Ubuntu 14.0
> Java -version 1.8.0_79
> Computer has 1 ssd and 1 hhd
>Reporter: yipzifai
>  Labels: features
> Attachments: cc.log, cpu.jpg, execute.log, my_asterix_nc1.log, 
> my_asterix_nc2.log
>
>
> I load data file using localfs but AsterixDB keeps running for a long long 
> time.(ps:CPU utilization ~= 100%) I have been waiting over 8 hours 
> yesterday.Then i found that the storage folder in workingdir didn't add any 
> files.
> Exectly, I try to use feeding or AQL "Insert", but it still goes wrong.
> AQL:
> use dataverse test;
> drop dataset relationship_B if exists;
> drop type relationshipB if exists;
> create type relationshipB as closed{
> pkId:int64,
> who_id:int64,
> who_name:string,
> id:int64,
> name:string,
> code:string,
> shortname:string,
> brief:string,
> validateDate:date?,
> gfType:string,
> shijizengjianchi:string,
> chiyoushuliang:double,
> chigubianhua:string,
> zhanbi:double,
> konggugongsiID:int64?,
> konggugongsiName:string?,
> rType:string,
> source:string,
> method:string
> };
> create dataset relationship_B(relationshipB) primary key pkId;
> use dataverse test;
> load dataset relationship_B
> using localfs
> (("path"="127.0.0.1:///home/to/adbSrc/ddl/relationshipB.adm"),("format"="adm"));
> About data files:
> one file is big object insertion(each record has over 30,000 characters); 
> each record of another file has 100~200 characters.
> {code}
> local.xml
> 
> 
> /usr/local/jdk1.8.0_91/jre
> 
> /home/to/adbSrc/asterix-mgmt/clusters/local/working_dir/logs
> 
> /home/to/adbSrc/asterix-mgmt/clusters/local/working_dir/txnLogs
> storage
> 
> /home/to/adbSrc/asterix-mgmt/clusters/local/working_dir
> true
> 
>   
> /home/to/adbSrc/asterix-mgmt/clusters/local/working_dir/nc/p1,/home/to/adbSrc/asterix-mgmt/clusters/local/working_dir/nc/p2
> 
> master
> 127.0.0.1
> 127.0.0.1
> 1098
> 1099
> 
> 8900
> 
> 
> nc1
> 127.0.0.1
> 
> /home/to/adbSrc/asterix-mgmt/clusters/local/working_dir/nc1/txnLogs
>  
> 8901
> 
> 
> nc2
> 127.0.0.1
> 
> /home/to/adbSrc/asterix-mgmt/clusters/local/working_dir/nc2/txnLogs
>   
> 8902
> 
> 1
> 5
> 0
> 5
> 10
> 8640
> 6
> 
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-867) string value turns into "null" value when not casted

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu updated ASTERIXDB-867:

Priority: Critical  (was: Minor)

> string value turns into "null" value when not casted
> 
>
> Key: ASTERIXDB-867
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-867
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB
>Reporter: asterixdb-importer
>Assignee: Yingyi Bu
>Priority: Critical
> Attachments: page_views_test.adm
>
>
> string value turns into "null" value when not casted



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (ASTERIXDB-1133) hard-coded "if not exists" in the AQL parser

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu reassigned ASTERIXDB-1133:


Assignee: Abdullah Alamoudi  (was: Yingyi Bu)

[~amoudi], that has already been fixed, right?

> hard-coded "if not exists" in the AQL parser
> 
>
> Key: ASTERIXDB-1133
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1133
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Yingyi Bu
>Assignee: Abdullah Alamoudi
>Priority: Minor
>
> "if not exists" is hard-coded in the AQL parser, therefore extra spaces among 
> the words will cause parsing failures.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (ASTERIXDB-1374) Wierd expectation/interpretation of datasets/names in SQL++ error cases

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu resolved ASTERIXDB-1374.
--
Resolution: Fixed
  Assignee: Michael J. Carey  (was: Yingyi Bu)

[~dtabass], it has been already fixed in the master.  Can you close that if 
your second query can work?

> Wierd expectation/interpretation of datasets/names in SQL++ error cases
> ---
>
> Key: ASTERIXDB-1374
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1374
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Error Reporting, Translator - AQL, Web 
> Interface
>Reporter: Michael J. Carey
>Assignee: Michael J. Carey
>Priority: Minor
>
> USE TinySocial;
> SELECT ELEMENT user
> FROM FacebookUsers AS user
> WHERE user.name = 'NilaMilliron';
> results in
> { "id": 8, "alias": "Nila", "name": "NilaMilliron", "user-since": 
> datetime("2008-01-01T10:10:00.000Z"), "friend-ids": {{ 3 }}, "employment": [ 
> { "organization-name": "Plexlane", "start-date": date("2010-02-28"), 
> "end-date": null } ] }
> Perfect!  However
> SELECT ELEMENT user
> FROM FacebookUsers AS user
> WHERE user.name = "NilaMilliron";   // or without the quotes at all
> gives
> Could not find dataset NilaMilliron in dataverse TinySocial 
> [AlgebricksException]
> !?!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Fulltext search initial implementation
..


Patch Set 6:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/989
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


[jira] [Assigned] (ASTERIXDB-1178) Remove tabs from all test query files

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu reassigned ASTERIXDB-1178:


Assignee: Michael Blow  (was: Yingyi Bu)

[~mblow], have you fixed this?

> Remove tabs from all test query files
> -
>
> Key: ASTERIXDB-1178
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1178
> Project: Apache AsterixDB
>  Issue Type: Improvement
>  Components: AsterixDB
>Reporter: Yingyi Bu
>Assignee: Michael Blow
>Priority: Minor
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Fulltext search initial implementation
..


Patch Set 6:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/1978/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/989
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Taewoo Kim (Code Review)
Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/989

to look at the new patch set (#6).

Change subject: Fulltext search initial implementation
..

Fulltext search initial implementation

 - Supports Fulltext search using XQuery syntax
 - Keyword level AND or OR search is possible
 - Changed a function name: contains -> string-contains to remove any confusion

Change-Id: I71887c2ea847e4488f4c98a11f8a5bcad02cac5a
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/operators/physical/InvertedIndexPOperator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/AnalysisUtil.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushLimitIntoOrderByRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AbstractIntroduceAccessMethodRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodJobGenParams.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodUtils.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/IntroduceJoinAccessMethodRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/IntroduceLSMComponentFilterRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/InvertedIndexAccessMethod.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/InvertedIndexJobGenParams.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/OptimizableFuncExpr.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/AqlExpressionToPlanTranslator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/AqlPlusExpressionToPlanTranslator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/LangExpressionToPlanTranslator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/util/FunctionCollection.java
M asterixdb/asterix-algebra/src/main/javacc/AQLPlus.jj
M asterixdb/asterix-app/data/csv/fragile_02.adm
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-1/dataset_with_meta-1.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-2/dataset_with_meta-2.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-3/dataset_with_meta-3.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-4/dataset_with_meta-4.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-5/dataset_with_meta-5.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-6/dataset_with_meta-6.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-7/dataset_with_meta-6.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_1/issue_251_dataset_hint_1.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_2/issue_251_dataset_hint_2.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_3/issue_251_dataset_hint_3.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_4/issue_251_dataset_hint_4.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_251_dataset_hint_error_1.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_251_dataset_hint_error_1/issue_251_dataset_hint_error_1.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_251_dataset_hint_error_2.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_251_dataset_hint_error_2/issue_251_dataset_hint_error_2.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/metadata/queries/exception/issue_255_create_feed_error/issue_255_create_feed_error.1.ddl.aql
M 
asterixdb/asterix-app/src/test/resources/nontagged/tpch/local/closedtables-q9.aql
M 
asterixdb/asterix-app/src/test/resources/nontagged/tpch/local/opentables-q9.aql
M asterixdb/asterix-app/src/test/resources/optimizerts/queries/count-tweets.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-basic/ngram-contains-panic.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-basic/ngram-contains.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-basic/word-contains.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-join/ngram-contains.aql
M 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/invert

[jira] [Resolved] (ASTERIXDB-1004) Null and true

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu resolved ASTERIXDB-1004.
--
Resolution: Won't Fix

Resolved in the current version of SQL++.

> Null and true
> -
>
> Key: ASTERIXDB-1004
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1004
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Optimizer
>Reporter: asterixdb-importer
>Assignee: Yingyi Bu
>Priority: Minor
>
> Null and true



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-830) Need to investigate why this query blows the frame size

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu updated ASTERIXDB-830:

Priority: Critical  (was: Minor)

> Need to investigate why this query blows the frame size
> ---
>
> Key: ASTERIXDB-830
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-830
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Optimizer
>Reporter: Till Westmann
>Assignee: Yingyi Bu
>Priority: Critical
>
> Need to investigate why this query blows the frame size



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (ASTERIXDB-1056) Loading (parsing) ADMs from LocalFS is single-threaded per NC

2016-07-22 Thread Yingyi Bu (JIRA)

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390404#comment-15390404
 ] 

Yingyi Bu commented on ASTERIXDB-1056:
--

[~amoudi], is this fixed now since we have RID generation now?

> Loading (parsing) ADMs from LocalFS is single-threaded per NC
> -
>
> Key: ASTERIXDB-1056
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1056
> Project: Apache AsterixDB
>  Issue Type: Improvement
>  Components: Adapters, AsterixDB, Operators
>Reporter: asterixdb-importer
>Assignee: Abdullah Alamoudi
>Priority: Minor
>
> Loading (parsing) ADMs from LocalFS is single-threaded per NC



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (ASTERIXDB-69) JobActivityGraph was null

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-69?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu resolved ASTERIXDB-69.

Resolution: Won't Fix

> JobActivityGraph was null
> -
>
> Key: ASTERIXDB-69
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-69
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Hyracks
>Reporter: Yingyi Bu
>Assignee: Yingyi Bu
>Priority: Minor
>
> JobActivityGraph was null



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (ASTERIXDB-1056) Loading (parsing) ADMs from LocalFS is single-threaded per NC

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu reassigned ASTERIXDB-1056:


Assignee: Abdullah Alamoudi  (was: Yingyi Bu)

> Loading (parsing) ADMs from LocalFS is single-threaded per NC
> -
>
> Key: ASTERIXDB-1056
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1056
> Project: Apache AsterixDB
>  Issue Type: Improvement
>  Components: Adapters, AsterixDB, Operators
>Reporter: asterixdb-importer
>Assignee: Abdullah Alamoudi
>Priority: Minor
>
> Loading (parsing) ADMs from LocalFS is single-threaded per NC



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-769) Incorrect variable propagation when loading a dataset in subquery

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu updated ASTERIXDB-769:

Priority: Critical  (was: Minor)

> Incorrect variable propagation when loading a dataset in subquery
> -
>
> Key: ASTERIXDB-769
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-769
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Optimizer
>Reporter: JArod Wen
>Assignee: Yingyi Bu
>Priority: Critical
>
> Incorrect variable propagation when loading a dataset in subquery



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (ASTERIXDB-1135) Feed policy creation statement for source policy file

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu reassigned ASTERIXDB-1135:


Assignee: Abdullah Alamoudi  (was: Yingyi Bu)

> Feed policy creation statement for source policy file
> -
>
> Key: ASTERIXDB-1135
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1135
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Translator - AQL
>Reporter: Yingyi Bu
>Assignee: Abdullah Alamoudi
>Priority: Minor
>
> The following feed policy creation statement cannot handle source policy file 
> path correctly.
> FeedPolicySpecification   ::= ( "ingestion" "policy" Identifier 
> IfNotExists  ( "policy" Identifier Configuration ( "definition" 
> StringLiteral )? | "path" Identifier ( "definition" StringLiteral )? ) )
> ""path" Identifier" should be ""path" StringLiteral". 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-819) If-Then-Else statements should allow for production of different types from then/else branches

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu updated ASTERIXDB-819:

Priority: Critical  (was: Minor)

> If-Then-Else statements should allow for production of different types from 
> then/else branches
> --
>
> Key: ASTERIXDB-819
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-819
> Project: Apache AsterixDB
>  Issue Type: Improvement
>  Components: AsterixDB, Translator - AQL
>Reporter: asterixdb-importer
>Assignee: Yingyi Bu
>Priority: Critical
>
> If-Then-Else statements should allow for production of different types from 
> then/else branches



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (ASTERIXDB-1174) Allow for more complex nested plans

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu reassigned ASTERIXDB-1174:


Assignee: Steven Jacobs  (was: Yingyi Bu)

[~sjaco002]  Can you verify if that's still a problem for you?  Since there is 
not a concrete query in the issue, it's hard to tell it's fixed or not.

> Allow for more complex nested plans
> ---
>
> Key: ASTERIXDB-1174
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1174
> Project: Apache AsterixDB
>  Issue Type: Improvement
>Reporter: Steven Jacobs
>Assignee: Steven Jacobs
>Priority: Minor
>
> Currently, when nested plans get too complex (such as containing joins) we 
> get a message such as:
> Attempting to construct a nested plan with 14 operator descriptors. 
> Currently, nested plans can only consist in linear pipelines of Asterix micro 
> operators. [AlgebricksException]
> It would be nice if we could allow such plans



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (ASTERIXDB-1269) UDF body has to be in different lines from the wrapping parens

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu reassigned ASTERIXDB-1269:


Assignee: Abdullah Alamoudi  (was: Yingyi Bu)

[~amoudi], this has already been fixed?

> UDF body has to be in different lines from the wrapping parens
> --
>
> Key: ASTERIXDB-1269
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1269
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Translator - AQL
>Reporter: Yingyi Bu
>Assignee: Abdullah Alamoudi
>
> The following query will fail the parser because the function body stays in 
> the same line of the wrapping parens. The parser thinks the wrapping parens 
> are part of the declared UDF body.
> {noformat}
> drop database test if exists;
> create database test;
> use test;
> create function printName() { 'AsterixDB Shared nothing parallel BDMS' }
> {noformat}
> This alternative works:
> {noformat}
> drop database test if exists;
> create database test;
> use test;
> create function printName() { 
>   'AsterixDB Shared nothing parallel BDMS' 
> }
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-971) Semantically equivalent FLWOR expressions involving dataset lookup; one executes fine, other fails with NPE during compilation

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu updated ASTERIXDB-971:

Priority: Critical  (was: Major)

> Semantically equivalent FLWOR expressions involving dataset lookup; one 
> executes fine, other fails with NPE during compilation
> --
>
> Key: ASTERIXDB-971
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-971
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Optimizer, Translator - AQL
>Reporter: asterixdb-importer
>Assignee: Yingyi Bu
>Priority: Critical
> Attachments: Exception.txt
>
>
> Semantically equivalent FLWOR expressions involving dataset lookup; one 
> executes fine, other fails with NPE during compilation



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1520) Preclustered Group by is displayed incorrectly in the web UI

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu updated ASTERIXDB-1520:
-
   Priority: Critical  (was: Major)
Description: 
To reproduce, uncheck execute query, check show optimized plan and run the 
following:

drop dataverse test if exists;
create dataverse test;
use dataverse test;

create type AuxiliaryType as open {
  id:int32,
  num:int32
}

create type LineType as open {
}

create dataset Book(LineType) with meta(AuxiliaryType)
primary key meta().id;

create index NumIndex1 on Book(meta().num);
create index NumIndex2 on Book(linenum:int32) enforced;
create index NumIndex3 on Book(count1:int32) enforced;
create index NumIndex4 on Book(count2:int32) enforced;

for $t1 in dataset Book
where $t1.linenum < 10
order by $t1.linenum
return {
"linenum1": $t1.linenum,
"count1":$t1.count1,
"t2info": for $t2 in dataset Book
  where $t1.count1 /* +indexnl */= $t2.count2
  order by $t2.linenum
  return {"linenum2": $t2.linenum,
  "count2":$t2.count2}
};


-- PRE_CLUSTERED_GROUP_BY[$$19]  |PARTITIONED|
  {
-- AGGREGATE  |LOCAL|
  -- STREAM_SELECT  |LOCAL|
-- NESTED_TUPLE_SOURCE  |LOCAL|
  }

will show incorrectly as:
  {
-- AGGREGATE  |LOCAL|
  -- STREAM_SELECT  |LOCAL|
-- NESTED_TUPLE_SOURCE  |LOCAL|
  }
-- PRE_CLUSTERED_GROUP_BY[$$19]  |PARTITIONED|

  was:

To reproduce, uncheck execute query, check show optimized plan and run the 
following:

drop dataverse test if exists;
create dataverse test;
use dataverse test;

create type AuxiliaryType as open {
  id:int32,
  num:int32
}

create type LineType as open {
}

create dataset Book(LineType) with meta(AuxiliaryType)
primary key meta().id;

create index NumIndex1 on Book(meta().num);
create index NumIndex2 on Book(linenum:int32) enforced;
create index NumIndex3 on Book(count1:int32) enforced;
create index NumIndex4 on Book(count2:int32) enforced;

for $t1 in dataset Book
where $t1.linenum < 10
order by $t1.linenum
return {
"linenum1": $t1.linenum,
"count1":$t1.count1,
"t2info": for $t2 in dataset Book
  where $t1.count1 /* +indexnl */= $t2.count2
  order by $t2.linenum
  return {"linenum2": $t2.linenum,
  "count2":$t2.count2}
};


-- PRE_CLUSTERED_GROUP_BY[$$19]  |PARTITIONED|
  {
-- AGGREGATE  |LOCAL|
  -- STREAM_SELECT  |LOCAL|
-- NESTED_TUPLE_SOURCE  |LOCAL|
  }

will show incorrectly as:
  {
-- AGGREGATE  |LOCAL|
  -- STREAM_SELECT  |LOCAL|
-- NESTED_TUPLE_SOURCE  |LOCAL|
  }
-- PRE_CLUSTERED_GROUP_BY[$$19]  |PARTITIONED|


> Preclustered Group by is displayed incorrectly in the web UI
> 
>
> Key: ASTERIXDB-1520
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1520
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Web Interface
>Reporter: Abdullah Alamoudi
>Assignee: Yingyi Bu
>Priority: Critical
>
> To reproduce, uncheck execute query, check show optimized plan and run the 
> following:
> drop dataverse test if exists;
> create dataverse test;
> use dataverse test;
> create type AuxiliaryType as open {
>   id:int32,
>   num:int32
> }
> create type LineType as open {
> }
> create dataset Book(LineType) with meta(AuxiliaryType)
> primary key meta().id;
> create index NumIndex1 on Book(meta().num);
> create index NumIndex2 on Book(linenum:int32) enforced;
> create index NumIndex3 on Book(count1:int32) enforced;
> create index NumIndex4 on Book(count2:int32) enforced;
> for $t1 in dataset Book
> where $t1.linenum < 10
> order by $t1.linenum
> return {
> "linenum1": $t1.linenum,
> "count1":$t1.count1,
> "t2info": for $t2 in dataset Book
>   where $t1.count1 /* +indexnl */= $t2.count2
>   order by $t2.linenum
>   return {"linenum2": $t2.linenum,
>   "count2":$t2.count2}
> };
> -- PRE_CLUSTERED_GROUP_BY[$$19]  |PARTITIONED|
>   {
> -- AGGREGATE  |LOCAL|
>   -- STREAM_SELECT  |LOCAL|
> -- NESTED_TUPLE_SOURCE  |LOCAL|
>   }
> will show incorrectly as:
>   {
> -- AGGREGATE  |LOCAL|
>   -- STREAM_SELECT

[jira] [Updated] (ASTERIXDB-1531) Order by bug for composite order keys and nested fields

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu updated ASTERIXDB-1531:
-
Priority: Critical  (was: Major)

> Order by bug for composite order keys and nested fields
> ---
>
> Key: ASTERIXDB-1531
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1531
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Translator - AQL
> Environment: 101-like demo (modified TinySocial) on current/latest 
> binary bits for Mac
>Reporter: Michael J. Carey
>Assignee: Yingyi Bu
>Priority: Critical
> Attachments: tinysocialnew.zip
>
>
> use dataverse TinySocial;  // okay, a name-modified version thereof
> from $cm in dataset ChirpMessages
> order by $cm.user.screen-name, $cm.chirpid
> select $cm;
> ---> This just orders by chirpid.  (You can repro by doing the same thing 
> with the current TinySocial data using the non-renamed stuff - so I won't 
> attach all the repro stuff here unless you want me too, in which case I can.)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1490) NPE for negative expression

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu updated ASTERIXDB-1490:
-
Priority: Critical  (was: Major)

> NPE for negative expression
> ---
>
> Key: ASTERIXDB-1490
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1490
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Optimizer
>Reporter: Yingyi Bu
>Assignee: Yingyi Bu
>Priority: Critical
>
> Query:
> {noformat}
> SELECT VALUE COUNT(1)
> FROM (
>SELECT DISTINCT VALUE -n.foo
>FROM Bar n 
> ) tmp;
> {noformat}
> Exception trace:
> {noformat}
> java.lang.NullPointerException
>   at 
> org.apache.asterix.om.typecomputer.impl.ListConstructorTypeComputer.computeTypeFromItems(ListConstructorTypeComputer.java:59)
>   at 
> org.apache.asterix.om.typecomputer.impl.ListConstructorTypeComputer.computeType(ListConstructorTypeComputer.java:50)
>   at 
> org.apache.asterix.dataflow.data.common.AqlExpressionTypeComputer.getTypeForFunction(AqlExpressionTypeComputer.java:75)
>   at 
> org.apache.asterix.dataflow.data.common.AqlExpressionTypeComputer.getType(AqlExpressionTypeComputer.java:53)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.logical.AggregateOperator.computeOutputTypeEnvironment(AggregateOperator.java:106)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AlgebricksOptimizationContext.computeAndSetTypeEnvironmentForOperator(AlgebricksOptimizationContext.java:295)
>   at 
> org.apache.hyracks.algebricks.rewriter.rules.InferTypesRule.rewritePost(InferTypesRule.java:42)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:125)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:111)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
>   at 
> org.apache.hyracks.algebricks.compiler.rewriter.rulecontrollers.SequentialOnceRuleController.rewriteWithRuleCollection(SequentialOnceRuleController.java:44)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.HeuristicOptimizer.runOptimizationSets(HeuristicOptimizer.java:95)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.HeuristicOptimizer.optimize(HeuristicOptimizer.java:82)
>   at 
> org.apache.hyracks.algebricks.compiler.api.HeuristicCompilerFactoryBuilder$1$1.optimize(HeuristicCompilerFactoryBuilder.java:88)
>   at 
> org.apache.asterix.api.common.APIFramework.compileQuery(APIFramework.java:263)
>   at 
> org.apache.asterix.aql.translator.QueryTranslator.rewriteCompileQuery(QueryTranslator.java:1959)
>   at 
> org.apache.asterix.aql.translator.QueryTranslator.handleQuery(QueryTranslator.java:2521)
>   at 
> org.apache.asterix.aql.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:389)
>   at 
> org.apache.asterix.aql.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:253)
>   at 
> org.apache.asterix.api.http.servlet.APIServlet.doPost(APIServlet.java:148)
>   at javax.servlet.http.HttpServlet.service(HttpServlet.java:754)
>   at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
>   at 
> org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:546)
>   at 
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:483)
>   at 
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
>   at 
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:970)
>   at 
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:411)
>   at 
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
>   at 
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:904)
>   at 
> org.eclipse.jetty.s

[jira] [Reopened] (ASTERIXDB-1355) Multiway UNION error

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu reopened ASTERIXDB-1355:
--

> Multiway UNION error
> 
>
> Key: ASTERIXDB-1355
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1355
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB
> Environment: General environment
>Reporter: Wenhai
>Assignee: Yingyi Bu
>
> I am not sure whether the following query is legal, but it really poses an 
> internel error.
> Schemas
> {noformat}
> drop dataverse tpch if exists;
> create dataverse tpch;
> use dataverse tpch;
> create type LineItemType as closed {
>   l_orderkey: int32, 
>   l_partkey: int32, 
>   l_suppkey: int32, 
>   l_linenumber: int32, 
>   l_quantity: int32, 
>   l_extendedprice: double,
>   l_discount: double, 
>   l_tax: double,
>   l_returnflag: string, 
>   l_linestatus: string, 
>   l_shipdate: string,
>   l_commitdate: string, 
>   l_receiptdate: string, 
>   l_shipinstruct: string, 
>   l_shipmode: string, 
>   l_comment: string
> }
> create type OrderType as closed {
>   o_orderkey: int32, 
>   o_custkey: int32, 
>   o_orderstatus: string, 
>   o_totalprice: double, 
>   o_orderdate: string, 
>   o_orderpriority: string,
>   o_clerk: string, 
>   o_shippriority: int32, 
>   o_comment: string
> }
> create type PartSuppType as closed {
>   ps_partkey: int32, 
>   ps_suppkey: int32,
>   ps_availqty: int32,
>   ps_supplycost: double,
>   ps_comment: string 
> }
> create dataset LineItem(LineItemType)
>   primary key l_orderkey, l_linenumber;
> create dataset Orders(OrderType)
>   primary key o_orderkey;
> create dataset Partsupp(PartSuppType)
>   primary key ps_partkey, ps_suppkey; 
> {noformat}
> Query:
> {noformat}
> use dataverse tpch;
> let $l := for $r in dataset LineItem where $r.l_orderkey = 1
> return $r.l_linenumber
> let $o := for $s in dataset Orders where $s.o_orderkey = 2
> return $s.o_custkey
> let $s := for $t in dataset Partsupp where $t.ps_parkey = 3
> return $t.ps_suppkey
> let $c := $l union $o union $s
> return $c
> {noformat}
> Error:
> {noformat}
> -7 [ArrayIndexOutOfBoundsException]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-883) NPE Exception - using three "for" loops

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu updated ASTERIXDB-883:

Priority: Critical  (was: Major)

> NPE Exception - using three "for" loops
> ---
>
> Key: ASTERIXDB-883
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-883
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Optimizer
>Reporter: asterixdb-importer
>Assignee: Yingyi Bu
>Priority: Critical
>
> NPE Exception - using three "for" loops



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (ASTERIXDB-1355) Multiway UNION error

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu resolved ASTERIXDB-1355.
--
Resolution: Duplicate

> Multiway UNION error
> 
>
> Key: ASTERIXDB-1355
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1355
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB
> Environment: General environment
>Reporter: Wenhai
>Assignee: Yingyi Bu
>
> I am not sure whether the following query is legal, but it really poses an 
> internel error.
> Schemas
> {noformat}
> drop dataverse tpch if exists;
> create dataverse tpch;
> use dataverse tpch;
> create type LineItemType as closed {
>   l_orderkey: int32, 
>   l_partkey: int32, 
>   l_suppkey: int32, 
>   l_linenumber: int32, 
>   l_quantity: int32, 
>   l_extendedprice: double,
>   l_discount: double, 
>   l_tax: double,
>   l_returnflag: string, 
>   l_linestatus: string, 
>   l_shipdate: string,
>   l_commitdate: string, 
>   l_receiptdate: string, 
>   l_shipinstruct: string, 
>   l_shipmode: string, 
>   l_comment: string
> }
> create type OrderType as closed {
>   o_orderkey: int32, 
>   o_custkey: int32, 
>   o_orderstatus: string, 
>   o_totalprice: double, 
>   o_orderdate: string, 
>   o_orderpriority: string,
>   o_clerk: string, 
>   o_shippriority: int32, 
>   o_comment: string
> }
> create type PartSuppType as closed {
>   ps_partkey: int32, 
>   ps_suppkey: int32,
>   ps_availqty: int32,
>   ps_supplycost: double,
>   ps_comment: string 
> }
> create dataset LineItem(LineItemType)
>   primary key l_orderkey, l_linenumber;
> create dataset Orders(OrderType)
>   primary key o_orderkey;
> create dataset Partsupp(PartSuppType)
>   primary key ps_partkey, ps_suppkey; 
> {noformat}
> Query:
> {noformat}
> use dataverse tpch;
> let $l := for $r in dataset LineItem where $r.l_orderkey = 1
> return $r.l_linenumber
> let $o := for $s in dataset Orders where $s.o_orderkey = 2
> return $s.o_custkey
> let $s := for $t in dataset Partsupp where $t.ps_parkey = 3
> return $t.ps_suppkey
> let $c := $l union $o union $s
> return $c
> {noformat}
> Error:
> {noformat}
> -7 [ArrayIndexOutOfBoundsException]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (ASTERIXDB-1355) Multiway UNION error

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu resolved ASTERIXDB-1355.
--
Resolution: Fixed

> Multiway UNION error
> 
>
> Key: ASTERIXDB-1355
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1355
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB
> Environment: General environment
>Reporter: Wenhai
>Assignee: Yingyi Bu
>
> I am not sure whether the following query is legal, but it really poses an 
> internel error.
> Schemas
> {noformat}
> drop dataverse tpch if exists;
> create dataverse tpch;
> use dataverse tpch;
> create type LineItemType as closed {
>   l_orderkey: int32, 
>   l_partkey: int32, 
>   l_suppkey: int32, 
>   l_linenumber: int32, 
>   l_quantity: int32, 
>   l_extendedprice: double,
>   l_discount: double, 
>   l_tax: double,
>   l_returnflag: string, 
>   l_linestatus: string, 
>   l_shipdate: string,
>   l_commitdate: string, 
>   l_receiptdate: string, 
>   l_shipinstruct: string, 
>   l_shipmode: string, 
>   l_comment: string
> }
> create type OrderType as closed {
>   o_orderkey: int32, 
>   o_custkey: int32, 
>   o_orderstatus: string, 
>   o_totalprice: double, 
>   o_orderdate: string, 
>   o_orderpriority: string,
>   o_clerk: string, 
>   o_shippriority: int32, 
>   o_comment: string
> }
> create type PartSuppType as closed {
>   ps_partkey: int32, 
>   ps_suppkey: int32,
>   ps_availqty: int32,
>   ps_supplycost: double,
>   ps_comment: string 
> }
> create dataset LineItem(LineItemType)
>   primary key l_orderkey, l_linenumber;
> create dataset Orders(OrderType)
>   primary key o_orderkey;
> create dataset Partsupp(PartSuppType)
>   primary key ps_partkey, ps_suppkey; 
> {noformat}
> Query:
> {noformat}
> use dataverse tpch;
> let $l := for $r in dataset LineItem where $r.l_orderkey = 1
> return $r.l_linenumber
> let $o := for $s in dataset Orders where $s.o_orderkey = 2
> return $s.o_custkey
> let $s := for $t in dataset Partsupp where $t.ps_parkey = 3
> return $t.ps_suppkey
> let $c := $l union $o union $s
> return $c
> {noformat}
> Error:
> {noformat}
> -7 [ArrayIndexOutOfBoundsException]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1354) Foreign key select error of UNION

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu updated ASTERIXDB-1354:
-
Priority: Critical  (was: Major)

> Foreign key select error of UNION
> -
>
> Key: ASTERIXDB-1354
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1354
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB
> Environment: General Environment.
>Reporter: Wenhai
>Assignee: Yingyi Bu
>Priority: Critical
>  Labels: patch
>
> If we set up a composite primary key (i.e. LineItem(l_orderkey, 
> l_linenumber)) referring to another table (i.e. Orders(o_orderkey)), the same 
> selection condition will introduce a readCount error.
> Schemas
> {noformat}
> use dataverse tpch;
> create type LineItemType as closed {
>   l_orderkey: int32, 
>   l_partkey: int32, 
>   l_suppkey: int32, 
>   l_linenumber: int32, 
>   l_quantity: int32, 
>   l_extendedprice: double,
>   l_discount: double, 
>   l_tax: double,
>   l_returnflag: string, 
>   l_linestatus: string, 
>   l_shipdate: string,
>   l_commitdate: string, 
>   l_receiptdate: string, 
>   l_shipinstruct: string, 
>   l_shipmode: string, 
>   l_comment: string
> }
> create type OrderType as closed {
>   o_orderkey: int32, 
>   o_custkey: int32, 
>   o_orderstatus: string, 
>   o_totalprice: double, 
>   o_orderdate: string, 
>   o_orderpriority: string,
>   o_clerk: string, 
>   o_shippriority: int32, 
>   o_comment: string
> }
> create dataset LineItem(LineItemType) primary key l_orderkey, l_linenumber;
> create dataset Orders(OrderType) primary key o_orderkey;
> use dataverse tpch;
> load dataset LineItem 
> using localfs
> (("path"="asterix_nc1://data/tpch0.001/lineitem.tbl"),("format"="delimited-text"),("delimiter"="|"));
> load dataset Orders 
> using localfs
> (("path"="asterix_nc2://data/tpch0.001/orders.tbl"),("format"="delimited-text"),("delimiter"="|"));
> {noformat}
> Query:
> {noformat}
> use dataverse tpch;
> let $l := for $r in dataset LineItem where $r.l_orderkey = 2
> return $r.l_linenumber
> let $o := for $s in dataset Orders where $s.o_orderkey =2
> return $s.o_custkey
> let $c := $l union $o
> return $c
> {noformat}
> Error:
> {noformat}
> Invalid LSM disk component readerCount: -1 [IllegalStateException]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Change in asterixdb[master]: Support CASE expression in SQL++.

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Support CASE expression in SQL++.
..


Patch Set 4:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/143/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1015
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Id9de7c3df70be43456e38a61ce767cc14f09e661
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


[jira] [Updated] (ASTERIXDB-1500) Inject filters to eliminate null/missing join keys for equality joins

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu updated ASTERIXDB-1500:
-
Priority: Critical  (was: Major)

> Inject filters to eliminate null/missing join keys for equality joins
> -
>
> Key: ASTERIXDB-1500
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1500
> Project: Apache AsterixDB
>  Issue Type: Improvement
>  Components: Optimizer
>Reporter: Yingyi Bu
>Assignee: Yingyi Bu
>Priority: Critical
>
> For the following query, there could be many tweets that has the field 
> in_reply_to_status_id being null/missing. Therefore, that would skewness of 
> for the hash join.  Since this is an inner join and missing/null join keys 
> anyway could not produce qualified join results, the optimizer should inject 
> null/missing filters before the join.
> {noformat}
> FROM Tweets t2 JOIN Tweets t1 ON t2.in_reply_to_status_id = t1.id
> WHERE not(`is-unknown`(t2.in_reply_to_status_id))
> GROUP BY t1.id AS id, t1.user.name AS name, t1.text AS text
> SELECT id, name, text, COUNT(t2) AS num_retweets
> ORDER BY num_retweets DESC
> LIMIT 5;
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (ASTERIXDB-1514) Separate degree-of-parallelism between computation and storage

2016-07-22 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu updated ASTERIXDB-1514:
-
Priority: Critical  (was: Major)

> Separate degree-of-parallelism between computation and storage
> --
>
> Key: ASTERIXDB-1514
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1514
> Project: Apache AsterixDB
>  Issue Type: Improvement
>Reporter: Yingyi Bu
>Assignee: Yingyi Bu
>Priority: Critical
>
> Currently, the parallelism of computation (i.e., query processing) is the 
> same as that of the storage. We need to separate these two parallelism 
> configurations to allow more flexible query processing, which fits the 
> environment where there are many more cores than disks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Change in asterixdb[master]: Support CASE expression in SQL++.

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Support CASE expression in SQL++.
..


Patch Set 4:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/1977/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1015
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Id9de7c3df70be43456e38a61ce767cc14f09e661
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


Change in asterixdb[master]: Support CASE expression in SQL++.

2016-07-22 Thread Yingyi Bu (Code Review)
Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1015

to look at the new patch set (#4).

Change subject: Support CASE expression in SQL++.
..

Support CASE expression in SQL++.

- support both simple CASE expression and searched CASE expression;
- remove IfElseExpression in SQL++.
- remove IfElseToSwitchCaseFunctionRule.java since the plan pattern it tries to 
identify is no longer right.

Change-Id: Id9de7c3df70be43456e38a61ce767cc14f09e661
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
D 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IfElseToSwitchCaseFunctionRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/LangExpressionToPlanTranslator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/SqlppExpressionToPlanTranslator.java
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/tpch/q12_shipping.sqlpp
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-ASTERIXDB-1203.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-ASTERIXDB-865.plan
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpch/q12_shipping.plan
M 
asterixdb/asterix-app/src/test/resources/parserts/queries_sqlpp/IfInFLOWGR.sqlpp
M 
asterixdb/asterix-app/src/test/resources/parserts/queries_sqlpp/IfThenElse.sqlpp
M 
asterixdb/asterix-app/src/test/resources/parserts/queries_sqlpp/functionDecl2.sqlpp
M 
asterixdb/asterix-app/src/test/resources/parserts/queries_sqlpp/nestedFLWOGR1.sqlpp
M 
asterixdb/asterix-app/src/test/resources/parserts/queries_sqlpp/nestedFLWOGR2.sqlpp
M 
asterixdb/asterix-app/src/test/resources/parserts/results_parser_sqlpp/IfInFLOWGR.ast
M 
asterixdb/asterix-app/src/test/resources/parserts/results_parser_sqlpp/IfThenElse.ast
M 
asterixdb/asterix-app/src/test/resources/parserts/results_parser_sqlpp/functionDecl2.ast
M 
asterixdb/asterix-app/src/test/resources/parserts/results_parser_sqlpp/nestedFLWOGR1.ast
M 
asterixdb/asterix-app/src/test/resources/parserts/results_parser_sqlpp/nestedFLWOGR2.ast
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/misc/ifthenelse_02/ifthenelse_01.3.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/misc/case_01/case_01.1.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/misc/case_02/case_02.1.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/misc/case_03/case_03.1.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/misc/ifthenelse_01/ifthenelse_01.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/open-closed/query-issue258/query-issue258.2.update.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql-like/q08_national_market_share/q08_national_market_share.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql-like/q12_shipping/q12_shipping.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql-like/q14_promotion_effect/q14_promotion_effect.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql-sugar/q08_national_market_share/q08_national_market_share.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql-sugar/q12_shipping/q12_shipping.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql-sugar/q14_promotion_effect/q14_promotion_effect.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql/q08_national_market_share/q08_national_market_share.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql/q12_shipping/q12_shipping.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql/q14_promotion_effect/q14_promotion_effect.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-with-index/q08_national_market_share/q08_national_market_share.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-with-index/q12_shipping/q12_shipping.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-with-index/q14_promotion_effect/q14_promotion_effect.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch/q08_national_market_share/q08_national_market_share.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch/q12_shipping/q12_shipping.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch/q14_promotion_effect/q14_promotion_effect.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/user-defined-functions/

Change in asterixdb[master]: Cast Record Before Insert for Open Indexes

2016-07-22 Thread Yingyi Bu (Code Review)
Yingyi Bu has posted comments on this change.

Change subject: Cast Record Before Insert for Open Indexes
..


Patch Set 8: Code-Review+1

LGTM.
Not sure if that's still a problem:
"Seems that $1s would be replaced by 'e', not 'tupleIndex'. Is that intended?". 
 Leave that to Till.

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/997
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I0eef5813ddbfe1b9c518cd7f92d37c95e8486914
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: abdullah alamoudi 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-Reviewer: abdullah alamoudi 
Gerrit-HasComments: No


Change in asterixdb[master]: Add init parameter option for external functions.

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Add init parameter option for external functions.
..


Patch Set 6: Integration-Tests+1

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/141/ : 
SUCCESS

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1006
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I437880a700f61440ffab9f44035798e538fb9ff5
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Xikui Wang 
Gerrit-HasComments: No


Change in asterixdb[master]: Cast Record Before Insert for Open Indexes

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Cast Record Before Insert for Open Indexes
..


Patch Set 8: Integration-Tests+1

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/140/ : 
SUCCESS

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/997
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I0eef5813ddbfe1b9c518cd7f92d37c95e8486914
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: abdullah alamoudi 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-Reviewer: abdullah alamoudi 
Gerrit-HasComments: No


Change in asterixdb[master]: Add init parameter option for external functions.

2016-07-22 Thread Xikui Wang (Code Review)
Xikui Wang has posted comments on this change.

Change subject: Add init parameter option for external functions.
..


Patch Set 6:

@Till & Michael,

There are many comments from SonaQube that regarding to the existed coding 
style problems. Should I try to resolve that in my patch? How about the 
parameter number one, the one in AsterixExternalScalarFunctionInfo.java. 

btw, in case I am using tools in a wrong and wasting resources on the server 
due to my lack of experience. I am following the 'Introduction to the Build 
Lifecycle
' on Maven and trying to minimize the submit to Jenkins (I assume that's the 
goal?). I executed 'mvn test' on my local machine for unit tests and then ran 
'mvn verify' based on the procedure. 'mvn test' costs ~40mins, which is 
acceptable. 'mvn verify' takes absurdly long time, and get stuck on certain 
cases (just keep waiting on something). So I guess the right procedure will be 
'mvn test' locally and then 'gerrit submit' to check integration test result on 
jenkins? Thanks ahead. :)

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1006
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I437880a700f61440ffab9f44035798e538fb9ff5
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Xikui Wang 
Gerrit-HasComments: No


Change in asterixdb[master]: Support CASE expression in SQL++.

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Support CASE expression in SQL++.
..


Patch Set 3:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/142/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1015
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Id9de7c3df70be43456e38a61ce767cc14f09e661
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


Change in asterixdb[master]: Fulltext search initial implementation

2016-07-22 Thread Taewoo Kim (Code Review)
Taewoo Kim has posted comments on this change.

Change subject: Fulltext search initial implementation
..


Patch Set 5:

(14 comments)

Addressed Jianfeng's comments.

https://asterix-gerrit.ics.uci.edu/#/c/989/5/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodUtils.java
File 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodUtils.java:

Line 216: // Checks whether a proper constant expression is in place for 
the full-text search.
> this comment doesn't give more information than the function name, better t
Done


https://asterix-gerrit.ics.uci.edu/#/c/989/5/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/InvertedIndexAccessMethod.java
File 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/InvertedIndexAccessMethod.java:

Line 1183: // For full-text search
> can't understand the comment. better to remove it?
changed the comment.


https://asterix-gerrit.ics.uci.edu/#/c/989/5/asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-1/dataset_with_meta-1.1.ddl.aql
File 
asterixdb/asterix-app/src/test/resources/metadata/queries/basic/dataset_with_meta-1/dataset_with_meta-1.1.ddl.aql:

Line 30:   'text': string
> just want to confirm that the single quote will work? i was thinking it onl
Yes. It works. `text` also works.


https://asterix-gerrit.ics.uci.edu/#/c/989/5/asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-basic/ngram-contains-panic.aql
File 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-basic/ngram-contains-panic.aql:

Line 45: where string-contains($o.title, "Mu")
> while `string-contains` check the index? There is an ngram_idx built on thi
N-gram index can be utilized only when the string constant is equal or longer 
than the gram length. "string-contains" is not a full-text search, it's just a 
new name of "contains" to avoid any confusion.


https://asterix-gerrit.ics.uci.edu/#/c/989/5/asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-basic/ngram-contains.aql
File 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-basic/ngram-contains.aql:

Line 44: where string-contains($o.title, "Multimedia")
> will it check the inverted index?
Yes. The optimizer will check whether n-gram index can be utilized.


https://asterix-gerrit.ics.uci.edu/#/c/989/5/asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-join/ngram-contains.aql
File 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-join/ngram-contains.aql:

Line 45: where string-contains($o1.title, $o2.title) and $o1.id < $o2.id
> will it check the inverted index?
Yes.


https://asterix-gerrit.ics.uci.edu/#/c/989/5/asterixdb/asterix-app/src/test/resources/runtimets/queries/index-selection/intersection/tinysocial-intersect.3.query.aql
File 
asterixdb/asterix-app/src/test/resources/runtimets/queries/index-selection/intersection/tinysocial-intersect.3.query.aql:

Line 27: and string-contains($t.message-text, $keyword)
> this test is supposed to trigger the inverted index search, so `string-cont
I have just checked the plan and it shows 
LENGTH_PARTITIONED_INVERTED_INDEX_SEARCH.


https://asterix-gerrit.ics.uci.edu/#/c/989/5/asterixdb/asterix-lang-common/src/main/java/org/apache/asterix/lang/common/base/Expression.java
File 
asterixdb/asterix-lang-common/src/main/java/org/apache/asterix/lang/common/base/Expression.java:

Line 35: FTCONTAINS_EXPRESSION,
> why full text search is an expression than just a function?
It's a expression. But, I think OP_Expression is enough since it's the parent 
expression. I have removed FTCONTAINS_EXPRESSION. Thanks.


https://asterix-gerrit.ics.uci.edu/#/c/989/5/asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/evaluators/comparisons/AbstractComparisonEvaluator.java
File 
asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/evaluators/comparisons/AbstractComparisonEvaluator.java:

Line 55: protected boolean isFullTextSearchQuery = false;
> code explain the comment. remove the comment?
Done


Line 170: // Full-text search field (document) should be a 
string type.
> the code implies the comment
Done


https://asterix-gerrit.ics.uci.edu/#/c/989/5/asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/evaluators/comparisons/ComparisonHelper.java
File 
asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/evaluators/comparisons/ComparisonHelper.java:

Line 491: private int fullTextContainsWithArg(ATypeTag typeTag2, IPointable 
arg1, IPointable[] args2)
> break this giant function into smaller ones?
Done


https://asterix-gerrit.ics.uci.edu/#/c/989/5/hyracks-fullstack/algebricks/algebricks-core/src/main/java/org/apache/hyracks/algebricks/core/alge

Change in asterixdb[master]: Support CASE expression in SQL++.

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Support CASE expression in SQL++.
..


Patch Set 3:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/1976/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1015
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Id9de7c3df70be43456e38a61ce767cc14f09e661
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


Change in asterixdb[master]: Support CASE expression in SQL++.

2016-07-22 Thread Yingyi Bu (Code Review)
Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1015

to look at the new patch set (#3).

Change subject: Support CASE expression in SQL++.
..

Support CASE expression in SQL++.

- support both simple CASE expression and searched CASE expression;
- remove IfElseExpression.

Change-Id: Id9de7c3df70be43456e38a61ce767cc14f09e661
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
D 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IfElseToSwitchCaseFunctionRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/LangExpressionToPlanTranslator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/SqlppExpressionToPlanTranslator.java
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/tpch/q12_shipping.sqlpp
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-ASTERIXDB-1203.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-ASTERIXDB-865.plan
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpch/q12_shipping.plan
M 
asterixdb/asterix-app/src/test/resources/parserts/queries_sqlpp/IfInFLOWGR.sqlpp
M 
asterixdb/asterix-app/src/test/resources/parserts/queries_sqlpp/IfThenElse.sqlpp
M 
asterixdb/asterix-app/src/test/resources/parserts/queries_sqlpp/functionDecl2.sqlpp
M 
asterixdb/asterix-app/src/test/resources/parserts/queries_sqlpp/nestedFLWOGR1.sqlpp
M 
asterixdb/asterix-app/src/test/resources/parserts/queries_sqlpp/nestedFLWOGR2.sqlpp
M 
asterixdb/asterix-app/src/test/resources/parserts/results_parser_sqlpp/IfInFLOWGR.ast
M 
asterixdb/asterix-app/src/test/resources/parserts/results_parser_sqlpp/IfThenElse.ast
M 
asterixdb/asterix-app/src/test/resources/parserts/results_parser_sqlpp/functionDecl2.ast
M 
asterixdb/asterix-app/src/test/resources/parserts/results_parser_sqlpp/nestedFLWOGR1.ast
M 
asterixdb/asterix-app/src/test/resources/parserts/results_parser_sqlpp/nestedFLWOGR2.ast
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/misc/ifthenelse_02/ifthenelse_01.3.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/misc/case_01/case_01.1.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/misc/case_02/case_02.1.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/misc/case_03/case_03.1.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/misc/ifthenelse_01/ifthenelse_01.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/open-closed/query-issue258/query-issue258.2.update.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql-like/q08_national_market_share/q08_national_market_share.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql-like/q12_shipping/q12_shipping.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql-like/q14_promotion_effect/q14_promotion_effect.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql-sugar/q08_national_market_share/q08_national_market_share.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql-sugar/q12_shipping/q12_shipping.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql-sugar/q14_promotion_effect/q14_promotion_effect.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql/q08_national_market_share/q08_national_market_share.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql/q12_shipping/q12_shipping.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql/q14_promotion_effect/q14_promotion_effect.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-with-index/q08_national_market_share/q08_national_market_share.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-with-index/q12_shipping/q12_shipping.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-with-index/q14_promotion_effect/q14_promotion_effect.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch/q08_national_market_share/q08_national_market_share.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch/q12_shipping/q12_shipping.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch/q14_promotion_effect/q14_promotion_effect.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/user-defined-functions/query-issue218-2/query-issue218-2.1.ddl.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/user-

Change in asterixdb[master]: Cleanup / Prune Repository References

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Cleanup / Prune Repository References
..


Patch Set 2:

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/139/ : 
SUCCESS

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1014
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I9c654a8e74edce035933731885958df0e0d7cc6b
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Michael Blow 
Gerrit-Reviewer: Ian Maxon 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: abdullah alamoudi 
Gerrit-HasComments: No


Change in asterixdb[master]: Add init parameter option for external functions.

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Add init parameter option for external functions.
..


Patch Set 6:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/141/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1006
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I437880a700f61440ffab9f44035798e538fb9ff5
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


Change in asterixdb[master]: Cast Record Before Insert for Open Indexes

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Cast Record Before Insert for Open Indexes
..


Patch Set 8:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/140/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/997
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I0eef5813ddbfe1b9c518cd7f92d37c95e8486914
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: abdullah alamoudi 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-Reviewer: abdullah alamoudi 
Gerrit-HasComments: No


Change in asterixdb[master]: Support CASE expression in SQL++.

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Support CASE expression in SQL++.
..


Patch Set 2:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/1975/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1015
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Id9de7c3df70be43456e38a61ce767cc14f09e661
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


Change in asterixdb[master]: Support CASE expression in SQL++.

2016-07-22 Thread Yingyi Bu (Code Review)
Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1015

to look at the new patch set (#2).

Change subject: Support CASE expression in SQL++.
..

Support CASE expression in SQL++.

- support both simple CASE expression and searched CASE expression;
- remove IfElseExpression.

Change-Id: Id9de7c3df70be43456e38a61ce767cc14f09e661
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/LangExpressionToPlanTranslator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/SqlppExpressionToPlanTranslator.java
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/tpch/q12_shipping.sqlpp
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpch/q12_shipping.plan
M 
asterixdb/asterix-app/src/test/resources/parserts/queries_sqlpp/IfInFLOWGR.sqlpp
M 
asterixdb/asterix-app/src/test/resources/parserts/queries_sqlpp/IfThenElse.sqlpp
M 
asterixdb/asterix-app/src/test/resources/parserts/queries_sqlpp/functionDecl2.sqlpp
M 
asterixdb/asterix-app/src/test/resources/parserts/queries_sqlpp/nestedFLWOGR1.sqlpp
M 
asterixdb/asterix-app/src/test/resources/parserts/queries_sqlpp/nestedFLWOGR2.sqlpp
M 
asterixdb/asterix-app/src/test/resources/parserts/results_parser_sqlpp/IfInFLOWGR.ast
M 
asterixdb/asterix-app/src/test/resources/parserts/results_parser_sqlpp/IfThenElse.ast
M 
asterixdb/asterix-app/src/test/resources/parserts/results_parser_sqlpp/functionDecl2.ast
M 
asterixdb/asterix-app/src/test/resources/parserts/results_parser_sqlpp/nestedFLWOGR1.ast
M 
asterixdb/asterix-app/src/test/resources/parserts/results_parser_sqlpp/nestedFLWOGR2.ast
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/misc/ifthenelse_02/ifthenelse_01.3.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/misc/case_01/case_01.1.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/misc/case_02/case_02.1.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/misc/case_03/case_03.1.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/misc/ifthenelse_01/ifthenelse_01.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/open-closed/query-issue258/query-issue258.2.update.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql-like/q08_national_market_share/q08_national_market_share.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql-like/q12_shipping/q12_shipping.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql-like/q14_promotion_effect/q14_promotion_effect.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql-sugar/q08_national_market_share/q08_national_market_share.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql-sugar/q12_shipping/q12_shipping.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql-sugar/q14_promotion_effect/q14_promotion_effect.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql/q08_national_market_share/q08_national_market_share.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql/q12_shipping/q12_shipping.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-sql/q14_promotion_effect/q14_promotion_effect.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-with-index/q08_national_market_share/q08_national_market_share.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-with-index/q12_shipping/q12_shipping.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch-with-index/q14_promotion_effect/q14_promotion_effect.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch/q08_national_market_share/q08_national_market_share.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch/q12_shipping/q12_shipping.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpch/q14_promotion_effect/q14_promotion_effect.3.query.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/user-defined-functions/query-issue218-2/query-issue218-2.1.ddl.sqlpp
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/user-defined-functions/query-issue218/query-issue218.1.ddl.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/misc/case_01/case_01.1.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/misc/case_02/case_02.1.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/r

[jira] [Commented] (ASTERIXDB-1516) Unable to find free page in buffer cache after 3 cycle

2016-07-22 Thread Yingyi Bu (JIRA)

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390161#comment-15390161
 ] 

Yingyi Bu commented on ASTERIXDB-1516:
--

Just run into this again with a different stack trace:

{noformat}
java.lang.Exception: Test 
"src/test/resources/runtimets/queries/big-object/big_object_feed_20M/big_object_feed_20M.3.query.aql"
 FAILED!
at 
org.apache.asterix.test.aql.TestExecutor.executeTest(TestExecutor.java:829)
at 
org.apache.asterix.test.runtime.ExecutionTest.test(ExecutionTest.java:110)
at sun.reflect.GeneratedMethodAccessor33.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.junit.runners.Suite.runChild(Suite.java:127)
at org.junit.runners.Suite.runChild(Suite.java:26)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at 
org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:86)
at 
org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
at 
org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:459)
at 
org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:675)
at 
org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:382)
at 
org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:192)
Caused by: java.lang.Exception: HTTP operation failed: 99
STATUS LINE: HTTP/1.1 500 Server Error
SUMMARY: Job failed on account of:
org.apache.hyracks.api.exceptions.HyracksDataException: 
java.util.concurrent.ExecutionException: 
org.apache.hyracks.api.exceptions.HyracksDataException: 
org.apache.hyracks.api.exceptions.HyracksDataException: Unable to find free 
page in buffer cache after 3 cycles (buffer cache undersized?)

 caused by: 
org.apache.hyracks.control.cc.job.JobRun.waitForCompletion(JobRun.java:212)
 caused by: 
org.apache.hyracks.control.common.utils.ExceptionUtils.setNodeIds(ExceptionUtils.java:45)
 caused by: 
org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:218)
 caused by: java.util.concurrent.FutureTask.report(FutureTask.java:122)
 caused by: 
org.apache.hyracks.storage.am.common.dataflow.IndexSearchOperatorNodePushable.nextFrame(IndexSearchOperatorNodePushable.java:187)
 caused by: 
org.apache.hyracks.storage.common.buffercache.BufferCache.findPage(BufferCache.java:478)
STACKTRACE: org.apache.hyracks.api.exceptions.HyracksException: Job failed on 
account of:
org.apache.hyracks.api.exceptions.HyracksDataException: 
java.util.concurrent.ExecutionException: 
org.apache.hyracks.api.exceptions.HyracksDataException: 
org.apache.hyracks.api.exceptions.HyracksDataException: Unable to find free 
page in buffer cache after 3 cycles (buffer cache undersized?)

at 
org.apache.hyracks.control.cc.job.JobRun.waitForCompletion(JobRun.java:212)
at 
org.apache.hyracks.control.cc.work.WaitForJobCompletionWork$1.run(WaitForJobCompletionWork.java:48)
at 
java.util.concurrent.Thr

Change in asterixdb[master]: Cleanup / Prune Repository References

2016-07-22 Thread Michael Blow (Code Review)
Michael Blow has submitted this change and it was merged.

Change subject: Cleanup / Prune Repository References
..


Cleanup / Prune Repository References

Change-Id: I9c654a8e74edce035933731885958df0e0d7cc6b
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1014
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Michael Blow 
---
M asterixdb/pom.xml
M hyracks-fullstack/pom.xml
2 files changed, 2 insertions(+), 67 deletions(-)

Approvals:
  Michael Blow: Looks good to me, approved
  Jenkins: Verified; No violations found



diff --git a/asterixdb/pom.xml b/asterixdb/pom.xml
index 5c2d7c8..37be3dc 100644
--- a/asterixdb/pom.xml
+++ b/asterixdb/pom.xml
@@ -590,49 +590,9 @@
 always
 fail
   
+  
   asterix-public
-  http://obelix.ics.uci.edu/nexus/content/groups/asterix-public/
-
-
-  
-true
-always
-warn
-  
-  
-true
-always
-fail
-  
-  third-party
-  
http://obelix.ics.uci.edu/nexus/content/repositories/third-party/
-
-
-  
-true
-always
-warn
-  
-  algebricks-releases
-  
http://obelix.ics.uci.edu/nexus/content/repositories/algebricks-releases/
-
-
-  
-true
-always
-fail
-  
-  algebricks-snapshots
-  
http://obelix.ics.uci.edu/nexus/content/repositories/algebricks-snapshots/
-
-
-  
-true
-always
-fail
-  
-  apache-staging
-  
https://repository.apache.org/content/repositories/orgapacheasterix-1019/
+  
http://obelix.ics.uci.edu/nexus/content/repositories/asterix-public/
 
   
   
diff --git a/hyracks-fullstack/pom.xml b/hyracks-fullstack/pom.xml
index e0b12dd..4a85156 100644
--- a/hyracks-fullstack/pom.xml
+++ b/hyracks-fullstack/pom.xml
@@ -478,31 +478,6 @@
 
   
 
-  
-
-  maven-central
-  http://repo1.maven.org/maven2/
-
-
-  hyracks-public
-  http://obelix.ics.uci.edu/nexus/content/groups/hyracks-public/
-
-
-  jboss-public
-  https://repository.jboss.org/nexus/content/groups/public/
-
-  
-
-  
-
-  hyracks-public
-  http://obelix.ics.uci.edu/nexus/content/groups/hyracks-public/
-  
-always
-  
-
-  
-
   
 hyracks
 algebricks

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1014
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: merged
Gerrit-Change-Id: I9c654a8e74edce035933731885958df0e0d7cc6b
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Michael Blow 
Gerrit-Reviewer: Ian Maxon 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: abdullah alamoudi 


Change in asterixdb[master]: Cleanup / Prune Repository References

2016-07-22 Thread Michael Blow (Code Review)
Michael Blow has posted comments on this change.

Change subject: Cleanup / Prune Repository References
..


Patch Set 2: Code-Review+2

Carrying forward +2 on rebase.

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1014
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I9c654a8e74edce035933731885958df0e0d7cc6b
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Michael Blow 
Gerrit-Reviewer: Ian Maxon 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: abdullah alamoudi 
Gerrit-HasComments: No


Change in asterixdb[master]: Cleanup / Prune Repository References

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Cleanup / Prune Repository References
..


Patch Set 2:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/139/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1014
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I9c654a8e74edce035933731885958df0e0d7cc6b
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Michael Blow 
Gerrit-Reviewer: Ian Maxon 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: abdullah alamoudi 
Gerrit-HasComments: No


Change in asterixdb[master]: Add init parameter option for external functions.

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Add init parameter option for external functions.
..


Patch Set 6:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/1974/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1006
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I437880a700f61440ffab9f44035798e538fb9ff5
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


Change in asterixdb[master]: Add init parameter option for external functions.

2016-07-22 Thread Xikui Wang (Code Review)
Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1006

to look at the new patch set (#6).

Change subject: Add init parameter option for external functions.
..

Add init parameter option for external functions.

1. Add one attribute to the external function descriptor.xml
STRING_VALUE
2. Add one test case 'Keyword detector' as a toy example for this
feature.

This init parameter option allows user to reuse the same external
function with different initialization parameters or configuration
files, such as keyword list, module file, etc.

Change-Id: I437880a700f61440ffab9f44035798e538fb9ff5
---
A asterixdb/asterix-app/data/external_function/KeywordsDetector_List1.txt
A asterixdb/asterix-app/data/external_function/KeywordsDetector_List2.txt
M 
asterixdb/asterix-app/src/main/java/org/apache/asterix/app/external/ExternalLibraryUtils.java
M 
asterixdb/asterix-app/src/main/java/org/apache/asterix/aql/translator/QueryTranslator.java
M 
asterixdb/asterix-app/src/test/resources/metadata/results/basic/meta06/meta06.1.adm
M 
asterixdb/asterix-app/src/test/resources/metadata/results/basic/metadata_datatype/metadata_datatype.1.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/external-library/keyword_detector/keyword_detector.1.ddl.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/external-library/keyword_detector/keyword_detector.2.update.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/external-library/keyword_detector/keyword_detector.3.lib.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/external-library/keyword_detector/keyword_detector.4.update.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/external-library/keyword_detector/keyword_detector.5.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/external-library/keyword_detector/keyword_detector.1.adm
M 
asterixdb/asterix-app/src/test/resources/runtimets/results/user-defined-functions/single-line-definition/single-line-definition.1.adm
M 
asterixdb/asterix-app/src/test/resources/runtimets/results/user-defined-functions/udf28/udf28.1.adm
M 
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/api/IFunctionHelper.java
M 
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/library/JavaFunctionHelper.java
M asterixdb/asterix-external-data/src/main/resources/schema/library.xsd
A 
asterixdb/asterix-external-data/src/test/java/org/apache/asterix/external/library/KeywordsDetecterFactory.java
A 
asterixdb/asterix-external-data/src/test/java/org/apache/asterix/external/library/KeywordsDetecterFunction.java
M asterixdb/asterix-external-data/src/test/resources/library_descriptor.xml
M 
asterixdb/asterix-installer/src/test/resources/integrationts/library/results/library-metadata/functionDataset/functionDataset.1.adm
M 
asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/MetadataTransactionContext.java
M 
asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/bootstrap/MetadataRecordTypes.java
M 
asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/entities/Function.java
M 
asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/entitytupletranslators/FunctionTupleTranslator.java
M 
asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/functions/AsterixExternalScalarFunctionInfo.java
M 
asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/functions/ExternalFunctionCompilerUtil.java
M 
asterixdb/asterix-om/src/main/java/org/apache/asterix/om/functions/AsterixExternalFunctionInfo.java
M 
asterixdb/asterix-om/src/main/java/org/apache/asterix/om/functions/IExternalFunctionInfo.java
M 
asterixdb/asterix-yarn/src/test/resources/library/results/library-metadata/functionDataset/functionDataset.1.adm
30 files changed, 342 insertions(+), 32 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/06/1006/6
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1006
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I437880a700f61440ffab9f44035798e538fb9ff5
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Till Westmann 


Change in asterixdb[master]: Cast Record Before Insert for Open Indexes

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Cast Record Before Insert for Open Indexes
..


Patch Set 8:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/1973/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/997
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I0eef5813ddbfe1b9c518cd7f92d37c95e8486914
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: abdullah alamoudi 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-Reviewer: abdullah alamoudi 
Gerrit-HasComments: No


Change in asterixdb[master]: Cast Record Before Insert for Open Indexes

2016-07-22 Thread abdullah alamoudi (Code Review)
abdullah alamoudi has posted comments on this change.

Change subject: Cast Record Before Insert for Open Indexes
..


Patch Set 8:

I believe that I have addressed all comments. 
Once this gets merged, I can rebase my other almost ready change (For the 
extensible grammar)

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/997
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I0eef5813ddbfe1b9c518cd7f92d37c95e8486914
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: abdullah alamoudi 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-Reviewer: abdullah alamoudi 
Gerrit-HasComments: No


Change in asterixdb[master]: Cast Record Before Insert for Open Indexes

2016-07-22 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Cast Record Before Insert for Open Indexes
..


Patch Set 8:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/997
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I0eef5813ddbfe1b9c518cd7f92d37c95e8486914
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: abdullah alamoudi 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-Reviewer: abdullah alamoudi 
Gerrit-HasComments: No


  1   2   >