Change in asterixdb[master]: Add upsert option for feed

2016-08-11 Thread Till Westmann (Code Review)
Till Westmann has posted comments on this change.

Change subject: Add upsert option for feed
..


Patch Set 2:

(1 comment)

https://asterix-gerrit.ics.uci.edu/#/c/1068/2/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/feeds/FeedMetadataUtil.java
File 
asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/feeds/FeedMetadataUtil.java:

Line 697: public static boolean isChangeFeed(Feed feed, String dataverse, 
String feedName) throws AlgebricksException {
As this is just a single line, should we just inline these methods?


-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1068
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ic5133e7c6941fea4110cc9983f99502f364dc810
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: Yes


Change in asterixdb[master]: Add upsert option for feed

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Add upsert option for feed
..


Patch Set 2: Integration-Tests+1

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/286/ : 
SUCCESS

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1068
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ic5133e7c6941fea4110cc9983f99502f364dc810
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


Change in asterixdb[master]: introduce AlgebraUtils and AlgebraUtils

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: introduce AlgebraUtils and AlgebraUtils
..


Patch Set 1:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2177/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1069
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ic0034bd6ba7f449a03eda48070a8de614608c2dd
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Till Westmann 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


Change in asterixdb[master]: introduce AlgebraUtils and AlgebraUtils

2016-08-11 Thread Till Westmann (Code Review)
Till Westmann has uploaded a new change for review.

  https://asterix-gerrit.ics.uci.edu/1069

Change subject: introduce AlgebraUtils and AlgebraUtils
..

introduce AlgebraUtils and AlgebraUtils

Change-Id: Ic0034bd6ba7f449a03eda48070a8de614608c2dd
---
A 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/util/AlgebraUtils.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/FuzzyUtils.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/AddEquivalenceClassForRecordConstructorRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/ByNameToByHandleFieldAccessRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/ByNameToByIndexFieldAccessRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/CancelUnnestWithNestedListifyRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/FeedScanCollectionToUnnest.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/FuzzyEqRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/InjectTypeCastForSwitchCaseRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/InjectTypeCastForUnionRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceAutogenerateIDRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceDynamicTypeCastRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceSecondaryIndexInsertDeleteRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceUnnestForCollectionToSequenceRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/MetaFunctionToMetaVariableRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PullPositionalVariableFromUnnestRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/RemoveRedundantListifyRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/ReplaceSinkOpWithCommitOpRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/ResolveVariableRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/SetClosedRecordConstructorsRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/SimilarityCheckRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/UnnestToDataScanRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodUtils.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/BTreeAccessMethod.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/InvertedIndexAccessMethod.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/RTreeAccessMethod.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/subplan/InlineAllNtsInSubplanVisitor.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/subplan/InlineSubplanInputForNestedTupleSourceRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/temporal/TranslateIntervalExpressionRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/typecast/StaticTypeCastUtil.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/util/EquivalenceClassUtils.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/AqlPlusExpressionToPlanTranslator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/LangExpressionToPlanTranslator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/SqlppExpressionToPlanTranslator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/util/PlanTranslationUtil.java
M 
asterixdb/asterix-app/src/main/java/org/apache/asterix/aql/translator/QueryTranslator.java
M 
asterixdb/asterix-app/src/test/java/org/apache/asterix/test/sqlpp/ParserTestExecutor.java
M 
asterixdb/asterix-lang-aql/src/main/java/org/apache/asterix/lang/aql/rewrites/AqlQueryRewriter.java
M 
asterixdb/asterix-lang-aql/src/main/java/org/apache/asterix/lang/aql/statement/SubscribeFeedStatement.java
R 
asterixdb/asterix-lang-common/src/main/java/org/apache/asterix/lang/common/util/LangUtils.java
M 
asterixdb/asterix-lang-sqlpp/src/main/java/org/apache/asterix/lang/sqlpp/rewrites/SqlppQueryRewriter.java
M 
asterixdb/asterix-lang-sqlpp/src/main/java/org/apache/asterix/lang/sqlpp/util/FunctionMapUtil.java
42 files changed, 229 insertions(+), 190 deletions(-)


  git pull s

Change in asterixdb[master]: Ensure RMI host is set to the cluster ip address

2016-08-11 Thread Till Westmann (Code Review)
Till Westmann has posted comments on this change.

Change subject: Ensure RMI host is set to the cluster ip address
..


Patch Set 1: Code-Review+1

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1065
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I0fbda4ce14c892e66595d7a1cc3801f0fc2b8fba
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Michael Blow 
Gerrit-Reviewer: Chris Hillery 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No


Change in asterixdb[master]: Add upsert option for feed

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Add upsert option for feed
..


Patch Set 2:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/286/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1068
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ic5133e7c6941fea4110cc9983f99502f364dc810
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


Change in asterixdb[master]: Add upsert option for feed

2016-08-11 Thread Xikui Wang (Code Review)
Xikui Wang has uploaded a new patch set (#2).

Change subject: Add upsert option for feed
..

Add upsert option for feed

For ASTERIXDB-1567. Provide "upsert-feed"="true" for
feed configuration, which changes the default record
insert to upsert.

Change-Id: Ic5133e7c6941fea4110cc9983f99502f364dc810
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/LangExpressionToPlanTranslator.java
M 
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/util/ExternalDataConstants.java
M 
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/util/ExternalDataUtils.java
M 
asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/feeds/FeedMetadataUtil.java
4 files changed, 23 insertions(+), 7 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/68/1068/2
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1068
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ic5133e7c6941fea4110cc9983f99502f364dc810
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 


Change in asterixdb[master]: Add upsert option for feed

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Add upsert option for feed
..


Patch Set 1:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2175/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1068
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ic5133e7c6941fea4110cc9983f99502f364dc810
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


[jira] [Closed] (ASTERIXDB-1463) Could not resolve type for function-call: field-access-by-name

2016-08-11 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu closed ASTERIXDB-1463.

Resolution: Fixed

Added a regression test

> Could not resolve type for function-call: field-access-by-name
> --
>
> Key: ASTERIXDB-1463
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1463
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Optimizer
>Reporter: Jianfeng Jia
>Assignee: Yingyi Bu
>
> The query is a bit long:
> {code}
> use dataverse twitter
> let $common := (
> for $t in dataset twitter.ds_tweet_help
> where similarity-jaccard(word-tokens($t."text"), word-tokens("help")) > 0.0
> where
> ($t."create_at">= datetime("2012-02-01T00:00:00.000Z")
> and $t."create_at" < datetime("2016-05-23T14:00:57.000Z"))
> let $set := [ 
> 37,51,24,11,10,34,42,9,44,48,35,4,40,6,20,32,8,49,12,22,28,1,13,45,5,47,21,29,54,17,18,39,19,55,26,27,31,56,41,46,16,30,53,38,25,36,50,33,23,2
>  ]
> for $sid in $set
> where $t.geo_tag.stateID = $sid
> return $t
> )
> let $hashtag := (
> for $t in $common
> where not(is-null($t.hashtags))
> for $h in $t.hashtags
> group by $tag := $h with $h
> let $c := count($h)
> order by $c desc
> limit 50
> return { "key": $tag, "count" : $c}
> )
> return $hashtag
> {code}
> It throws the following error: 
> {code}
> SEVERE: Could not resolve type for function-call: asterix:scan-collection, 
> Args:[function-call: asterix:field-access-by-name, Args:[%0->$$0, AString: 
> {hashtags}]],please check whether the used variables has been defined!
> org.apache.hyracks.algebricks.common.exceptions.AlgebricksException: Could 
> not resolve type for function-call: asterix:scan-collection, 
> Args:[function-call: asterix:field-access-by-name, Args:[%0->$$0, AString: 
> {hashtags}]],please check whether the used variables has been defined!
> at 
> org.apache.hyracks.algebricks.core.algebra.typing.AbstractTypeEnvironment.getType(AbstractTypeEnvironment.java:48)
> at 
> org.apache.hyracks.algebricks.core.algebra.operators.logical.UnnestOperator.computeOutputTypeEnvironment(UnnestOperator.java:51)
> at 
> org.apache.hyracks.algebricks.core.rewriter.base.AlgebricksOptimizationContext.computeAndSetTypeEnvironmentForOperator(AlgebricksOptimizationContext.java:295)
> at 
> org.apache.hyracks.algebricks.core.algebra.util.OperatorPropertiesUtil.typeOpRec(OperatorPropertiesUtil.java:256)
> at 
> org.apache.hyracks.algebricks.core.algebra.util.OperatorPropertiesUtil.typeOpRec(OperatorPropertiesUtil.java:249)
> at 
> org.apache.hyracks.algebricks.core.algebra.util.OperatorPropertiesUtil.typeOpRec(OperatorPropertiesUtil.java:249)
> .
> Caused by: java.lang.NullPointerException
> at 
> org.apache.asterix.om.util.NonTaggedFormatUtil.isOptional(NonTaggedFormatUtil.java:105)
>   
> 
> at 
> org.apache.asterix.om.typecomputer.impl.NonTaggedCollectionMemberResultType.computeType(NonTaggedCollectionMemberResultType.java:46)
> at 
> org.apache.asterix.dataflow.data.common.AqlExpressionTypeComputer.getTypeForFunction(AqlExpressionTypeComputer.java:86)
> at 
> org.apache.asterix.dataflow.data.common.AqlExpressionTypeComputer.getType(AqlExpressionTypeComputer.java:57)
> at 
> org.apache.hyracks.algebricks.core.algebra.typing.AbstractTypeEnvironment.getType(AbstractTypeEnvironment.java:46)
> {code}
> The ddl is following
> {code}
> create dataverse twitter if not exists;
> use dataverse twitter
> create type typeUser if not exists as open {
> id: int64,
> name: string,
> screen_name : string,
> lang : string,
> location: string,
> create_at: date,
> description: string,
> followers_count: int32,
> friends_count: int32,
> statues_count: int64
> }
> create type typePlace if not exists as open{
> country : string,
> country_code : string,
> full_name : string,
> id : string,
> name : string,
> place_type : string,
> bounding_box : rectangle
> }
> create type typeGeoTag if not exists as open {
> stateID: int32,
> stateName: string,
> countyID: int32,
> countyName: string,
> cityID: int32?,
> cityName: string?
> }
> create type typeTweet if not exists as open{
> create_at : datetime,
> id: int64,
> "text": string,
> in_reply_to_status : int64,
> in_reply_to_user : int64,
> favorite_count : int64,
> coordinate: point?,
> retweet_count : int64,
> lang : string,
> is_retweet: boolean,
> hashtags : {{ string }} ?,
> user_mentions : {{ int64 }} ? ,
> user : typeUser,
> place : typePlace?,
> geo_tag: typeGeoTag
> }
> create dataset ds_tweet(typeTweet) if not exists primary key id;
> //with filter on crea

Change in asterixdb[master]: ASTERIXDB-1463: add a regression test.

2016-08-11 Thread Yingyi Bu (Code Review)
Yingyi Bu has submitted this change and it was merged.

Change subject: ASTERIXDB-1463: add a regression test.
..


ASTERIXDB-1463: add a regression test.

Change-Id: Iaf3a5a616799af2ee58ba559e1dc1db8b6e010ad
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1067
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Jianfeng Jia 
Integration-Tests: Jenkins 
---
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1463/query-ASTERIXDB-1463.1.ddl.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1463/query-ASTERIXDB-1463.2.update.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1463/query-ASTERIXDB-1463.3.query.aql
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
4 files changed, 156 insertions(+), 0 deletions(-)

Approvals:
  Jianfeng Jia: Looks good to me, approved
  Jenkins: Verified; No violations found; Verified



diff --git 
a/asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1463/query-ASTERIXDB-1463.1.ddl.aql
 
b/asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1463/query-ASTERIXDB-1463.1.ddl.aql
new file mode 100644
index 000..5153d4a
--- /dev/null
+++ 
b/asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1463/query-ASTERIXDB-1463.1.ddl.aql
@@ -0,0 +1,81 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+
+drop dataverse test if exists;
+create dataverse test;
+use dataverse test;
+
+create type typeUser if not exists as open {
+id: int64,
+name: string,
+screen_name : string,
+lang : string,
+location: string,
+create_at: date,
+description: string,
+followers_count: int32,
+friends_count: int32,
+statues_count: int64
+}
+
+create type typePlace if not exists as open{
+country : string,
+country_code : string,
+full_name : string,
+id : string,
+name : string,
+place_type : string,
+bounding_box : rectangle
+}
+
+create type typeGeoTag if not exists as open {
+stateID: int32,
+stateName: string,
+countyID: int32,
+countyName: string,
+cityID: int32?,
+cityName: string?
+}
+
+create type typeTweet if not exists as open{
+create_at : datetime,
+id: int64,
+"text": string,
+in_reply_to_status : int64,
+in_reply_to_user : int64,
+favorite_count : int64,
+coordinate: point?,
+retweet_count : int64,
+lang : string,
+is_retweet: boolean,
+hashtags : {{ string }} ?,
+user_mentions : {{ int64 }} ? ,
+user : typeUser,
+place : typePlace?,
+geo_tag: typeGeoTag
+}
+
+create dataset ds_tweet(typeTweet) if not exists primary key id;
+
+create index text_idx if not exists on ds_tweet("text") type keyword;
+create index location_idx if not exists on ds_tweet(coordinate) type rtree;
+create index time_idx if not exists on ds_tweet(create_at) type btree;
+create index state_idx if not exists on ds_tweet(geo_tag.stateID) type btree;
+create index county_idx if not exists on ds_tweet(geo_tag.countyID) type btree;
+create index city_idx if not exists on ds_tweet(geo_tag.cityID) type btree;
diff --git 
a/asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1463/query-ASTERIXDB-1463.2.update.aql
 
b/asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1463/query-ASTERIXDB-1463.2.update.aql
new file mode 100644
index 000..9d3c8a1
--- /dev/null
+++ 
b/asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1463/query-ASTERIXDB-1463.2.update.aql
@@ -0,0 +1,24 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *

[jira] [Commented] (ASTERIXDB-1569) The configuration file should support byte units (KB, MB, GB ...).

2016-08-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418263#comment-15418263
 ] 

ASF subversion and git services commented on ASTERIXDB-1569:


Commit bddc811068f42795c3b07c20cf027270bdd83762 in asterixdb's branch 
refs/heads/master from [~wangsaeu]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=bddc811 ]

ASTERIXDB-1569: the config file now supports unit, comma, and decimal.

 - This patch fixes an issue that the config file only supports byte
   value for the byte required parameters. Now, we can use unit (KB, MB, GB 
...),
   comma, and decimal.

Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1064
Reviewed-by: Yingyi Bu 
Reviewed-by: Till Westmann 
Tested-by: Jenkins 
Integration-Tests: Jenkins 


> The configuration file should support byte units (KB, MB, GB ...).
> --
>
> Key: ASTERIXDB-1569
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1569
> Project: Apache AsterixDB
>  Issue Type: Improvement
>Reporter: Taewoo Kim
>Assignee: Taewoo Kim
>
> In the asterix-configuration.xml file, we set bytes for some settings (e.g., 
> compiler.sortmemory). It would be more convenient if a user can specify byte 
> units in the number like the following:
> compiler.sortmemory = 5242880
> compiler.sortmemory = 5,242,880
> compiler.sortmemory = 5120kb
> compiler.sortmemory = 5120KB
> compiler.sortmemory = 5,120KB
> compiler.sortmemory = 5MB
> compiler.sortmemory = 5mb
> compiler.sortmemory = 0.5GB



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Change in asterixdb[master]: Add Asterix Extension Manager

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Add Asterix Extension Manager
..


Patch Set 9:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/285/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1017
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I280268495cc3aad00f898cba21f7299f7120ce5c
Gerrit-PatchSet: 9
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: abdullah alamoudi 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Steven Jacobs 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-Reviewer: abdullah alamoudi 
Gerrit-HasComments: No


Change in asterixdb[master]: ASTERIXDB-1463: add a regression test.

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1463: add a regression test.
..


Patch Set 1:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/284/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1067
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Iaf3a5a616799af2ee58ba559e1dc1db8b6e010ad
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-HasComments: No


Change in asterixdb[master]: Add Asterix Extension Manager

2016-08-11 Thread abdullah alamoudi (Code Review)
Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1017

to look at the new patch set (#9).

Change subject: Add Asterix Extension Manager
..

Add Asterix Extension Manager

More extension support is added. A user can now provide implementations
for the IExtension interface which will give them more control over
the behavior of the system and give them the ability to add custom
features.

Initial customizations include:
1. Metadata Tuple Translators
2. Metadata Datasets
3. Query Translators
4. Statement Handlers
5. Lang Compilation Provider

Change-Id: I280268495cc3aad00f898cba21f7299f7120ce5c
---
M 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/ActiveEvent.java
M 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/ActiveJobNotificationHandler.java
M 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/ActiveManager.java
M 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/ActiveRuntimeId.java
M 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/ActiveRuntimeManager.java
D 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/ActiveRuntimeRegistry.java
A 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/ActiveSourceOperatorNodePushable.java
M 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/IActiveRuntime.java
D 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/IActiveRuntimeRegistry.java
R 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/message/ActiveManagerMessage.java
C 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/message/ActivePartitionMessage.java
M asterixdb/asterix-algebra/pom.xml
A 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/base/ILangExtension.java
A 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/extension/ExtensionFunctionIdentifier.java
A 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/extension/IAlgebraExtensionManager.java
A 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/extension/IExtensionStatement.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/FuzzyUtils.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/AddEquivalenceClassForRecordConstructorRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/ByNameToByHandleFieldAccessRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/ByNameToByIndexFieldAccessRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/CancelUnnestWithNestedListifyRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/FeedScanCollectionToUnnest.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/FuzzyEqRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/InjectToAnyTypeCastRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceAutogenerateIDRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceDynamicTypeCastRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceSecondaryIndexInsertDeleteRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceUnnestForCollectionToSequenceRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/MetaFunctionToMetaVariableRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PullPositionalVariableFromUnnestRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/RemoveRedundantListifyRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/ReplaceSinkOpWithCommitOpRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/ResolveVariableRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/SetClosedRecordConstructorsRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/SimilarityCheckRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/UnnestToDataScanRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AbstractIntroduceAccessMethodRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodUtils.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/BTreeAccessMethod.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/IntroduceLSMComponentFilt

Change in asterixdb[master]: Add Asterix Extension Manager

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Add Asterix Extension Manager
..


Patch Set 8:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1017
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I280268495cc3aad00f898cba21f7299f7120ce5c
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: abdullah alamoudi 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Steven Jacobs 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-Reviewer: abdullah alamoudi 
Gerrit-HasComments: No


Change in asterixdb[master]: Add Asterix Extension Manager

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Add Asterix Extension Manager
..


Patch Set 8:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2173/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1017
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I280268495cc3aad00f898cba21f7299f7120ce5c
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: abdullah alamoudi 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Steven Jacobs 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-Reviewer: abdullah alamoudi 
Gerrit-HasComments: No


Change in asterixdb[master]: Add Asterix Extension Manager

2016-08-11 Thread abdullah alamoudi (Code Review)
Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1017

to look at the new patch set (#8).

Change subject: Add Asterix Extension Manager
..

Add Asterix Extension Manager

More extension support is added. A user can now provide implementations
for the IExtension interface which will give them more control over
the behavior of the system and give them the ability to add custom
features.

Initial customizations include:
1. Metadata Tuple Translators
2. Metadata Datasets
3. Query Translators
4. Statement Handlers
5. Lang Compilation Provider

Change-Id: I280268495cc3aad00f898cba21f7299f7120ce5c
---
M 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/ActiveEvent.java
M 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/ActiveJobNotificationHandler.java
M 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/ActiveManager.java
M 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/ActiveRuntimeId.java
M 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/ActiveRuntimeManager.java
D 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/ActiveRuntimeRegistry.java
A 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/ActiveSourceOperatorNodePushable.java
M 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/IActiveRuntime.java
D 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/IActiveRuntimeRegistry.java
R 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/message/ActiveManagerMessage.java
C 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/message/ActivePartitionMessage.java
M asterixdb/asterix-algebra/pom.xml
A 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/base/ILangExtension.java
A 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/extension/ExtensionFunctionIdentifier.java
A 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/extension/IAlgebraExtensionManager.java
A 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/extension/IExtensionStatement.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/FuzzyUtils.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/AddEquivalenceClassForRecordConstructorRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/ByNameToByHandleFieldAccessRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/ByNameToByIndexFieldAccessRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/CancelUnnestWithNestedListifyRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/FeedScanCollectionToUnnest.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/FuzzyEqRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/InjectToAnyTypeCastRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceAutogenerateIDRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceDynamicTypeCastRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceSecondaryIndexInsertDeleteRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceUnnestForCollectionToSequenceRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/MetaFunctionToMetaVariableRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PullPositionalVariableFromUnnestRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/RemoveRedundantListifyRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/ReplaceSinkOpWithCommitOpRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/ResolveVariableRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/SetClosedRecordConstructorsRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/SimilarityCheckRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/UnnestToDataScanRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AbstractIntroduceAccessMethodRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodUtils.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/BTreeAccessMethod.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/IntroduceLSMComponentFilt

Change in asterixdb[master]: ASTERIXDB-1463: add a regression test.

2016-08-11 Thread Yingyi Bu (Code Review)
Yingyi Bu has uploaded a new change for review.

  https://asterix-gerrit.ics.uci.edu/1067

Change subject: ASTERIXDB-1463: add a regression test.
..

ASTERIXDB-1463: add a regression test.

Change-Id: Iaf3a5a616799af2ee58ba559e1dc1db8b6e010ad
---
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1463/query-ASTERIXDB-1463.1.ddl.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1463/query-ASTERIXDB-1463.2.update.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1463/query-ASTERIXDB-1463.3.query.aql
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
4 files changed, 156 insertions(+), 0 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/67/1067/1

diff --git 
a/asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1463/query-ASTERIXDB-1463.1.ddl.aql
 
b/asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1463/query-ASTERIXDB-1463.1.ddl.aql
new file mode 100644
index 000..5153d4a
--- /dev/null
+++ 
b/asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1463/query-ASTERIXDB-1463.1.ddl.aql
@@ -0,0 +1,81 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+
+drop dataverse test if exists;
+create dataverse test;
+use dataverse test;
+
+create type typeUser if not exists as open {
+id: int64,
+name: string,
+screen_name : string,
+lang : string,
+location: string,
+create_at: date,
+description: string,
+followers_count: int32,
+friends_count: int32,
+statues_count: int64
+}
+
+create type typePlace if not exists as open{
+country : string,
+country_code : string,
+full_name : string,
+id : string,
+name : string,
+place_type : string,
+bounding_box : rectangle
+}
+
+create type typeGeoTag if not exists as open {
+stateID: int32,
+stateName: string,
+countyID: int32,
+countyName: string,
+cityID: int32?,
+cityName: string?
+}
+
+create type typeTweet if not exists as open{
+create_at : datetime,
+id: int64,
+"text": string,
+in_reply_to_status : int64,
+in_reply_to_user : int64,
+favorite_count : int64,
+coordinate: point?,
+retweet_count : int64,
+lang : string,
+is_retweet: boolean,
+hashtags : {{ string }} ?,
+user_mentions : {{ int64 }} ? ,
+user : typeUser,
+place : typePlace?,
+geo_tag: typeGeoTag
+}
+
+create dataset ds_tweet(typeTweet) if not exists primary key id;
+
+create index text_idx if not exists on ds_tweet("text") type keyword;
+create index location_idx if not exists on ds_tweet(coordinate) type rtree;
+create index time_idx if not exists on ds_tweet(create_at) type btree;
+create index state_idx if not exists on ds_tweet(geo_tag.stateID) type btree;
+create index county_idx if not exists on ds_tweet(geo_tag.countyID) type btree;
+create index city_idx if not exists on ds_tweet(geo_tag.cityID) type btree;
diff --git 
a/asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1463/query-ASTERIXDB-1463.2.update.aql
 
b/asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1463/query-ASTERIXDB-1463.2.update.aql
new file mode 100644
index 000..9d3c8a1
--- /dev/null
+++ 
b/asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1463/query-ASTERIXDB-1463.2.update.aql
@@ -0,0 +1,24 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS I

[jira] [Closed] (ASTERIXDB-1485) NPE when translate one AQL query

2016-08-11 Thread Yingyi Bu (JIRA)

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu closed ASTERIXDB-1485.

Resolution: Fixed

Added a regression test.

> NPE when translate one AQL query
> 
>
> Key: ASTERIXDB-1485
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1485
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Optimizer
> Environment: Master: 
> commit fd1d460da73397de9f44d7b098543f7897844794
> Date:   Wed Jun 15 11:29:36 2016 -0400
>Reporter: Jianfeng Jia
>Assignee: Yingyi Bu
>
> AQL is as following
> {code}
> use dataverse twitter
> let $common := (
> for $t in dataset twitter.ds_tweet
> where similarity-jaccard(word-tokens($t."text"), word-tokens("happy")) > 0.0
> and contains($t."text", "hate")
> let $set := [ 
> 72,37,51,24,11,10,34,42,9,44,15,48,35,4,40,6,20,32,8,49,12,22,28,1,13,45,5,47,21,29,54,17,18,39,19,55,26,27,31,56,41,46,16,30,53,38,25,36,50,33,23,2
>  ]
> for $sid in $set
> where $t.geo_tag.stateID = $sid
> where
> ($t."create_at">= datetime("2016-06-15T18:53:42.894Z")
> and $t."create_at" <= datetime("2016-06-15T19:25:11.000Z"))
> return $t
> )
> let $hashtag := (
> for $t in $common
> where not(is-null($t.hashtags))
> for $h in $t.hashtags
> group by $tag := $h with $h
> let $c := count($h)
> order by $c desc
> limit 50
> return { "key": $tag, "count" : $c}
> )
> return $hashtag
> {code}
> ddl can be found [here| 
> https://github.com/ISG-ICS/cloudberry/blob/master/noah/src/main/resources/twitter/aql/ddl.aql]
> The exception is following:
> {code}
> SEVERE: null 
> java.lang.NullPointerException
> at 
> org.apache.asterix.om.typecomputer.impl.TypeComputeUtils.getActualType(TypeComputeUtils.java:174)
> at 
> org.apache.asterix.om.typecomputer.impl.TypeComputeUtils.getActualType(TypeComputeUtils.java:153)
> at 
> org.apache.asterix.om.typecomputer.impl.TypeComputeUtils.resolveResultType(TypeComputeUtils.java:84)
> at 
> org.apache.asterix.om.typecomputer.base.AbstractResultTypeComputer.computeType(AbstractResultTypeComputer.java:39)
> at 
> org.apache.asterix.dataflow.data.common.AqlExpressionTypeComputer.getTypeForFunction(AqlExpressionTypeComputer.java:75)
> at 
> org.apache.asterix.dataflow.data.common.AqlExpressionTypeComputer.getType(AqlExpressionTypeComputer.java:53)
> at 
> org.apache.hyracks.algebricks.core.algebra.operators.logical.AssignOperator.computeOutputTypeEnvironment(AssignOperator.java:92)
> at 
> org.apache.hyracks.algebricks.core.rewriter.base.AlgebricksOptimizationContext.computeAndSetTypeEnvironmentForOperator(AlgebricksOptimizationContext.java:295)
> at 
> org.apache.hyracks.algebricks.core.algebra.util.OperatorPropertiesUtil.typeOpRec(OperatorPropertiesUtil.java:256)
> at 
> org.apache.hyracks.algebricks.core.algebra.util.OperatorPropertiesUtil.typeOpRec(OperatorPropertiesUtil.java:249)
> at 
> org.apache.hyracks.algebricks.core.algebra.util.OperatorPropertiesUtil.typeOpRec(OperatorPropertiesUtil.java:249)
> at 
> org.apache.hyracks.algebricks.core.algebra.util.OperatorPropertiesUtil.typeOpRec(OperatorPropertiesUtil.java:249)
> at 
> org.apache.hyracks.algebricks.core.algebra.util.OperatorPropertiesUtil.typeOpRec(OperatorPropertiesUtil.java:249)
> at 
> org.apache.hyracks.algebricks.core.algebra.util.OperatorPropertiesUtil.typeOpRec(OperatorPropertiesUtil.java:249)
> at 
> org.apache.hyracks.algebricks.core.algebra.util.OperatorPropertiesUtil.typeOpRec(OperatorPropertiesUtil.java:249)
> at 
> org.apache.hyracks.algebricks.rewriter.rules.PushSelectDownRule.rewritePre(PushSelectDownRule.java:66)
> at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:90)
> at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
> at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
> at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
> at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
> at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
> at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
> at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
> at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleC

Change in asterixdb[master]: ASTERIXDB-1485: add a regression test.

2016-08-11 Thread Yingyi Bu (Code Review)
Yingyi Bu has submitted this change and it was merged.

Change subject: ASTERIXDB-1485: add a regression test.
..


ASTERIXDB-1485: add a regression test.

Change-Id: Id7505ae3842fc659adac3debfcf9c857aff5fd26
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1066
Reviewed-by: Jianfeng Jia 
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
---
A asterixdb/asterix-app/data/twitter/sample.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1485/query-ASTERIXDB-1485.1.ddl.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1485/query-ASTERIXDB-1485.2.update.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1485/query-ASTERIXDB-1485.3.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/flwor/query-ASTERIXDB-1485/query-ASTERIXDB-1485.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
6 files changed, 165 insertions(+), 0 deletions(-)

Approvals:
  Jianfeng Jia: Looks good to me, approved
  Jenkins: Verified; No violations found; Verified



diff --git a/asterixdb/asterix-app/data/twitter/sample.adm 
b/asterixdb/asterix-app/data/twitter/sample.adm
new file mode 100644
index 000..a0ffeb7
--- /dev/null
+++ b/asterixdb/asterix-app/data/twitter/sample.adm
@@ -0,0 +1,7 @@
+{ "create_at": datetime("2012-05-01T09:15:07.000Z"), "id": 197358499422928896, 
"text": "I hate writing document", "in_reply_to_status": -1, 
"in_reply_to_user": -1, "favorite_count": -1, "coordinate": point("-81.6430449, 
38.3092672"), "retweet_count": 0, "lang": "null", "is_retweet": false, 
"hashtags": {{ "hate", "document" }}, "user_mentions": null, "user": { "id": 
331998689, "name": "ImAGlenardenNigga", "screen_name": "WhiteBoyTurntUp", 
"lang": "en", "location": "Glenarden D $M$ V ", "create_at": 
date("2011-07-08"), "description": "#TeamNAS #TeamTatted #TeamTakin 
#TeamLightSkin #TeamRollUp #TeamGDHU #TeamGlenarden #Follow My Folk's 
@EfffYou_PayMe & Go Follow My Short Stuff @_Chinkyy ", "followers_count": 1629, 
"friends_count": 1542, "statues_count": 40754 }, "place": { "country": "United 
States", "country_code": "United States", "full_name": "Charleston, WV", "id": 
"44439f1538ac3ca0", "name": "Charleston", "place_type": "city", "bounding_box": 
rectangle("-81.72,38.28113
 9 -81.559673,38.405759") }, "geo_tag": { "stateID": 54, "stateName": "West 
Virgnia", "countyID": 54039, "countyName": "Kanawha", "cityID": 5414600, 
"cityName": "Charleston" } }
+{ "create_at": datetime("2012-05-02T09:15:08.000Z"), "id": 197358503617241088, 
"text": "✍ UK [contract] Java/ATG Developer x 4 at http://t.co/TvUNu4UR ✔ 
#jobs", "in_reply_to_status": -1, "in_reply_to_user": -1, "favorite_count": -1, 
"coordinate": point("0.13017578, 51.26358251"), "retweet_count": 0, "lang": 
"null", "is_retweet": false, "hashtags": {{ "jobs" }}, "user_mentions": null, 
"user": { "id": 80654241, "name": "david morgan", "screen_name": 
"adsbringcust", "lang": "en", "location": "Northampton, UK", "create_at": 
date("2009-10-07"), "description": "see my latest site:", "followers_count": 
1765, "friends_count": 1998, "statues_count": 77360 }, "place": { "country": 
"United Kingdom", "country_code": "United Kingdom", "full_name": "Sevenoaks, 
Kent", "id": "5747f33800b71f4b", "name": "Sevenoaks", "place_type": "city", 
"bounding_box": rectangle("0.033526,51.13179 0.344757,51.417971) }, "geo_tag": 
{ "stateID": 2, "stateName": "Alaska", "countyID": 2016, "countyName": "A
 leutians West", "cityID": null, "cityName": null } }
+{ "create_at": datetime("2012-05-03T09:15:16.000Z"), "id": 197358537167482881, 
"text": "I like writing code", "in_reply_to_status": -1, "in_reply_to_user": 
-1, "favorite_count": -1, "coordinate": point("-77.3015925, 38.6525867"), 
"retweet_count": 0, "lang": "null", "is_retweet": false, "hashtags": null, 
"user_mentions": null, "user": { "id": 227806764, "name": 
"DominiqueHalliburton", "screen_name": "NdeaaLovee_", "lang": "en", "location": 
"", "create_at": date("2010-12-17"), "description": "Better run, better run, 
faster then my bullet ︻┳═一\r\nBabyy ima BOSS, idk wht they do", 
"followers_count": 327, "friends_count": 316, "statues_count": 5692 }, "place": 
{ "country": "United States", "country_code": "United States", "full_name": 
"Maryland, US", "id": "dea1eac2d7ef8878", "name": "Maryland", "place_type": 
"admin", "bounding_box": rectangle("-79.487651,37.886605 -74.986282,39.723037") 
}, "geo_tag": { "stateID": 51, "stateName": "Virginia", "countyID": 51153, 
"countyNam
 e": "Prince William", "cityID": 5121088, "cityName": "Dale City" } }
+{ "create_at": datetime("2012-05-04T09:15:25.000Z"), "id": 197358574933000192, 
"text": "I'm at Спортмастер (Москва, Россия)", "in_reply_to_status": -1, 
"in_reply_to_user": -1, "favorite_count": -1, "coordinate": point("37.74370193, 
55.64500063"), "retweet_count": 0, "lang

Change in asterixdb[master]: ASTERIXDB-1569: the config file now supports unit, comma, an...

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1569: the config file now supports unit, comma, and 
decimal.
..


Patch Set 4:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/283/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1064
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Chen Li 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No


Change in asterixdb[master]: ASTERIXDB-1485: add a regression test.

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1485: add a regression test.
..


Patch Set 2: Integration-Tests+1

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/282/ : 
SUCCESS

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1066
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Id7505ae3842fc659adac3debfcf9c857aff5fd26
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-HasComments: No


Change in asterixdb[master]: TweetParser Extension

2016-08-11 Thread Till Westmann (Code Review)
Till Westmann has posted comments on this change.

Change subject: TweetParser Extension
..


Patch Set 7:

(1 comment)

https://asterix-gerrit.ics.uci.edu/#/c/1002/7/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/library/java/JObjectAccessors.java
File 
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/library/java/JObjectAccessors.java:

Line 484: }
The formatting of the if-then-else here doesn't seem quite right. It'd be nice 
to use the formatter. Also, I think that a conditional expression should work 
nicely here.


-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1002
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I7021e7b779de05b9ec999a8d5f8464fb0ab413c0
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Xikui Wang 
Gerrit-Reviewer: abdullah alamoudi 
Gerrit-HasComments: Yes


Change in asterixdb[master]: ASTERIXDB-1569: the config file now supports unit, comma, an...

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1569: the config file now supports unit, comma, and 
decimal.
..


Patch Set 4:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1064
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Chen Li 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No


Change in asterixdb[master]: ASTERIXDB-1569: the config file now supports unit, comma, an...

2016-08-11 Thread Till Westmann (Code Review)
Till Westmann has posted comments on this change.

Change subject: ASTERIXDB-1569: the config file now supports unit, comma, and 
decimal.
..


Patch Set 4: Code-Review+1

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1064
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Chen Li 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No


Change in asterixdb[master]: ASTERIXDB-1569: the config file now supports unit, comma, an...

2016-08-11 Thread Yingyi Bu (Code Review)
Yingyi Bu has posted comments on this change.

Change subject: ASTERIXDB-1569: the config file now supports unit, comma, and 
decimal.
..


Patch Set 4: Code-Review+2

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1064
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Chen Li 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No


Change in asterixdb[master]: TweetParser Extension

2016-08-11 Thread Xikui Wang (Code Review)
Xikui Wang has posted comments on this change.

Change subject: TweetParser Extension
..


Patch Set 7: Code-Review+1

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1002
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I7021e7b779de05b9ec999a8d5f8464fb0ab413c0
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Xikui Wang 
Gerrit-Reviewer: abdullah alamoudi 
Gerrit-HasComments: No


Change in asterixdb[master]: ASTERIXDB-1569: the config file now supports unit, comma, an...

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1569: the config file now supports unit, comma, and 
decimal.
..


Patch Set 4:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2171/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1064
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Chen Li 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No


Change in asterixdb[master]: ASTERIXDB-1569: the config file now supports unit, comma, an...

2016-08-11 Thread Taewoo Kim (Code Review)
Hello Yingyi Bu, Till Westmann, Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1064

to look at the new patch set (#4).

Change subject: ASTERIXDB-1569: the config file now supports unit, comma, and 
decimal.
..

ASTERIXDB-1569: the config file now supports unit, comma, and decimal.

 - This patch fixes an issue that the config file only supports byte
   value for the byte required parameters. Now, we can use unit (KB, MB, GB 
...),
   comma, and decimal.

Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
---
M asterixdb/asterix-app/src/main/resources/asterix-build-configuration.xml
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixCompilerProperties.java
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixFeedProperties.java
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixReplicationProperties.java
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixStorageProperties.java
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixTransactionProperties.java
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/PropertyInterpreters.java
M asterixdb/asterix-docker/docker/asterix-configuration.xml
M 
asterixdb/asterix-experiments/src/main/resources/ingestion-experiment-binary-and-configs/configs/asterix-configuration.xml
M asterixdb/asterix-installer/src/main/resources/conf/asterix-configuration.xml
M 
asterixdb/asterix-installer/src/test/resources/integrationts/asterix-configuration.xml
M asterixdb/asterix-yarn/src/main/resources/base-asterix-configuration.xml
M 
asterixdb/asterix-yarn/src/main/resources/configs/base-asterix-configuration.xml
M 
hyracks-fullstack/hyracks/hyracks-util/src/main/java/org/apache/hyracks/util/StorageUtil.java
14 files changed, 242 insertions(+), 104 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/64/1064/4
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1064
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Chen Li 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 


Change in asterixdb[master]: ASTERIXDB-1569: the config file now supports unit, comma, an...

2016-08-11 Thread Taewoo Kim (Code Review)
Taewoo Kim has posted comments on this change.

Change subject: ASTERIXDB-1569: the config file now supports unit, comma, and 
decimal.
..


Patch Set 3:

(1 comment)

https://asterix-gerrit.ics.uci.edu/#/c/1064/3/hyracks-fullstack/hyracks/hyracks-util/src/main/java/org/apache/hyracks/util/StorageUtil.java
File 
hyracks-fullstack/hyracks/hyracks-util/src/main/java/org/apache/hyracks/util/StorageUtil.java:

Line 39: public String toString() {
> MAJOR SonarQube violation:
Done


-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1064
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Chen Li 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: Yes


Change in asterixdb[master]: ASTERIXDB-1569: the config file now supports unit, comma, an...

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1569: the config file now supports unit, comma, and 
decimal.
..


Patch Set 3: Integration-Tests+1

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/281/ : 
SUCCESS

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1064
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Chen Li 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No


Change in asterixdb[master]: ASTERIXDB-1485: add a regression test.

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1485: add a regression test.
..


Patch Set 2:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2170/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1066
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Id7505ae3842fc659adac3debfcf9c857aff5fd26
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-HasComments: No


Change in asterixdb[master]: ASTERIXDB-1569: the config file now supports unit, comma, an...

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1569: the config file now supports unit, comma, and 
decimal.
..


Patch Set 3:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/281/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1064
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Chen Li 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No


[jira] [Created] (ASTERIXDB-1570) Sporadic test failure "Unable to find free page in buffer cache after 1000 cycles"

2016-08-11 Thread Yingyi Bu (JIRA)
Yingyi Bu created ASTERIXDB-1570:


 Summary: Sporadic test failure "Unable to find free page in buffer 
cache after 1000 cycles"
 Key: ASTERIXDB-1570
 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1570
 Project: Apache AsterixDB
  Issue Type: Bug
  Components: Storage
Reporter: Yingyi Bu
Assignee: Michael Blow
Priority: Critical


It happened on my recent jenkins job:

{noformat}
Error Message

Test 
"src/test/resources/runtimets/queries/big-object/big_object_feed_20M/big_object_feed_20M.3.query.aql"
 FAILED!
Stacktrace

java.lang.Exception: Test 
"src/test/resources/runtimets/queries/big-object/big_object_feed_20M/big_object_feed_20M.3.query.aql"
 FAILED!
at 
org.apache.asterix.test.aql.TestExecutor.executeHttpRequest(TestExecutor.java:278)
at 
org.apache.asterix.test.aql.TestExecutor.executeQuery(TestExecutor.java:288)
at 
org.apache.asterix.test.aql.TestExecutor.executeTest(TestExecutor.java:538)
at 
org.apache.asterix.test.aql.TestExecutor.executeTest(TestExecutor.java:785)
at 
org.apache.asterix.test.runtime.ExecutionTest.test(ExecutionTest.java:110)
Standard Error

org.apache.hyracks.api.exceptions.HyracksDataException: Unable to find free 
page in buffer cache after 1000 cycles (buffer cache undersized?)
at 
org.apache.hyracks.storage.common.buffercache.BufferCache.getPageLoop(BufferCache.java:1287)
at 
org.apache.hyracks.storage.common.buffercache.BufferCache.confiscatePage(BufferCache.java:1154)
at 
org.apache.hyracks.storage.common.buffercache.BufferCache.confiscatePage(BufferCache.java:1141)
at 
org.apache.hyracks.storage.am.bloomfilter.impls.BloomFilter$BloomFilterBuilder.allocateAndInitMetaDataPage(BloomFilter.java:253)
at 
org.apache.hyracks.storage.am.bloomfilter.impls.BloomFilter$BloomFilterBuilder.end(BloomFilter.java:283)
at 
org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTree.flush(LSMBTree.java:481)
at 
org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.flush(LSMHarness.java:434)
at 
org.apache.hyracks.storage.am.lsm.common.impls.LSMTreeIndexAccessor.flush(LSMTreeIndexAccessor.java:105)
at 
org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTreeFlushOperation.call(LSMBTreeFlushOperation.java:73)
at 
org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTreeFlushOperation.call(LSMBTreeFlushOperation.java:34)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
org.apache.hyracks.api.exceptions.HyracksDataException: 
org.apache.hyracks.api.exceptions.HyracksDataException: Unable to find free 
page in buffer cache after 1000 cycles (buffer cache undersized?)
at 
org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:218)
at 
org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:83)
at org.apache.hyracks.control.nc.Task.run(Task.java:263)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.ExecutionException: 
org.apache.hyracks.api.exceptions.HyracksDataException: Unable to find free 
page in buffer cache after 1000 cycles (buffer cache undersized?)
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at 
org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:212)
... 5 more
Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: Unable to 
find free page in buffer cache after 1000 cycles (buffer cache undersized?)
at 
org.apache.hyracks.storage.am.common.dataflow.IndexSearchOperatorNodePushable.nextFrame(IndexSearchOperatorNodePushable.java:187)
at 
org.apache.hyracks.dataflow.common.comm.io.AbstractFrameAppender.write(AbstractFrameAppender.java:92)
at 
org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.flushAndReset(AbstractOneInputOneOutputOneFramePushRuntime.java:63)
at 
org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.flushIfNotFailed(AbstractOneInputOneOutputOneFramePushRuntime.java:69)
at 
org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRun

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

2016-08-11 Thread Michael J. Carey (JIRA)

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418016#comment-15418016
 ] 

Michael J. Carey commented on ASTERIXDB-1556:
-

Semi-agreed - but - if this is a PartitionedFramedHashTable (vs. a more vanilla 
FramedHashTable) with the notion of partitions that are bulk-reset - then this 
would be a natural thing to do when resetting a partition.  HOWEVER: Given how 
stuff is laid out, I'm not sure garbage collection is easily done on a 
per-partition basis (without having separate hash tables per partition)?  
Anyway, I'm in favor of whatever turns out to get as much space back as 
possible as often as possible while not slowing down the normal case. :-)

> Hash Table used by External hash group-by doesn't conform to the budget.
> 
>
> Key: ASTERIXDB-1556
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1556
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Taewoo Kim
>Assignee: Taewoo Kim
> Attachments: 2wayjoin.pdf, 2wayjoin.rtf, 2wayjoinplan.rtf, 
> 3wayjoin.pdf, 3wayjoin.rtf, 3wayjoinplan.rtf
>
>
> When we enable prefix-based fuzzy-join and apply the multi-way fuzzy-join ( > 
> 2), the system generates an out-of-memory exception. 
> Since a fuzzy-join is created using 30-40 lines of AQL codes and this AQL is 
> translated into massive number of operators (more than 200 operators in the 
> plan for a 3-way fuzzy join), it could generate out-of-memory exception.
> /// Update: as the discussion goes, we found that hash table in the external 
> hash group by doesn't conform to the frame limit. So, an out of memory 
> exception happens during the execution of an external hash group by operator.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

2016-08-11 Thread Taewoo Kim (JIRA)

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418007#comment-15418007
 ] 

Taewoo Kim commented on ASTERIXDB-1556:
---

I see. We can keep the current scheme (just setting the number of used slot as 
zero for the hash values that are corresponding to those of the spilled data 
parition) and just coalescing hash slots (remove dead spaces). 

> Hash Table used by External hash group-by doesn't conform to the budget.
> 
>
> Key: ASTERIXDB-1556
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1556
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Taewoo Kim
>Assignee: Taewoo Kim
> Attachments: 2wayjoin.pdf, 2wayjoin.rtf, 2wayjoinplan.rtf, 
> 3wayjoin.pdf, 3wayjoin.rtf, 3wayjoinplan.rtf
>
>
> When we enable prefix-based fuzzy-join and apply the multi-way fuzzy-join ( > 
> 2), the system generates an out-of-memory exception. 
> Since a fuzzy-join is created using 30-40 lines of AQL codes and this AQL is 
> translated into massive number of operators (more than 200 operators in the 
> plan for a 3-way fuzzy join), it could generate out-of-memory exception.
> /// Update: as the discussion goes, we found that hash table in the external 
> hash group by doesn't conform to the frame limit. So, an out of memory 
> exception happens during the execution of an external hash group by operator.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Change in asterixdb[master]: ASTERIXDB-1569: the config file now supports unit, comma, an...

2016-08-11 Thread Till Westmann (Code Review)
Till Westmann has posted comments on this change.

Change subject: ASTERIXDB-1569: the config file now supports unit, comma, and 
decimal.
..


Patch Set 3: Code-Review+1

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1064
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Chen Li 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No


[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

2016-08-11 Thread Jianfeng Jia (JIRA)

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418001#comment-15418001
 ] 

Jianfeng Jia commented on ASTERIXDB-1556:
-

About (2), the data part `frame limit <=1` policy should be transparent to 
HastTable. I feel it's a little over optimization engineering-wise, because 
that breaks the generality of the hashtable data structure.

> Hash Table used by External hash group-by doesn't conform to the budget.
> 
>
> Key: ASTERIXDB-1556
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1556
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Taewoo Kim
>Assignee: Taewoo Kim
> Attachments: 2wayjoin.pdf, 2wayjoin.rtf, 2wayjoinplan.rtf, 
> 3wayjoin.pdf, 3wayjoin.rtf, 3wayjoinplan.rtf
>
>
> When we enable prefix-based fuzzy-join and apply the multi-way fuzzy-join ( > 
> 2), the system generates an out-of-memory exception. 
> Since a fuzzy-join is created using 30-40 lines of AQL codes and this AQL is 
> translated into massive number of operators (more than 200 operators in the 
> plan for a 3-way fuzzy join), it could generate out-of-memory exception.
> /// Update: as the discussion goes, we found that hash table in the external 
> hash group by doesn't conform to the frame limit. So, an out of memory 
> exception happens during the execution of an external hash group by operator.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Change in asterixdb[master]: ASTERIXDB-1569: the config file now supports unit, comma, an...

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1569: the config file now supports unit, comma, and 
decimal.
..


Patch Set 3:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1064
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Chen Li 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No


Change in asterixdb[master]: ASTERIXDB-1569: the config file now supports unit, comma, an...

2016-08-11 Thread Taewoo Kim (Code Review)
Hello Yingyi Bu, Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1064

to look at the new patch set (#3).

Change subject: ASTERIXDB-1569: the config file now supports unit, comma, and 
decimal.
..

ASTERIXDB-1569: the config file now supports unit, comma, and decimal.

 - This patch fixes an issue that the config file only supports byte
   value for the byte required parameters. Now, we can use unit (KB, MB, GB 
...),
   comma, and decimal.

Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
---
M asterixdb/asterix-app/src/main/resources/asterix-build-configuration.xml
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixCompilerProperties.java
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixFeedProperties.java
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixReplicationProperties.java
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixStorageProperties.java
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixTransactionProperties.java
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/PropertyInterpreters.java
M asterixdb/asterix-docker/docker/asterix-configuration.xml
M 
asterixdb/asterix-experiments/src/main/resources/ingestion-experiment-binary-and-configs/configs/asterix-configuration.xml
M asterixdb/asterix-installer/src/main/resources/conf/asterix-configuration.xml
M 
asterixdb/asterix-installer/src/test/resources/integrationts/asterix-configuration.xml
M asterixdb/asterix-yarn/src/main/resources/base-asterix-configuration.xml
M 
asterixdb/asterix-yarn/src/main/resources/configs/base-asterix-configuration.xml
M 
hyracks-fullstack/hyracks/hyracks-util/src/main/java/org/apache/hyracks/util/StorageUtil.java
14 files changed, 241 insertions(+), 104 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/64/1064/3
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1064
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Chen Li 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 


Change in asterixdb[master]: ASTERIXDB-1485: add a regression test.

2016-08-11 Thread Jianfeng Jia (Code Review)
Jianfeng Jia has posted comments on this change.

Change subject: ASTERIXDB-1485: add a regression test.
..


Patch Set 2: Code-Review+2

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1066
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Id7505ae3842fc659adac3debfcf9c857aff5fd26
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-HasComments: No


Change in asterixdb[master]: ASTERIXDB-1485: add a regression test.

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1485: add a regression test.
..


Patch Set 2:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2168/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1066
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Id7505ae3842fc659adac3debfcf9c857aff5fd26
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


Change in asterixdb[master]: ASTERIXDB-1485: add a regression test.

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1485: add a regression test.
..


Patch Set 1:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2167/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1066
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Id7505ae3842fc659adac3debfcf9c857aff5fd26
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


Change in asterixdb[master]: ASTERIXDB-1485: add a regression test.

2016-08-11 Thread Yingyi Bu (Code Review)
Yingyi Bu has uploaded a new patch set (#2).

Change subject: ASTERIXDB-1485: add a regression test.
..

ASTERIXDB-1485: add a regression test.

Change-Id: Id7505ae3842fc659adac3debfcf9c857aff5fd26
---
A asterixdb/asterix-app/data/twitter/sample.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1485/query-ASTERIXDB-1485.1.ddl.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1485/query-ASTERIXDB-1485.2.update.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1485/query-ASTERIXDB-1485.3.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/flwor/query-ASTERIXDB-1485/query-ASTERIXDB-1485.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
6 files changed, 165 insertions(+), 0 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/66/1066/2
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1066
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Id7505ae3842fc659adac3debfcf9c857aff5fd26
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 


Change in asterixdb[master]: ASTERIXDB-1569: the config file now supports unit, comma, an...

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1569: the config file now supports unit, comma, and 
decimal.
..


Patch Set 2:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/280/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1064
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Chen Li 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No


Change in asterixdb[master]: ASTERIXDB-1485: add a regression test.

2016-08-11 Thread Yingyi Bu (Code Review)
Yingyi Bu has uploaded a new change for review.

  https://asterix-gerrit.ics.uci.edu/1066

Change subject: ASTERIXDB-1485: add a regression test.
..

ASTERIXDB-1485: add a regression test.

Change-Id: Id7505ae3842fc659adac3debfcf9c857aff5fd26
---
A asterixdb/asterix-app/data/twitter/sample.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1485/query-ASTERIXDB-1485.1.ddl.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1485/query-ASTERIXDB-1485.2.update.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/flwor/query-ASTERIXDB-1485/query-ASTERIXDB-1485.3.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/flwor/query-ASTERIXDB-1485/query-ASTERIXDB-1485.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
6 files changed, 166 insertions(+), 0 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/66/1066/1

diff --git a/asterixdb/asterix-app/data/twitter/sample.adm 
b/asterixdb/asterix-app/data/twitter/sample.adm
new file mode 100644
index 000..a0ffeb7
--- /dev/null
+++ b/asterixdb/asterix-app/data/twitter/sample.adm
@@ -0,0 +1,7 @@
+{ "create_at": datetime("2012-05-01T09:15:07.000Z"), "id": 197358499422928896, 
"text": "I hate writing document", "in_reply_to_status": -1, 
"in_reply_to_user": -1, "favorite_count": -1, "coordinate": point("-81.6430449, 
38.3092672"), "retweet_count": 0, "lang": "null", "is_retweet": false, 
"hashtags": {{ "hate", "document" }}, "user_mentions": null, "user": { "id": 
331998689, "name": "ImAGlenardenNigga", "screen_name": "WhiteBoyTurntUp", 
"lang": "en", "location": "Glenarden D $M$ V ", "create_at": 
date("2011-07-08"), "description": "#TeamNAS #TeamTatted #TeamTakin 
#TeamLightSkin #TeamRollUp #TeamGDHU #TeamGlenarden #Follow My Folk's 
@EfffYou_PayMe & Go Follow My Short Stuff @_Chinkyy ", "followers_count": 1629, 
"friends_count": 1542, "statues_count": 40754 }, "place": { "country": "United 
States", "country_code": "United States", "full_name": "Charleston, WV", "id": 
"44439f1538ac3ca0", "name": "Charleston", "place_type": "city", "bounding_box": 
rectangle("-81.72,38.28113
 9 -81.559673,38.405759") }, "geo_tag": { "stateID": 54, "stateName": "West 
Virgnia", "countyID": 54039, "countyName": "Kanawha", "cityID": 5414600, 
"cityName": "Charleston" } }
+{ "create_at": datetime("2012-05-02T09:15:08.000Z"), "id": 197358503617241088, 
"text": "✍ UK [contract] Java/ATG Developer x 4 at http://t.co/TvUNu4UR ✔ 
#jobs", "in_reply_to_status": -1, "in_reply_to_user": -1, "favorite_count": -1, 
"coordinate": point("0.13017578, 51.26358251"), "retweet_count": 0, "lang": 
"null", "is_retweet": false, "hashtags": {{ "jobs" }}, "user_mentions": null, 
"user": { "id": 80654241, "name": "david morgan", "screen_name": 
"adsbringcust", "lang": "en", "location": "Northampton, UK", "create_at": 
date("2009-10-07"), "description": "see my latest site:", "followers_count": 
1765, "friends_count": 1998, "statues_count": 77360 }, "place": { "country": 
"United Kingdom", "country_code": "United Kingdom", "full_name": "Sevenoaks, 
Kent", "id": "5747f33800b71f4b", "name": "Sevenoaks", "place_type": "city", 
"bounding_box": rectangle("0.033526,51.13179 0.344757,51.417971) }, "geo_tag": 
{ "stateID": 2, "stateName": "Alaska", "countyID": 2016, "countyName": "A
 leutians West", "cityID": null, "cityName": null } }
+{ "create_at": datetime("2012-05-03T09:15:16.000Z"), "id": 197358537167482881, 
"text": "I like writing code", "in_reply_to_status": -1, "in_reply_to_user": 
-1, "favorite_count": -1, "coordinate": point("-77.3015925, 38.6525867"), 
"retweet_count": 0, "lang": "null", "is_retweet": false, "hashtags": null, 
"user_mentions": null, "user": { "id": 227806764, "name": 
"DominiqueHalliburton", "screen_name": "NdeaaLovee_", "lang": "en", "location": 
"", "create_at": date("2010-12-17"), "description": "Better run, better run, 
faster then my bullet ︻┳═一\r\nBabyy ima BOSS, idk wht they do", 
"followers_count": 327, "friends_count": 316, "statues_count": 5692 }, "place": 
{ "country": "United States", "country_code": "United States", "full_name": 
"Maryland, US", "id": "dea1eac2d7ef8878", "name": "Maryland", "place_type": 
"admin", "bounding_box": rectangle("-79.487651,37.886605 -74.986282,39.723037") 
}, "geo_tag": { "stateID": 51, "stateName": "Virginia", "countyID": 51153, 
"countyNam
 e": "Prince William", "cityID": 5121088, "cityName": "Dale City" } }
+{ "create_at": datetime("2012-05-04T09:15:25.000Z"), "id": 197358574933000192, 
"text": "I'm at Спортмастер (Москва, Россия)", "in_reply_to_status": -1, 
"in_reply_to_user": -1, "favorite_count": -1, "coordinate": point("37.74370193, 
55.64500063"), "retweet_count": 0, "lang": "null", "is_retweet": false, 
"hashtags": null, "user_mentions": null, "user": { "id": 94982186, "name": 
"Liana", "screen_name": "Li

Change in asterixdb[master]: ASTERIXDB-1569: the config file now supports unit, comma, an...

2016-08-11 Thread Till Westmann (Code Review)
Till Westmann has posted comments on this change.

Change subject: ASTERIXDB-1569: the config file now supports unit, comma, and 
decimal.
..


Patch Set 1:

(1 comment)

https://asterix-gerrit.ics.uci.edu/#/c/1064/1/hyracks-fullstack/hyracks/hyracks-util/src/main/java/org/apache/hyracks/util/StorageUtil.java
File 
hyracks-fullstack/hyracks/hyracks-util/src/main/java/org/apache/hyracks/util/StorageUtil.java:

Line 108: unitType = StorageUnit.KILOBYTE;
> Done
I see that the lowercasing is here now, but the code not a method in 
StorageUnit. It seems to me that this code would be better placed in the 
StorageUnit enum, as that would basically be a factory method that creates a 
StorageUnit from a string.
Does this make sense?


-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1064
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Chen Li 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: Yes


Change in asterixdb[master]: ASTERIXDB-1569: the config file now supports unit, comma, an...

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1569: the config file now supports unit, comma, and 
decimal.
..


Patch Set 2:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1064
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Chen Li 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No


Change in asterixdb[master]: ASTERIXDB-1569: the config file now supports unit, comma, an...

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1569: the config file now supports unit, comma, and 
decimal.
..


Patch Set 2:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2166/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1064
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Chen Li 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No


Change in asterixdb[master]: Ensure RMI host is set to the cluster ip address

2016-08-11 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: Ensure RMI host is set to the cluster ip address
..


Patch Set 1:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2165/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1065
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I0fbda4ce14c892e66595d7a1cc3801f0fc2b8fba
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Michael Blow 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


[jira] [Commented] (ASTERIXDB-1485) NPE when translate one AQL query

2016-08-11 Thread Jianfeng Jia (JIRA)

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15417751#comment-15417751
 ] 

Jianfeng Jia commented on ASTERIXDB-1485:
-

Here are 5 sample records:
{code}
[ { "create_at": "2012-05-01T09:15:07.000Z", "id": 197358499422928896, "text": 
"I Miss Da Hood", "in_reply_to_status": -1, "in_reply_to_user": -1, 
"favorite_count": -1, "coordinate": [-81.6430449, 38.3092672], "retweet_count": 
0, "lang": "null", "is_retweet": false, "hashtags": null, "user_mentions": 
null, "user": { "id": 331998689, "name": "ImAGlenardenNigga", "screen_name": 
"WhiteBoyTurntUp", "lang": "en", "location": "Glenarden D $M$ V ", "create_at": 
"2011-07-08", "description": "#TeamNAS #TeamTatted #TeamTakin #TeamLightSkin 
#TeamRollUp #TeamGDHU #TeamGlenarden #Follow My Folk's @EfffYou_PayMe & Go 
Follow My Short Stuff @_Chinkyy ", "followers_count": 1629, "friends_count": 
1542, "statues_count": 40754 }, "place": { "country": "United States", 
"country_code": "United States", "full_name": "Charleston, WV", "id": 
"44439f1538ac3ca0", "name": "Charleston", "place_type": "city", "bounding_box": 
[ [-81.72, 38.281139], [-81.559673, 38.405759] ] }, "geo_tag": { "stateID": 
54, "stateName": "West Virginia", "countyID": 54039, "countyName": "Kanawha", 
"cityID": 5414600, "cityName": "Charleston" } }
, { "create_at": "2012-05-01T09:15:08.000Z", "id": 197358503617241088, "text": 
"✍ UK [contract] Java/ATG Developer x 4 at http://t.co/TvUNu4UR ✔ #jobs", 
"in_reply_to_status": -1, "in_reply_to_user": -1, "favorite_count": -1, 
"coordinate": [0.13017578, 51.26358251], "retweet_count": 0, "lang": "null", 
"is_retweet": false, "hashtags": [ "jobs" ], "user_mentions": null, "user": { 
"id": 80654241, "name": "david morgan", "screen_name": "adsbringcust", "lang": 
"en", "location": "Northampton, UK", "create_at": "2009-10-07", "description": 
"see my latest site:", "followers_count": 1765, "friends_count": 1998, 
"statues_count": 77360 }, "place": { "country": "United Kingdom", 
"country_code": "United Kingdom", "full_name": "Sevenoaks, Kent", "id": 
"5747f33800b71f4b", "name": "Sevenoaks", "place_type": "city", "bounding_box": 
[ [0.033526, 51.13179], [0.344757, 51.417971] ] }, "geo_tag": { "stateID": 2, 
"stateName": "Alaska", "countyID": 2016, "countyName": "Aleutians West", 
"cityID": null, "cityName": null } }
, { "create_at": "2012-05-01T09:15:16.000Z", "id": 197358537167482881, "text": 
"I don't condone dick ridinn", "in_reply_to_status": -1, "in_reply_to_user": 
-1, "favorite_count": -1, "coordinate": [-77.3015925, 38.6525867], 
"retweet_count": 0, "lang": "null", "is_retweet": false, "hashtags": null, 
"user_mentions": null, "user": { "id": 227806764, "name": 
"DominiqueHalliburton", "screen_name": "NdeaaLovee_", "lang": "en", "location": 
"", "create_at": "2010-12-17", "description": "Better run, better run, faster 
then my bullet ︻┳═一\r\nBabyy ima BOSS, idk wht they do", "followers_count": 
327, "friends_count": 316, "statues_count": 5692 }, "place": { "country": 
"United States", "country_code": "United States", "full_name": "Maryland, US", 
"id": "dea1eac2d7ef8878", "name": "Maryland", "place_type": "admin", 
"bounding_box": [ [-79.487651, 37.886605], [-74.986282, 39.723037] ] }, 
"geo_tag": { "stateID": 51, "stateName": "Virginia", "countyID": 51153, 
"countyName": "Prince William", "cityID": 5121088, "cityName": "Dale City" } }
, { "create_at": "2012-05-01T09:15:25.000Z", "id": 197358574933000192, "text": 
"I'm at Спортмастер (Москва, Россия) http://t.co/nLT49yhG";, 
"in_reply_to_status": -1, "in_reply_to_user": -1, "favorite_count": -1, 
"coordinate": [37.74370193, 55.64500063], "retweet_count": 0, "lang": "null", 
"is_retweet": false, "hashtags": null, "user_mentions": null, "user": { "id": 
94982186, "name": "Liana", "screen_name": "Lianochka_", "lang": "en", 
"location": "Russia, Moscow", "create_at": "2009-12-06", "description": "", 
"followers_count": 74, "friends_count": 54, "statues_count": 3570 }, "place": { 
"country": "Russia", "country_code": "Russia", "full_name": "Спортмастер, 
Moscow", "id": "c2b9829738f1d427", "name": "Спортмастер", "place_type": "poi", 
"bounding_box": [ [37.7437789, 55.6453589], [37.743779, 55.645359] ] }, 
"geo_tag": { "stateID": 2, "stateName": "Alaska", "countyID": 2016, 
"countyName": "Aleutians West", "cityID": null, "cityName": null } }
, { "create_at": "2012-05-01T09:15:36.000Z", "id": 197358621032583168, "text": 
"#thankyougame I thank everyone who has stuck by my side <3", 
"in_reply_to_status": -1, "in_reply_to_user": -1, "favorite_count": -1, 
"coordinate": [-70.8766775, 42.8107381], "retweet_count": 0, "lang": "null", 
"is_retweet": false, "hashtags": [ "thankyougame" ], "user_mentions": null, 
"user": { "id": 567441471, "name": "kelsey w harrington", "screen_name": 
"KelsWHarrington", "lang": "en", "location": "Massachusetts", "create_at": 
"2012-04