Change in asterixdb[master]: WIP - Fix feed connection

2017-04-02 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: WIP - Fix feed connection
..


Patch Set 1: Integration-Tests+1

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2412/ 
: SUCCESS

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1652
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I4e1f7dd3621482a11feb675a93b826ae2cb965a7
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


Change in asterixdb[master]: WIP - Fix feed connection

2017-04-01 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: WIP - Fix feed connection
..


Patch Set 1: BAD+1

BAD Compatibility Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/959/ : SUCCESS

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1652
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I4e1f7dd3621482a11feb675a93b826ae2cb965a7
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


Change in asterixdb[master]: WIP - Fix feed connection

2017-04-01 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: WIP - Fix feed connection
..


Patch Set 1:

BAD Compatibility Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/959/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1652
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I4e1f7dd3621482a11feb675a93b826ae2cb965a7
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


Change in asterixdb[master]: WIP - Fix feed connection

2017-04-01 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: WIP - Fix feed connection
..


Patch Set 1:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2412/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1652
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I4e1f7dd3621482a11feb675a93b826ae2cb965a7
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


Change in asterixdb[master]: WIP - Fix feed connection

2017-04-01 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: WIP - Fix feed connection
..


Patch Set 1:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4925/ (2/5)

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1652
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I4e1f7dd3621482a11feb675a93b826ae2cb965a7
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


Change in asterixdb[master]: WIP - Fix feed connection

2017-04-01 Thread Xikui Wang (Code Review)
Xikui Wang has uploaded a new change for review.

  https://asterix-gerrit.ics.uci.edu/1652

Change subject: WIP - Fix feed connection
..

WIP - Fix feed connection

Resubmit this patch for unknown compilation error

Change-Id: I4e1f7dd3621482a11feb675a93b826ae2cb965a7
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceRandomPartitioningFeedComputationRule.java
M 
asterixdb/asterix-app/src/main/java/org/apache/asterix/utils/FeedOperations.java
M 
asterixdb/asterix-app/src/test/resources/runtimets/results/feeds/change-feed-with-meta-pk-in-meta/change-feed-with-meta-pk-in-meta.4.adm
M 
asterixdb/asterix-app/src/test/resources/runtimets/results/feeds/change-feed-with-meta-pk-in-meta/change-feed-with-meta-pk-in-meta.5.adm
M 
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/operators/FeedCollectOperatorDescriptor.java
M 
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/operators/FeedMetaOperatorDescriptor.java
M 
asterixdb/asterix-installer/src/test/resources/transactionts/results/query_after_restart/dataset-with-meta-record/dataset-with-meta-record.5.adm
7 files changed, 33 insertions(+), 27 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/52/1652/1

diff --git 
a/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceRandomPartitioningFeedComputationRule.java
 
b/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceRandomPartitioningFeedComputationRule.java
index 1a0ecd9..dfb73ee 100644
--- 
a/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceRandomPartitioningFeedComputationRule.java
+++ 
b/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceRandomPartitioningFeedComputationRule.java
@@ -61,7 +61,7 @@
 
 final FeedDataSource feedDataSource = (FeedDataSource) dataSource;
 FeedConnection feedConnection = feedDataSource.getFeedConnection();
-if (feedConnection.getAppliedFunctions() == null) {
+if (feedConnection.getAppliedFunctions() == null || 
feedConnection.getAppliedFunctions().size() == 0) {
 return false;
 }
 
diff --git 
a/asterixdb/asterix-app/src/main/java/org/apache/asterix/utils/FeedOperations.java
 
b/asterixdb/asterix-app/src/main/java/org/apache/asterix/utils/FeedOperations.java
index 4ea524a..7e54395 100644
--- 
a/asterixdb/asterix-app/src/main/java/org/apache/asterix/utils/FeedOperations.java
+++ 
b/asterixdb/asterix-app/src/main/java/org/apache/asterix/utils/FeedOperations.java
@@ -80,6 +80,7 @@
 import org.apache.hyracks.algebricks.common.utils.Triple;
 import org.apache.hyracks.algebricks.runtime.base.IPushRuntimeFactory;
 import 
org.apache.hyracks.algebricks.runtime.operators.meta.AlgebricksMetaOperatorDescriptor;
+import 
org.apache.hyracks.algebricks.runtime.operators.std.AssignRuntimeFactory;
 import 
org.apache.hyracks.algebricks.runtime.operators.std.StreamSelectRuntimeFactory;
 import org.apache.hyracks.api.client.IHyracksClientConnection;
 import org.apache.hyracks.api.constraints.Constraint;
@@ -207,12 +208,15 @@
 Map> operatorLocations 
= new HashMap<>();
 Map operatorCounts = new HashMap<>();
 List jobIds = new ArrayList<>();
+FeedMetaOperatorDescriptor metaOp;
 
 for (int iter1 = 0; iter1 < jobsList.size(); iter1++) {
 FeedConnection curFeedConnection = feedConnections.get(iter1);
 JobSpecification subJob = jobsList.get(iter1);
 operatorIdMapping.clear();
 Map operatorsMap = 
subJob.getOperatorMap();
+FeedConnectionId feedConnectionId = new 
FeedConnectionId(ingestionOp.getEntityId(),
+feedConnections.get(iter1).getDatasetName());
 
 FeedPolicyEntity feedPolicyEntity =
 
FeedMetadataUtil.validateIfPolicyExists(curFeedConnection.getDataverseName(),
@@ -221,26 +225,41 @@
 for (Map.Entry entry : 
operatorsMap.entrySet()) {
 IOperatorDescriptor opDesc = entry.getValue();
 OperatorDescriptorId oldId = opDesc.getOperatorId();
-OperatorDescriptorId opId;
+OperatorDescriptorId opId = null;
 if (opDesc instanceof LSMTreeInsertDeleteOperatorDescriptor
 && ((LSMTreeInsertDeleteOperatorDescriptor) 
opDesc).isPrimary()) {
 String operandId = 
((LSMTreeInsertDeleteOperatorDescriptor) opDesc).getIndexName();
-FeedMetaOperatorDescriptor metaOp = new 
FeedMetaOperatorDescriptor(jobSpec,
-new FeedConnectionId(ingestionOp.getEntityId(),
-
feedConnections.get(iter1).getDatasetName()),
-opDesc, feedPolicyEntity.getProperties(), 
FeedRuntim

Change in asterixdb[master]: WIP - Fix feed connection

2017-04-01 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: WIP - Fix feed connection
..


Patch Set 1:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/246/ (5/5)

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1652
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I4e1f7dd3621482a11feb675a93b826ae2cb965a7
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


Change in asterixdb[master]: WIP - Fix feed connection

2017-04-01 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: WIP - Fix feed connection
..


Patch Set 1:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-sonar/3458/ (4/5)

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1652
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I4e1f7dd3621482a11feb675a93b826ae2cb965a7
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


Change in asterixdb[master]: WIP - Fix feed connection

2017-04-01 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: WIP - Fix feed connection
..


Patch Set 1:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-no-installer-app/61/
 (3/5)

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1652
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I4e1f7dd3621482a11feb675a93b826ae2cb965a7
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No


Change in asterixdb[master]: WIP - Fix feed connection

2017-04-01 Thread Jenkins (Code Review)
Jenkins has posted comments on this change.

Change subject: WIP - Fix feed connection
..


Patch Set 1:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-asterix-app/63/ 
(1/5)

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1652
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I4e1f7dd3621482a11feb675a93b826ae2cb965a7
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No