Change in asterixdb[master]: [ASTERIXDB-1944][STO] Align LSM inverted index with other in...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1944][STO] Align LSM inverted index with other indexes .. Patch Set 1: BAD-1 BAD Compatibility Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/1455/ : UNSTABLE -- To view, visit https://asterix-gerrit.ics.uci.edu/1852 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0fb7b446edfb14de25ecaf99965ae0a7325101c9 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [TEST] Test index re-creation
Jenkins has posted comments on this change. Change subject: [TEST] Test index re-creation .. Patch Set 1: BAD+1 BAD Compatibility Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/1454/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1851 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I96eda91a26362ca5b8f2e84b7ddc1c8272b59364 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Dmitry Lychagin Gerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1944][STO] Align LSM inverted index with other in...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1944][STO] Align LSM inverted index with other indexes .. Patch Set 1: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/1455/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1852 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0fb7b446edfb14de25ecaf99965ae0a7325101c9 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [TEST] Test index re-creation
Jenkins has posted comments on this change. Change subject: [TEST] Test index re-creation .. Patch Set 1: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/1454/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1851 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I96eda91a26362ca5b8f2e84b7ddc1c8272b59364 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Dmitry Lychagin Gerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 2: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/3283/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [TEST] Test index re-creation
Jenkins has posted comments on this change. Change subject: [TEST] Test index re-creation .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-asterix-app/915/ (10/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1851 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I96eda91a26362ca5b8f2e84b7ddc1c8272b59364 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Dmitry Lychagin Gerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1944][STO] Align LSM inverted index with other in...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1944][STO] Align LSM inverted index with other indexes .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-asterix-app/914/ (10/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1852 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0fb7b446edfb14de25ecaf99965ae0a7325101c9 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
[jira] [Commented] (ASTERIXDB-1443) No unit test cases for FrameDistributor
[ https://issues.apache.org/jira/browse/ASTERIXDB-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061786#comment-16061786 ] ASF subversion and git services commented on ASTERIXDB-1443: Commit d1d047b5e4d8a097c6b0c9d49058fc4ffe137cf6 in asterixdb's branch refs/heads/master from [~alamoudi] [ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=d1d047b ] [ASTERIXDB-1443][FEED] Remove Frame Distributor - user model changes: no - storage format changes: no - interface changes: no details: - FrameDistributor and DistributeFeedFrameWriter are not used anymore. Change-Id: I27c1ff99ce797923dd709d181387560e4f9448a5 Reviewed-on: https://asterix-gerrit.ics.uci.edu/1853 Sonar-Qube: JenkinsReviewed-by: Xikui Wang Integration-Tests: Jenkins Tested-by: Jenkins BAD: Jenkins > No unit test cases for FrameDistributor > --- > > Key: ASTERIXDB-1443 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1443 > Project: Apache AsterixDB > Issue Type: Bug >Reporter: Abdullah Alamoudi >Assignee: Abdullah Alamoudi > > A frame distributor is a special frame. it has a very specialized behavior > and it requires its own unit tests to ensure that it works as expected -- This message was sent by Atlassian JIRA (v6.4.14#64029)
Change in asterixdb[master]: [ASTERIXDB-1443][FEED] Remove Frame Distributor
abdullah alamoudi has submitted this change and it was merged. Change subject: [ASTERIXDB-1443][FEED] Remove Frame Distributor .. [ASTERIXDB-1443][FEED] Remove Frame Distributor - user model changes: no - storage format changes: no - interface changes: no details: - FrameDistributor and DistributeFeedFrameWriter are not used anymore. Change-Id: I27c1ff99ce797923dd709d181387560e4f9448a5 Reviewed-on: https://asterix-gerrit.ics.uci.edu/1853 Sonar-Qube: JenkinsReviewed-by: Xikui Wang Integration-Tests: Jenkins Tested-by: Jenkins BAD: Jenkins --- D asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/feed/dataflow/DistributeFeedFrameWriter.java D asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/feed/dataflow/FrameDistributor.java 2 files changed, 0 insertions(+), 302 deletions(-) Approvals: Xikui Wang: Looks good to me, approved Jenkins: Verified; No violations found; No violations found; Verified diff --git a/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/feed/dataflow/DistributeFeedFrameWriter.java b/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/feed/dataflow/DistributeFeedFrameWriter.java deleted file mode 100644 index ae2e0b9..000 --- a/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/feed/dataflow/DistributeFeedFrameWriter.java +++ /dev/null @@ -1,116 +0,0 @@ -/* - * Licensed to the Apache Software Foundation (ASF) under one - * or more contributor license agreements. See the NOTICE file - * distributed with this work for additional information - * regarding copyright ownership. The ASF licenses this file - * to you under the Apache License, Version 2.0 (the - * "License"); you may not use this file except in compliance - * with the License. You may obtain a copy of the License at - * - * http://www.apache.org/licenses/LICENSE-2.0 - * - * Unless required by applicable law or agreed to in writing, - * software distributed under the License is distributed on an - * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY - * KIND, either express or implied. See the License for the - * specific language governing permissions and limitations - * under the License. - */ -package org.apache.asterix.external.feed.dataflow; - -import java.io.IOException; -import java.nio.ByteBuffer; - -import org.apache.asterix.active.EntityId; -import org.apache.asterix.external.feed.management.FeedConnectionId; -import org.apache.asterix.external.util.FeedUtils.FeedRuntimeType; -import org.apache.hyracks.api.comm.IFrameWriter; -import org.apache.hyracks.api.exceptions.HyracksDataException; - -/** - * Provides mechanism for distributing the frames, as received from an operator to a - * set of registered readers. Each reader typically operates at a different pace. Readers - * are isolated from each other to ensure that a slow reader does not impact the progress of - * others. - **/ -public class DistributeFeedFrameWriter implements IFrameWriter { - -/** A unique identifier for the feed to which the incoming tuples belong. **/ -private final EntityId feedId; - -/** - * An instance of FrameDistributor that provides the mechanism for distributing a frame to multiple readers, each - * operating in isolation. - **/ -private final FrameDistributor frameDistributor; - -/** The original frame writer instantiated as part of job creation **/ -private final IFrameWriter writer; - -/** The feed operation whose output is being distributed by the DistributeFeedFrameWriter **/ -private final FeedRuntimeType feedRuntimeType; - -/** The value of the partition 'i' if this is the i'th instance of the associated operator **/ -private final int partition; - -public DistributeFeedFrameWriter(EntityId feedId, IFrameWriter writer, FeedRuntimeType feedRuntimeType, -int partition) throws IOException { -this.feedId = feedId; -this.frameDistributor = new FrameDistributor(); -this.feedRuntimeType = feedRuntimeType; -this.partition = partition; -this.writer = writer; -} - -/** - * @param fpa - *Feed policy accessor - * @param nextOnlyWriter - *the writer which will deliver the buffers - * @param connectionId - *(Dataverse - Dataset - Feed) - * @return A frame collector. - * @throws HyracksDataException - */ -public void subscribe(FeedFrameCollector collector) throws HyracksDataException { -frameDistributor.registerFrameCollector(collector); -} - -public void unsubscribeFeed(FeedConnectionId connectionId) throws HyracksDataException { -
Change in asterixdb[master]: [ASTERIXDB-1443][FEED] Remove Frame Distributor
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1443][FEED] Remove Frame Distributor .. Patch Set 1: BAD+1 BAD Compatibility Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/1453/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1853 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I27c1ff99ce797923dd709d181387560e4f9448a5 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1944][STO] Align LSM inverted index with other in...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1944][STO] Align LSM inverted index with other indexes .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-asterix-app/913/ (10/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1852 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0fb7b446edfb14de25ecaf99965ae0a7325101c9 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1443][FEED] Remove Frame Distributor
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1443][FEED] Remove Frame Distributor .. Patch Set 1: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/1453/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1853 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I27c1ff99ce797923dd709d181387560e4f9448a5 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/1079/ (8/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-no-installer-app/884/ (9/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 2: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/3283/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-sonar/4275/ (3/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-verify-storage/813/ (5/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-source-assemblies/469/ (1/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/hyracks-gerrit/180/ (7/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1854 to look at the new patch set (#2). Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. [ASTERIXDB-1869][MTD][TX] Control Lock size - user model changes: no - storage format changes: no - interface changes: no details: - Previously, each lock call to the metadata lock manager increment the lock counter and create a new Pairobject. After this change, the lock manager checks if the lock was obtained previously. Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 --- M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/DatasetLock.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/LockList.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/MetadataLock.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/MetadataLockManager.java 4 files changed, 137 insertions(+), 59 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/54/1854/2 -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudi Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/5754/ (6/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-cancellation-test/193/ (4/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-asterix-app/911/ (2/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [TEST] Test index re-creation
Jenkins has posted comments on this change. Change subject: [TEST] Test index re-creation .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-asterix-app/910/ (10/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1851 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I96eda91a26362ca5b8f2e84b7ddc1c8272b59364 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Dmitry Lychagin Gerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1443][FEED] Remove Frame Distributor
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1443][FEED] Remove Frame Distributor .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-asterix-app/909/ (10/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1853 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I27c1ff99ce797923dd709d181387560e4f9448a5 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1443][FEED] Remove Frame Distributor
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1443][FEED] Remove Frame Distributor .. Patch Set 1: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/3281/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1853 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I27c1ff99ce797923dd709d181387560e4f9448a5 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 1: Integration-Tests-1 Integration Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/3282/ : FAILURE -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app-sql-execution/202/ (10/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-no-installer-app/883/ (9/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/1078/ (8/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 1: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/3282/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-sonar/4274/ (3/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
abdullah alamoudi has uploaded a new change for review. https://asterix-gerrit.ics.uci.edu/1854 Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. [ASTERIXDB-1869][MTD][TX] Control Lock size - user model changes: no - storage format changes: no - interface changes: no details: - Previously, each lock call to the metadata lock manager increment the lock counter and create a new Pairobject. After this change, the lock manager checks if the lock was obtained previously. Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 --- M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/DatasetLock.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/LockList.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/MetadataLock.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/MetadataLockManager.java 4 files changed, 138 insertions(+), 58 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/54/1854/1 diff --git a/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/DatasetLock.java b/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/DatasetLock.java index ffcff78..bf19cf6 100644 --- a/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/DatasetLock.java +++ b/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/DatasetLock.java @@ -20,16 +20,19 @@ import java.util.concurrent.locks.ReentrantReadWriteLock; -import org.apache.asterix.metadata.lock.IMetadataLock.Mode; import org.apache.asterix.om.base.AMutableInt32; + +import com.google.common.base.Objects; public class DatasetLock implements IMetadataLock { -private ReentrantReadWriteLock dsLock; -private ReentrantReadWriteLock dsModifyLock; -private AMutableInt32 indexBuildCounter; +private final String key; +private final ReentrantReadWriteLock dsLock; +private final ReentrantReadWriteLock dsModifyLock; +private final AMutableInt32 indexBuildCounter; -public DatasetLock() { +public DatasetLock(String key) { +this.key = key; dsLock = new ReentrantReadWriteLock(true); dsModifyLock = new ReentrantReadWriteLock(true); indexBuildCounter = new AMutableInt32(0); @@ -154,4 +157,24 @@ break; } } + +public String getKey() { +return key; +} + +@Override +public int hashCode() { +return key.hashCode(); +} + +@Override +public boolean equals(Object o) { +if (!(o instanceof DatasetLock)) { +return false; +} +if (o == this) { +return true; +} +return Objects.equal(key, ((DatasetLock) o).key); +} } diff --git a/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/LockList.java b/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/LockList.java index bb708db..6317990 100644 --- a/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/LockList.java +++ b/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/LockList.java @@ -19,7 +19,9 @@ package org.apache.asterix.metadata.lock; import java.util.ArrayList; +import java.util.HashSet; import java.util.List; +import java.util.Set; import org.apache.asterix.common.exceptions.AsterixException; import org.apache.asterix.common.exceptions.ErrorCode; @@ -29,7 +31,8 @@ * The LockList is used for two phase locking. */ public class LockList { -private List > locks = new ArrayList<>(); +private final List > locks = new ArrayList<>(); +private final Set lockSet = new HashSet<>(); private boolean lockPhase = true; /** @@ -43,6 +46,9 @@ public void add(IMetadataLock.Mode mode, IMetadataLock lock) throws AsterixException { if (!lockPhase) { throw new AsterixException(ErrorCode.COMPILATION_TWO_PHASE_LOCKING_VIOLATION); +} +if (lockSet.contains(lock)) { +return; } lock.acquire(mode); locks.add(Pair.of(mode, lock)); @@ -58,6 +64,7 @@ pair.getRight().release(pair.getLeft()); } locks.clear(); +lockSet.clear(); lockPhase = false; } diff --git a/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/MetadataLock.java b/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/MetadataLock.java index c8fd64f..3786975 100644 --- a/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/MetadataLock.java +++ b/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/lock/MetadataLock.java @@
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-verify-storage/812/ (5/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/5753/ (1/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-cancellation-test/192/ (4/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-source-assemblies/468/ (7/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1869][MTD][TX] Control Lock size
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1869][MTD][TX] Control Lock size .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/hyracks-gerrit/179/ (6/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1854 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icc884949a824d64fcf27e26c350a2bc0fa496141 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1944][STO] Align LSM inverted index with other in...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1944][STO] Align LSM inverted index with other indexes .. Patch Set 1: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/3280/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1852 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0fb7b446edfb14de25ecaf99965ae0a7325101c9 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [TEST] Test index re-creation
Jenkins has posted comments on this change. Change subject: [TEST] Test index re-creation .. Patch Set 1: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/3279/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1851 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I96eda91a26362ca5b8f2e84b7ddc1c8272b59364 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Dmitry Lychagin Gerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats .. Patch Set 7: BAD-1 BAD Compatibility Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/1452/ : FAILURE -- To view, visit https://asterix-gerrit.ics.uci.edu/1748 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I46b48b52a1c9906510c5bdce778d1672845f75ca Gerrit-PatchSet: 7 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-Reviewer: Steven Jacobs Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: [TEST] Test index re-creation
Jenkins has posted comments on this change. Change subject: [TEST] Test index re-creation .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-asterix-app/907/ (10/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1851 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I96eda91a26362ca5b8f2e84b7ddc1c8272b59364 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Dmitry Lychagin Gerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1443][FEED] Remove Frame Distributor
Xikui Wang has posted comments on this change. Change subject: [ASTERIXDB-1443][FEED] Remove Frame Distributor .. Patch Set 1: Code-Review+2 -- To view, visit https://asterix-gerrit.ics.uci.edu/1853 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I27c1ff99ce797923dd709d181387560e4f9448a5 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats .. Patch Set 7: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/1452/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1748 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I46b48b52a1c9906510c5bdce778d1672845f75ca Gerrit-PatchSet: 7 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-Reviewer: Steven Jacobs Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
[jira] [Resolved] (ASTERIXDB-1953) Clean LSM File Managers
[ https://issues.apache.org/jira/browse/ASTERIXDB-1953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Alamoudi resolved ASTERIXDB-1953. -- Resolution: Fixed > Clean LSM File Managers > --- > > Key: ASTERIXDB-1953 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1953 > Project: Apache AsterixDB > Issue Type: Bug >Reporter: Abdullah Alamoudi >Assignee: Abdullah Alamoudi > > Currently, LSM File managers store all the paths as absolute path Strings. > This makes the code bug prone, and requires constructing multiple File > objects. and using the IO manager to resolve the io device. > More over, all the error messages in these classes are outdated and use the > old mechanism of creating error messages. > Instead of using absolute path strings, we should use FileReferences. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (ASTERIXDB-1830) Refactor CC Application Context
[ https://issues.apache.org/jira/browse/ASTERIXDB-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Alamoudi resolved ASTERIXDB-1830. -- Resolution: Fixed > Refactor CC Application Context > --- > > Key: ASTERIXDB-1830 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1830 > Project: Apache AsterixDB > Issue Type: Bug >Reporter: Abdullah Alamoudi >Assignee: Abdullah Alamoudi > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (ASTERIXDB-1827) Refactor Index dataflow helper
[ https://issues.apache.org/jira/browse/ASTERIXDB-1827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Alamoudi resolved ASTERIXDB-1827. -- Resolution: Fixed > Refactor Index dataflow helper > -- > > Key: ASTERIXDB-1827 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1827 > Project: Apache AsterixDB > Issue Type: Bug >Reporter: Abdullah Alamoudi >Assignee: Abdullah Alamoudi > > Currently, index dataflow helper creates and also open indexes. > This is risky especially that it creates an index if it is not found. > Refactor such that index dataflow helper only opens and close existing > indexes. Make a special class (IndexCreator ?) responsible for creating > indexes. > While at it, replace exceptions with error codes -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (ASTERIXDB-1441) License and NOTICE missing for Mockito and PowerMock
[ https://issues.apache.org/jira/browse/ASTERIXDB-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Alamoudi resolved ASTERIXDB-1441. -- Resolution: Fixed > License and NOTICE missing for Mockito and PowerMock > > > Key: ASTERIXDB-1441 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1441 > Project: Apache AsterixDB > Issue Type: Task >Reporter: Abdullah Alamoudi >Assignee: Abdullah Alamoudi >Priority: Blocker > Labels: soon > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (ASTERIXDB-915) Passing a wrong dataflow helper factory to secondary index drop operator
[ https://issues.apache.org/jira/browse/ASTERIXDB-915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Alamoudi resolved ASTERIXDB-915. - Resolution: Fixed > Passing a wrong dataflow helper factory to secondary index drop operator > > > Key: ASTERIXDB-915 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-915 > Project: Apache AsterixDB > Issue Type: Bug > Components: *DB - AsterixDB, STO - Storage >Reporter: asterixdb-importer >Assignee: Abdullah Alamoudi >Priority: Minor > Labels: soon > > Passing a wrong dataflow helper factory to secondary index drop operator -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (ASTERIXDB-811) when the DDL is going on, prevent other operations from seeing the pending ddl operation until the ddl is over.
[ https://issues.apache.org/jira/browse/ASTERIXDB-811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Alamoudi resolved ASTERIXDB-811. - Resolution: Won't Fix Not an issue since compiler checks the pending op flag before considering accepting a metadata entity > when the DDL is going on, prevent other operations from seeing the pending > ddl operation until the ddl is over. > --- > > Key: ASTERIXDB-811 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-811 > Project: Apache AsterixDB > Issue Type: Bug > Components: *DB - AsterixDB, MTD - Metadata, TX - Transactions >Reporter: Young-Seok Kim >Assignee: Abdullah Alamoudi > Labels: soon > > when the DDL is going on, prevent other operations from seeing the pending > ddl operation until the ddl is over. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (ASTERIXDB-1062) Reuse Hyracks infrastructure to manage Feeds events
[ https://issues.apache.org/jira/browse/ASTERIXDB-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Alamoudi resolved ASTERIXDB-1062. -- Resolution: Fixed > Reuse Hyracks infrastructure to manage Feeds events > --- > > Key: ASTERIXDB-1062 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1062 > Project: Apache AsterixDB > Issue Type: Improvement > Components: *DB - AsterixDB, CLUS - Cluster management, ING - > Ingestion >Reporter: asterixdb-importer >Assignee: Abdullah Alamoudi > > Feeds service disconnected during high CPU usage time -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (ASTERIXDB-1426) NPE on Drop Feed if Exists
[ https://issues.apache.org/jira/browse/ASTERIXDB-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Alamoudi resolved ASTERIXDB-1426. -- Resolution: Fixed > NPE on Drop Feed if Exists > -- > > Key: ASTERIXDB-1426 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1426 > Project: Apache AsterixDB > Issue Type: Bug > Components: ING - Ingestion >Reporter: Murtadha Hubail >Assignee: Abdullah Alamoudi > Labels: soon > > If a feed doesn't exist and a "drop feed if exists" is executed, a NPE > is thrown. > To reproduce the issue, run the following statements: > drop dataverse test if exists; > create dataverse test; > use dataverse test; > drop feed test_feed if exists; > Here is the stacktrace: > java.lang.NullPointerException > at > org.apache.asterix.app.external.FeedOperations.buildRemoveFeedStorageJob(FeedOperations.java:264) > at > org.apache.asterix.aql.translator.QueryTranslator.handleDropFeedStatement(QueryTranslator.java:2103) > at > org.apache.asterix.aql.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:358) > at > org.apache.asterix.aql.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:254) > at > org.apache.asterix.api.http.servlet.APIServlet.doPost(APIServlet.java:148) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) > at > org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:546) > at > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:483) > at > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:228) > at > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:956) > at > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:411) > at > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:188) > at > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:891) > at > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117) > at > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:114) > at org.eclipse.jetty.server.Server.handle(Server.java:353) > at > org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:598) > at > org.eclipse.jetty.server.HttpConnection$RequestHandler.content(HttpConnection.java:1076) > at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:805) > at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:218) > at > org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:427) > at > org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:510) > at > org.eclipse.jetty.io.nio.SelectChannelEndPoint.access$000(SelectChannelEndPoint.java:34) > at > org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:40) > at > org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:450) > at java.lang.Thread.run(Thread.java:745) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
Change in asterixdb[master]: [ASTERIXDB-1443][FEED] Remove Frame Distributor
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1443][FEED] Remove Frame Distributor .. Patch Set 1: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/3281/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1853 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I27c1ff99ce797923dd709d181387560e4f9448a5 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats .. Patch Set 7: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/3278/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1748 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I46b48b52a1c9906510c5bdce778d1672845f75ca Gerrit-PatchSet: 7 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-Reviewer: Steven Jacobs Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
[jira] [Assigned] (ASTERIXDB-1398) Feed policies don't work
[ https://issues.apache.org/jira/browse/ASTERIXDB-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Alamoudi reassigned ASTERIXDB-1398: Assignee: Xikui Wang (was: Abdullah Alamoudi) > Feed policies don't work > > > Key: ASTERIXDB-1398 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1398 > Project: Apache AsterixDB > Issue Type: Bug >Reporter: Abdullah Alamoudi >Assignee: Xikui Wang > > Feed policies are not obeyed by the running feed. We need to ensure that the > following basic feed policies work and have unit test cases for them: > 1. Spilling. > 2. Throttle. > 3. Discard. > Elastic policy will be disabled until needed by a user and At least once will > be redesigned. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
Change in asterixdb[master]: [ASTERIXDB-1443][FEED] Remove Frame Distributor
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1443][FEED] Remove Frame Distributor .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/1077/ (8/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1853 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I27c1ff99ce797923dd709d181387560e4f9448a5 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
[jira] [Resolved] (ASTERIXDB-1360) Bad error message when the localfs format field is invalid
[ https://issues.apache.org/jira/browse/ASTERIXDB-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Alamoudi resolved ASTERIXDB-1360. -- Resolution: Fixed > Bad error message when the localfs format field is invalid > -- > > Key: ASTERIXDB-1360 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1360 > Project: Apache AsterixDB > Issue Type: Bug >Reporter: Steven Jacobs >Assignee: Abdullah Alamoudi > > When doing a load from localfs, if the "format" value isn't valid, the error > message to the user will be that the localfs reader is unknown. This is > really confusing for the user. I'm attaching a sample query and stack trace > (note the "add" format ) > load dataset EmergencyReports using > localfs(("path"="asterix_nc1:///Users/stevenjacobs/Desktop/EmergencyDataset/EmergencyReports.adm"),("format"="add")); > d by: org.apache.asterix.common.exceptions.AsterixException: unknown record > reader factory: localfs > at > org.apache.asterix.external.provider.DatasourceFactoryProvider.getRecordReaderFactory(DatasourceFactoryProvider.java:146) > at > org.apache.asterix.external.provider.DatasourceFactoryProvider.getExternalDataSourceFactory(DatasourceFactoryProvider.java:48) > at > org.apache.asterix.external.adapter.factory.GenericAdapterFactory.configure(GenericAdapterFactory.java:122) > at > org.apache.asterix.external.provider.AdapterFactoryProvider.getAdapterFactory(AdapterFactoryProvider.java:46) > at > org.apache.asterix.metadata.declared.AqlMetadataProvider.getConfiguredAdapterFactory(AqlMetadataProvider.java:563) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
Change in asterixdb[master]: [ASTERIXDB-1443][FEED] Remove Frame Distributor
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1443][FEED] Remove Frame Distributor .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-no-installer-app/882/ (9/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1853 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I27c1ff99ce797923dd709d181387560e4f9448a5 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1443][FEED] Remove Frame Distributor
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1443][FEED] Remove Frame Distributor .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app-sql-execution/201/ (10/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1853 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I27c1ff99ce797923dd709d181387560e4f9448a5 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1443][FEED] Remove Frame Distributor
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1443][FEED] Remove Frame Distributor .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-cancellation-test/191/ (7/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1853 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I27c1ff99ce797923dd709d181387560e4f9448a5 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1443][FEED] Remove Frame Distributor
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1443][FEED] Remove Frame Distributor .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/hyracks-gerrit/178/ (5/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1853 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I27c1ff99ce797923dd709d181387560e4f9448a5 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1443][FEED] Remove Frame Distributor
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1443][FEED] Remove Frame Distributor .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-verify-storage/811/ (1/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1853 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I27c1ff99ce797923dd709d181387560e4f9448a5 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1443][FEED] Remove Frame Distributor
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1443][FEED] Remove Frame Distributor .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-asterix-app/906/ (2/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1853 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I27c1ff99ce797923dd709d181387560e4f9448a5 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1443][FEED] Remove Frame Distributor
abdullah alamoudi has uploaded a new change for review. https://asterix-gerrit.ics.uci.edu/1853 Change subject: [ASTERIXDB-1443][FEED] Remove Frame Distributor .. [ASTERIXDB-1443][FEED] Remove Frame Distributor - user model changes: no - storage format changes: no - interface changes: no details: - FrameDistributor and DistributeFeedFrameWriter are not used anymore. Change-Id: I27c1ff99ce797923dd709d181387560e4f9448a5 --- D asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/feed/dataflow/DistributeFeedFrameWriter.java D asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/feed/dataflow/FrameDistributor.java 2 files changed, 0 insertions(+), 302 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/53/1853/1 diff --git a/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/feed/dataflow/DistributeFeedFrameWriter.java b/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/feed/dataflow/DistributeFeedFrameWriter.java deleted file mode 100644 index ae2e0b9..000 --- a/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/feed/dataflow/DistributeFeedFrameWriter.java +++ /dev/null @@ -1,116 +0,0 @@ -/* - * Licensed to the Apache Software Foundation (ASF) under one - * or more contributor license agreements. See the NOTICE file - * distributed with this work for additional information - * regarding copyright ownership. The ASF licenses this file - * to you under the Apache License, Version 2.0 (the - * "License"); you may not use this file except in compliance - * with the License. You may obtain a copy of the License at - * - * http://www.apache.org/licenses/LICENSE-2.0 - * - * Unless required by applicable law or agreed to in writing, - * software distributed under the License is distributed on an - * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY - * KIND, either express or implied. See the License for the - * specific language governing permissions and limitations - * under the License. - */ -package org.apache.asterix.external.feed.dataflow; - -import java.io.IOException; -import java.nio.ByteBuffer; - -import org.apache.asterix.active.EntityId; -import org.apache.asterix.external.feed.management.FeedConnectionId; -import org.apache.asterix.external.util.FeedUtils.FeedRuntimeType; -import org.apache.hyracks.api.comm.IFrameWriter; -import org.apache.hyracks.api.exceptions.HyracksDataException; - -/** - * Provides mechanism for distributing the frames, as received from an operator to a - * set of registered readers. Each reader typically operates at a different pace. Readers - * are isolated from each other to ensure that a slow reader does not impact the progress of - * others. - **/ -public class DistributeFeedFrameWriter implements IFrameWriter { - -/** A unique identifier for the feed to which the incoming tuples belong. **/ -private final EntityId feedId; - -/** - * An instance of FrameDistributor that provides the mechanism for distributing a frame to multiple readers, each - * operating in isolation. - **/ -private final FrameDistributor frameDistributor; - -/** The original frame writer instantiated as part of job creation **/ -private final IFrameWriter writer; - -/** The feed operation whose output is being distributed by the DistributeFeedFrameWriter **/ -private final FeedRuntimeType feedRuntimeType; - -/** The value of the partition 'i' if this is the i'th instance of the associated operator **/ -private final int partition; - -public DistributeFeedFrameWriter(EntityId feedId, IFrameWriter writer, FeedRuntimeType feedRuntimeType, -int partition) throws IOException { -this.feedId = feedId; -this.frameDistributor = new FrameDistributor(); -this.feedRuntimeType = feedRuntimeType; -this.partition = partition; -this.writer = writer; -} - -/** - * @param fpa - *Feed policy accessor - * @param nextOnlyWriter - *the writer which will deliver the buffers - * @param connectionId - *(Dataverse - Dataset - Feed) - * @return A frame collector. - * @throws HyracksDataException - */ -public void subscribe(FeedFrameCollector collector) throws HyracksDataException { -frameDistributor.registerFrameCollector(collector); -} - -public void unsubscribeFeed(FeedConnectionId connectionId) throws HyracksDataException { -frameDistributor.deregisterFrameCollector(connectionId); -} - -@Override -public void close() throws HyracksDataException { -try { -frameDistributor.close(); -} finally { -writer.close(); -} -} - -@Override -public void fail() throws HyracksDataException { -
Change in asterixdb[master]: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats
Xikui Wang has posted comments on this change. Change subject: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats .. Patch Set 7: (1 comment) https://asterix-gerrit.ics.uci.edu/#/c/1748/7/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/feed/management/FeedEventsListener.java File asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/feed/management/FeedEventsListener.java: Line 168: } catch (TimeoutException e) { > CRITICAL SonarQube violation: Will set the response to "TIMEOUT" in next patch. -- To view, visit https://asterix-gerrit.ics.uci.edu/1748 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I46b48b52a1c9906510c5bdce778d1672845f75ca Gerrit-PatchSet: 7 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-Reviewer: Steven Jacobs Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: Yes
[jira] [Resolved] (ASTERIXDB-1443) No unit test cases for FrameDistributor
[ https://issues.apache.org/jira/browse/ASTERIXDB-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Alamoudi resolved ASTERIXDB-1443. -- Resolution: Won't Fix FrameDistributor is to be removed! > No unit test cases for FrameDistributor > --- > > Key: ASTERIXDB-1443 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1443 > Project: Apache AsterixDB > Issue Type: Bug >Reporter: Abdullah Alamoudi >Assignee: Abdullah Alamoudi > > A frame distributor is a special frame. it has a very specialized behavior > and it requires its own unit tests to ensure that it works as expected -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (ASTERIXDB-1397) New Feed user model not implemented
[ https://issues.apache.org/jira/browse/ASTERIXDB-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Alamoudi resolved ASTERIXDB-1397. -- Resolution: Fixed > New Feed user model not implemented > --- > > Key: ASTERIXDB-1397 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1397 > Project: Apache AsterixDB > Issue Type: Bug >Reporter: Abdullah Alamoudi >Assignee: Abdullah Alamoudi > > As per the new user model, secondary feeds should be removed and replaced > with allowing multiple connections to a single feed. > At the same time, functions must be moved to connections rather than with > Feed definition. > Following is a list of tasks that need to be completed in order to close this > item: > 1. Make connect/diconnect logical operations and start/stop control the flow > of data. > 2. Change the function association from "with-feed" to "with connection". > 3. Support a list of functions per connection. > 4. Enable multiple connections per feed. Connections can be modified only > when the feed is in the stopped state. > 5. Enable adding and removing connections while feed is in the running state. > None of this is supported at this time. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (ASTERIXDB-1385) Swallowed "java.net.SocketException: Socket closed" exception in feeds test using socket adapter
[ https://issues.apache.org/jira/browse/ASTERIXDB-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Alamoudi reassigned ASTERIXDB-1385: Assignee: Xikui Wang (was: Abdullah Alamoudi) > Swallowed "java.net.SocketException: Socket closed" exception in feeds test > using socket adapter > > > Key: ASTERIXDB-1385 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1385 > Project: Apache AsterixDB > Issue Type: Bug > Components: ING - Ingestion >Reporter: Ildar Absalyamov >Assignee: Xikui Wang >Priority: Minor > > When executing socket-based feed test (e.g. > runtiments/feeds/feed-push-socket) the following exception gets written into > the output. The exception is swallowed and does not seem to break anything, > but if that's completely normal situation should the stacktrace be even > logged? > {noformat} > java.net.SocketException: Socket closed > at java.net.SocketInputStream.socketRead0(Native Method) > at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) > at java.net.SocketInputStream.read(SocketInputStream.java:170) > at java.net.SocketInputStream.read(SocketInputStream.java:141) > at > org.apache.asterix.external.input.stream.SocketServerInputStream.read(SocketServerInputStream.java:73) > at > org.apache.asterix.external.input.stream.AsterixInputStreamReader.read(AsterixInputStreamReader.java:92) > at > org.apache.asterix.external.input.stream.AsterixInputStreamReader.read(AsterixInputStreamReader.java:65) > at > org.apache.asterix.external.input.record.reader.stream.SemiStructuredRecordReader.hasNext(SemiStructuredRecordReader.java:84) > at > org.apache.asterix.external.dataflow.FeedRecordDataFlowController.start(FeedRecordDataFlowController.java:62) > at > org.apache.asterix.external.dataset.adapter.FeedAdapter.start(FeedAdapter.java:36) > at > org.apache.asterix.external.feed.runtime.AdapterExecutor.run(AdapterExecutor.java:59) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (ASTERIXDB-951) sporadic test failure (feeds/issue_711_feeds)
[ https://issues.apache.org/jira/browse/ASTERIXDB-951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Alamoudi resolved ASTERIXDB-951. - Resolution: Fixed Haven't seen this happen for more than a year. Will re-open if it happens again! > sporadic test failure (feeds/issue_711_feeds) > - > > Key: ASTERIXDB-951 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-951 > Project: Apache AsterixDB > Issue Type: Bug > Components: *DB - AsterixDB, ING - Ingestion >Reporter: asterixdb-importer >Assignee: Abdullah Alamoudi > > sporadic test failure (feeds/issue_711_feeds) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (ASTERIXDB-1237) Refactor Feed Classes
[ https://issues.apache.org/jira/browse/ASTERIXDB-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Alamoudi resolved ASTERIXDB-1237. -- Resolution: Fixed > Refactor Feed Classes > - > > Key: ASTERIXDB-1237 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1237 > Project: Apache AsterixDB > Issue Type: Improvement >Reporter: Abdullah Alamoudi >Assignee: Abdullah Alamoudi > > Currently, Feed classes are scattered between different modules. We need to > move them to a central location for maintainability and readability. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
Change in asterixdb[master]: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats .. Patch Set 7: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-asterix-app/905/ (10/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1748 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I46b48b52a1c9906510c5bdce778d1672845f75ca Gerrit-PatchSet: 7 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-Reviewer: Steven Jacobs Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1944][STO] Align LSM inverted index with other in...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1944][STO] Align LSM inverted index with other indexes .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app-sql-execution/200/ (10/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1852 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0fb7b446edfb14de25ecaf99965ae0a7325101c9 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1944][STO] Align LSM inverted index with other in...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1944][STO] Align LSM inverted index with other indexes .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-no-installer-app/881/ (9/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1852 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0fb7b446edfb14de25ecaf99965ae0a7325101c9 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1944][STO] Align LSM inverted index with other in...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1944][STO] Align LSM inverted index with other indexes .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/1076/ (8/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1852 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0fb7b446edfb14de25ecaf99965ae0a7325101c9 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1944][STO] Align LSM inverted index with other in...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1944][STO] Align LSM inverted index with other indexes .. Patch Set 1: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/3280/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1852 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0fb7b446edfb14de25ecaf99965ae0a7325101c9 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1944][STO] Align LSM inverted index with other in...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1944][STO] Align LSM inverted index with other indexes .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-verify-storage/810/ (5/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1852 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0fb7b446edfb14de25ecaf99965ae0a7325101c9 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1944][STO] Align LSM inverted index with other in...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1944][STO] Align LSM inverted index with other indexes .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-asterix-app/904/ (4/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1852 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0fb7b446edfb14de25ecaf99965ae0a7325101c9 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1944][STO] Align LSM inverted index with other in...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1944][STO] Align LSM inverted index with other indexes .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/5751/ (7/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1852 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0fb7b446edfb14de25ecaf99965ae0a7325101c9 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1944][STO] Align LSM inverted index with other in...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1944][STO] Align LSM inverted index with other indexes .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-source-assemblies/466/ (3/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1852 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0fb7b446edfb14de25ecaf99965ae0a7325101c9 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1944][STO] Align LSM inverted index with other in...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1944][STO] Align LSM inverted index with other indexes .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/hyracks-gerrit/177/ (2/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1852 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0fb7b446edfb14de25ecaf99965ae0a7325101c9 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1944][STO] Align LSM inverted index with other in...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1944][STO] Align LSM inverted index with other indexes .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-cancellation-test/190/ (1/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1852 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0fb7b446edfb14de25ecaf99965ae0a7325101c9 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1944][STO] Align LSM inverted index with other in...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1944][STO] Align LSM inverted index with other indexes .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-sonar/4272/ (6/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1852 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0fb7b446edfb14de25ecaf99965ae0a7325101c9 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1944][STO] Align LSM inverted index with other in...
abdullah alamoudi has uploaded a new change for review. https://asterix-gerrit.ics.uci.edu/1852 Change subject: [ASTERIXDB-1944][STO] Align LSM inverted index with other indexes .. [ASTERIXDB-1944][STO] Align LSM inverted index with other indexes - user model changes: no - storage format changes: no - interface changes: yes IInvertedIndexComponent was introduced to separate LSM inverted index from its component and avoid multiple MethodNotSupported exceptions Change-Id: I0fb7b446edfb14de25ecaf99965ae0a7325101c9 --- M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/api/IInvertedIndex.java A hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/api/IInvertedIndexComponent.java M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/impls/LSMInvertedIndex.java M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/impls/LSMInvertedIndexDiskComponent.java M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/inmemory/InMemoryInvertedIndex.java M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/ondisk/OnDiskInvertedIndex.java M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/ondisk/OnDiskInvertedIndexFactory.java M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/ondisk/OnDiskInvertedIndexRangeSearchCursor.java M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/ondisk/PartitionedOnDiskInvertedIndexFactory.java M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/search/AbstractTOccurrenceSearcher.java M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/search/InvertedListCursorFactory.java M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/search/PartitionedTOccurrenceSearcher.java M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/search/TOccurrenceSearcher.java 13 files changed, 83 insertions(+), 60 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/52/1852/1 diff --git a/hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/api/IInvertedIndex.java b/hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/api/IInvertedIndex.java index eceb7b4..a693a99 100644 --- a/hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/api/IInvertedIndex.java +++ b/hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/api/IInvertedIndex.java @@ -21,16 +21,9 @@ import org.apache.hyracks.api.dataflow.value.IBinaryComparatorFactory; import org.apache.hyracks.api.dataflow.value.ITypeTraits; -import org.apache.hyracks.api.exceptions.HyracksDataException; -import org.apache.hyracks.dataflow.common.data.accessors.ITupleReference; -import org.apache.hyracks.storage.am.common.api.IIndexOperationContext; import org.apache.hyracks.storage.common.IIndex; public interface IInvertedIndex extends IIndex { -IInvertedListCursor createInvertedListCursor(); - -void openInvertedListCursor(IInvertedListCursor listCursor, ITupleReference searchKey, IIndexOperationContext ictx) -throws HyracksDataException; ITypeTraits[] getInvListTypeTraits(); @@ -39,13 +32,4 @@ ITypeTraits[] getTokenTypeTraits(); IBinaryComparatorFactory[] getTokenCmpFactories(); - -/** - * Purge the index files out of the buffer cache. - * Can only be called if the caller is absolutely sure the files don't contain dirty pages - * - * @throws HyracksDataException - * if the index is active - */ -void purge() throws HyracksDataException; } diff --git a/hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/api/IInvertedIndexComponent.java
Change in asterixdb[master]: [TEST] Test index re-creation
Xikui Wang has posted comments on this change. Change subject: [TEST] Test index re-creation .. Patch Set 1: Code-Review+2 -- To view, visit https://asterix-gerrit.ics.uci.edu/1851 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I96eda91a26362ca5b8f2e84b7ddc1c8272b59364 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Dmitry Lychagin Gerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: [TEST] Test index re-creation
Jenkins has posted comments on this change. Change subject: [TEST] Test index re-creation .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app-sql-execution/199/ (10/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1851 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I96eda91a26362ca5b8f2e84b7ddc1c8272b59364 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [TEST] Test index re-creation
Jenkins has posted comments on this change. Change subject: [TEST] Test index re-creation .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-no-installer-app/880/ (9/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1851 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I96eda91a26362ca5b8f2e84b7ddc1c8272b59364 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [TEST] Test index re-creation
Jenkins has posted comments on this change. Change subject: [TEST] Test index re-creation .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/1075/ (8/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1851 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I96eda91a26362ca5b8f2e84b7ddc1c8272b59364 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [TEST] Test index re-creation
Jenkins has posted comments on this change. Change subject: [TEST] Test index re-creation .. Patch Set 1: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/3279/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1851 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I96eda91a26362ca5b8f2e84b7ddc1c8272b59364 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [TEST] Test index re-creation
Jenkins has posted comments on this change. Change subject: [TEST] Test index re-creation .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-source-assemblies/465/ (4/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1851 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I96eda91a26362ca5b8f2e84b7ddc1c8272b59364 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [TEST] Test index re-creation
Jenkins has posted comments on this change. Change subject: [TEST] Test index re-creation .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-cancellation-test/189/ (6/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1851 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I96eda91a26362ca5b8f2e84b7ddc1c8272b59364 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [TEST] Test index re-creation
abdullah alamoudi has uploaded a new change for review. https://asterix-gerrit.ics.uci.edu/1851 Change subject: [TEST] Test index re-creation .. [TEST] Test index re-creation Change-Id: I96eda91a26362ca5b8f2e84b7ddc1c8272b59364 --- A asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/dml/recreate-index/recreate-index.1.ddl.sqlpp A asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/dml/recreate-index/recreate-index.2.update.sqlpp A asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/dml/recreate-index/recreate-index.3.ddl.sqlpp A asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/dml/recreate-index/recreate-index.4.update.sqlpp A asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/dml/recreate-index/recreate-index.5.query.sqlpp A asterixdb/asterix-app/src/test/resources/runtimets/results/dml/recreate-index/recreate-index.1.adm M asterixdb/asterix-app/src/test/resources/runtimets/testsuite_sqlpp.xml 7 files changed, 183 insertions(+), 0 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/51/1851/1 diff --git a/asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/dml/recreate-index/recreate-index.1.ddl.sqlpp b/asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/dml/recreate-index/recreate-index.1.ddl.sqlpp new file mode 100644 index 000..80ef192 --- /dev/null +++ b/asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/dml/recreate-index/recreate-index.1.ddl.sqlpp @@ -0,0 +1,46 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NOTICE file + * distributed with this work for additional information + * regarding copyright ownership. The ASF licenses this file + * to you under the Apache License, Version 2.0 (the + * "License"); you may not use this file except in compliance + * with the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, + * software distributed under the License is distributed on an + * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY + * KIND, either express or implied. See the License for the + * specific language governing permissions and limitations + * under the License. + */ +/* + * Test case Name : recreate-index + * Description : This test is intended to test creating and inserting into a dataset with an index + * then deleting the index, re-create the same index with the same name, and then insert + * additional data + * Expected Result : Success + * Date: June 23 2017 + */ + +drop dataverse test if exists; +create dataverse test; + +use test; + + +create type test.Emp as + closed { + id : bigint, + fname : string, + lname : string, + age : bigint, + dept : string +} + +create dataset test.employee(Emp) primary key id; + +create index idx_employee_first_name on test.employee (fname) type btree; + diff --git a/asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/dml/recreate-index/recreate-index.2.update.sqlpp b/asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/dml/recreate-index/recreate-index.2.update.sqlpp new file mode 100644 index 000..08a2f88 --- /dev/null +++ b/asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/dml/recreate-index/recreate-index.2.update.sqlpp @@ -0,0 +1,36 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NOTICE file + * distributed with this work for additional information + * regarding copyright ownership. The ASF licenses this file + * to you under the Apache License, Version 2.0 (the + * "License"); you may not use this file except in compliance + * with the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, + * software distributed under the License is distributed on an + * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY + * KIND, either express or implied. See the License for the + * specific language governing permissions and limitations + * under the License. + */ +/* + * Test case Name : recreate-index + * Description : This test is intended to test creating and inserting into a dataset with an index + * then deleting the index, re-create the same index with the same name, and then insert + * additional data + * Expected Result : Success + * Date: June 23 2017 + */ + +use test; + + +load dataset test.employee using localfs ((`path`=`asterix_nc1://data/names.adm`),(`format`=`delimited-text`),(`delimiter`=`|`)); + +insert into test.employee +select element {'id':(x.id +
Change in asterixdb[master]: [TEST] Test index re-creation
Jenkins has posted comments on this change. Change subject: [TEST] Test index re-creation .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-sonar/4271/ (7/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1851 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I96eda91a26362ca5b8f2e84b7ddc1c8272b59364 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [TEST] Test index re-creation
Jenkins has posted comments on this change. Change subject: [TEST] Test index re-creation .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-verify-storage/809/ (1/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1851 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I96eda91a26362ca5b8f2e84b7ddc1c8272b59364 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [TEST] Test index re-creation
Jenkins has posted comments on this change. Change subject: [TEST] Test index re-creation .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/hyracks-gerrit/176/ (3/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1851 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I96eda91a26362ca5b8f2e84b7ddc1c8272b59364 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [TEST] Test index re-creation
Jenkins has posted comments on this change. Change subject: [TEST] Test index re-creation .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-asterix-app/903/ (2/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1851 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I96eda91a26362ca5b8f2e84b7ddc1c8272b59364 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats .. Patch Set 7: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app-sql-execution/198/ (10/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1748 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I46b48b52a1c9906510c5bdce778d1672845f75ca Gerrit-PatchSet: 7 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-Reviewer: Steven Jacobs Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats .. Patch Set 7: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-no-installer-app/879/ (9/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1748 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I46b48b52a1c9906510c5bdce778d1672845f75ca Gerrit-PatchSet: 7 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-Reviewer: Steven Jacobs Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats .. Patch Set 7: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-asterix-app/902/ (7/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1748 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I46b48b52a1c9906510c5bdce778d1672845f75ca Gerrit-PatchSet: 7 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-Reviewer: Steven Jacobs Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats .. Patch Set 7: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/3278/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1748 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I46b48b52a1c9906510c5bdce778d1672845f75ca Gerrit-PatchSet: 7 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-Reviewer: Steven Jacobs Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-1950][ING][API] REST API for ActiveEntity stats .. Patch Set 7: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-sonar/4270/ (1/10) -- To view, visit https://asterix-gerrit.ics.uci.edu/1748 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I46b48b52a1c9906510c5bdce778d1672845f75ca Gerrit-PatchSet: 7 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-Reviewer: Steven Jacobs Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No