Change in asterixdb[master]: Add job cancellation support in Hyracks.
Jenkins has posted comments on this change. Change subject: Add job cancellation support in Hyracks. .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4483/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1537 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ic26330c19c8642dd3246739b5150c4aa667c359c Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Add job cancellation support in Hyracks.
Yingyi Bu has uploaded a new change for review. https://asterix-gerrit.ics.uci.edu/1537 Change subject: Add job cancellation support in Hyracks. .. Add job cancellation support in Hyracks. Change-Id: Ic26330c19c8642dd3246739b5150c4aa667c359c --- M hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/HyracksClientInterfaceFunctions.java M hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/HyracksClientInterfaceRemoteProxy.java M hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/HyracksConnection.java M hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/IHyracksClientConnection.java M hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/IHyracksClientInterface.java M hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/exceptions/ErrorCode.java M hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/exceptions/HyracksException.java M hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/rewriter/runtime/SuperActivityOperatorNodePushable.java M hyracks-fullstack/hyracks/hyracks-api/src/main/resources/errormsg/en.properties M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/ClientInterfaceIPCI.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/executor/JobExecutor.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/job/IJobManager.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/job/JobManager.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/scheduler/FIFOJobQueue.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/scheduler/IJobQueue.java A hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/util/MappedLinkedList.java A hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/util/MappedQueue.java A hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/work/CancelJobWork.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/test/java/org/apache/hyracks/control/cc/job/JobManagerTest.java M hyracks-fullstack/hyracks/hyracks-examples/hyracks-integration-tests/src/test/java/org/apache/hyracks/tests/integration/AbstractMultiNCIntegrationTest.java A hyracks-fullstack/hyracks/hyracks-examples/hyracks-integration-tests/src/test/java/org/apache/hyracks/tests/integration/CancelJobTest.java 21 files changed, 587 insertions(+), 45 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/37/1537/1 diff --git a/hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/HyracksClientInterfaceFunctions.java b/hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/HyracksClientInterfaceFunctions.java index aa292f6..aa9232e 100644 --- a/hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/HyracksClientInterfaceFunctions.java +++ b/hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/HyracksClientInterfaceFunctions.java @@ -38,6 +38,7 @@ START_JOB, DISTRIBUTE_JOB, DESTROY_JOB, +CANCEL_JOB, GET_DATASET_DIRECTORY_SERIVICE_INFO, GET_DATASET_RESULT_STATUS, GET_DATASET_RESULT_LOCATIONS, @@ -122,6 +123,25 @@ } } +public static class CancelJobFunction extends Function { +private static final long serialVersionUID = 1L; + +private final JobId jobId; + +public CancelJobFunction(JobId jobId) { +this.jobId = jobId; +} + +@Override +public FunctionId getFunctionId() { +return FunctionId.CANCEL_JOB; +} + +public JobId getJobId() { +return jobId; +} +} + public static class DestroyJobFunction extends Function { private static final long serialVersionUID = 1L; diff --git a/hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/HyracksClientInterfaceRemoteProxy.java b/hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/HyracksClientInterfaceRemoteProxy.java index 8e7affb..0142c7d 100644 --- a/hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/HyracksClientInterfaceRemoteProxy.java +++
Change in asterixdb[master]: ASTERIXDB-1806: let inject_failure not utilize an index
Taewoo Kim has posted comments on this change. Change subject: ASTERIXDB-1806: let inject_failure not utilize an index .. Patch Set 4: Added Steven since BAD test fails. -- To view, visit https://asterix-gerrit.ics.uci.edu/1536 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Steven Jacobs Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Configuration Revamp
Jenkins has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 34: BAD-1 BAD Compatibility Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/661/ : FAILURE -- To view, visit https://asterix-gerrit.ics.uci.edu/1487 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 Gerrit-PatchSet: 34 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Configuration Revamp
Jenkins has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 34: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2037/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1487 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 Gerrit-PatchSet: 34 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Configuration Revamp
Jenkins has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 34: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/661/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1487 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 Gerrit-PatchSet: 34 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1806: let inject_failure not utilize an index
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1806: let inject_failure not utilize an index .. Patch Set 4: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2036/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1536 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Configuration Revamp
Jenkins has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 34: WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN: * asterixdb * hyracks-fullstack PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES! -- To view, visit https://asterix-gerrit.ics.uci.edu/1487 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 Gerrit-PatchSet: 34 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Configuration Revamp
Jenkins has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 34: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4482/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1487 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 Gerrit-PatchSet: 34 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Configuration Revamp
Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1487 to look at the new patch set (#34). Change subject: Configuration Revamp .. Configuration Revamp - Ini section of node / cc details now returns ini param names instead of managix option names - Normalized command line -vs- ini file configuration parameter names - Eliminated unused parameters - Ini validation - Migrate *DB parameters out of [app] and into nc / cc sections as appropriate - Eliminate [app] section. Cluster-wide configuration lives in [common] - Sort properties alphabetically when returned by HTTP api Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 --- M asterixdb/asterix-app/pom.xml M asterixdb/asterix-app/scripts/asterix/startnc.sh M asterixdb/asterix-app/scripts/idefix/startnc1.sh M asterixdb/asterix-app/scripts/idefix/startnc2.sh M asterixdb/asterix-app/scripts/rainbow/startnc.sh M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/common/APIFramework.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/common/AsterixHyracksIntegrationUtil.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/ClusterApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/ClusterControllerDetailsApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/DiagnosticsApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/NodeControllerDetailsApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/VersionApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/servlet/ServletConstants.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/AutoFaultToleranceStrategy.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/CCApplicationEntryPoint.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/ClusterLifecycleListener.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/NCApplicationEntryPoint.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/util/FaultToleranceUtil.java M asterixdb/asterix-app/src/main/resources/asterix-build-configuration.xml M asterixdb/asterix-app/src/test/java/org/apache/asterix/api/http/servlet/VersionApiServletTest.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/app/bootstrap/TestNodeController.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/test/common/TestExecutor.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/test/common/TestHelper.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/test/logging/CheckpointingTest.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/test/runtime/ClusterStateDefaultParameterTest.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/test/sqlpp/OptimizerParserTest.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/test/sqlpp/ParserTestUtil.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/test/sqlpp/SmokeParserTest.java M asterixdb/asterix-app/src/test/resources/runtimets/api.xml A asterixdb/asterix-app/src/test/resources/runtimets/queries/api/APIQueries.xml D asterixdb/asterix-app/src/test/resources/runtimets/queries/api/replication/replication.1.get.http M asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_1/cluster_state_1.1.adm M asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_1_full/cluster_state_1_full.1.adm M asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_1_less/cluster_state_1_less.1.adm D asterixdb/asterix-app/src/test/resources/runtimets/results/api/replication/replication.1.adm M asterixdb/asterix-client-helper/pom.xml M asterixdb/asterix-common/pom.xml M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/cluster/IClusterStateManager.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AbstractProperties.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixProperties.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/BuildProperties.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/CompilerProperties.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/ExternalProperties.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/FeedProperties.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/IPropertiesProvider.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/MessagingProperties.java M
Change in asterixdb[master]: Configuration Revamp
Michael Blow has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 33: (7 comments) https://asterix-gerrit.ics.uci.edu/#/c/1487/33/asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_1/cluster_state_1.1.adm File asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_1/cluster_state_1.1.adm: PS33, Line 26: metadata > Do we have/need tests for the config APIs that contain the information that not yet, i would like to get validation from folks that the options are in the right sections (e.g. nc / cc / common) before adding new tests. https://asterix-gerrit.ics.uci.edu/#/c/1487/33/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/MessagingProperties.java File asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/MessagingProperties.java: PS33, Line 21: .*; > Expand * include. Done https://asterix-gerrit.ics.uci.edu/#/c/1487/33/asterixdb/asterix-events/src/main/resources/events/cc_start/cc_start.sh File asterixdb/asterix-events/src/main/resources/events/cc_start/cc_start.sh: PS33, Line 21: > WS Done https://asterix-gerrit.ics.uci.edu/#/c/1487/33/asterixdb/asterix-installer/src/test/java/org/apache/asterix/installer/test/AsterixInstallerIntegrationUtil.java File asterixdb/asterix-installer/src/test/java/org/apache/asterix/installer/test/AsterixInstallerIntegrationUtil.java: PS33, Line 129: sleep > Why do we need this now? Done https://asterix-gerrit.ics.uci.edu/#/c/1487/33/asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/utils/AppContextInfo.java File asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/utils/AppContextInfo.java: Line 79: private CCConfig ccConfig; > Good point. Done https://asterix-gerrit.ics.uci.edu/#/c/1487/33/hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/config/ConfigManager.java File hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/config/ConfigManager.java: PS33, Line 287: commandLineOptions > Even though this is really efficient wrt screen real estate , splitting it Done PS33, Line 390: recieve > s/recieve/receive/ Done -- To view, visit https://asterix-gerrit.ics.uci.edu/1487 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 Gerrit-PatchSet: 33 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-HasComments: Yes
Change in asterixdb[master]: Feed Exception Revise
Jenkins has posted comments on this change. Change subject: Feed Exception Revise .. Patch Set 3: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2035/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1534 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Iee65b2a5365067c9ba2aa1615ac23f0ace41b51e Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1806: let inject_failure not utilize an index
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1806: let inject_failure not utilize an index .. Patch Set 4: BAD-1 BAD Compatibility Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/660/ : FAILURE -- To view, visit https://asterix-gerrit.ics.uci.edu/1536 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1806: let inject_failure not utilize an index
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1806: let inject_failure not utilize an index .. Patch Set 4: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2036/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1536 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1806: let inject_failure not utilize an index
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1806: let inject_failure not utilize an index .. Patch Set 4: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/660/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1536 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1806: let inject_failure not utilize an index
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1806: let inject_failure not utilize an index .. Patch Set 4: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4481/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1536 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1806: let inject_failure not utilize an index
Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1536 to look at the new patch set (#4). Change subject: ASTERIXDB-1806: let inject_failure not utilize an index .. ASTERIXDB-1806: let inject_failure not utilize an index - Change the condition check logic of index transformation rule so that only arguments of AND function can be checked. - Let Index TransFormation Rule ignore Inject_failure() since the function can't utilize the index because of its arguments. Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b --- M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AbstractIntroduceAccessMethodRule.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/BTreeAccessMethod.java A asterixdb/asterix-app/src/test/resources/optimizerts/queries/query-ASTERIXDB-1806.sqlpp A asterixdb/asterix-app/src/test/resources/optimizerts/results/query-ASTERIXDB-1806.plan M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/exceptions/ErrorCode.java M asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties 6 files changed, 124 insertions(+), 14 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/36/1536/4 -- To view, visit https://asterix-gerrit.ics.uci.edu/1536 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Yingyi Bu
Change in asterixdb[master]: Configuration Revamp
Till Westmann has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 33: (7 comments) https://asterix-gerrit.ics.uci.edu/#/c/1487/33/asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_1/cluster_state_1.1.adm File asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_1/cluster_state_1.1.adm: PS33, Line 26: metadata Do we have/need tests for the config APIs that contain the information that is not reported here anymore? https://asterix-gerrit.ics.uci.edu/#/c/1487/33/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/MessagingProperties.java File asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/MessagingProperties.java: PS33, Line 21: .*; Expand * include. https://asterix-gerrit.ics.uci.edu/#/c/1487/33/asterixdb/asterix-events/src/main/resources/events/cc_start/cc_start.sh File asterixdb/asterix-events/src/main/resources/events/cc_start/cc_start.sh: PS33, Line 21: WS https://asterix-gerrit.ics.uci.edu/#/c/1487/33/asterixdb/asterix-installer/src/test/java/org/apache/asterix/installer/test/AsterixInstallerIntegrationUtil.java File asterixdb/asterix-installer/src/test/java/org/apache/asterix/installer/test/AsterixInstallerIntegrationUtil.java: PS33, Line 129: sleep Why do we need this now? https://asterix-gerrit.ics.uci.edu/#/c/1487/33/asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/utils/AppContextInfo.java File asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/utils/AppContextInfo.java: Line 79: private CCConfig ccConfig; > MAJOR SonarQube violation: Good point. https://asterix-gerrit.ics.uci.edu/#/c/1487/33/hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/config/ConfigManager.java File hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/config/ConfigManager.java: PS33, Line 287: commandLineOptions Even though this is really efficient wrt screen real estate , splitting it up might be a bit more readable :) PS33, Line 390: recieve s/recieve/receive/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1487 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 Gerrit-PatchSet: 33 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-HasComments: Yes
Change in asterixdb[master]: ASTERIXDB-1806: let inject_failure not utilize an index
Taewoo Kim has posted comments on this change. Change subject: ASTERIXDB-1806: let inject_failure not utilize an index .. Patch Set 1: (2 comments) https://asterix-gerrit.ics.uci.edu/#/c/1536/1/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/exceptions/ErrorCode.java File asterixdb/asterix-common/src/main/java/org/apache/asterix/common/exceptions/ErrorCode.java: PS1, Line 83: COMPILATION_NOT_SUPPORTED_FUNC_EXPRESSION > The name is confusing. The function is supported but not able to leverage Done https://asterix-gerrit.ics.uci.edu/#/c/1536/1/asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties File asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties: PS1, Line 67: > The message is confusing. The function is supported, but cannot take advant Done -- To view, visit https://asterix-gerrit.ics.uci.edu/1536 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: Yes
Change in asterixdb[master]: ASTERIXDB-1806: let inject_failure not utilize an index
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1806: let inject_failure not utilize an index .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4480/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1536 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1806: let inject_failure not utilize an index
Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1536 to look at the new patch set (#3). Change subject: ASTERIXDB-1806: let inject_failure not utilize an index .. ASTERIXDB-1806: let inject_failure not utilize an index - Change the condition check logic of index transformation rule so that only arguments of AND function can be checked. - Let Index TransFormation Rule ignore Inject_failure() since the function can't utilize the index because of its arguments. Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b --- M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AbstractIntroduceAccessMethodRule.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/BTreeAccessMethod.java A asterixdb/asterix-app/src/test/resources/optimizerts/queries/query-ASTERIXDB-1806.sqlpp A asterixdb/asterix-app/src/test/resources/optimizerts/results/query-ASTERIXDB-1806.plan M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/exceptions/ErrorCode.java M asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties 6 files changed, 123 insertions(+), 14 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/36/1536/3 -- To view, visit https://asterix-gerrit.ics.uci.edu/1536 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu
Change in asterixdb[master]: ASTERIXDB-1806: let inject_failure not utilize an index
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1806: let inject_failure not utilize an index .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4479/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1536 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1806: let inject_failure not utilize an index
Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1536 to look at the new patch set (#2). Change subject: ASTERIXDB-1806: let inject_failure not utilize an index .. ASTERIXDB-1806: let inject_failure not utilize an index - Change the condition check logic of index transformation rule so that only arguments of AND function can be checked. - Let Index TransFormation Rule ignore Inject_failure() since the function can't utilize the index because of its arguments. Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b --- M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AbstractIntroduceAccessMethodRule.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/BTreeAccessMethod.java A asterixdb/asterix-app/src/test/resources/optimizerts/queries/query-ASTERIXDB-1806.sqlpp A asterixdb/asterix-app/src/test/resources/optimizerts/results/query-ASTERIXDB-1806.plan M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/exceptions/ErrorCode.java M asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties 6 files changed, 123 insertions(+), 14 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/36/1536/2 -- To view, visit https://asterix-gerrit.ics.uci.edu/1536 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu
Change in asterixdb[master]: Fix for numeric overflow in integer constructors
Jenkins has posted comments on this change. Change subject: Fix for numeric overflow in integer constructors .. Patch Set 9: Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2034/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1509 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0cb3411bf9a808ee87f4938c60804a8d267c36d0 Gerrit-PatchSet: 9 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Ildar AbsalyamovGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Ildar Absalyamov Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Feed Exception Revise
Jenkins has posted comments on this change. Change subject: Feed Exception Revise .. Patch Set 3: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2035/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1534 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Iee65b2a5365067c9ba2aa1615ac23f0ace41b51e Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Feed Exception Revise
Jenkins has posted comments on this change. Change subject: Feed Exception Revise .. Patch Set 3: Integration-Tests-1 Integration Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2033/ : UNSTABLE -- To view, visit https://asterix-gerrit.ics.uci.edu/1534 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Iee65b2a5365067c9ba2aa1615ac23f0ace41b51e Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1806: let inject_failure not utilize an index
Yingyi Bu has posted comments on this change. Change subject: ASTERIXDB-1806: let inject_failure not utilize an index .. Patch Set 1: (2 comments) https://asterix-gerrit.ics.uci.edu/#/c/1536/1/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/exceptions/ErrorCode.java File asterixdb/asterix-common/src/main/java/org/apache/asterix/common/exceptions/ErrorCode.java: PS1, Line 83: COMPILATION_NOT_SUPPORTED_FUNC_EXPRESSION The name is confusing. The function is supported but not able to leverage index. https://asterix-gerrit.ics.uci.edu/#/c/1536/1/asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties File asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties: PS1, Line 67: The message is confusing. The function is supported, but cannot take advantage of indexes. -- To view, visit https://asterix-gerrit.ics.uci.edu/1536 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: Yes
Change in asterixdb[master]: ASTERIXDB-1806: let inject_failure not utilize an index
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1806: let inject_failure not utilize an index .. Patch Set 1: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2032/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1536 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Fix for numeric overflow in integer constructors
Jenkins has posted comments on this change. Change subject: Fix for numeric overflow in integer constructors .. Patch Set 9: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2034/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1509 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0cb3411bf9a808ee87f4938c60804a8d267c36d0 Gerrit-PatchSet: 9 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Ildar AbsalyamovGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Ildar Absalyamov Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Feed Adaptor and RecordReader Clean
Jenkins has posted comments on this change. Change subject: Feed Adaptor and RecordReader Clean .. Patch Set 3: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2031/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1535 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I699657ddd8408fd00bcbd7df57b6610ef3692a1a Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Fix for numeric overflow in integer constructors
Ildar Absalyamov has submitted this change and it was merged. Change subject: Fix for numeric overflow in integer constructors .. Fix for numeric overflow in integer constructors Change-Id: I0cb3411bf9a808ee87f4938c60804a8d267c36d0 Reviewed-on: https://asterix-gerrit.ics.uci.edu/1509 Sonar-Qube: JenkinsTested-by: Jenkins Reviewed-by: Ian Maxon --- A asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries/domain_boundaries.1.ddl.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries/domain_boundaries.2.ddl.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries/domain_boundaries.3.query.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries_error/domain_boundaries_error.1.ddl.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries_error/domain_boundaries_error.2.ddl.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries_error/domain_boundaries_error.3.ddl.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries_error/domain_boundaries_error.4.ddl.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries_error/domain_boundaries_error.5.ddl.aql A asterixdb/asterix-app/src/test/resources/runtimets/results/types/domain_boundaries/domain_boundaries.1.adm M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml M asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/evaluators/constructors/AInt16ConstructorDescriptor.java M asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/evaluators/constructors/AInt32ConstructorDescriptor.java M asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/evaluators/constructors/AInt64ConstructorDescriptor.java M asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/evaluators/constructors/AInt8ConstructorDescriptor.java 14 files changed, 376 insertions(+), 12 deletions(-) Approvals: Ian Maxon: Looks good to me, approved Jenkins: Verified; No violations found Objections: Jenkins: Violations found diff --git a/asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries/domain_boundaries.1.ddl.aql b/asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries/domain_boundaries.1.ddl.aql new file mode 100644 index 000..0885da1 --- /dev/null +++ b/asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries/domain_boundaries.1.ddl.aql @@ -0,0 +1,32 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NOTICE file + * distributed with this work for additional information + * regarding copyright ownership. The ASF licenses this file + * to you under the Apache License, Version 2.0 (the + * "License"); you may not use this file except in compliance + * with the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, + * software distributed under the License is distributed on an + * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY + * KIND, either express or implied. See the License for the + * specific language governing permissions and limitations + * under the License. + */ +drop dataverse test if exists; +create dataverse test; + +use dataverse test; + +create type Type as open { + id: int64, + int8: int8, + int16: int16, + int32: int32, + int64: int64 +} + +create dataset TestDS(Type) primary key id; diff --git a/asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries/domain_boundaries.2.ddl.aql b/asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries/domain_boundaries.2.ddl.aql new file mode 100644 index 000..551f658 --- /dev/null +++ b/asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries/domain_boundaries.2.ddl.aql @@ -0,0 +1,37 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NOTICE file + * distributed with this work for additional information + * regarding copyright ownership. The ASF licenses this file + * to you under the Apache License, Version 2.0 (the + * "License"); you may not use this file except in compliance + * with the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, + * software distributed under the License is distributed on an + * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY + * KIND, either express or
Change in asterixdb[master]: Fix for numeric overflow in integer constructors
Ian Maxon has posted comments on this change. Change subject: Fix for numeric overflow in integer constructors .. Patch Set 9: Code-Review+2 -- To view, visit https://asterix-gerrit.ics.uci.edu/1509 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0cb3411bf9a808ee87f4938c60804a8d267c36d0 Gerrit-PatchSet: 9 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Ildar AbsalyamovGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Ildar Absalyamov Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Exceptions Cleanup for Replication/FaultTolerance Strategies
Yingyi Bu has submitted this change and it was merged. Change subject: Exceptions Cleanup for Replication/FaultTolerance Strategies .. Exceptions Cleanup for Replication/FaultTolerance Strategies Change-Id: I8f28b8db42bf7c8537ff2da22cbd2a97e243f32f Reviewed-on: https://asterix-gerrit.ics.uci.edu/1529 Sonar-Qube: JenkinsTested-by: Jenkins Integration-Tests: Jenkins Reviewed-by: Yingyi Bu --- M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/RecoveryManager.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/task/MetadataBootstrapTask.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/AutoFaultToleranceStrategy.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/MetadataNodeFaultToleranceStrategy.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/NoFaultToleranceStrategy.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/NCApplicationEntryPoint.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/util/FaultToleranceUtil.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/test/common/TestExecutor.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/ClusterProperties.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/ReplicationProperties.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/exceptions/ErrorCode.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/replication/ChainedDeclusteringReplicationStrategy.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/replication/IReplicationStrategy.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/replication/MetadataOnlyReplicationStrategy.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/replication/ReplicationStrategyFactory.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/IRecoveryManager.java M asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties M asterixdb/asterix-installer/src/test/java/org/apache/asterix/installer/test/MetadataReplicationIT.java 19 files changed, 90 insertions(+), 44 deletions(-) Approvals: Yingyi Bu: Looks good to me, approved Jenkins: Verified; No violations found; Verified Objections: Jenkins: Violations found diff --git a/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java b/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java index b4b7a95..625f18f 100644 --- a/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java +++ b/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java @@ -191,7 +191,7 @@ IRecoveryManager recoveryMgr = txnSubsystem.getRecoveryManager(); SystemState systemState = recoveryMgr.getSystemState(); -if (initialRun || systemState == SystemState.NEW_UNIVERSE) { +if (initialRun || systemState == SystemState.PERMANENT_DATA_LOSS) { //delete any storage data before the resource factory is initialized localResourceRepository.deleteStorageData(true); } diff --git a/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/RecoveryManager.java b/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/RecoveryManager.java index 2efb139..4ee1122 100644 --- a/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/RecoveryManager.java +++ b/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/RecoveryManager.java @@ -121,10 +121,10 @@ Checkpoint checkpointObject = checkpointManager.getLatest(); if (checkpointObject == null) { //The checkpoint file doesn't exist => Failure happened during NC initialization. -//Retry to initialize the NC by setting the state to NEW_UNIVERSE -state = SystemState.NEW_UNIVERSE; +//Retry to initialize the NC by setting the state to PERMANENT_DATA_LOSS +state = SystemState.PERMANENT_DATA_LOSS; if (LOGGER.isLoggable(Level.INFO)) { -LOGGER.info("The checkpoint file doesn't exist: systemState = NEW_UNIVERSE"); +LOGGER.info("The checkpoint file doesn't exist: systemState = PERMANENT_DATA_LOSS"); } return state; } @@ -182,7 +182,9 @@ @Override public void startLocalRecovery(Set partitions) throws IOException, ACIDException { state = SystemState.RECOVERING; -LOGGER.log(Level.INFO, "starting recovery
Change in asterixdb[master]: Exceptions Cleanup for Replication/FaultTolerance Strategies
Yingyi Bu has posted comments on this change. Change subject: Exceptions Cleanup for Replication/FaultTolerance Strategies .. Patch Set 4: Code-Review+2 -- To view, visit https://asterix-gerrit.ics.uci.edu/1529 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8f28b8db42bf7c8537ff2da22cbd2a97e243f32f Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Jenkins Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Fix for numeric overflow in integer constructors
Jenkins has posted comments on this change. Change subject: Fix for numeric overflow in integer constructors .. Patch Set 9: BAD-1 BAD Compatibility Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/659/ : FAILURE -- To view, visit https://asterix-gerrit.ics.uci.edu/1509 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0cb3411bf9a808ee87f4938c60804a8d267c36d0 Gerrit-PatchSet: 9 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Ildar AbsalyamovGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Ildar Absalyamov Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Fix for numeric overflow in integer constructors
Jenkins has posted comments on this change. Change subject: Fix for numeric overflow in integer constructors .. Patch Set 9: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/659/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1509 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0cb3411bf9a808ee87f4938c60804a8d267c36d0 Gerrit-PatchSet: 9 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Ildar AbsalyamovGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Ildar Absalyamov Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Feed Exception Revise
Jenkins has posted comments on this change. Change subject: Feed Exception Revise .. Patch Set 3: BAD-1 BAD Compatibility Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/658/ : FAILURE -- To view, visit https://asterix-gerrit.ics.uci.edu/1534 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Iee65b2a5365067c9ba2aa1615ac23f0ace41b51e Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Feed Exception Revise
Jenkins has posted comments on this change. Change subject: Feed Exception Revise .. Patch Set 3: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/658/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1534 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Iee65b2a5365067c9ba2aa1615ac23f0ace41b51e Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1806: let inject_failure not utilize an index
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1806: let inject_failure not utilize an index .. Patch Set 1: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/657/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1536 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Fix for numeric overflow in integer constructors
Jenkins has posted comments on this change. Change subject: Fix for numeric overflow in integer constructors .. Patch Set 9: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4478/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1509 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0cb3411bf9a808ee87f4938c60804a8d267c36d0 Gerrit-PatchSet: 9 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Ildar AbsalyamovGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Ildar Absalyamov Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1806: let inject_failure not utilize an index
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1806: let inject_failure not utilize an index .. Patch Set 1: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2032/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1536 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Feed Exception Revise
Jenkins has posted comments on this change. Change subject: Feed Exception Revise .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4477/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1534 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Iee65b2a5365067c9ba2aa1615ac23f0ace41b51e Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Feed Adaptor and RecordReader Clean
Jenkins has posted comments on this change. Change subject: Feed Adaptor and RecordReader Clean .. Patch Set 3: BAD-1 BAD Compatibility Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/656/ : FAILURE -- To view, visit https://asterix-gerrit.ics.uci.edu/1535 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I699657ddd8408fd00bcbd7df57b6610ef3692a1a Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Feed Adaptor and RecordReader Clean
Jenkins has posted comments on this change. Change subject: Feed Adaptor and RecordReader Clean .. Patch Set 3: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/656/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1535 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I699657ddd8408fd00bcbd7df57b6610ef3692a1a Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Feed Adaptor and RecordReader Clean
Jenkins has posted comments on this change. Change subject: Feed Adaptor and RecordReader Clean .. Patch Set 3: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2031/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1535 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I699657ddd8408fd00bcbd7df57b6610ef3692a1a Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1806: let inject_failure not utilize an index
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1806: let inject_failure not utilize an index .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4476/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1536 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1806: let inject_failure not utilize an index
Taewoo Kim has uploaded a new change for review. https://asterix-gerrit.ics.uci.edu/1536 Change subject: ASTERIXDB-1806: let inject_failure not utilize an index .. ASTERIXDB-1806: let inject_failure not utilize an index - Let Index TransFormation Rule ignore Inject_failure() since the function can't utilize the index because of its arguments. Change-Id: I5ca2da1eb08fbb7c27205bdff9795c0aa816794b --- M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AbstractIntroduceAccessMethodRule.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/BTreeAccessMethod.java A asterixdb/asterix-app/src/test/resources/optimizerts/queries/query-ASTERIXDB-1806.sqlpp A asterixdb/asterix-app/src/test/resources/optimizerts/results/query-ASTERIXDB-1806.plan M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/exceptions/ErrorCode.java M asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties 6 files changed, 113 insertions(+), 6 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/36/1536/1 diff --git a/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AbstractIntroduceAccessMethodRule.java b/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AbstractIntroduceAccessMethodRule.java index ca042f1..e2595c8 100644 --- a/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AbstractIntroduceAccessMethodRule.java +++ b/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AbstractIntroduceAccessMethodRule.java @@ -84,6 +84,10 @@ BuiltinFunctions.NUMERIC_ADD, BuiltinFunctions.NUMERIC_SUBTRACT, BuiltinFunctions.NUMERIC_MULTIPLY, BuiltinFunctions.NUMERIC_DIVIDE, BuiltinFunctions.NUMERIC_MOD); +// Function Identifier sets that cannot utilize any index. +private final ImmutableSet funcIDSetThatCannotUtilizeIndex = +ImmutableSet.of(BuiltinFunctions.OR, BuiltinFunctions.INJECT_FAILURE); + public abstract MapgetAccessMethods(); protected static void registerAccessMethod(IAccessMethod accessMethod, @@ -386,9 +390,10 @@ IVariableTypeEnvironment typeEnvironment) throws AlgebricksException { AbstractFunctionCallExpression funcExpr = (AbstractFunctionCallExpression) cond; FunctionIdentifier funcIdent = funcExpr.getFunctionIdentifier(); + // Don't consider optimizing a disjunctive condition with an index (too -// complicated for now). -if (funcIdent == AlgebricksBuiltinFunctions.OR) { +// complicated for now). Also, if a function can't utilize index, then we don't need to check its arguments. +if (funcIDSetThatCannotUtilizeIndex.contains(funcIdent)) { return false; } boolean found = analyzeFunctionExpr(funcExpr, assignsAndUnnests, analyzedAMs, context, typeEnvironment); diff --git a/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/BTreeAccessMethod.java b/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/BTreeAccessMethod.java index 79ef433..e5050e2 100644 --- a/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/BTreeAccessMethod.java +++ b/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/BTreeAccessMethod.java @@ -31,6 +31,8 @@ import org.apache.asterix.common.annotations.SkipSecondaryIndexSearchExpressionAnnotation; import org.apache.asterix.common.config.DatasetConfig.DatasetType; import org.apache.asterix.common.config.DatasetConfig.IndexType; +import org.apache.asterix.common.exceptions.CompilationException; +import org.apache.asterix.common.exceptions.ErrorCode; import org.apache.asterix.lang.common.util.FunctionUtil; import org.apache.asterix.metadata.entities.Dataset; import org.apache.asterix.metadata.entities.Index; @@ -541,7 +543,11 @@ // If not, we create a new condition based on remaining ones. if (!primaryIndexPostProccessingIsNeeded) { List remainingFuncExprs = new ArrayList<>(); -getNewConditionExprs(conditionRef, replacedFuncExprs, remainingFuncExprs); +try { +getNewConditionExprs(conditionRef, replacedFuncExprs, remainingFuncExprs); +} catch (CompilationException e) { +return null; +} // Generate new condition. if (!remainingFuncExprs.isEmpty()) { ILogicalExpression pulledCond = createSelectCondition(remainingFuncExprs); @@ -630,7 +636,8 @@ } private void getNewConditionExprs(Mutable conditionRef, -Set replacedFuncExprs, List
Change in asterixdb[master]: Feed Adaptor and RecordReader Clean
Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1535 to look at the new patch set (#3). Change subject: Feed Adaptor and RecordReader Clean .. Feed Adaptor and RecordReader Clean 1. Cleaned DatasourceFactoryProvider with service interface 2. Cleaned StreamRecordReaderProvider with serivce interface 3. Combined LineRecordReader with QuotedLineRecordReader to fit the StreamRecordReader interface. 4. Delayed the Inputstream binding to the configuration phase. 5. Added one simple test case for StreamRecordReaderProvider. Change-Id: I699657ddd8408fd00bcbd7df57b6610ef3692a1a --- M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/exceptions/ErrorCode.java M asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties M asterixdb/asterix-external-data/pom.xml M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/api/IRecordReaderFactory.java M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/HDFSDataSourceFactory.java M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/rss/RSSRecordReaderFactory.java M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/stream/EmptyLineSeparatedRecordReader.java M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/stream/LineRecordReader.java D asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/stream/QuotedLineRecordReader.java M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/stream/SemiStructuredRecordReader.java M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/stream/StreamRecordReader.java M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/stream/StreamRecordReaderFactory.java M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/twitter/TwitterRecordReaderFactory.java M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/provider/DatasourceFactoryProvider.java M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/provider/StreamRecordReaderProvider.java A asterixdb/asterix-external-data/src/main/resources/META-INF/services/org.apache.asterix.external.api.IRecordReaderFactory A asterixdb/asterix-external-data/src/main/resources/META-INF/services/org.apache.asterix.external.input.record.reader.stream.StreamRecordReader M asterixdb/asterix-external-data/src/test/java/org/apache/asterix/external/classad/test/ClassAdToADMTest.java M asterixdb/asterix-external-data/src/test/java/org/apache/asterix/external/input/record/reader/RecordWithPKTestReaderFactory.java M asterixdb/asterix-external-data/src/test/java/org/apache/asterix/external/input/record/reader/kv/KVTestReaderFactory.java M asterixdb/asterix-external-data/src/test/java/org/apache/asterix/external/parser/test/ByteBufUTF8DecodeTest.java M asterixdb/asterix-external-data/src/test/java/org/apache/asterix/external/parser/test/RecordWithMetaTest.java A asterixdb/asterix-external-data/src/test/java/org/apache/asterix/external/parser/test/StreamRecordReaderProviderTest.java 23 files changed, 479 insertions(+), 250 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/35/1535/3 -- To view, visit https://asterix-gerrit.ics.uci.edu/1535 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I699657ddd8408fd00bcbd7df57b6610ef3692a1a Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins
Change in asterixdb[master]: Feed Adaptor and RecordReader Clean
Jenkins has posted comments on this change. Change subject: Feed Adaptor and RecordReader Clean .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4475/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1535 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I699657ddd8408fd00bcbd7df57b6610ef3692a1a Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Make Xmx small on 32bit JVM
Ian Maxon has submitted this change and it was merged. Change subject: Make Xmx small on 32bit JVM .. Make Xmx small on 32bit JVM There can be issues with the default memory parameter settings if run on a 32Bit JVM, as the maximum RAM can be large due to PAE or using 32bit JVM on a 64bit OS, therefore leading to an -Xmx setting that is too large to address. This makes the maximum 1GB by default on 32bit JVMs, as there is a related issue on Windows where 32 bit processes are limited to about 1.5G per process. Change-Id: I025174fc2ca53e8d15ed53fac31b43bea3ddf281 Reviewed-on: https://asterix-gerrit.ics.uci.edu/1521 Sonar-Qube: JenkinsTested-by: Jenkins Reviewed-by: Michael Blow Integration-Tests: Jenkins --- M hyracks-fullstack/hyracks/hyracks-control/hyracks-nc-service/src/main/java/org/apache/hyracks/control/nc/service/NCService.java 1 file changed, 14 insertions(+), 11 deletions(-) Approvals: Michael Blow: Looks good to me, approved Jenkins: Verified; No violations found; Verified Objections: Jenkins: Violations found diff --git a/hyracks-fullstack/hyracks/hyracks-control/hyracks-nc-service/src/main/java/org/apache/hyracks/control/nc/service/NCService.java b/hyracks-fullstack/hyracks/hyracks-control/hyracks-nc-service/src/main/java/org/apache/hyracks/control/nc/service/NCService.java index 5a03d3c..9b00cc2 100644 --- a/hyracks-fullstack/hyracks/hyracks-control/hyracks-nc-service/src/main/java/org/apache/hyracks/control/nc/service/NCService.java +++ b/hyracks-fullstack/hyracks/hyracks-control/hyracks-nc-service/src/main/java/org/apache/hyracks/control/nc/service/NCService.java @@ -111,7 +111,7 @@ return cList; } -private static void configEnvironment(Map env) { +private static void configEnvironment(Map env) { String jvmargs = IniUtils.getString(ini, nodeSection, "jvm.args", null); if (jvmargs != null) { LOGGER.info("Using JAVA_OPTS from conf file (jvm.args)"); @@ -122,7 +122,11 @@ } else { LOGGER.info("Using default JAVA_OPTS"); long ramSize = ((com.sun.management.OperatingSystemMXBean) osMXBean).getTotalPhysicalMemorySize(); -jvmargs = "-Xmx" + (int) Math.ceil(0.6 * ramSize / (1024 * 1024)) + "m"; +int proportionalRamSize = (int) Math.ceil(0.6 * ramSize / (1024 * 1024)); +//if under 32bit JVM, use less than 1GB heap by default. otherwise use proportional ramsize. +int heapSize = "32".equals(System.getProperty("sun.arch.data.model")) +? (proportionalRamSize <= 1024 ? proportionalRamSize : 1024) : proportionalRamSize; +jvmargs = "-Xmx" + heapSize + "m"; } } env.put("JAVA_OPTS", jvmargs); @@ -132,10 +136,11 @@ /** * Attempts to launch the "real" NCDriver, based on the configuration * information gathered so far. + * * @return true if the process was successfully launched and has now - * exited with a 0 (normal) exit code. false if some configuration error - * prevented the process from being launched or the process returned - * a non-0 (abnormal) exit code. + * exited with a 0 (normal) exit code. false if some configuration error + * prevented the process from being launched or the process returned + * a non-0 (abnormal) exit code. */ private static boolean launchNCProcess() { try { @@ -149,13 +154,11 @@ } // Logfile -if (! "-".equals(config.logdir)) { +if (!"-".equals(config.logdir)) { pb.redirectErrorStream(true); File log = new File(config.logdir); -if (! log.mkdirs()) { -if (! log.isDirectory()) { -throw new IOException(config.logdir + ": cannot create"); -} +if (!log.mkdirs() && !log.isDirectory()) { +throw new IOException(config.logdir + ": cannot create"); // If the directory IS there, all is well } File logfile = new File(config.logdir, "nc-" + ncId + ".log"); @@ -202,7 +205,7 @@ try { ObjectInputStream ois = new ObjectInputStream(is); String magic = ois.readUTF(); -if (! ServiceConstants.NC_SERVICE_MAGIC_COOKIE.equals(magic)) { +if (!ServiceConstants.NC_SERVICE_MAGIC_COOKIE.equals(magic)) { LOGGER.severe("Connection used incorrect magic cookie"); return false; } -- To view, visit https://asterix-gerrit.ics.uci.edu/1521 To unsubscribe, visit
Change in asterixdb[master]: Exceptions Cleanup for Replication/FaultTolerance Strategies
Jenkins has posted comments on this change. Change subject: Exceptions Cleanup for Replication/FaultTolerance Strategies .. Patch Set 4: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2030/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1529 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8f28b8db42bf7c8537ff2da22cbd2a97e243f32f Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Jenkins Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Make Xmx small on 32bit JVM
Jenkins has posted comments on this change. Change subject: Make Xmx small on 32bit JVM .. Patch Set 9: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2029/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1521 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I025174fc2ca53e8d15ed53fac31b43bea3ddf281 Gerrit-PatchSet: 9 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Ian MaxonGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Fix for numeric overflow in integer constructors
Jenkins has posted comments on this change. Change subject: Fix for numeric overflow in integer constructors .. Patch Set 8: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4474/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1509 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0cb3411bf9a808ee87f4938c60804a8d267c36d0 Gerrit-PatchSet: 8 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Ildar AbsalyamovGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Ildar Absalyamov Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Fix for numeric overflow in integer constructors
Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1509 to look at the new patch set (#8). Change subject: Fix for numeric overflow in integer constructors .. Fix for numeric overflow in integer constructors Change-Id: I0cb3411bf9a808ee87f4938c60804a8d267c36d0 --- A asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries/domain_boundaries.1.ddl.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries/domain_boundaries.2.ddl.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries/domain_boundaries.3.query.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries_error/domain_boundaries_error.1.ddl.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries_error/domain_boundaries_error.2.ddl.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries_error/domain_boundaries_error.3.ddl.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries_error/domain_boundaries_error.4.ddl.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/types/domain_boundaries_error/domain_boundaries_error.5.ddl.aql A asterixdb/asterix-app/src/test/resources/runtimets/results/types/domain_boundaries/domain_boundaries.1.adm M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml M asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/evaluators/constructors/AInt16ConstructorDescriptor.java M asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/evaluators/constructors/AInt32ConstructorDescriptor.java M asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/evaluators/constructors/AInt64ConstructorDescriptor.java M asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/evaluators/constructors/AInt8ConstructorDescriptor.java 14 files changed, 376 insertions(+), 12 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/09/1509/8 -- To view, visit https://asterix-gerrit.ics.uci.edu/1509 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I0cb3411bf9a808ee87f4938c60804a8d267c36d0 Gerrit-PatchSet: 8 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Ildar AbsalyamovGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Ildar Absalyamov Gerrit-Reviewer: Jenkins
Change in asterixdb[master]: Exceptions Cleanup for Replication/FaultTolerance Strategies
Jenkins has posted comments on this change. Change subject: Exceptions Cleanup for Replication/FaultTolerance Strategies .. Patch Set 4: BAD-1 BAD Compatibility Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/655/ : FAILURE -- To view, visit https://asterix-gerrit.ics.uci.edu/1529 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8f28b8db42bf7c8537ff2da22cbd2a97e243f32f Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Jenkins Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Exceptions Cleanup for Replication/FaultTolerance Strategies
Jenkins has posted comments on this change. Change subject: Exceptions Cleanup for Replication/FaultTolerance Strategies .. Patch Set 4: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/655/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1529 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8f28b8db42bf7c8537ff2da22cbd2a97e243f32f Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Jenkins Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Make Xmx small on 32bit JVM
Jenkins has posted comments on this change. Change subject: Make Xmx small on 32bit JVM .. Patch Set 9: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2029/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1521 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I025174fc2ca53e8d15ed53fac31b43bea3ddf281 Gerrit-PatchSet: 9 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Ian MaxonGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Exceptions Cleanup for Replication/FaultTolerance Strategies
Murtadha Hubail has posted comments on this change. Change subject: Exceptions Cleanup for Replication/FaultTolerance Strategies .. Patch Set 2: (4 comments) https://asterix-gerrit.ics.uci.edu/#/c/1529/2/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/IRecoveryManager.java File asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/IRecoveryManager.java: PS2, Line 38: checkpoint > I'm confused here. I replaced INTIAL_RUN by BOOTSTRAPPING and NEW_UNIVERSE by PERMANENT_DATA_LOSS. https://asterix-gerrit.ics.uci.edu/#/c/1529/3/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/IRecoveryManager.java File asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/IRecoveryManager.java: PS3, Line 38: NEW_UNIVERSE, // No > This sounds rather harsh compared to "NEW_UNIVERSE" - a good change :) It's good to see this dark side of you :) https://asterix-gerrit.ics.uci.edu/#/c/1529/2/asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties File asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties: PS2, Line 52: error > A more concrete error message? A user still cannot know the root cause via Done https://asterix-gerrit.ics.uci.edu/#/c/1529/3/asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties File asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties: PS3, Line 51: Initializatio > Having a new "section" here seems a little too tight - especially as there Done -- To view, visit https://asterix-gerrit.ics.uci.edu/1529 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8f28b8db42bf7c8537ff2da22cbd2a97e243f32f Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Jenkins Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: Yes
Change in asterixdb[master]: Exceptions Cleanup for Replication/FaultTolerance Strategies
Jenkins has posted comments on this change. Change subject: Exceptions Cleanup for Replication/FaultTolerance Strategies .. Patch Set 4: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4473/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1529 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8f28b8db42bf7c8537ff2da22cbd2a97e243f32f Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Exceptions Cleanup for Replication/FaultTolerance Strategies
Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1529 to look at the new patch set (#4). Change subject: Exceptions Cleanup for Replication/FaultTolerance Strategies .. Exceptions Cleanup for Replication/FaultTolerance Strategies Change-Id: I8f28b8db42bf7c8537ff2da22cbd2a97e243f32f --- M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/RecoveryManager.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/task/MetadataBootstrapTask.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/AutoFaultToleranceStrategy.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/MetadataNodeFaultToleranceStrategy.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/NoFaultToleranceStrategy.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/NCApplicationEntryPoint.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/util/FaultToleranceUtil.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/test/common/TestExecutor.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/ClusterProperties.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/ReplicationProperties.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/exceptions/ErrorCode.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/replication/ChainedDeclusteringReplicationStrategy.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/replication/IReplicationStrategy.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/replication/MetadataOnlyReplicationStrategy.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/replication/ReplicationStrategyFactory.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/IRecoveryManager.java M asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties M asterixdb/asterix-installer/src/test/java/org/apache/asterix/installer/test/MetadataReplicationIT.java 19 files changed, 90 insertions(+), 44 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/29/1529/4 -- To view, visit https://asterix-gerrit.ics.uci.edu/1529 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I8f28b8db42bf7c8537ff2da22cbd2a97e243f32f Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu