[
https://issues.apache.org/jira/browse/GEODE-5371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16537528#comment-16537528
]
Patrick Rhomberg edited comment on GEODE-5371 at 7/9/18 9:21 PM:
-----------------------------------------------------------------
Running over the weekend, the {{FlakyTest}} precheckin target was run 1513
times. The results as aggregated by the {{concourse-job-performance.py}}
script used by the metrics pipeline yields the following:
{noformat}
org.apache.geode.cache30.DistributedAckPersistentRegionCCEOffHeapDUnitTest.testConcurrentEventsOnEmptyRegion:
1 failures (99.93390614672836% success rate)
org.apache.geode.cache30.DistributedNoAckRegionCCEDUnitTest.testConcurrentEventsOnEmptyRegion:
1 failures (99.93390614672836% success rate)
org.apache.geode.cache30.DistributedNoAckRegionCCEOffHeapDUnitTest.testConcurrentEventsOnEmptyRegion:
1 failures (99.93390614672836% success rate)
org.apache.geode.distributed.SystemAdminDUnitTest.testPrintStacks: 1 failures
(99.93390614672836% success rate)
org.apache.geode.internal.cache.DeprecatedCacheServerLauncherIntegrationTest.testCreateBuckets:
1 failures (99.93390614672836% success rate)
org.apache.geode.internal.cache.PartitionedRegionSingleHopDUnitTest.testMetadataIsSameOnAllServersAndClients:
1 failures (99.93390614672836% success rate)
org.apache.geode.internal.cache.partitioned.PersistentPartitionedRegionDistributedTest.recoversFromCloseDuringRegionOperation:
15 failures (99.00859220092532% success rate)
org.apache.geode.internal.cache.partitioned.fixed.FixedPartitioningDUnitTest.testBug43283:
97 failures (93.58889623265037% success rate)
org.apache.geode.internal.cache.persistence.PersistentRecoveryOrderDUnitTest.testCrashDuringPreparePersistentId:
36 failures (97.62062128222075% success rate)
org.apache.geode.internal.cache.persistence.PersistentRecoveryOrderOldConfigDUnitTest.testCrashDuringPreparePersistentId:
30 failures (98.01718440185063% success rate)
org.apache.geode.internal.cache.wan.asyncqueue.AsyncEventQueueStatsDUnitTest.testAsyncStatsTwoListeners:
82 failures (94.58030403172505% success rate)
org.apache.geode.management.WANManagementDUnitTest.testReceiverMBean: 1
failures (99.93390614672836% success rate)
org.apache.geode.management.internal.cli.commands.DurableClientCommandsDUnitTest.testCloseDurableCQ:
2 failures (99.86781229345671% success rate)
org.apache.geode.management.internal.cli.commands.DurableClientCommandsDUnitTest.testCloseDurableClients:
1 failures (99.93390614672836% success rate)
org.apache.geode.management.internal.cli.commands.GemfireDataCommandsDUnitTest.testRebalanceCommandForSimulateWithNoMember:
1 failures (99.93390614672836% success rate)
org.apache.geode.management.internal.cli.commands.GemfireDataCommandsDUnitTest.testRebalanceCommandForTimeOutForRegion:
1 failures (99.93390614672836% success rate)
org.apache.geode.management.internal.cli.commands.GemfireDataCommandsDUnitTest.testRegionsViaMbeanAndFunctions:
3 failures (99.80171844018506% success rate)
org.apache.geode.management.internal.cli.commands.GemfireDataCommandsDUnitTest.testSimulateForEntireDS:
1 failures (99.93390614672836% success rate)
org.apache.geode.management.internal.cli.commands.GemfireDataCommandsDUnitTest.testSimulateForEntireDSWithTimeout:
1 failures (99.93390614672836% success rate)
org.apache.geode.management.internal.cli.commands.LauncherLifecycleCommandsDUnitTest.test014GemFireServerJvmProcessTerminatesOnOutOfMemoryError:
40 failures (97.35624586913417% success rate)
org.apache.geode.management.internal.cli.commands.LauncherLifecycleCommandsDUnitTest.testVersionTitleForStartServerAndLocator:
2 failures (99.86781229345671% success rate)
org.apache.geode.management.internal.cli.commands.RebalanceCommandOverHttpDistributedTest.testSimulateForEntireDSWithTimeout:
1 failures (99.93390614672836% success rate)
org.apache.geode.redis.HashesJUnitTest.testHIncrBy: 4 failures
(99.73562458691342% success rate)
org.apache.geode.security.ClientPostAuthorizationDUnitTest.testAllOpsNotifications:
6 failures (99.60343688037013% success rate)
{noformat}
was (Author: prhomberg):
Running over the weekend, the {{FlakyTest}} precheckin target was run 1513
times. The results as aggregated by the {{concourse-job-performance.py}}
script used by the metrics pipeline yields the following:
{noformat}
org.apache.geode.internal.cache.wan.asyncqueue.AsyncEventQueueStatsDUnitTest.testAsyncStatsTwoListeners:
82 failures (94.58030403172505% success rate)
org.apache.geode.internal.cache.partitioned.fixed.FixedPartitioningDUnitTest.testBug43283:
97 failures (93.58889623265037% success rate)
org.apache.geode.internal.cache.partitioned.PersistentPartitionedRegionDistributedTest.recoversFromCloseDuringRegionOperation:
15 failures (99.00859220092532% success rate)
org.apache.geode.internal.cache.persistence.PersistentRecoveryOrderDUnitTest.testCrashDuringPreparePersistentId:
36 failures (97.62062128222075% success rate)
org.apache.geode.security.ClientPostAuthorizationDUnitTest.testAllOpsNotifications:
6 failures (99.60343688037013% success rate)
org.apache.geode.management.internal.cli.commands.LauncherLifecycleCommandsDUnitTest.test014GemFireServerJvmProcessTerminatesOnOutOfMemoryError:
40 failures (97.35624586913417% success rate)
org.apache.geode.internal.cache.persistence.PersistentRecoveryOrderOldConfigDUnitTest.testCrashDuringPreparePersistentId:
30 failures (98.01718440185063% success rate)
org.apache.geode.management.internal.cli.commands.GemfireDataCommandsDUnitTest.testRegionsViaMbeanAndFunctions:
3 failures (99.80171844018506% success rate)
org.apache.geode.redis.HashesJUnitTest.testHIncrBy: 4 failures
(99.73562458691342% success rate)
org.apache.geode.management.internal.cli.commands.GemfireDataCommandsDUnitTest.testRebalanceCommandForSimulateWithNoMember:
1 failures (99.93390614672836% success rate)
org.apache.geode.management.internal.cli.commands.DurableClientCommandsDUnitTest.testCloseDurableCQ:
2 failures (99.86781229345671% success rate)
org.apache.geode.management.internal.cli.commands.LauncherLifecycleCommandsDUnitTest.testVersionTitleForStartServerAndLocator:
2 failures (99.86781229345671% success rate)
org.apache.geode.management.internal.cli.commands.DurableClientCommandsDUnitTest.testCloseDurableClients:
1 failures (99.93390614672836% success rate)
org.apache.geode.distributed.SystemAdminDUnitTest.testPrintStacks: 1 failures
(99.93390614672836% success rate)
org.apache.geode.management.internal.cli.commands.RebalanceCommandOverHttpDistributedTest.testSimulateForEntireDSWithTimeout:
1 failures (99.93390614672836% success rate)
org.apache.geode.cache30.DistributedNoAckRegionCCEDUnitTest.testConcurrentEventsOnEmptyRegion:
1 failures (99.93390614672836% success rate)
org.apache.geode.internal.cache.DeprecatedCacheServerLauncherIntegrationTest.testCreateBuckets:
1 failures (99.93390614672836% success rate)
org.apache.geode.internal.cache.PartitionedRegionSingleHopDUnitTest.testMetadataIsSameOnAllServersAndClients:
1 failures (99.93390614672836% success rate)
org.apache.geode.management.internal.cli.commands.GemfireDataCommandsDUnitTest.testSimulateForEntireDS:
1 failures (99.93390614672836% success rate)
org.apache.geode.cache30.DistributedNoAckRegionCCEOffHeapDUnitTest.testConcurrentEventsOnEmptyRegion:
1 failures (99.93390614672836% success rate)
org.apache.geode.management.WANManagementDUnitTest.testReceiverMBean: 1
failures (99.93390614672836% success rate)
org.apache.geode.management.internal.cli.commands.GemfireDataCommandsDUnitTest.testRebalanceCommandForTimeOutForRegion:
1 failures (99.93390614672836% success rate)
org.apache.geode.management.internal.cli.commands.GemfireDataCommandsDUnitTest.testSimulateForEntireDSWithTimeout:
1 failures (99.93390614672836% success rate)
org.apache.geode.cache30.DistributedAckPersistentRegionCCEOffHeapDUnitTest.testConcurrentEventsOnEmptyRegion:
1 failures (99.93390614672836% success rate)
{noformat}
> Ensure all tests marked as Flaky have not been resolved and still are
> accurately tagged
> ---------------------------------------------------------------------------------------
>
> Key: GEODE-5371
> URL: https://issues.apache.org/jira/browse/GEODE-5371
> Project: Geode
> Issue Type: Task
> Reporter: Alexander Murmann
> Assignee: Patrick Rhomberg
> Priority: Major
> Labels: swat
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
