[ https://issues.apache.org/jira/browse/CASSANDRA-14043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260036#comment-16260036 ]
Joseph Lynch commented on CASSANDRA-14043: ------------------------------------------ [~mkjellman] I'm trying to reproduce these failures/flakes so I can debug them, but these appear to pass locally for me against latest trunk running on Mac OSX (once I setup the 9 localhost aliases needed by Mac). Do these fail every time for you or is it more of a flakey experience? e.g. {noformat} ~/pg/cassandra-dtest-mirror(CASSANDRA-14043*) ยป nosetests --no-skip -x consistency_test.py ........... ---------------------------------------------------------------------- Ran 24 tests in 1388.105s OK {noformat} > Lots of failures in test_network_topology_strategy > -------------------------------------------------- > > Key: CASSANDRA-14043 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14043 > Project: Cassandra > Issue Type: Bug > Components: Testing > Reporter: Michael Kjellman > > There are lots of failures in test_network_topology_strategy... Creating one > JIRA to track them all... > test_network_topology_strategy - consistency_test.TestAvailability > [Errno 2] No such file or directory: > '/tmp/dtest-H1psQ0/test/node1/logs/system.log' > -------------------- >> begin captured logging << -------------------- > dtest: DEBUG: cluster ccm directory: /tmp/dtest-H1psQ0 > dtest: DEBUG: Done setting configuration options: > { 'initial_token': None, > 'num_tokens': '32', > 'phi_convict_threshold': 5, > 'range_request_timeout_in_ms': 10000, > 'read_request_timeout_in_ms': 10000, > 'request_timeout_in_ms': 10000, > 'truncate_request_timeout_in_ms': 10000, > 'write_request_timeout_in_ms': 10000} > --------------------- >> end captured logging << --------------------- > File "/usr/lib/python2.7/unittest/case.py", line 358, in run > self.tearDown() > File "/home/cassandra/cassandra-dtest/dtest.py", line 597, in tearDown > if not self.allow_log_errors and self.check_logs_for_errors(): > File "/home/cassandra/cassandra-dtest/dtest.py", line 614, in > check_logs_for_errors > ['\n'.join(msg) for msg in node.grep_log_for_errors()])) > File > "/home/cassandra/env/local/lib/python2.7/site-packages/ccmlib/node.py", line > 386, in grep_log_for_errors > return self.grep_log_for_errors_from(seek_start=getattr(self, > 'error_mark', 0)) > File > "/home/cassandra/env/local/lib/python2.7/site-packages/ccmlib/node.py", line > 389, in grep_log_for_errors_from > with open(os.path.join(self.get_path(), 'logs', filename)) as f: > "[Errno 2] No such file or directory: > '/tmp/dtest-H1psQ0/test/node1/logs/system.log'\n-------------------- >> begin > captured logging << --------------------\ndtest: DEBUG: cluster ccm > directory: /tmp/dtest-H1psQ0\ndtest: DEBUG: Done setting configuration > options:\n{ 'initial_token': None,\n 'num_tokens': '32',\n > 'phi_convict_threshold': 5,\n 'range_request_timeout_in_ms': 10000,\n > 'read_request_timeout_in_ms': 10000,\n 'request_timeout_in_ms': 10000,\n > 'truncate_request_timeout_in_ms': 10000,\n 'write_request_timeout_in_ms': > 10000}\n--------------------- >> end captured logging << > ---------------------" > test_network_topology_strategy_counters - consistency_test.TestAccuracy > Error starting node3. > -------------------- >> begin captured logging << -------------------- > dtest: DEBUG: cluster ccm directory: /tmp/dtest-3px8TH > dtest: DEBUG: Done setting configuration options: > { 'initial_token': None, > 'num_tokens': '32', > 'phi_convict_threshold': 5, > 'range_request_timeout_in_ms': 10000, > 'read_request_timeout_in_ms': 10000, > 'request_timeout_in_ms': 10000, > 'truncate_request_timeout_in_ms': 10000, > 'write_request_timeout_in_ms': 10000} > dtest: DEBUG: Testing multiple dcs, counters > --------------------- >> end captured logging << --------------------- > File "/usr/lib/python2.7/unittest/case.py", line 329, in run > testMethod() > File "/home/cassandra/cassandra-dtest/consistency_test.py", line 753, in > test_network_topology_strategy_counters > > self._run_test_function_in_parallel(TestAccuracy.Validation.validate_counters, > self.nodes, self.rf.values(), combinations), > File "/home/cassandra/cassandra-dtest/consistency_test.py", line 535, in > _run_test_function_in_parallel > self._start_cluster(save_sessions=True, > requires_local_reads=requires_local_reads) > File "/home/cassandra/cassandra-dtest/consistency_test.py", line 141, in > _start_cluster > cluster.start(wait_for_binary_proto=True, wait_other_notice=True) > File > "/home/cassandra/env/local/lib/python2.7/site-packages/ccmlib/cluster.py", > line 423, in start > raise NodeError("Error starting {0}.".format(node.name), p) > "Error starting node3.\n-------------------- >> begin captured logging << > --------------------\ndtest: DEBUG: cluster ccm directory: > /tmp/dtest-3px8TH\ndtest: DEBUG: Done setting configuration options:\n{ > 'initial_token': None,\n 'num_tokens': '32',\n 'phi_convict_threshold': > 5,\n 'range_request_timeout_in_ms': 10000,\n > 'read_request_timeout_in_ms': 10000,\n 'request_timeout_in_ms': 10000,\n > 'truncate_request_timeout_in_ms': 10000,\n 'write_request_timeout_in_ms': > 10000}\ndtest: DEBUG: Testing multiple dcs, counters\n--------------------- > >> end captured logging << ---------------------" > test_network_topology_strategy_each_quorum_counters - > consistency_test.TestAccuracy > Error starting node1. > -------------------- >> begin captured logging << -------------------- > dtest: DEBUG: cluster ccm directory: /tmp/dtest-EkrtYq > dtest: DEBUG: Done setting configuration options: > { 'initial_token': None, > 'num_tokens': '32', > 'phi_convict_threshold': 5, > 'range_request_timeout_in_ms': 10000, > 'read_request_timeout_in_ms': 10000, > 'request_timeout_in_ms': 10000, > 'truncate_request_timeout_in_ms': 10000, > 'write_request_timeout_in_ms': 10000} > dtest: DEBUG: Testing multiple dcs, counters, each quorum reads > --------------------- >> end captured logging << --------------------- > File "/usr/lib/python2.7/unittest/case.py", line 329, in run > testMethod() > File "/home/cassandra/cassandra-dtest/tools/decorators.py", line 48, in > wrapped > f(obj) > File "/home/cassandra/cassandra-dtest/consistency_test.py", line 772, in > test_network_topology_strategy_each_quorum_counters > > self._run_test_function_in_parallel(TestAccuracy.Validation.validate_counters, > self.nodes, self.rf.values(), combinations), > File "/home/cassandra/cassandra-dtest/consistency_test.py", line 535, in > _run_test_function_in_parallel > self._start_cluster(save_sessions=True, > requires_local_reads=requires_local_reads) > File "/home/cassandra/cassandra-dtest/consistency_test.py", line 141, in > _start_cluster > cluster.start(wait_for_binary_proto=True, wait_other_notice=True) > File > "/home/cassandra/env/local/lib/python2.7/site-packages/ccmlib/cluster.py", > line 423, in start > raise NodeError("Error starting {0}.".format(node.name), p) > "Error starting node1.\n-------------------- >> begin captured logging << > --------------------\ndtest: DEBUG: cluster ccm directory: > /tmp/dtest-EkrtYq\ndtest: DEBUG: Done setting configuration options:\n{ > 'initial_token': None,\n 'num_tokens': '32',\n 'phi_convict_threshold': > 5,\n 'range_request_timeout_in_ms': 10000,\n > 'read_request_timeout_in_ms': 10000,\n 'request_timeout_in_ms': 10000,\n > 'truncate_request_timeout_in_ms': 10000,\n 'write_request_timeout_in_ms': > 10000}\ndtest: DEBUG: Testing multiple dcs, counters, each quorum > reads\n--------------------- >> end captured logging << ---------------------" -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org