[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570539#comment-16570539 ] Mark Miller commented on SOLR-10032: I don’t own the code and had not had a chance to

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570398#comment-16570398 ] Shalin Shekhar Mangar commented on SOLR-10032: -- Hi [~markrmil...@gmail.com],

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16120074#comment-16120074 ] Mark Miller commented on SOLR-10032: Thanks! It actually ended up being a ton of work.

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16120050#comment-16120050 ] Erick Erickson commented on SOLR-10032: --- This is excellent, thanks for all your hard

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16119959#comment-16119959 ] Mark Miller commented on SOLR-10032: Those are special codes to order and identify tes

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16119899#comment-16119899 ] Cassandra Targett commented on SOLR-10032: -- [~markrmil...@gmail.com] - This is re

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16119585#comment-16119585 ] Mark Miller commented on SOLR-10032: Yeah, I'll move it to a public repo at some point

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16119489#comment-16119489 ] Anshum Gupta commented on SOLR-10032: - [~markrmil...@gmail.com] do you intend to open

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16119386#comment-16119386 ] Mark Miller commented on SOLR-10032: Okay, I'm pretty much ready here. I have a generi

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16070530#comment-16070530 ] Anshum Gupta commented on SOLR-10032: - This is looking really good! > Create report t

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16070484#comment-16070484 ] Erick Erickson commented on SOLR-10032: --- Sweet! > Create report to assess Solr test

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16070480#comment-16070480 ] Mark Miller commented on SOLR-10032: As part of fully automating everything, I've been

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16070191#comment-16070191 ] Mark Miller commented on SOLR-10032: I actually bailed on spending more time with repo

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930325#comment-15930325 ] Mark Miller commented on SOLR-10032: I'm a little behind on my latest run because I wa

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923605#comment-15923605 ] Mark Miller commented on SOLR-10032: I've recorded a talk on this topic that also demo

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15907112#comment-15907112 ] Ishan Chattopadhyaya commented on SOLR-10032: - bq. work on removing any tests

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15905210#comment-15905210 ] Shawn Heisey commented on SOLR-10032: - If graphs can be generated showing the time it

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15900701#comment-15900701 ] Mark Miller commented on SOLR-10032: I've got a few issue to look into, but when I'm d

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15874022#comment-15874022 ] Mark Miller commented on SOLR-10032: Here are some notes and color for the last test r

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872034#comment-15872034 ] Mark Miller commented on SOLR-10032: bq. Would it be convenient for you to publicly sh

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15870265#comment-15870265 ] Erick Erickson commented on SOLR-10032: --- Mark: First of all, really appreciate the

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861677#comment-15861677 ] Mark Miller commented on SOLR-10032: Back to my point that devs and Jenkins will play

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861628#comment-15861628 ] Mark Miller commented on SOLR-10032: It's what I mention above. Surviving 30 runs is a

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861609#comment-15861609 ] Tomás Fernández Löbbe commented on SOLR-10032: -- Interesting that PeerSyncRepl

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15860371#comment-15860371 ] Mark Miller commented on SOLR-10032: I suppose it depends on the cost of integrating a

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15860219#comment-15860219 ] Alexandre Rafalovitch commented on SOLR-10032: -- Just thinking out loud, I won

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15858902#comment-15858902 ] Mark Miller commented on SOLR-10032: I'd also been wondering why the test framework di

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15858889#comment-15858889 ] Mark Miller commented on SOLR-10032: For this next report I have switched to an 8 core

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15851916#comment-15851916 ] Mark Miller commented on SOLR-10032: bq. but you seemed to have had no problems with t

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15851836#comment-15851836 ] Mark Miller commented on SOLR-10032: In other words: I am looking for tests that fail

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15851620#comment-15851620 ] Mark Miller commented on SOLR-10032: This report is not made to reproduce all fails.

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15851389#comment-15851389 ] Ishan Chattopadhyaya commented on SOLR-10032: - The report looks great, and muc

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15848458#comment-15848458 ] Mark Miller commented on SOLR-10032: In some cases, because the machine I have been us

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15848398#comment-15848398 ] ASF subversion and git services commented on SOLR-10032: Commit 73

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15843701#comment-15843701 ] Mark Miller commented on SOLR-10032: This report covers 876 tests. If any tests share

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838489#comment-15838489 ] Mark Miller commented on SOLR-10032: I think there is likely too much of a test covera

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838475#comment-15838475 ] Ishan Chattopadhyaya commented on SOLR-10032: - I think a hammer approach (and

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838364#comment-15838364 ] Mark Miller commented on SOLR-10032: This will also help address getting our nightly r

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838177#comment-15838177 ] Yonik Seeley commented on SOLR-10032: - bq. We can also send an occasional email to the

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838163#comment-15838163 ] Mark Miller commented on SOLR-10032: bq. If there's stuff we can do to raise the visib

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838149#comment-15838149 ] Mark Miller commented on SOLR-10032: How the report is generated: I am running each o

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838140#comment-15838140 ] Mark Miller commented on SOLR-10032: bq. If there's stuff we can do to raise the visi

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838093#comment-15838093 ] David Smiley commented on SOLR-10032: - +1 I'm so glad you're looking into this Mark; t

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15837927#comment-15837927 ] Cassandra Targett commented on SOLR-10032: -- +1. Flakey test clean up is an arduou

[jira] [Commented] (SOLR-10032) Create report to assess Solr test quality at a commit point.

[ https://issues.apache.org/jira/browse/SOLR-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15837890#comment-15837890 ] Mark Miller commented on SOLR-10032: I'll create sub issues off this JIRA to address t