[jira] [Commented] (SOLR-10864) Add static (test only) boolean to PointField indicating 'precisionStep' should be ignored so we can simplify points randomization in our schemas
[ https://issues.apache.org/jira/browse/SOLR-10864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16070518#comment-16070518 ] ASF subversion and git services commented on SOLR-10864: Commit f3c851a015e5d8c775f0fb28ffbd8f5725f2f11b in lucene-solr's branch refs/heads/master from Chris Hostetter [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=f3c851a ] SOLR-10864: Fixup: Restore the DV vs trie vs points intent of TestRandomDVFaceting > Add static (test only) boolean to PointField indicating 'precisionStep' > should be ignored so we can simplify points randomization in our schemas > > > Key: SOLR-10864 > URL: https://issues.apache.org/jira/browse/SOLR-10864 > Project: Solr > Issue Type: Sub-task > Security Level: Public(Default Security Level. Issues are Public) >Reporter: Hoss Man >Assignee: Hoss Man > Fix For: master (7.0) > > Attachments: SOLR-10864.patch, SOLR-10864.patch, SOLR-10864.patch, > SOLR-10864.patch, SOLR-10864.patch, SOLR-10864.patch > > > (I'm spinning this idea out of parent jira SOLR-10807 so that it gets it's > own jira# w/ it's own summary for increased visibility/comments) > In the interest of making it easier & more straight forward to get good > randomized test coverage of Points fields, I'd like to add the following to > the {{PointField}} class... > {code} > /** > * > * The Test framework can set this global variable to instruct PointField > that > * (on init) it should be tollerant of the precisionStep > argument used by TrieFields. > * This allows for simple randomization of TrieFields and PointFields w/o > extensive duplication > * ofdeclarations. > * > * > * NOTE: When {@link TrieField} is removed, this boolean must also be > removed > * > * @lucene.internal > * @lucene.experimental > */ > public static boolean TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS = false; > /** > * NOTE: This method can be removed completely when > * {@link #TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS} is removed > */ > @Override > protected void init(IndexSchema schema, Map args) { >super.init(schema, args); >if (TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS) { > args.remove("precisionStep"); >} > } > {code} > Then in SolrTestCaseJ4, set > {{PointField.TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS}} on a class by class > basis when randomizing Trie/Points (and unset \@AfterClass). > (details to follow in comment) -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-10864) Add static (test only) boolean to PointField indicating 'precisionStep' should be ignored so we can simplify points randomization in our schemas
[ https://issues.apache.org/jira/browse/SOLR-10864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16069450#comment-16069450 ] Tomás Fernández Löbbe commented on SOLR-10864: -- bq. I'm not sure what you mean by "consistency with other schemas"... and there's nothing to stop people from adding new tests that use this schema as well I meant adding fields that are explicitly trie fields, something like "tint" or "int_t" and modify the test to use those instead of reverting what you did. bq. force non-points and non-dv via sys prop overrides +1 That makes sense and it's simpler than what I was proposing. > Add static (test only) boolean to PointField indicating 'precisionStep' > should be ignored so we can simplify points randomization in our schemas > > > Key: SOLR-10864 > URL: https://issues.apache.org/jira/browse/SOLR-10864 > Project: Solr > Issue Type: Sub-task > Security Level: Public(Default Security Level. Issues are Public) >Reporter: Hoss Man >Assignee: Hoss Man > Fix For: master (7.0) > > Attachments: SOLR-10864.patch, SOLR-10864.patch, SOLR-10864.patch, > SOLR-10864.patch, SOLR-10864.patch, SOLR-10864.patch > > > (I'm spinning this idea out of parent jira SOLR-10807 so that it gets it's > own jira# w/ it's own summary for increased visibility/comments) > In the interest of making it easier & more straight forward to get good > randomized test coverage of Points fields, I'd like to add the following to > the {{PointField}} class... > {code} > /** > * > * The Test framework can set this global variable to instruct PointField > that > * (on init) it should be tollerant of the precisionStep > argument used by TrieFields. > * This allows for simple randomization of TrieFields and PointFields w/o > extensive duplication > * ofdeclarations. > * > * > * NOTE: When {@link TrieField} is removed, this boolean must also be > removed > * > * @lucene.internal > * @lucene.experimental > */ > public static boolean TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS = false; > /** > * NOTE: This method can be removed completely when > * {@link #TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS} is removed > */ > @Override > protected void init(IndexSchema schema, Map args) { >super.init(schema, args); >if (TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS) { > args.remove("precisionStep"); >} > } > {code} > Then in SolrTestCaseJ4, set > {{PointField.TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS}} on a class by class > basis when randomizing Trie/Points (and unset \@AfterClass). > (details to follow in comment) -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-10864) Add static (test only) boolean to PointField indicating 'precisionStep' should be ignored so we can simplify points randomization in our schemas
[ https://issues.apache.org/jira/browse/SOLR-10864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16069442#comment-16069442 ] Hoss Man commented on SOLR-10864: - bq. ... I think these changes left TestRandomDVFaceting in a bad state. ... Hmm, ok -- yeah, i see what you mean. bq. For consistency with other schemas, maybe we want schema-docValuesFaceting.xml to have specific trie fields and use those in this test. I'm not sure what you mean by "consistency with other schemas", but in general my concern is that {{schema-docValuesFaceting.xml}} is already used by (one) other tests -- and there's nothing to stop people from adding new tests that use this schema as well -- so I think it would make more sense to change TestRandomDVFaceting.beforeTests to _force_ non-points and non-dv via sys prop overrides, so that it can do the comparisons as originally intended (and compare the trie to points you added in 57934ba4) make sense? > Add static (test only) boolean to PointField indicating 'precisionStep' > should be ignored so we can simplify points randomization in our schemas > > > Key: SOLR-10864 > URL: https://issues.apache.org/jira/browse/SOLR-10864 > Project: Solr > Issue Type: Sub-task > Security Level: Public(Default Security Level. Issues are Public) >Reporter: Hoss Man >Assignee: Hoss Man > Fix For: master (7.0) > > Attachments: SOLR-10864.patch, SOLR-10864.patch, SOLR-10864.patch, > SOLR-10864.patch, SOLR-10864.patch, SOLR-10864.patch > > > (I'm spinning this idea out of parent jira SOLR-10807 so that it gets it's > own jira# w/ it's own summary for increased visibility/comments) > In the interest of making it easier & more straight forward to get good > randomized test coverage of Points fields, I'd like to add the following to > the {{PointField}} class... > {code} > /** > * > * The Test framework can set this global variable to instruct PointField > that > * (on init) it should be tollerant of the precisionStep > argument used by TrieFields. > * This allows for simple randomization of TrieFields and PointFields w/o > extensive duplication > * ofdeclarations. > * > * > * NOTE: When {@link TrieField} is removed, this boolean must also be > removed > * > * @lucene.internal > * @lucene.experimental > */ > public static boolean TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS = false; > /** > * NOTE: This method can be removed completely when > * {@link #TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS} is removed > */ > @Override > protected void init(IndexSchema schema, Map args) { >super.init(schema, args); >if (TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS) { > args.remove("precisionStep"); >} > } > {code} > Then in SolrTestCaseJ4, set > {{PointField.TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS}} on a class by class > basis when randomizing Trie/Points (and unset \@AfterClass). > (details to follow in comment) -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-10864) Add static (test only) boolean to PointField indicating 'precisionStep' should be ignored so we can simplify points randomization in our schemas
[ https://issues.apache.org/jira/browse/SOLR-10864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16069403#comment-16069403 ] Tomás Fernández Löbbe commented on SOLR-10864: -- Sorry for the late response, I've been taking some time off. One minor comment, I think these changes left {{TestRandomDVFaceting}} in a bad state. It was originally intended to compare faceting between dv=true and dv=false. It would also compare with point fields most of the times (see https://github.com/apache/lucene-solr/blob/master/solr/core/src/test/org/apache/solr/TestRandomDVFaceting.java#L250-L258 ). After this change, half the time (when {{randomizeNumericTypesProperties}} decides to use PointFields) the test just compares dv=true three times. For consistency with other schemas, maybe we want {{schema-docValuesFaceting.xml}} to have specific trie fields and use those in this test. > Add static (test only) boolean to PointField indicating 'precisionStep' > should be ignored so we can simplify points randomization in our schemas > > > Key: SOLR-10864 > URL: https://issues.apache.org/jira/browse/SOLR-10864 > Project: Solr > Issue Type: Sub-task > Security Level: Public(Default Security Level. Issues are Public) >Reporter: Hoss Man >Assignee: Hoss Man > Fix For: master (7.0) > > Attachments: SOLR-10864.patch, SOLR-10864.patch, SOLR-10864.patch, > SOLR-10864.patch, SOLR-10864.patch, SOLR-10864.patch > > > (I'm spinning this idea out of parent jira SOLR-10807 so that it gets it's > own jira# w/ it's own summary for increased visibility/comments) > In the interest of making it easier & more straight forward to get good > randomized test coverage of Points fields, I'd like to add the following to > the {{PointField}} class... > {code} > /** > * > * The Test framework can set this global variable to instruct PointField > that > * (on init) it should be tollerant of the precisionStep > argument used by TrieFields. > * This allows for simple randomization of TrieFields and PointFields w/o > extensive duplication > * ofdeclarations. > * > * > * NOTE: When {@link TrieField} is removed, this boolean must also be > removed > * > * @lucene.internal > * @lucene.experimental > */ > public static boolean TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS = false; > /** > * NOTE: This method can be removed completely when > * {@link #TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS} is removed > */ > @Override > protected void init(IndexSchema schema, Map args) { >super.init(schema, args); >if (TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS) { > args.remove("precisionStep"); >} > } > {code} > Then in SolrTestCaseJ4, set > {{PointField.TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS}} on a class by class > basis when randomizing Trie/Points (and unset \@AfterClass). > (details to follow in comment) -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-10864) Add static (test only) boolean to PointField indicating 'precisionStep' should be ignored so we can simplify points randomization in our schemas
[ https://issues.apache.org/jira/browse/SOLR-10864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061238#comment-16061238 ] ASF subversion and git services commented on SOLR-10864: Commit c20d3aff9474be338ccf9fdb138f467435d06f09 in lucene-solr's branch refs/heads/master from Chris Hostetter [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=c20d3af ] SOLR-10177: replace adhoc points randomization with new standard introduced by SOLR-10864 > Add static (test only) boolean to PointField indicating 'precisionStep' > should be ignored so we can simplify points randomization in our schemas > > > Key: SOLR-10864 > URL: https://issues.apache.org/jira/browse/SOLR-10864 > Project: Solr > Issue Type: Sub-task > Security Level: Public(Default Security Level. Issues are Public) >Reporter: Hoss Man >Assignee: Hoss Man > Fix For: master (7.0) > > Attachments: SOLR-10864.patch, SOLR-10864.patch, SOLR-10864.patch, > SOLR-10864.patch, SOLR-10864.patch, SOLR-10864.patch > > > (I'm spinning this idea out of parent jira SOLR-10807 so that it gets it's > own jira# w/ it's own summary for increased visibility/comments) > In the interest of making it easier & more straight forward to get good > randomized test coverage of Points fields, I'd like to add the following to > the {{PointField}} class... > {code} > /** > * > * The Test framework can set this global variable to instruct PointField > that > * (on init) it should be tollerant of the precisionStep > argument used by TrieFields. > * This allows for simple randomization of TrieFields and PointFields w/o > extensive duplication > * ofdeclarations. > * > * > * NOTE: When {@link TrieField} is removed, this boolean must also be > removed > * > * @lucene.internal > * @lucene.experimental > */ > public static boolean TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS = false; > /** > * NOTE: This method can be removed completely when > * {@link #TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS} is removed > */ > @Override > protected void init(IndexSchema schema, Map args) { >super.init(schema, args); >if (TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS) { > args.remove("precisionStep"); >} > } > {code} > Then in SolrTestCaseJ4, set > {{PointField.TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS}} on a class by class > basis when randomizing Trie/Points (and unset \@AfterClass). > (details to follow in comment) -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-10864) Add static (test only) boolean to PointField indicating 'precisionStep' should be ignored so we can simplify points randomization in our schemas
[ https://issues.apache.org/jira/browse/SOLR-10864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16060048#comment-16060048 ] ASF subversion and git services commented on SOLR-10864: Commit ae01113472378093462e88b90e6e07a2cd863f8f in lucene-solr's branch refs/heads/master from Chris Hostetter [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=ae01113 ] remove SuppressPointFields from TestCloudPivotFacet now that SOLR-10864 is in place, there's no reason this test can't use points+docValues > Add static (test only) boolean to PointField indicating 'precisionStep' > should be ignored so we can simplify points randomization in our schemas > > > Key: SOLR-10864 > URL: https://issues.apache.org/jira/browse/SOLR-10864 > Project: Solr > Issue Type: Sub-task > Security Level: Public(Default Security Level. Issues are Public) >Reporter: Hoss Man >Assignee: Hoss Man > Fix For: master (7.0) > > Attachments: SOLR-10864.patch, SOLR-10864.patch, SOLR-10864.patch, > SOLR-10864.patch, SOLR-10864.patch, SOLR-10864.patch > > > (I'm spinning this idea out of parent jira SOLR-10807 so that it gets it's > own jira# w/ it's own summary for increased visibility/comments) > In the interest of making it easier & more straight forward to get good > randomized test coverage of Points fields, I'd like to add the following to > the {{PointField}} class... > {code} > /** > * > * The Test framework can set this global variable to instruct PointField > that > * (on init) it should be tollerant of the precisionStep > argument used by TrieFields. > * This allows for simple randomization of TrieFields and PointFields w/o > extensive duplication > * ofdeclarations. > * > * > * NOTE: When {@link TrieField} is removed, this boolean must also be > removed > * > * @lucene.internal > * @lucene.experimental > */ > public static boolean TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS = false; > /** > * NOTE: This method can be removed completely when > * {@link #TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS} is removed > */ > @Override > protected void init(IndexSchema schema, Map args) { >super.init(schema, args); >if (TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS) { > args.remove("precisionStep"); >} > } > {code} > Then in SolrTestCaseJ4, set > {{PointField.TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS}} on a class by class > basis when randomizing Trie/Points (and unset \@AfterClass). > (details to follow in comment) -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-10864) Add static (test only) boolean to PointField indicating 'precisionStep' should be ignored so we can simplify points randomization in our schemas
[ https://issues.apache.org/jira/browse/SOLR-10864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16059645#comment-16059645 ] ASF subversion and git services commented on SOLR-10864: Commit 38f29b2674c2465057d522e5862b8a32b1637a71 in lucene-solr's branch refs/heads/master from Chris Hostetter [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=38f29b2 ] SOLR-10864: Simplified how Trie vs Points based numerics are randomized by SolrTestCaseJ4 Adds a static option to PointsField to ignore 'precisionStep' attribute. This change also begins to attempt to randomize 'docValues' on numeric field types unless tests explicity enable/disable them > Add static (test only) boolean to PointField indicating 'precisionStep' > should be ignored so we can simplify points randomization in our schemas > > > Key: SOLR-10864 > URL: https://issues.apache.org/jira/browse/SOLR-10864 > Project: Solr > Issue Type: Sub-task > Security Level: Public(Default Security Level. Issues are Public) >Reporter: Hoss Man >Assignee: Hoss Man > Fix For: master (7.0) > > Attachments: SOLR-10864.patch, SOLR-10864.patch, SOLR-10864.patch, > SOLR-10864.patch, SOLR-10864.patch, SOLR-10864.patch > > > (I'm spinning this idea out of parent jira SOLR-10807 so that it gets it's > own jira# w/ it's own summary for increased visibility/comments) > In the interest of making it easier & more straight forward to get good > randomized test coverage of Points fields, I'd like to add the following to > the {{PointField}} class... > {code} > /** > * > * The Test framework can set this global variable to instruct PointField > that > * (on init) it should be tollerant of the precisionStep > argument used by TrieFields. > * This allows for simple randomization of TrieFields and PointFields w/o > extensive duplication > * ofdeclarations. > * > * > * NOTE: When {@link TrieField} is removed, this boolean must also be > removed > * > * @lucene.internal > * @lucene.experimental > */ > public static boolean TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS = false; > /** > * NOTE: This method can be removed completely when > * {@link #TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS} is removed > */ > @Override > protected void init(IndexSchema schema, Map args) { >super.init(schema, args); >if (TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS) { > args.remove("precisionStep"); >} > } > {code} > Then in SolrTestCaseJ4, set > {{PointField.TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS}} on a class by class > basis when randomizing Trie/Points (and unset \@AfterClass). > (details to follow in comment) -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-10864) Add static (test only) boolean to PointField indicating 'precisionStep' should be ignored so we can simplify points randomization in our schemas
[ https://issues.apache.org/jira/browse/SOLR-10864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16055918#comment-16055918 ] Steve Rowe commented on SOLR-10864: --- bq. ...but actually in hindsight, I think your idea is just plain objectively better, because it would keep the usage simpler... (almost) every numeric field type should have docValues="${solr.tests.numeric.dv}" Sound Good? +1 bq. one other question I had was about changing the semantics of the current solr.tests.preferPointFields users can set ... it can currently only be used to "prefer points" for tests that don't have @SuppressPointFields, but I think it would be better to change that to solr.tests.use.numeric.points any objections? +1 > Add static (test only) boolean to PointField indicating 'precisionStep' > should be ignored so we can simplify points randomization in our schemas > > > Key: SOLR-10864 > URL: https://issues.apache.org/jira/browse/SOLR-10864 > Project: Solr > Issue Type: Sub-task > Security Level: Public(Default Security Level. Issues are Public) >Reporter: Hoss Man >Assignee: Hoss Man > Fix For: master (7.0) > > Attachments: SOLR-10864.patch, SOLR-10864.patch > > > (I'm spinning this idea out of parent jira SOLR-10807 so that it gets it's > own jira# w/ it's own summary for increased visibility/comments) > In the interest of making it easier & more straight forward to get good > randomized test coverage of Points fields, I'd like to add the following to > the {{PointField}} class... > {code} > /** > * > * The Test framework can set this global variable to instruct PointField > that > * (on init) it should be tollerant of the precisionStep > argument used by TrieFields. > * This allows for simple randomization of TrieFields and PointFields w/o > extensive duplication > * ofdeclarations. > * > * > * NOTE: When {@link TrieField} is removed, this boolean must also be > removed > * > * @lucene.internal > * @lucene.experimental > */ > public static boolean TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS = false; > /** > * NOTE: This method can be removed completely when > * {@link #TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS} is removed > */ > @Override > protected void init(IndexSchema schema, Map args) { >super.init(schema, args); >if (TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS) { > args.remove("precisionStep"); >} > } > {code} > Then in SolrTestCaseJ4, set > {{PointField.TEST_HACK_IGNORE_USELESS_TRIEFIELD_ARGS}} on a class by class > basis when randomizing Trie/Points (and unset \@AfterClass). > (details to follow in comment) -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org