RE: [JENKINS-EA] Lucene-Solr-trunk-Linux (32bit/jdk1.9.0-ea-b78) - Build # 13972 - Failure!
Hi Rory, hi Balchandra,
the fix about https://bugs.openjdk.java.net/browse/JDK-8130845 is still
incomplete.
Our test framework found a date string which was created by Date#toString(),
which is not parseable, neither with ENGLISH, US or ROOT locale!
Here is test program:
=
import java.text.ParseException;
import java.text.SimpleDateFormat;
import java.util.Locale;
public final class Test {
private static void testParse(Locale locale) {
try {
new SimpleDateFormat(EEE MMM d hh:mm:ss z , locale).parse(Sat Jun
23 02:57:58 XJT 2012);
System.out.println(OK: + locale);
} catch (ParseException pe) {
pe.printStackTrace();
}
}
public static void main(String[] args) {
testParse(Locale.ENGLISH);
testParse(Locale.US);
testParse(Locale.ROOT);
}
}
=
Can you reopen https://bugs.openjdk.java.net/browse/JDK-8130845 and attach the
above program?
It passes with Java 8, but fails with Java 9.
The Date was created by Date#toString(). XJT is Xinjiang Time also known as
Asia/Kashgar, used in parts of China
(https://en.wikipedia.org/wiki/Asia/Kashgar). I would suggest to the developer
of the Locale updates, that there should be some test that asserts the round
trip between the above Date format and Date#toString() for all Timezones
available.
Uwe
-
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: u...@thetaphi.de
-Original Message-
From: Uwe Schindler [mailto:u...@thetaphi.de]
Sent: Sunday, August 23, 2015 8:27 PM
To: dev@lucene.apache.org
Cc: rory.odonn...@oracle.com; Balchandra Vaidya
Subject: RE: [JENKINS-EA] Lucene-Solr-trunk-Linux (32bit/jdk1.9.0-ea-b78) -
Build # 13972 - Failure!
I am digging, seems to be SOLR-7770 related. The problem with the new
Locale Data in the JDK9 is that not all possible Timezone Short identifiers
are
available... I will try this date and send it back to Rory for addition to
https://bugs.openjdk.java.net/browse/JDK-8130845
Uwe
-
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: u...@thetaphi.de
From: Policeman Jenkins Server [mailto:jenk...@thetaphi.de]
Sent: Sunday, August 23, 2015 7:55 PM
To: dev@lucene.apache.org
Subject: [JENKINS-EA] Lucene-Solr-trunk-Linux (32bit/jdk1.9.0-ea-b78)
- Build # 13972 - Failure!
Importance: Low
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13972/
Java: 32bit/jdk1.9.0-ea-b78 -client -XX:+UseConcMarkSweepGC
4 tests failed.
FAILED:
org.apache.solr.handler.extraction.ExtractingRequestHandlerTest.testPa
ssw
ordProtected
Error Message:
Invalid Date String:'Sat Jun 23 02:57:58 XJT 2012'
Stack Trace:
org.apache.solr.common.SolrException: Invalid Date String:'Sat Jun 23
02:57:58 XJT 2012'
at
__randomizedtesting.SeedInfo.seed([ABCF3FCC3426170F:AD6ABB37CA1F47
D5]:0)
at
org.apache.solr.util.DateFormatUtil.parseMath(DateFormatUtil.java:89)
at org.apache.solr.schema.TrieField.createField(TrieField.java:695)
at org.apache.solr.schema.TrieField.createFields(TrieField.java:732)
at
org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:4
8
)
at
org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.jav
a:123)
at
org.apache.solr.update.AddUpdateCommand.getLuceneDocument(AddUpd
ateCommand.java:84)
at
org.apache.solr.update.DirectUpdateHandler2.doNormalUpdate(DirectUpda
teHandler2.java:268)
at
org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandle
r2.java:202)
at
org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler
2.java:164)
at
org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUp
dateProcessorFactory.java:69)
at
org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(Up
dateRequestProcessor.java:51)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd
(
DistributedUpdateProcessor.java:980)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd
(
DistributedUpdateProcessor.java:705)
at
org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpd
ateProcessorFactory.java:104)
at
org.apache.solr.handler.extraction.ExtractingDocumentLoader.doAdd(Extr
ac
tingDocumentLoader.java:122)
at
org.apache.solr.handler.extraction.ExtractingDocumentLoader.addDoc(Ext
ra
ctingDocumentLoader.java:127)
at
org.apache.solr.handler.extraction.ExtractingDocumentLoader.load(Extra
ctin
gDocumentLoader.java:230)
at
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(Co
ntentStreamHandlerBase.java:74)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandl
erBase.java:151
RE: [JENKINS-EA] Lucene-Solr-trunk-Linux (32bit/jdk1.9.0-ea-b78) - Build # 13972 - Failure!
I am digging, seems to be SOLR-7770 related. The problem with the new Locale Data in the JDK9 is that not all possible Timezone Short identifiers are available... I will try this date and send it back to Rory for addition to https://bugs.openjdk.java.net/browse/JDK-8130845 Uwe - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de From: Policeman Jenkins Server [mailto:jenk...@thetaphi.de] Sent: Sunday, August 23, 2015 7:55 PM To: dev@lucene.apache.org Subject: [JENKINS-EA] Lucene-Solr-trunk-Linux (32bit/jdk1.9.0-ea-b78) - Build # 13972 - Failure! Importance: Low Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13972/ Java: 32bit/jdk1.9.0-ea-b78 -client -XX:+UseConcMarkSweepGC 4 tests failed. FAILED: org.apache.solr.handler.extraction.ExtractingRequestHandlerTest.testPassw ordProtected Error Message: Invalid Date String:'Sat Jun 23 02:57:58 XJT 2012' Stack Trace: org.apache.solr.common.SolrException: Invalid Date String:'Sat Jun 23 02:57:58 XJT 2012' at __randomizedtesting.SeedInfo.seed([ABCF3FCC3426170F:AD6ABB37CA1F47 D5]:0) at org.apache.solr.util.DateFormatUtil.parseMath(DateFormatUtil.java:89) at org.apache.solr.schema.TrieField.createField(TrieField.java:695) at org.apache.solr.schema.TrieField.createFields(TrieField.java:732) at org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:48 ) at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.jav a:123) at org.apache.solr.update.AddUpdateCommand.getLuceneDocument(AddUpd ateCommand.java:84) at org.apache.solr.update.DirectUpdateHandler2.doNormalUpdate(DirectUpda teHandler2.java:268) at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandle r2.java:202) at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler 2.java:164) at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUp dateProcessorFactory.java:69) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(Up dateRequestProcessor.java:51) at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd( DistributedUpdateProcessor.java:980) at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd( DistributedUpdateProcessor.java:705) at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpd ateProcessorFactory.java:104) at org.apache.solr.handler.extraction.ExtractingDocumentLoader.doAdd(Extrac tingDocumentLoader.java:122) at org.apache.solr.handler.extraction.ExtractingDocumentLoader.addDoc(Extra ctingDocumentLoader.java:127) at org.apache.solr.handler.extraction.ExtractingDocumentLoader.load(Extractin gDocumentLoader.java:230) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(Co ntentStreamHandlerBase.java:74) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandl erBase.java:151) at org.apache.solr.core.SolrCore.execute(SolrCore.java:2079) at org.apache.solr.util.TestHarness.queryAndResponse(TestHarness.java:339) at org.apache.solr.handler.extraction.ExtractingRequestHandlerTest.loadLocalF romHandler(ExtractingRequestHandlerTest.java:737) at org.apache.solr.handler.extraction.ExtractingRequestHandlerTest.loadLocal( ExtractingRequestHandlerTest.java:744) at org.apache.solr.handler.extraction.ExtractingRequestHandlerTest.testPassw ordProtected(ExtractingRequestHandlerTest.java:662) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j ava:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:504) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize dRunner.java:1627) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando mizedRunner.java:836) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando mizedRunner.java:872) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando mizedRunner.java:886) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1. evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule SetupTeardownChained.java:50) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA fterRule.java:46) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh readAndTestName.java:49) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule IgnoreAfterMaxFailures.java:65) at
Re: [JENKINS-EA] Lucene-Solr-trunk-Linux (32bit/jdk1.9.0-ea-b78) - Build # 13972 - Failure!
This doesn’t reproduce for me on Java8 on Linux or OS X. Uwe, do you know if there is a known Java9 issue here? Steve On Aug 23, 2015, at 1:55 PM, Policeman Jenkins Server jenk...@thetaphi.de wrote: Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13972/ Java: 32bit/jdk1.9.0-ea-b78 -client -XX:+UseConcMarkSweepGC 4 tests failed. FAILED: org.apache.solr.handler.extraction.ExtractingRequestHandlerTest.testPasswordProtected Error Message: Invalid Date String:'Sat Jun 23 02:57:58 XJT 2012' Stack Trace: org.apache.solr.common.SolrException: Invalid Date String:'Sat Jun 23 02:57:58 XJT 2012' at __randomizedtesting.SeedInfo.seed([ABCF3FCC3426170F:AD6ABB37CA1F47D5]:0) at org.apache.solr.util.DateFormatUtil.parseMath(DateFormatUtil.java:89) at org.apache.solr.schema.TrieField.createField(TrieField.java:695) at org.apache.solr.schema.TrieField.createFields(TrieField.java:732) at org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:48) at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:123) at org.apache.solr.update.AddUpdateCommand.getLuceneDocument(AddUpdateCommand.java:84) at org.apache.solr.update.DirectUpdateHandler2.doNormalUpdate(DirectUpdateHandler2.java:268) at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:202) at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:164) at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:980) at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:705) at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104) at org.apache.solr.handler.extraction.ExtractingDocumentLoader.doAdd(ExtractingDocumentLoader.java:122) at org.apache.solr.handler.extraction.ExtractingDocumentLoader.addDoc(ExtractingDocumentLoader.java:127) at org.apache.solr.handler.extraction.ExtractingDocumentLoader.load(ExtractingDocumentLoader.java:230) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:151) at org.apache.solr.core.SolrCore.execute(SolrCore.java:2079) at org.apache.solr.util.TestHarness.queryAndResponse(TestHarness.java:339) at org.apache.solr.handler.extraction.ExtractingRequestHandlerTest.loadLocalFromHandler(ExtractingRequestHandlerTest.java:737) at org.apache.solr.handler.extraction.ExtractingRequestHandlerTest.loadLocal(ExtractingRequestHandlerTest.java:744) at org.apache.solr.handler.extraction.ExtractingRequestHandlerTest.testPasswordProtected(ExtractingRequestHandlerTest.java:662) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:504) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) at
RE: [JENKINS-EA] Lucene-Solr-trunk-Linux (32bit/jdk1.9.0-ea-b78) - Build # 13972 - Failure!
Hi Rory, hi Balchandra,
I set up a quick round trip test (it iterates all available timezones in the
JDK, sets them as default, creates a String out of new Date().toString() and
tried to parse that afterwards with ENGLISH, US and ROOT locale.
===
import java.text.ParseException;
import java.text.SimpleDateFormat;
import java.util.Date;
import java.util.Locale;
import java.util.TimeZone;
public final class Test {
private static void testParse(Locale locale, String date) {
try {
new SimpleDateFormat(EEE MMM d hh:mm:ss z , locale).parse(date);
System.out.println(String.format(Locale.ENGLISH, OK parsing '%s' in
locale '%s', date, locale));
} catch (ParseException pe) {
System.out.println(String.format(Locale.ENGLISH, ERROR parsing '%s' in
locale '%s': %s, date, locale, pe.toString()));
}
}
public static void main(String[] args) {
for (String id : TimeZone.getAvailableIDs()) {
System.out.println(Testing time zone: + id);
TimeZone.setDefault(TimeZone.getTimeZone(id));
// some date today:
String date1 = new Date(1440358930504L).toString();
testParse(Locale.ENGLISH, date1);
testParse(Locale.US, date1);
testParse(Locale.ROOT, date1);
// half a year back to hit DST difference:
String date2 = new Date(1440358930504L - 8640L * 180).toString();
testParse(Locale.ENGLISH, date2);
testParse(Locale.US, date2);
testParse(Locale.ROOT, date2);
}
}
}
With Java 8 this passes, with Java 9 build 78 it fails for several timezones.
The funny thing is: SimpleDateFormat is not even able to parse UTC - LOL.
Could you pass this to the issue after reopening? It’s a good test!
-
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: u...@thetaphi.de
-Original Message-
From: Uwe Schindler [mailto:u...@thetaphi.de]
Sent: Sunday, August 23, 2015 9:19 PM
To: dev@lucene.apache.org
Cc: rory.odonn...@oracle.com; 'Balchandra Vaidya'
Subject: RE: [JENKINS-EA] Lucene-Solr-trunk-Linux (32bit/jdk1.9.0-ea-b78) -
Build # 13972 - Failure!
Hi Rory, hi Balchandra,
the fix about https://bugs.openjdk.java.net/browse/JDK-8130845 is still
incomplete.
Our test framework found a date string which was created by
Date#toString(), which is not parseable, neither with ENGLISH, US or ROOT
locale!
Here is test program:
=
import java.text.ParseException;
import java.text.SimpleDateFormat;
import java.util.Locale;
public final class Test {
private static void testParse(Locale locale) {
try {
new SimpleDateFormat(EEE MMM d hh:mm:ss z ,
locale).parse(Sat Jun 23 02:57:58 XJT 2012);
System.out.println(OK: + locale);
} catch (ParseException pe) {
pe.printStackTrace();
}
}
public static void main(String[] args) {
testParse(Locale.ENGLISH);
testParse(Locale.US);
testParse(Locale.ROOT);
}
}
=
Can you reopen https://bugs.openjdk.java.net/browse/JDK-8130845 and
attach the above program?
It passes with Java 8, but fails with Java 9.
The Date was created by Date#toString(). XJT is Xinjiang Time also known as
Asia/Kashgar, used in parts of China
(https://en.wikipedia.org/wiki/Asia/Kashgar). I would suggest to the
developer of the Locale updates, that there should be some test that asserts
the round trip between the above Date format and Date#toString() for all
Timezones available.
Uwe
-
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: u...@thetaphi.de
-Original Message-
From: Uwe Schindler [mailto:u...@thetaphi.de]
Sent: Sunday, August 23, 2015 8:27 PM
To: dev@lucene.apache.org
Cc: rory.odonn...@oracle.com; Balchandra Vaidya
Subject: RE: [JENKINS-EA] Lucene-Solr-trunk-Linux (32bit/jdk1.9.0-ea-b78) -
Build # 13972 - Failure!
I am digging, seems to be SOLR-7770 related. The problem with the new
Locale Data in the JDK9 is that not all possible Timezone Short identifiers
are
available... I will try this date and send it back to Rory for addition to
https://bugs.openjdk.java.net/browse/JDK-8130845
Uwe
-
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: u...@thetaphi.de
From: Policeman Jenkins Server [mailto:jenk...@thetaphi.de]
Sent: Sunday, August 23, 2015 7:55 PM
To: dev@lucene.apache.org
Subject: [JENKINS-EA] Lucene-Solr-trunk-Linux (32bit/jdk1.9.0-ea-b78)
- Build # 13972 - Failure!
Importance: Low
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13972/
Java: 32bit/jdk1.9.0-ea-b78 -client -XX:+UseConcMarkSweepGC
4 tests failed.
FAILED
