I had problems with these file: urls when originally setting up the smoker task.
i added a hack to the python script to handle the ones coming from ant (sorry), but it was only just one hack in a pile of URL hacks: def getDirEntries(urlString): if urlString.startswith('file:/') and not urlString.startswith('file://'): # stupid bogus ant URI urlString = "file:///" + urlString[6:] if urlString.startswith('file://'): path = urlString[7:] if path.endswith('/'): path = path[:-1] if cygwin: # Convert Windows path to Cygwin path path = re.sub(r'^/([A-Za-z]):/', r'/cygdrive/\1/', path) l = [] for ent in os.listdir(path): entPath = '%s/%s' % (path, ent) if os.path.isdir(entPath): entPath += '/' ent += '/' l.append((ent, 'file://%s' % entPath)) l.sort() return l else: links = getHREFs(urlString) for i, (text, subURL) in enumerate(links): if text == 'Parent Directory' or text == '..': return links[(i+1):] On Sat, Nov 3, 2012 at 12:56 PM, Uwe Schindler <u...@thetaphi.de> wrote: > Maybe the linter again has a wrong "file:" vs. "filesystem path" issue - I > don't trust the python code, only my own ANT knowledge, so maybe the smoker > script calls the linter with wrong parameters. Javadocs links must be real > URLs not filesystem paths? The ANT lint call passes a correct file: URL to > the linter, maybe smoker does not do this and we have some strange characters > in the Workspace path? > > ----- > Uwe Schindler > H.-H.-Meier-Allee 63, D-28213 Bremen > http://www.thetaphi.de > eMail: u...@thetaphi.de > > >> -----Original Message----- >> From: Robert Muir [mailto:rcm...@gmail.com] >> Sent: Saturday, November 03, 2012 5:36 PM >> To: dev@lucene.apache.org >> Subject: Re: [JENKINS] Lucene-Solr-SmokeRelease-4.x - Build # 21 - Still >> Failing >> >> Stranger than that: I checked out trunk on the apache jenkins server, and ran >> this: >> >> ant nightly-smoke -DJAVA6_HOME=/usr/local/openjdk6 >> -DJAVA7_HOME=/usr/local/openjdk7 >> >> BUILD SUCCESSFUL >> Total time: 54 minutes 42 seconds >> >> >> On Sat, Nov 3, 2012 at 10:02 AM, Uwe Schindler <u...@thetaphi.de> wrote: >> > The strange thing is that this does not happen when we run the linter from >> the hourly tests! What is the difference? >> > >> > ----- >> > Uwe Schindler >> > H.-H.-Meier-Allee 63, D-28213 Bremen >> > http://www.thetaphi.de >> > eMail: u...@thetaphi.de >> > >> > >> >> -----Original Message----- >> >> From: Robert Muir [mailto:rcm...@gmail.com] >> >> Sent: Saturday, November 03, 2012 2:44 PM >> >> To: dev@lucene.apache.org >> >> Subject: Re: [JENKINS] Lucene-Solr-SmokeRelease-4.x - Build # 21 - >> >> Still Failing >> >> >> >> My current theory is that javadoc itself could have a default charset >> >> bug >> >> (http://blog.thetaphi.de/2012/07/default-locales-default-charsets- >> >> and.html), >> >> even though we supply charset=en_US via ant. >> >> >> >> We know that in some cases javadoc generates broken html for >> >> different charsets (Adrien found this for french). So its possible >> >> its happening because the default locale is C? >> >> >> >> But i havent had time to look into it. >> >> >> >> On Sat, Nov 3, 2012 at 9:39 AM, Uwe Schindler <u...@thetaphi.de> >> wrote: >> >> > I have no idea, maybe an OpenJDK bug, but possibly not related to >> >> FreeBSD. Does anybody have OpenJDK (or IcedTea) installed on Linux? >> >> > >> >> > ----- >> >> > Uwe Schindler >> >> > H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de >> >> > eMail: u...@thetaphi.de >> >> > >> >> > >> >> >> -----Original Message----- >> >> >> From: Apache Jenkins Server [mailto:jenk...@builds.apache.org] >> >> >> Sent: Saturday, November 03, 2012 2:28 PM >> >> >> To: dev@lucene.apache.org >> >> >> Subject: [JENKINS] Lucene-Solr-SmokeRelease-4.x - Build # 21 - Still >> >> >> Failing >> >> >> >> >> >> Build: https://builds.apache.org/job/Lucene-Solr-SmokeRelease- >> 4.x/21/ >> >> >> >> >> >> No tests ran. >> >> >> >> >> >> Build Log: >> >> >> [...truncated 30515 lines...] >> >> >> prepare-release-no-sign: >> >> >> [mkdir] Created dir: >> >> >> /usr/home/hudson/hudson-slave/workspace/Lucene- >> >> >> Solr-SmokeRelease-4.x/lucene/build/fakeRelease >> >> >> [copy] Copying 381 files to /usr/home/hudson/hudson- >> >> >> slave/workspace/Lucene-Solr-SmokeRelease- >> >> >> 4.x/lucene/build/fakeRelease/lucene >> >> >> [copy] Copying 4 files to /usr/home/hudson/hudson- >> >> >> slave/workspace/Lucene-Solr-SmokeRelease- >> >> >> 4.x/lucene/build/fakeRelease/lucene/changes >> >> >> [get] Getting: http://people.apache.org/keys/group/lucene.asc >> >> >> [get] To: /usr/home/hudson/hudson-slave/workspace/Lucene- >> Solr- >> >> >> SmokeRelease-4.x/lucene/build/fakeRelease/lucene/KEYS >> >> >> [copy] Copying 189 files to /usr/home/hudson/hudson- >> >> >> slave/workspace/Lucene-Solr-SmokeRelease- >> >> >> 4.x/lucene/build/fakeRelease/solr >> >> >> [copy] Copying 1 file to /usr/home/hudson/hudson- >> >> >> slave/workspace/Lucene-Solr-SmokeRelease- >> >> >> 4.x/lucene/build/fakeRelease/solr >> >> >> [copy] Copying 4 files to /usr/home/hudson/hudson- >> >> >> slave/workspace/Lucene-Solr-SmokeRelease- >> >> >> 4.x/lucene/build/fakeRelease/solr/changes >> >> >> [exec] NOTE: output encoding is US-ASCII >> >> >> [exec] >> >> >> [exec] Load release URL "file:/usr/home/hudson/hudson- >> >> >> slave/workspace/Lucene-Solr-SmokeRelease- >> >> >> 4.x/lucene/build/fakeRelease/"... >> >> >> [exec] >> >> >> [exec] Test Lucene... >> >> >> [exec] test basics... >> >> >> [exec] get KEYS >> >> >> [exec] 0.1 MB >> >> >> [exec] check changes HTML... >> >> >> [exec] download lucene-4.1.0-src.tgz... >> >> >> [exec] 26.5 MB >> >> >> [exec] verify md5/sha1 digests >> >> >> [exec] download lucene-4.1.0.tgz... >> >> >> [exec] 47.7 MB >> >> >> [exec] verify md5/sha1 digests >> >> >> [exec] download lucene-4.1.0.zip... >> >> >> [exec] 57.1 MB >> >> >> [exec] verify md5/sha1 digests >> >> >> [exec] unpack lucene-4.1.0.tgz... >> >> >> [exec] verify JAR/WAR metadata... >> >> >> [exec] test demo with 1.6... >> >> >> [exec] got 5351 hits for query "lucene" >> >> >> [exec] test demo with 1.7... >> >> >> [exec] got 5351 hits for query "lucene" >> >> >> [exec] check Lucene's javadoc JAR >> >> >> [exec] unpack lucene-4.1.0.zip... >> >> >> [exec] verify JAR/WAR metadata... >> >> >> [exec] test demo with 1.6... >> >> >> [exec] got 5351 hits for query "lucene" >> >> >> [exec] test demo with 1.7... >> >> >> [exec] got 5351 hits for query "lucene" >> >> >> [exec] check Lucene's javadoc JAR >> >> >> [exec] unpack lucene-4.1.0-src.tgz... >> >> >> [exec] make sure no JARs/WARs in src dist... >> >> >> [exec] run "ant validate" >> >> >> [exec] run tests w/ Java 6... >> >> >> [exec] test demo with 1.6... >> >> >> [exec] got 215 hits for query "lucene" >> >> >> [exec] generate javadocs w/ Java 6... >> >> >> [exec] run tests w/ Java 7... >> >> >> [exec] test demo with 1.7... >> >> >> [exec] got 215 hits for query "lucene" >> >> >> [exec] generate javadocs w/ Java 7... >> >> >> [exec] Traceback (most recent call last): >> >> >> [exec] File "/usr/home/hudson/hudson-slave/workspace/Lucene- >> >> Solr- >> >> >> SmokeRelease-4.x/dev-tools/script >> >> >> [exec] s/smokeTestRelease.py", line 1342, in <module> >> >> >> [exec] main() >> >> >> [exec] File "/usr/home/hudson/hudson-slave/workspace/Lucene- >> >> Solr- >> >> >> SmokeRelease-4.x/dev-tools/scripts/smokeTestRelease.py", line 1288, >> >> >> in main >> >> >> [exec] smokeTest(baseURL, version, tmpDir, isSigned) >> >> >> [exec] File "/usr/home/hudson/hudson-slave/workspace/Lucene- >> >> Solr- >> >> >> SmokeRelease-4.x/dev-tools/scripts/smokeTestRelease.py", line 1324, >> >> >> in smokeTest >> >> >> [exec] unpackAndVerify('lucene', tmpDir, 'lucene-%s-src.tgz' % >> >> version, >> >> >> version) >> >> >> [exec] File "/usr/home/hudson/hudson-slave/workspace/Lucene- >> >> Solr- >> >> >> SmokeRelease-4.x/dev-tools/scripts/smokeTestRelease.py", line 563, >> in >> >> >> unpackAndVerify >> >> >> [exec] verifyUnpacked(project, artifact, unpackPath, version, >> tmpDir) >> >> >> [exec] File "/usr/home/hudson/hudson-slave/workspace/Lucene- >> >> Solr- >> >> >> SmokeRelease-4.x/dev-tools/scripts/smokeTestRelease.py", line 673, >> in >> >> >> verifyUnpacked >> >> >> [exec] checkJavadocpathFull('%s/build/docs' % unpackPath) >> >> >> [exec] File "/usr/home/hudson/hudson-slave/workspace/Lucene- >> >> Solr- >> >> >> SmokeRelease-4.x/dev-tools/scripts/smokeTestRelease.py", line 854, >> in >> >> >> checkJavadocpathFull >> >> >> [exec] if checkJavadocLinks.checkAll(path): >> >> >> [exec] File "/usr/home/hudson/hudson-slave/workspace/Lucene- >> >> Solr- >> >> >> SmokeRelease-4.x/dev-tools/scripts/checkJavadocLinks.py", line 160, >> >> >> in checkAll >> >> >> [exec] allFiles[fullPath] = parse(fullPath, open('%s/%s' % >> >> >> (root, f), >> >> >> encoding='UTF-8').read()) >> >> >> [exec] File "/usr/home/hudson/hudson-slave/workspace/Lucene- >> >> Solr- >> >> >> SmokeRelease-4.x/dev-tools/scripts/checkJavadocLinks.py", line 110, >> >> >> in parse >> >> >> [exec] parser.feed(html) >> >> >> [exec] File "/usr/local/lib/python3.2/html/parser.py", line >> >> >> 142, in >> feed >> >> >> [exec] self.goahead(0) >> >> >> [exec] File "/usr/local/lib/python3.2/html/parser.py", line >> >> >> 188, in >> >> goahead >> >> >> [exec] k = self.parse_endtag(i) >> >> >> [exec] File "/usr/local/lib/python3.2/html/parser.py", line >> >> >> 454, in >> >> >> parse_endtag >> >> >> [exec] self.handle_endtag(elem.lower()) >> >> >> [exec] File "/usr/home/hudson/hudson-slave/workspace/Lucene- >> >> Solr- >> >> >> SmokeRelease-4.x/dev-tools/scripts/checkJavadocLinks.py", line 92, in >> >> >> handle_endtag >> >> >> [exec] raise RuntimeError('%s %s:%s: saw </%s> but expected >> >> </%s>' % >> >> >> (self.baseURL, self.getpos()[0], self.getpos()[1], tag, >> >> >> self.stack[-1])) >> >> >> [exec] RuntimeError: file:///usr/home/hudson/hudson- >> >> >> slave/workspace/Lucene-Solr-SmokeRelease- >> >> >> 4.x/lucene/build/fakeReleaseTmp/unpack/lucene- >> >> >> 4.1.0/build/docs/memory/overview-tree.html 87:128: saw </dl> but >> >> >> expected </dd> >> >> >> [exec] >> >> >> [exec] Crawl/parse... >> >> >> >> >> >> BUILD FAILED >> >> >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr- >> >> SmokeRelease- >> >> >> 4.x/build.xml:279: exec returned: 1 >> >> >> >> >> >> Total time: 42 minutes 21 seconds >> >> >> Build step 'Invoke Ant' marked build as failure Email was triggered >> >> >> for: Failure Sending email for trigger: Failure >> >> >> >> >> > >> >> > >> >> > >> >> > --------------------------------------------------------------------- >> >> > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For >> >> > additional commands, e-mail: dev-h...@lucene.apache.org >> >> > >> >> >> >> --------------------------------------------------------------------- >> >> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For >> additional >> >> commands, e-mail: dev-h...@lucene.apache.org >> > >> > >> > --------------------------------------------------------------------- >> > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org >> > For additional commands, e-mail: dev-h...@lucene.apache.org >> > >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org >> For additional commands, e-mail: dev-h...@lucene.apache.org > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > For additional commands, e-mail: dev-h...@lucene.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org