I had problems with these file: urls when originally setting up the smoker task.

i added a hack to the python script to handle the ones coming from ant
(sorry), but it was only just one hack in a pile of URL hacks:

def getDirEntries(urlString):
  if urlString.startswith('file:/') and not urlString.startswith('file://'):
    # stupid bogus ant URI
    urlString = "file:///" + urlString[6:]

  if urlString.startswith('file://'):
    path = urlString[7:]
    if path.endswith('/'):
      path = path[:-1]
    if cygwin: # Convert Windows path to Cygwin path
      path = re.sub(r'^/([A-Za-z]):/', r'/cygdrive/\1/', path)
    l = []
    for ent in os.listdir(path):
      entPath = '%s/%s' % (path, ent)
      if os.path.isdir(entPath):
        entPath += '/'
        ent += '/'
      l.append((ent, 'file://%s' % entPath))
    l.sort()
    return l
  else:
    links = getHREFs(urlString)
    for i, (text, subURL) in enumerate(links):
      if text == 'Parent Directory' or text == '..':
        return links[(i+1):]

On Sat, Nov 3, 2012 at 12:56 PM, Uwe Schindler <u...@thetaphi.de> wrote:
> Maybe the linter again has a wrong "file:" vs. "filesystem path" issue - I 
> don't trust the python code, only my own ANT knowledge, so maybe the smoker 
> script calls the linter with wrong parameters. Javadocs links must be real 
> URLs not filesystem paths? The ANT lint call passes a correct file: URL to 
> the linter, maybe smoker does not do this and we have some strange characters 
> in the Workspace path?
>
> -----
> Uwe Schindler
> H.-H.-Meier-Allee 63, D-28213 Bremen
> http://www.thetaphi.de
> eMail: u...@thetaphi.de
>
>
>> -----Original Message-----
>> From: Robert Muir [mailto:rcm...@gmail.com]
>> Sent: Saturday, November 03, 2012 5:36 PM
>> To: dev@lucene.apache.org
>> Subject: Re: [JENKINS] Lucene-Solr-SmokeRelease-4.x - Build # 21 - Still
>> Failing
>>
>> Stranger than that: I checked out trunk on the apache jenkins server, and ran
>> this:
>>
>> ant nightly-smoke -DJAVA6_HOME=/usr/local/openjdk6
>> -DJAVA7_HOME=/usr/local/openjdk7
>>
>> BUILD SUCCESSFUL
>> Total time: 54 minutes 42 seconds
>>
>>
>> On Sat, Nov 3, 2012 at 10:02 AM, Uwe Schindler <u...@thetaphi.de> wrote:
>> > The strange thing is that this does not happen when we run the linter from
>> the hourly tests! What is the difference?
>> >
>> > -----
>> > Uwe Schindler
>> > H.-H.-Meier-Allee 63, D-28213 Bremen
>> > http://www.thetaphi.de
>> > eMail: u...@thetaphi.de
>> >
>> >
>> >> -----Original Message-----
>> >> From: Robert Muir [mailto:rcm...@gmail.com]
>> >> Sent: Saturday, November 03, 2012 2:44 PM
>> >> To: dev@lucene.apache.org
>> >> Subject: Re: [JENKINS] Lucene-Solr-SmokeRelease-4.x - Build # 21 -
>> >> Still Failing
>> >>
>> >> My current theory is that javadoc itself could have a default charset
>> >> bug
>> >> (http://blog.thetaphi.de/2012/07/default-locales-default-charsets-
>> >> and.html),
>> >> even though we supply charset=en_US via ant.
>> >>
>> >> We know that in some cases javadoc generates broken html for
>> >> different charsets (Adrien found this for french). So its possible
>> >> its happening because the default locale is C?
>> >>
>> >> But i havent had time to look into it.
>> >>
>> >> On Sat, Nov 3, 2012 at 9:39 AM, Uwe Schindler <u...@thetaphi.de>
>> wrote:
>> >> > I have no idea, maybe an OpenJDK bug, but possibly not related to
>> >> FreeBSD. Does anybody have OpenJDK (or IcedTea) installed on Linux?
>> >> >
>> >> > -----
>> >> > Uwe Schindler
>> >> > H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de
>> >> > eMail: u...@thetaphi.de
>> >> >
>> >> >
>> >> >> -----Original Message-----
>> >> >> From: Apache Jenkins Server [mailto:jenk...@builds.apache.org]
>> >> >> Sent: Saturday, November 03, 2012 2:28 PM
>> >> >> To: dev@lucene.apache.org
>> >> >> Subject: [JENKINS] Lucene-Solr-SmokeRelease-4.x - Build # 21 - Still
>> >> >> Failing
>> >> >>
>> >> >> Build: https://builds.apache.org/job/Lucene-Solr-SmokeRelease-
>> 4.x/21/
>> >> >>
>> >> >> No tests ran.
>> >> >>
>> >> >> Build Log:
>> >> >> [...truncated 30515 lines...]
>> >> >> prepare-release-no-sign:
>> >> >>     [mkdir] Created dir:
>> >> >> /usr/home/hudson/hudson-slave/workspace/Lucene-
>> >> >> Solr-SmokeRelease-4.x/lucene/build/fakeRelease
>> >> >>      [copy] Copying 381 files to /usr/home/hudson/hudson-
>> >> >> slave/workspace/Lucene-Solr-SmokeRelease-
>> >> >> 4.x/lucene/build/fakeRelease/lucene
>> >> >>      [copy] Copying 4 files to /usr/home/hudson/hudson-
>> >> >> slave/workspace/Lucene-Solr-SmokeRelease-
>> >> >> 4.x/lucene/build/fakeRelease/lucene/changes
>> >> >>       [get] Getting: http://people.apache.org/keys/group/lucene.asc
>> >> >>       [get] To: /usr/home/hudson/hudson-slave/workspace/Lucene-
>> Solr-
>> >> >> SmokeRelease-4.x/lucene/build/fakeRelease/lucene/KEYS
>> >> >>      [copy] Copying 189 files to /usr/home/hudson/hudson-
>> >> >> slave/workspace/Lucene-Solr-SmokeRelease-
>> >> >> 4.x/lucene/build/fakeRelease/solr
>> >> >>      [copy] Copying 1 file to /usr/home/hudson/hudson-
>> >> >> slave/workspace/Lucene-Solr-SmokeRelease-
>> >> >> 4.x/lucene/build/fakeRelease/solr
>> >> >>      [copy] Copying 4 files to /usr/home/hudson/hudson-
>> >> >> slave/workspace/Lucene-Solr-SmokeRelease-
>> >> >> 4.x/lucene/build/fakeRelease/solr/changes
>> >> >>      [exec] NOTE: output encoding is US-ASCII
>> >> >>      [exec]
>> >> >>      [exec] Load release URL "file:/usr/home/hudson/hudson-
>> >> >> slave/workspace/Lucene-Solr-SmokeRelease-
>> >> >> 4.x/lucene/build/fakeRelease/"...
>> >> >>      [exec]
>> >> >>      [exec] Test Lucene...
>> >> >>      [exec]   test basics...
>> >> >>      [exec]   get KEYS
>> >> >>      [exec]     0.1 MB
>> >> >>      [exec]   check changes HTML...
>> >> >>      [exec]   download lucene-4.1.0-src.tgz...
>> >> >>      [exec]     26.5 MB
>> >> >>      [exec]     verify md5/sha1 digests
>> >> >>      [exec]   download lucene-4.1.0.tgz...
>> >> >>      [exec]     47.7 MB
>> >> >>      [exec]     verify md5/sha1 digests
>> >> >>      [exec]   download lucene-4.1.0.zip...
>> >> >>      [exec]     57.1 MB
>> >> >>      [exec]     verify md5/sha1 digests
>> >> >>      [exec]   unpack lucene-4.1.0.tgz...
>> >> >>      [exec]     verify JAR/WAR metadata...
>> >> >>      [exec]     test demo with 1.6...
>> >> >>      [exec]       got 5351 hits for query "lucene"
>> >> >>      [exec]     test demo with 1.7...
>> >> >>      [exec]       got 5351 hits for query "lucene"
>> >> >>      [exec]     check Lucene's javadoc JAR
>> >> >>      [exec]   unpack lucene-4.1.0.zip...
>> >> >>      [exec]     verify JAR/WAR metadata...
>> >> >>      [exec]     test demo with 1.6...
>> >> >>      [exec]       got 5351 hits for query "lucene"
>> >> >>      [exec]     test demo with 1.7...
>> >> >>      [exec]       got 5351 hits for query "lucene"
>> >> >>      [exec]     check Lucene's javadoc JAR
>> >> >>      [exec]   unpack lucene-4.1.0-src.tgz...
>> >> >>      [exec]     make sure no JARs/WARs in src dist...
>> >> >>      [exec]     run "ant validate"
>> >> >>      [exec]     run tests w/ Java 6...
>> >> >>      [exec]     test demo with 1.6...
>> >> >>      [exec]       got 215 hits for query "lucene"
>> >> >>      [exec]     generate javadocs w/ Java 6...
>> >> >>      [exec]     run tests w/ Java 7...
>> >> >>      [exec]     test demo with 1.7...
>> >> >>      [exec]       got 215 hits for query "lucene"
>> >> >>      [exec]     generate javadocs w/ Java 7...
>> >> >>      [exec] Traceback (most recent call last):
>> >> >>      [exec]   File "/usr/home/hudson/hudson-slave/workspace/Lucene-
>> >> Solr-
>> >> >> SmokeRelease-4.x/dev-tools/script
>> >> >>      [exec] s/smokeTestRelease.py", line 1342, in <module>
>> >> >>      [exec]     main()
>> >> >>      [exec]   File "/usr/home/hudson/hudson-slave/workspace/Lucene-
>> >> Solr-
>> >> >> SmokeRelease-4.x/dev-tools/scripts/smokeTestRelease.py", line 1288,
>> >> >> in main
>> >> >>      [exec]     smokeTest(baseURL, version, tmpDir, isSigned)
>> >> >>      [exec]   File "/usr/home/hudson/hudson-slave/workspace/Lucene-
>> >> Solr-
>> >> >> SmokeRelease-4.x/dev-tools/scripts/smokeTestRelease.py", line 1324,
>> >> >> in smokeTest
>> >> >>      [exec]     unpackAndVerify('lucene', tmpDir, 'lucene-%s-src.tgz' %
>> >> version,
>> >> >> version)
>> >> >>      [exec]   File "/usr/home/hudson/hudson-slave/workspace/Lucene-
>> >> Solr-
>> >> >> SmokeRelease-4.x/dev-tools/scripts/smokeTestRelease.py", line 563,
>> in
>> >> >> unpackAndVerify
>> >> >>      [exec]     verifyUnpacked(project, artifact, unpackPath, version,
>> tmpDir)
>> >> >>      [exec]   File "/usr/home/hudson/hudson-slave/workspace/Lucene-
>> >> Solr-
>> >> >> SmokeRelease-4.x/dev-tools/scripts/smokeTestRelease.py", line 673,
>> in
>> >> >> verifyUnpacked
>> >> >>      [exec]     checkJavadocpathFull('%s/build/docs' % unpackPath)
>> >> >>      [exec]   File "/usr/home/hudson/hudson-slave/workspace/Lucene-
>> >> Solr-
>> >> >> SmokeRelease-4.x/dev-tools/scripts/smokeTestRelease.py", line 854,
>> in
>> >> >> checkJavadocpathFull
>> >> >>      [exec]     if checkJavadocLinks.checkAll(path):
>> >> >>      [exec]   File "/usr/home/hudson/hudson-slave/workspace/Lucene-
>> >> Solr-
>> >> >> SmokeRelease-4.x/dev-tools/scripts/checkJavadocLinks.py", line 160,
>> >> >> in checkAll
>> >> >>      [exec]     allFiles[fullPath] = parse(fullPath, open('%s/%s' % 
>> >> >> (root, f),
>> >> >> encoding='UTF-8').read())
>> >> >>      [exec]   File "/usr/home/hudson/hudson-slave/workspace/Lucene-
>> >> Solr-
>> >> >> SmokeRelease-4.x/dev-tools/scripts/checkJavadocLinks.py", line 110,
>> >> >> in parse
>> >> >>      [exec]     parser.feed(html)
>> >> >>      [exec]   File "/usr/local/lib/python3.2/html/parser.py", line 
>> >> >> 142, in
>> feed
>> >> >>      [exec]     self.goahead(0)
>> >> >>      [exec]   File "/usr/local/lib/python3.2/html/parser.py", line 
>> >> >> 188, in
>> >> goahead
>> >> >>      [exec]     k = self.parse_endtag(i)
>> >> >>      [exec]   File "/usr/local/lib/python3.2/html/parser.py", line 
>> >> >> 454, in
>> >> >> parse_endtag
>> >> >>      [exec]     self.handle_endtag(elem.lower())
>> >> >>      [exec]   File "/usr/home/hudson/hudson-slave/workspace/Lucene-
>> >> Solr-
>> >> >> SmokeRelease-4.x/dev-tools/scripts/checkJavadocLinks.py", line 92, in
>> >> >> handle_endtag
>> >> >>      [exec]     raise RuntimeError('%s %s:%s: saw </%s> but expected
>> >> </%s>' %
>> >> >> (self.baseURL, self.getpos()[0], self.getpos()[1], tag, 
>> >> >> self.stack[-1]))
>> >> >>      [exec] RuntimeError: file:///usr/home/hudson/hudson-
>> >> >> slave/workspace/Lucene-Solr-SmokeRelease-
>> >> >> 4.x/lucene/build/fakeReleaseTmp/unpack/lucene-
>> >> >> 4.1.0/build/docs/memory/overview-tree.html 87:128: saw </dl> but
>> >> >> expected </dd>
>> >> >>      [exec]
>> >> >>      [exec] Crawl/parse...
>> >> >>
>> >> >> BUILD FAILED
>> >> >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-
>> >> SmokeRelease-
>> >> >> 4.x/build.xml:279: exec returned: 1
>> >> >>
>> >> >> Total time: 42 minutes 21 seconds
>> >> >> Build step 'Invoke Ant' marked build as failure Email was triggered
>> >> >> for: Failure Sending email for trigger: Failure
>> >> >>
>> >> >
>> >> >
>> >> >
>> >> > ---------------------------------------------------------------------
>> >> > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For
>> >> > additional commands, e-mail: dev-h...@lucene.apache.org
>> >> >
>> >>
>> >> ---------------------------------------------------------------------
>> >> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For
>> additional
>> >> commands, e-mail: dev-h...@lucene.apache.org
>> >
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>> > For additional commands, e-mail: dev-h...@lucene.apache.org
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>> For additional commands, e-mail: dev-h...@lucene.apache.org
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to