Hi. Two more points: * It looks like none of my files worked correctly on the 2nd try. (I was misreading the log files when I thought they worked the 2nd time). I'm going to try multiple times, as well as with other download mechanisms (wget, browser download). Someone has reported that it worked the 3rd time with wget, so maybe persistence is they key. :) * I left the Java app running overnight. It failed with the error below. It's not that helpful, but I'm posting it in case anyone else notices anything. Note that I'm running with openJDK 1.8
---- openjdk version "1.8.0_91" OpenJDK Runtime Environment (IcedTea 3.0.1) (suse-12.1-x86_64) OpenJDK 64-Bit Server VM (build 25.91-b14, mixed mode) ---- 1560: C1 10 0B 0B CF C3 9E 5A 91 84 .......Z.. main, handling exception: javax.net.ssl.SSLException: SSL peer shut down incorrectly %% Invalidated: [Session-1, TLS_DHE_RSA_WITH_AES_128_GCM_SHA256] main, SEND TLSv1.2 ALERT: fatal, description = unexpected_message Padded plaintext before ENCRYPTION: len = 2 0000: 02 0A .. main, WRITE: TLSv1.2 Alert, length = 26 [Raw write]: length = 31 0000: 15 03 03 00 1A 00 00 00 00 00 00 00 02 3C 52 6B .............<Rk 0010: 35 CF CE 06 AE 79 20 47 3A 0D 6D 31 FF 0B 6B 5....y G:.m1..k main, called closeSocket() download failed: src=https://dumps.wikimedia.org/enwiki/latest/enwiki-latest-pagelinks.sql.gz trg=/home/xowa/wiki/en.wikipedia.org/enwiki-latest-pagelinks.sql.gz err=[err 0] <javax.net.ssl.SSLException> SSL peer shut down incorrectly [trace]: sun.security.ssl.InputRecord.readV3Record(InputRecord.java:596) sun.security.ssl.InputRecord.read(InputRecord.java:532) sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973) sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930) sun.security.ssl.AppInputStream.read(AppInputStream.java:105) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.net.www.MeteredStream.read(MeteredStream.java:134) java.io.FilterInputStream.read(FilterInputStream.java:133) sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:3336) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) gplx.core.ios.IoEngine_system.DownloadFil(Unknown Source) gplx.core.ios.IoEngine_xrg_downloadFil.Exec(Unknown Source) gplx.xowa.bldrs.cmds.utils.Xob_download_cmd.Cmd_run(Unknown Source) gplx.xowa.bldrs.Xob_bldr.Run(Unknown Source) gplx.xowa.bldrs.Xob_bldr.Invk(Unknown Source) gplx.langs.gfs.GfsCore_.Exec(Unknown Source) gplx.langs.gfs.GfsCore_.Exec(Unknown Source) gplx.langs.gfs.GfsCore_.Exec(Unknown Source) gplx.langs.gfs.GfsCore.ExecOne_to(Unknown Source) gplx.xowa.apps.gfs.Xoa_gfs_mgr.Run_str_for(Unknown Source) gplx.xowa.apps.gfs.Xoa_gfs_mgr.Run_str_for(Unknown Source) gplx.xowa.apps.gfs.Xoa_gfs_mgr.Run_url_for(Unknown Source) gplx.xowa.apps.gfs.Xoa_gfs_mgr.Run_url(Unknown Source) gplx.xowa.apps.boots.Xoa_boot_mgr.Run_app(Unknown Source) gplx.xowa.apps.boots.Xoa_boot_mgr.Run(Unknown Source) gplx.xowa.Xoa_app_.Run(Unknown Source) gplx.xowa.Xowa_main.main(Unknown Source) On Fri, Aug 5, 2016 at 10:28 PM, gnosygnu <gnosy...@gmail.com> wrote: > Hi. I've run across an error while downloading dumps, which I've not > seen before. (I've been downloading dumps regularly for over 5 years). > I've done some research on it, but haven't found much information. > It's a bit random, and from what I can tell, it's not failing for > client-side reasons. I'm a bit stumped, so I'm reaching out for any > help. > > I provide more details below. My quick questions are: > > * Has anyone else run across this error recently? Or just random > failed downloads? I've first received reports of it on July 29th, and > encountered it myself several times today. > * Has anything changed recently on the Wikimedia dump server side that > might require TLSv1? Or anything similar? > > Any detail or feedback would be helpful. > > Thanks. > > ---- > > I'm downloading XML data dumps from https://dumps.wikimedia.org > through XOWA. Recently, random downloads fail with a > javax.net.ssl.SSLException: "SSL peer shut down incorrectly" > > Some details: > * This seems to happen more often when downloading large files. I ran > across it five times today on an openSUSE box. Each file was over 5 > GB. > ** > https://dumps.wikimedia.org/commonswiki/20160801/commonswiki-20160801-pages-articles.xml.bz2 > ** > https://dumps.wikimedia.org/commonswiki/20160801/commonswiki-20160801-image.sql.gz > ** > https://dumps.wikimedia.org/enwiki/20160801/enwiki-20160801-pages-articles.xml.bz2 > ** > https://dumps.wikimedia.org/enwiki/20160801/enwiki-20160801-pagelinks.sql.gz > * In addition, I know of one other person who also encountered this > error several times. This person was downloading Polish Wikipedia, and > encountered it on both Windows and Ubuntu. I believe they were in a > different part of the world (Poland vs East Coast United States) > ** > https://dumps.wikimedia.org/plwiki/20160801/plwiki-20160801-pages-articles.xml.bz2 > * This error does not occur when initiating the connection (at > handshake). It occurs sometime during the download of the file (for > example, at the 85% mark). The actual percentage appears to vary > (i.e.: not always at the 1 GB mark) > > Some other observations: > * Restarting the download for the file seems to work, but that may > have just been "luck" > * I've downloaded other 5+ GB files without problems. For example, > https://dumps.wikimedia.org/wikidatawiki/20160801/wikidatawiki-20160801-pages-articles.xml.bz2 > . Again, this may have been just "luck" > * I've downloaded other "smaller" files such as the pageprops file > without problems. > * I've tried running the Java application with > "-Djavax.net.debug=all". This provides a lot of info, but nothing > particularly interesting. It seems to confirm that the server requires > TLSv1 (and not TLSv1.1 or TLSv1.2). Furthermore, I haven't been able > to reproduce the error while this debug flag is running. _______________________________________________ Xmldatadumps-l mailing list Xmldatadumps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/xmldatadumps-l
