P.S.: ProxyAuthentication is a good class name as well. :-) On 2 May 2013 17:04, Jona Christopher Sahnwaldt <j...@sahnwaldt.de> wrote: > On 2 May 2013 12:55, Julien Plu <julien....@redaction-developpez.com> wrote: >> Ok, now that works like a charm. I added just two properties inside >> "download.minimal.properties" file which are : "user" and "password" and the >> authentication is made only is these parameters are set. And I created a >> class "ProxyAuthentication.scala". >> > > A few recommendations: > > - Use the system properties http.proxyUser and http.proxyPassword. > Usually, system properties are problematic, but in this case, they're > ok: 1. we use system properties for the proxy settings anyway, 2. we > don't have to change the download config, and 3. we can more easily > reuse the solution elsewhere. See below. > > - I just googled a bit and think we should make the implementation a > bit safer: > http://stackoverflow.com/questions/1626549/authenticated-http-proxy-with-java/16340273#16340273 > > - Put the code in a new util class ProxyUtils.scala in the core module > in the util package > https://github.com/dbpedia/extraction-framework/tree/master/core/src/main/java/org/dbpedia/extraction/util > , or you can just use ProxyUtils.java and create a new util package in > https://github.com/dbpedia/extraction-framework/tree/master/core/src/main/java/org/dbpedia/extraction > , then you won't have to port the code to Scala. > > We make HTTP calls in a few other places, so we will have to call the > method from there as well, so we should have an implementation in the > core module. > >> I have to do the same thing for "Extraction.scala" class or this class >> doesn't need an internet connexion ? > > I'm pretty sure it doesn't. I don't think we make any requests during > extraction. > > But there are other places. You can look in the pom.xml files, they > should contain Scala launchers for all main classes that we have. For > example, all the launchers in core/pom.xml download some stuff over > HTTP, so if you want you can add a call to your new method in each of > their main() methods. When your code uses the system properties, you > just have to add one line: ProxyUtils.configureProxyAuthenticator(); > > Cheers, > JC > > > >> >> >> 2013/4/30 Julien Plu <julien....@redaction-developpez.com> >>> >>> That's a really good idea ! I will do it thursday because now I finished >>> my working day and tomorrow is a national day off in France. >>> >>> I have also try to solve some bugs in the extraction with separators. >>> >>> Best. >>> >>> Julien. >>> >>> >>> 2013/4/30 Jona Christopher Sahnwaldt <j...@sahnwaldt.de> >>>> >>>> >>>> https://github.com/dbpedia/extraction-framework/blob/master/dump/src/main/scala/org/dbpedia/extraction/dump/download/Download.scala >>>> >>>> It would be cool if you send a pull request when you are done! As a >>>> first step, you can simply copy & paste the code from SO and hard-code >>>> your settings to test if that solves your problem at all, but it would >>>> be nice if you could make the code a little smarter so others can use >>>> it: call System.getProperty("http.proxyUser") and "...Password" and >>>> only install the authenticator if both are set. Good luck! >>>> >>>> On 30 April 2013 19:47, Julien Plu <julien....@redaction-developpez.com> >>>> wrote: >>>> > Ok so apparently it's normal that it's doesn't works with command line, >>>> > I >>>> > have to modify the main. So which file contains the main function ? >>>> > >>>> > Best. >>>> > >>>> > Julien. >>>> > >>>> > >>>> > 2013/4/30 Jona Christopher Sahnwaldt <j...@sahnwaldt.de> >>>> >> >>>> >> Maybe you have to tweak the code a bit: >>>> >> >>>> >> >>>> >> http://stackoverflow.com/questions/1626549/authenticated-http-proxy-with-java >>>> >> >>>> >> On 30 April 2013 19:28, Julien Plu >>>> >> <julien....@redaction-developpez.com> >>>> >> wrote: >>>> >> > Doesn't works :-( >>>> >> > >>>> >> > Best >>>> >> > >>>> >> > Julien. >>>> >> > >>>> >> > >>>> >> > 2013/4/30 Jona Christopher Sahnwaldt <j...@sahnwaldt.de> >>>> >> >> >>>> >> >> Hi Julien, >>>> >> >> >>>> >> >> try adding the settings for https as well, e.g. >>>> >> >> >>>> >> >> <jvmArg>-Dhttps.proxyHost=myproxyhost</jvmArg> >>>> >> >> >>>> >> >> Might help, I'm not sure. >>>> >> >> >>>> >> >> JC >>>> >> >> >>>> >> >> On 30 April 2013 16:57, Julien Plu >>>> >> >> <julien....@redaction-developpez.com> >>>> >> >> wrote: >>>> >> >> > Hi, >>>> >> >> > >>>> >> >> > I try to use the extraction framework on my Windows machine, but >>>> >> >> > I >>>> >> >> > fall >>>> >> >> > on a >>>> >> >> > 407 http proxy authentication error during the dumps download. I >>>> >> >> > put >>>> >> >> > these >>>> >> >> > lines inside the dump/pom.xml : >>>> >> >> > >>>> >> >> > <jvmArg>-Dhttp.proxyHost=myproxyhost</jvmArg> >>>> >> >> > <jvmArg>-Dhttp.proxyPort=port</jvmArg> >>>> >> >> > <jvmArg>-Dhttp.proxyUser=myuser</jvmArg> >>>> >> >> > <jvmArg>-Dhttp.proxyPassword=mypass</jvmArg> >>>> >> >> > >>>> >> >> > Even this : >>>> >> >> > >>>> >> >> > <jvmArg>-Djava.net.useSystemProxies=true</jvmArg> >>>> >> >> > >>>> >> >> > Doesn't work. >>>> >> >> > >>>> >> >> > There is something more to use ? >>>> >> >> > >>>> >> >> > Best. >>>> >> >> > >>>> >> >> > Julien. >>>> >> >> > >>>> >> >> > >>>> >> >> > >>>> >> >> > >>>> >> >> > ------------------------------------------------------------------------------ >>>> >> >> > Introducing AppDynamics Lite, a free troubleshooting tool for >>>> >> >> > Java/.NET >>>> >> >> > Get 100% visibility into your production application - at no >>>> >> >> > cost. >>>> >> >> > Code-level diagnostics for performance bottlenecks with <2% >>>> >> >> > overhead >>>> >> >> > Download for free and get started troubleshooting in minutes. >>>> >> >> > http://p.sf.net/sfu/appdyn_d2d_ap1 >>>> >> >> > _______________________________________________ >>>> >> >> > Dbpedia-discussion mailing list >>>> >> >> > Dbpedia-discussion@lists.sourceforge.net >>>> >> >> > https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion >>>> >> >> > >>>> >> > >>>> >> > >>>> > >>>> > >>> >>> >>
------------------------------------------------------------------------------ Introducing AppDynamics Lite, a free troubleshooting tool for Java/.NET Get 100% visibility into your production application - at no cost. Code-level diagnostics for performance bottlenecks with <2% overhead Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap1 _______________________________________________ Dbpedia-discussion mailing list Dbpedia-discussion@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion
