Re: [tor-dev] Searchable Tor descriptor and Metrics data archive - GSoC 2013

2013-04-11 Thread Karsten Loesing
On 4/10/13 11:44 PM, Praveen Kumar wrote:
 I am Praveen Kumar from India. I want to work on the project Searchable
 Tor descriptor and Metrics data archive. I have participated in the past
 instances of GSoC with Melange and e-cidadania, and have an extensive
 experience in development with Python.
 
 For the search application, I propose using Django with MongoDB as a NoSQL
 database backend for our search application. We have 100GB+ of data which
 eventually grows everyday and so using a NoSQL backend will ensure us that
 our application scales well with the increase in data as well as user
 traffic.
  The application will have various interfaces such as:
 1) Data Updator: This end will connect and retrieve data from the metrics
 website periodically via rsync. It will also be responsible for
 pre-processing the data to a suitable format as our search application
 needs.
 2) Storage End: A relay descriptor can be searched by nickname,
 fingerprint, IP Addr and various other attributes that define a relay
 descriptor. So we can preprocess the whole data, extract the attributes
 that define a descriptor and then save it in an appropriate model MongoDB
 provides. Since queries are very fast in a NoSQL datastore, our searches
 will be very fast.
 3) Search Front End: This will be exposed to the user where a user provides
 its search query to us.
 4) Search query processor: This end will process the query of a user and
 determine its type for eg. whether the query is an IP Address or a nickname
 etc. It will then connect with our Storage End and return the appropriate
 data to the Search Front End.
 
 Above is a very high level view of my approach to this project. We can also
 use Django Haystack as a search application framework(I did some research
 for existing search frameworks). I can implement this app in an object
 oriented way in Python. Python being such a beautiful and easy to
 understand language, it will be easy for others to understand and make
 changes to the application in least amount of time.
 
 I would like to know if I am thinking in the right direction and would like
 to know what Karsten has to say about this.

Hi Praveen!

Glad to see that you're interested in this project!

Your high-level description makes sense to me.  I guess the point where
I'd expect more details in a GSoC application is where you say: Since
queries are very fast in a NoSQL datastore, our searches will be very fast.

See also the last paragraph in the project idea: Applications for this
project should come with a design of the proposed search application,
ideally with a proof-of-concept based on a subset of the available data
to show that it will be able to handle the 100G+ of data.  I'd like to
understand why you think MongoDB will handle searches sufficiently fast.

As an alternative to relying on NoSQL databases doing magic is to
investigate Django Haystack and other existing search application
frameworks.

Note that I don't know what's the best tool or design here.  But I ran
into too many pitfalls in the past when I thought a database design was
fast enough to provide data for an Internet-facing service.  That's why
I'd like to see a convincing design first, bonus points if it comes with
a proof of concept.

Best,
Karsten

___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev


[tor-dev] Fwd: Fwd: Orbot feature for GSoC 2013

2013-04-11 Thread Nathan Freitas
Is there room for an Orbot developer under Tor's GSoC?

I know that I was completely awol during this process, and not a mentor,
but this is a worthwhile effort!


 Original Message 
Subject:Fwd: Orbot feature for GSoC 2013
Date:   Thu, 11 Apr 2013 17:50:26 +0200
From:   Pavlos onexema...@gmail.com
To: nat...@guardianproject.info
CC: a...@guardianproject.info



Hello,

I talked in #tor-dev and asked about a feature I could implement for
Orbot as part of Google summer of code 2013 and abel suggested the
implementation of the android 4.x's VPN Service as a way to get rootless
transparent torification.
I understand this was created
https://github.com/guardianproject/OrbotVPN but for some reason couldn't be
finished? Is it plausible to implement it? If not maybe there is something
else I could make?

Some words about me:
I'm a CS student at my 5th year. I finished with my courses a year ago and
I'm just enrolled because I'm an intern at CERN and have to be a student.
My github is here: https://github.com/uberspot/
I have worked previously on two android apps (OpenWifiStatistics that
coorelates gps with wifi scan data and AnagramSolver for solving anagrams)
and I have another one almost complete (a lan multiplayer trivia game).

Kindly awaiting your responce,
Paul



___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev


Re: [tor-dev] Fwd: Fwd: Orbot feature for GSoC 2013

2013-04-11 Thread Damian Johnson
 Is there room for an Orbot developer under Tor's GSoC?

 I know that I was completely awol during this process, and not a mentor,
but this is a worthwhile effort!

Hi Nathan. Are you offering to mentor this? If so then you're welcome to
apply to be a mentor in melange and review Orbot related applications.
___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev


Re: [tor-dev] Fwd: Fwd: Orbot feature for GSoC 2013

2013-04-11 Thread Nathan Freitas
On 04/11/2013 01:38 PM, Roger Dingledine wrote:
 But as Damian says, if you show up with a worthwhile project, a student,
 and no mentor in mind, this will not end well.

I understand. Good to know the window is still open. I will work with
the student some more to assess their viability. Abel on my team could
be an excellent mentor, with me as a backup, so long as he is planning
to be within range of radio comms this summer.

+n


___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev


[tor-dev] Building Tor on OS X with brew fails

2013-04-11 Thread Bernard Tyers - ei8fdb
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi there,

I just tried building Tor with brew on OS X (10.6.8) using the instructions 
available on the TP website ( ). It fails at the last few steps complaining of 
a 404:

Homebrew. If formula fail to build uninstall Macports/Fink and reinstall any
affected formula.
Also installing dependencies: libevent
== Downloading http://monkey.org/~provos/libevent-2.0.12-stable.tar.gz
 100.0%
== ./configure --prefix=/usr/local/Cellar/libevent/2.0.12
== make install
/usr/local/Cellar/libevent/2.0.12: 47 files, 2.0M, built in 66 seconds
== Downloading https://www.torproject.org/dist/tor-0.2.1.30.tar.gz

curl: (22) The requested URL returned error: 404
Error: Failure while executing: /usr/bin/curl -f#LA Homebrew\ 0.8\ (Ruby\ 
1.8.7-358;\ Mac\ OS\ X\ 10.6.8) 
https://www.torproject.org/dist/tor-0.2.1.30.tar.gz -o 
/Library/Caches/Homebrew/tor-0.2.1.30.tar.gz

I can confirm that https://www.torproject.org/dist/tor-0.2.1.30.tar.gz is (to 
me) a 404.

I know I can install TBB but I was curious if this approach also worked.

Has the location moved? Thanks.

Bernard

- --
Bernard / bluboxthief / ei8fdb

IO91XM / www.ei8fdb.org

-BEGIN PGP SIGNATURE-
Version: GnuPG/MacGPG2 v2.0.17 (Darwin)
Comment: GPGTools - http://gpgtools.org

iQEcBAEBAgAGBQJRZw0rAAoJENsz1IO7MIrrI+oH/jE6hxAeTb9SD3orihGZ0Hn4
wVxf9MkagvH4aS2Hl33FUycr0liy6JqHxxXa16NjZqAfiuUstvQiEiMWAXah1Oa9
A0qNjNOfnmi0BsxJES4E30e3+MvmGzNw4fLjos6iPk2B/+s5orqSv2cba5iVEwXp
3VsqhFOlugVatI592201K9+tQgl/a1aCXfZnW1t4GFqAIf2ApdoX89cV1l3jqMDP
NYOZRaX79FGB7iF+/3SrTKtEwVifjAh/IoCx4cEuVOpGFjFt0Jmkgbd1ThlKYqwn
TYLFUdKWhebl1N9v4fjow0sXrXh71g3oBuavX2XA+YFqG/ChBDSFPKzps2JyWIQ=
=BiEt
-END PGP SIGNATURE-
___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev


Re: [tor-dev] Building Tor on OS X with brew fails

2013-04-11 Thread Nick Mathewson
On Thu, Apr 11, 2013 at 3:21 PM, Bernard Tyers - ei8fdb
ei8...@ei8fdb.org wrote:
 I can confirm that https://www.torproject.org/dist/tor-0.2.1.30.tar.gz is (to 
 me) a 404.

If that's the version in their ports, their ports are horribly out of date.

The latest stable version is 0.2.3.25.  Tor 0.2.1.x is no longer supported.

hope this helps,
-- 
Nick
___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev


Re: [tor-dev] Building Tor on OS X with brew fails

2013-04-11 Thread Bernard Tyers - ei8fdb
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Apologies, I forgot to add the brew instructions link:

https://www.torproject.org/docs/tor-doc-osx.html.en


Bernard

On 11 Apr 2013, at 20:21, Bernard Tyers - ei8fdb wrote:

 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1
 
 Hi there,
 
 I just tried building Tor with brew on OS X (10.6.8) using the instructions 
 available on the TP website ( ). It fails at the last few steps complaining 
 of a 404:
 
 Homebrew. If formula fail to build uninstall Macports/Fink and reinstall any
 affected formula.
 Also installing dependencies: libevent
 == Downloading http://monkey.org/~provos/libevent-2.0.12-stable.tar.gz
  
 100.0%
 == ./configure --prefix=/usr/local/Cellar/libevent/2.0.12
 == make install
 /usr/local/Cellar/libevent/2.0.12: 47 files, 2.0M, built in 66 seconds
 == Downloading https://www.torproject.org/dist/tor-0.2.1.30.tar.gz
 
 curl: (22) The requested URL returned error: 404
 Error: Failure while executing: /usr/bin/curl -f#LA Homebrew\ 0.8\ (Ruby\ 
 1.8.7-358;\ Mac\ OS\ X\ 10.6.8) 
 https://www.torproject.org/dist/tor-0.2.1.30.tar.gz -o 
 /Library/Caches/Homebrew/tor-0.2.1.30.tar.gz
 
 I can confirm that https://www.torproject.org/dist/tor-0.2.1.30.tar.gz is (to 
 me) a 404.
 
 I know I can install TBB but I was curious if this approach also worked.
 
 Has the location moved? Thanks.
 
 Bernard
 
 - --
 Bernard / bluboxthief / ei8fdb
 
 IO91XM / www.ei8fdb.org
 
 -BEGIN PGP SIGNATURE-
 Version: GnuPG/MacGPG2 v2.0.17 (Darwin)
 Comment: GPGTools - http://gpgtools.org
 
 iQEcBAEBAgAGBQJRZw0rAAoJENsz1IO7MIrrI+oH/jE6hxAeTb9SD3orihGZ0Hn4
 wVxf9MkagvH4aS2Hl33FUycr0liy6JqHxxXa16NjZqAfiuUstvQiEiMWAXah1Oa9
 A0qNjNOfnmi0BsxJES4E30e3+MvmGzNw4fLjos6iPk2B/+s5orqSv2cba5iVEwXp
 3VsqhFOlugVatI592201K9+tQgl/a1aCXfZnW1t4GFqAIf2ApdoX89cV1l3jqMDP
 NYOZRaX79FGB7iF+/3SrTKtEwVifjAh/IoCx4cEuVOpGFjFt0Jmkgbd1ThlKYqwn
 TYLFUdKWhebl1N9v4fjow0sXrXh71g3oBuavX2XA+YFqG/ChBDSFPKzps2JyWIQ=
 =BiEt
 -END PGP SIGNATURE-
 ___
 tor-dev mailing list
 tor-dev@lists.torproject.org
 https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev

- --
Bernard / bluboxthief / ei8fdb

IO91XM / www.ei8fdb.org

-BEGIN PGP SIGNATURE-
Version: GnuPG/MacGPG2 v2.0.17 (Darwin)
Comment: GPGTools - http://gpgtools.org

iQEcBAEBAgAGBQJRZw1zAAoJENsz1IO7MIrrCvEH/RYBldDmHhNDUw3KknilGubt
cPqB0O57vua6O4MvPUKvT9ncvNTdn/o2JUisMlELdmLPj7fMcpOVDfGq/GGONtzz
xCCEZcKbue9QklXqOJkVTf8ylao/t9hMjJPeswHinL6cLPZNOyPKWurmgsb39qVW
MbLyY/2SLS7n/ZyiVJeTjs+Dn5KMZHE94XF6kv/pzXI3b+atSIOjIPQJ4qSY5S5O
9XKC1zfND6Oz2pZ6KlHWPSiUZ3EZmREGdFTJdJWUDJPytLJBZi7tE0qzd+gik3nE
WVbiHuSPFqxOccUNljpWDIa8u7MgunMDKdWaw7MZTJjKCF1YrNfQcnMVelYEAhc=
=GO4R
-END PGP SIGNATURE-
___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev


Re: [tor-dev] (Py)Obfsproxy Debian packages

2013-04-11 Thread Peter Palfrader
On Tue, 09 Apr 2013, George Kadianakis wrote:

 weasel, would you do the honors?
 
 I guess what must be done is:
 - Move /obfsproxy.git to /pluggable-transports/obfsproxy-legacy.git .
 - Move /pluggable-transports/pyobfsproxy.git to 
 /pluggable-transports/obfsproxy.git .
 - Add redirects or HTTP 301s to /obfsproxy.git and to 
 /pluggable-transports/pyobfsproxy.git .

Done the first two as discussed on IRC.

-- 
   |  .''`.   ** Debian **
  Peter Palfrader  | : :' :  The  universal
 http://www.palfrader.org/ | `. `'  Operating System
   |   `-http://www.debian.org/
___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev