Re: [tor-bugs] #18797 [Metrics/metrics-lib]: create a DescriptorGenerator?

[Tor Bug Tracker & Wiki]

#18797: create a DescriptorGenerator?
-+---
 Reporter:  iwakeh   |  Owner:  karsten
 Type:  enhancement  | Status:  new
 Priority:  Low  |  Milestone:  metrics-lib 2.0.0
Component:  Metrics/metrics-lib  |Version:
 Severity:  Normal   | Resolution:
 Keywords:   |  Actual Points:
Parent ID:   | Points:
 Reviewer:   |Sponsor:
-+---

Comment (by iwakeh):

 While replying to #21934, I had another idea for this ticket:

 We could use a grammar and from that generate a descriptor parser and all
 related code.
 I'm thinking of something like
 [https://github.com/antlr/antlr4/blob/4.7/doc/index.md antlr].

 This might be an interesting project for GSOC 2018.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #18797 [Metrics/metrics-lib]: create a DescriptorGenerator?

[Tor Bug Tracker & Wiki]

#18797: create a DescriptorGenerator?
-+---
 Reporter:  iwakeh   |  Owner:  karsten
 Type:  enhancement  | Status:  new
 Priority:  Low  |  Milestone:  metrics-lib 2.0.0
Component:  Metrics/metrics-lib  |Version:
 Severity:  Normal   | Resolution:
 Keywords:   |  Actual Points:
Parent ID:   | Points:
 Reviewer:   |Sponsor:
-+---

Comment (by karsten):

 Here's a related thread from 1.5 years ago:
 https://lists.torproject.org/pipermail/tor-dev/2015-November/009855.html

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #18797 [Metrics/metrics-lib]: create a DescriptorGenerator?

[Tor Bug Tracker & Wiki]

#18797: create a DescriptorGenerator?
-+---
 Reporter:  iwakeh   |  Owner:  karsten
 Type:  enhancement  | Status:  new
 Priority:  Low  |  Milestone:  metrics-lib 2.0.0
Component:  Metrics/metrics-lib  |Version:
 Severity:  Normal   | Resolution:
 Keywords:   |  Actual Points:
Parent ID:   | Points:
 Reviewer:   |Sponsor:
-+---

Comment (by iwakeh):

 Replying to [comment:6 karsten]:
 > Here's a related thread from 1.5 years ago:
 https://lists.torproject.org/pipermail/tor-dev/2015-November/009855.html

 That's interesting! I didn't see a real showstopper (yet) in the mail
 thread.
 Could you make that grammar available again?
 All those things discussed in the thread should be possible to write into
 grammar, but that's only an opinion as I didn't try this, yet.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #18797 [Metrics/metrics-lib]: create a DescriptorGenerator?

[Tor Bug Tracker & Wiki]

#18797: create a DescriptorGenerator?
-+---
 Reporter:  iwakeh   |  Owner:  karsten
 Type:  enhancement  | Status:  new
 Priority:  Low  |  Milestone:  metrics-lib 2.0.0
Component:  Metrics/metrics-lib  |Version:
 Severity:  Normal   | Resolution:
 Keywords:   |  Actual Points:
Parent ID:   | Points:
 Reviewer:   |Sponsor:
-+---

Comment (by karsten):

 Oh, I didn't realize that the file was not available anymore.  I attached
 it to this ticket, so that it will be archived forever.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #18797 [Metrics/metrics-lib]: create a DescriptorGenerator?

[Tor Bug Tracker & Wiki]

#18797: create a DescriptorGenerator?
-+---
 Reporter:  iwakeh   |  Owner:  karsten
 Type:  enhancement  | Status:  new
 Priority:  Low  |  Milestone:  metrics-lib 2.0.0
Component:  Metrics/metrics-lib  |Version:
 Severity:  Normal   | Resolution:
 Keywords:   |  Actual Points:
Parent ID:   | Points:
 Reviewer:   |Sponsor:
-+---
Changes (by karsten):

 * cc: atagar (added)


Comment:

 I'm copying atagar on this ticket who just recently
 [https://lists.torproject.org/pipermail/tor-dev/2017-May/012237.html added
 the ability for Stem to create descriptors].

 atagar, can you give us some background on why you added this ability now,
 what you expect it will be used for, how much code this adds to the
 overall codebase, etc.?  Like, can you recommend it?  Or do you think it's
 sufficient to have this ability in one Tor descriptor-parsing library and
 not in all of them?  Thanks!

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #18797 [Metrics/metrics-lib]: create a DescriptorGenerator?

[Tor Bug Tracker & Wiki]

#18797: create a DescriptorGenerator?
-+-
 Reporter:  iwakeh   |  Owner:  karsten
 Type:  enhancement  | Status:  new
 Priority:  Low  |  Milestone:
Component:  Metrics/metrics-lib  |Version:
 Severity:  Normal   | Resolution:
 Keywords:   |  Actual Points:
Parent ID:   | Points:
 Reviewer:   |Sponsor:
-+-
Changes (by karsten):

 * milestone:  metrics-lib 2.0.0 =>


Comment:

 This might be too much for version 2.0.0 if we still want to put that out
 before end of June.  Pessimistically removing the milestone for now.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #18797 [Metrics/metrics-lib]: create a DescriptorGenerator?

[Tor Bug Tracker & Wiki]

#18797: create a DescriptorGenerator?
-+-
 Reporter:  iwakeh   |  Owner:  karsten
 Type:  enhancement  | Status:  new
 Priority:  Low  |  Milestone:
Component:  Metrics/metrics-lib  |Version:
 Severity:  Normal   | Resolution:
 Keywords:   |  Actual Points:
Parent ID:   | Points:
 Reviewer:   |Sponsor:
-+-
Changes (by atagar):

 * cc: isis (added)


Comment:

 Hi Karsten - interesting! I didn't realize you were considering this too.
 Adding Isis too since she's interested in this topic as well.

 Descriptor creation has been on my radar for quite a few years (#10227).
 Stem and BridgeDB need it for their unit tests. Stem filled this need with
 test helpers, and Isis did so with her own library called
 [https://pypi.python.org/pypi/leekspin leekspin].

 Descriptor generation fits nicely into Stem's API so I'm adding it now so
 we can deduplicate this effort. So TL;DR is...

 * At present the only use of descriptor generation I'm aware of is
 testing. That said, we might find other uses too.

 * There's two parts to descriptor generation: creating valid descriptors
 and signing it. Stem presently supports the former but not the later
 (however, leekspin can). I'm looking into that next.

 Cheers! -Damian

 PS. Once again kinda sad we keep duplicating each other's efforts. Seems
 like a waist to keep repeating each other's work... :/

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #18797 [Metrics/metrics-lib]: create a DescriptorGenerator?

[Tor Bug Tracker & Wiki]

#18797: create a DescriptorGenerator?
-+-
 Reporter:  iwakeh   |  Owner:  karsten
 Type:  enhancement  | Status:  new
 Priority:  Low  |  Milestone:
Component:  Metrics/metrics-lib  |Version:
 Severity:  Normal   | Resolution:
 Keywords:   |  Actual Points:
Parent ID:   | Points:
 Reviewer:   |Sponsor:
-+-

Comment (by karsten):

 Thanks, atagar, for sharing your experience here!  I have to admit that
 this is not top priority for us at the moment, so we might continue using
 real descriptors or partial descriptor for testing rather than generating
 our own.  But let's keep this ticket open, and if we find out new use
 cases (or a bunch of free development time), we can start hacking on this!

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #18797 [Metrics/metrics-lib]: create a DescriptorGenerator?

[Tor Bug Tracker & Wiki]

#18797: create a DescriptorGenerator?
-+-
 Reporter:  iwakeh   |  Owner:  karsten
 Type:  enhancement  | Status:  new
 Priority:  Low  |  Milestone:
Component:  Metrics/metrics-lib  |Version:
 Severity:  Normal   | Resolution:
 Keywords:   |  Actual Points:
Parent ID:   | Points:
 Reviewer:   |Sponsor:
-+-

Comment (by isis):

 Hey, thanks for getting this conversation started!  Leekspin can do
 signing, but it's a bit out of date in terms of missing some newly-
 introduced fields in descriptors.  Also, leekspin was primarily meant to
 generate bridge descriptors, and then later HS descriptors, to fuzz the
 parsers.

 I'm happy to expand leekspin, or combine it into something else, as long
 as I can still fuzz test BridgeDB's parsers and logic with it.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #18797 [Metrics/metrics-lib]: create a DescriptorGenerator?

[Tor Bug Tracker & Wiki]

#18797: create a DescriptorGenerator?
-+-
 Reporter:  iwakeh   |  Owner:  karsten
 Type:  enhancement  | Status:  new
 Priority:  Low  |  Milestone:
Component:  Metrics/metrics-lib  |Version:
 Severity:  Normal   | Resolution:
 Keywords:   |  Actual Points:
Parent ID:   | Points:
 Reviewer:   |Sponsor:
-+-

Comment (by atagar):

 Thanks Isis! The trixy scheme I planned was to send you a BrideDB patch to
 use Stem's new descriptor creation once it had signing support. That way I
 can make sure the new functions meet your needs as well as mine, and
 adjust them if not.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #18797 [Metrics/metrics-lib]: create a DescriptorGenerator?

[Tor Bug Tracker & Wiki]

#18797: create a DescriptorGenerator?
-+---
 Reporter:  iwakeh   |  Owner:  karsten
 Type:  enhancement  | Status:  new
 Priority:  Low  |  Milestone:  metrics-lib 1.4.0
Component:  Metrics/metrics-lib  |Version:
 Severity:  Normal   | Resolution:
 Keywords:   |  Actual Points:
Parent ID:   | Points:
 Reviewer:   |Sponsor:
-+---

Comment (by iwakeh):

 Ideas for a descriptor generator and maybe the descriptor itself:

 * use reflection to set descriptor values
 * use a key-value approach for setting the descriptor values
 * a combination of the two above; like reading key-value strings and
 setting the appropriate fields by reflection.

 needs more thinking ...

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #18797 [Metrics/metrics-lib]: create a DescriptorGenerator?

[Tor Bug Tracker & Wiki]

#18797: create a DescriptorGenerator?
-+---
 Reporter:  iwakeh   |  Owner:  karsten
 Type:  enhancement  | Status:  new
 Priority:  Low  |  Milestone:  metrics-lib 1.5.0
Component:  Metrics/metrics-lib  |Version:
 Severity:  Normal   | Resolution:
 Keywords:   |  Actual Points:
Parent ID:   | Points:
 Reviewer:   |Sponsor:
-+---

Comment (by CurtisSalazar):

 ==  ==
 The following solution can be: The XML has to be generated easy, utilizing
 the !JavaBean contracts as well as creating an element for each and every
 property that will figure in generator. It is better to build generator on
 Java's reflection mechanisms which is where properties are the only things
 that matter here. Look, I found the code at [http://essaydune.com/ college
 essay writing services] :!

  !
 

 I hope this helps...Let me know if some troubles..

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs