Re: [tor-bugs] #24217 [Metrics/Statistics]: Specify data format and aggregation process of new IPv6 relay statistics

[Tor Bug Tracker & Wiki]

#24217: Specify data format and aggregation process of new IPv6 relay statistics
+--
 Reporter:  karsten |  Owner:  karsten
 Type:  enhancement | Status:  needs_review
 Priority:  High|  Milestone:
Component:  Metrics/Statistics  |Version:
 Severity:  Normal  | Resolution:
 Keywords:  |  Actual Points:
Parent ID:  | Points:
 Reviewer:  iwakeh  |Sponsor:
+--

Comment (by karsten):

 Quick update: we moved to storm, and I added more content. Then I realized
 that the shortcuts should better be written in code and wrote the
 "download data as CSV" feature that is now deployed on all graph pages on
 Tor Metrics. Next step will be to add more content for the complete
 journeys. There's not much to see yet for that part.

 I wonder if we should generalize the scope of this ticket. We're writing
 documentation for all data available on Tor Metrics, not just IPv6 relay
 statistics. But we can change the summary when we move forward here.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24217 [Metrics/Statistics]: Specify data format and aggregation process of new IPv6 relay statistics

[Tor Bug Tracker & Wiki]

#24217: Specify data format and aggregation process of new IPv6 relay statistics
+--
 Reporter:  karsten |  Owner:  karsten
 Type:  enhancement | Status:  needs_review
 Priority:  High|  Milestone:
Component:  Metrics/Statistics  |Version:
 Severity:  Normal  | Resolution:
 Keywords:  |  Actual Points:
Parent ID:  | Points:
 Reviewer:  iwakeh  |Sponsor:
+--

Comment (by karsten):

 Okay, let's move to a storm-etherpad. Or maybe a storm-markdown-thing. In
 any case a storm-something.

 Regarding shortcuts vs. complete journeys, I agree that we should ask
 reviewers what they'd find most useful. Another aspect that we're not
 covering very well yet is background. The current description says what
 we're doing, but not why. I could imagine that some questions are left
 unanswered by the current format.

 I want to move forward here. I'll copy over what we have on the Google Doc
 to storm, and then I'll add more content. If you have ideas what
 specifically I should be adding next, just let me know.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24217 [Metrics/Statistics]: Specify data format and aggregation process of new IPv6 relay statistics

[Tor Bug Tracker & Wiki]

#24217: Specify data format and aggregation process of new IPv6 relay statistics
+--
 Reporter:  karsten |  Owner:  karsten
 Type:  enhancement | Status:  needs_review
 Priority:  High|  Milestone:
Component:  Metrics/Statistics  |Version:
 Severity:  Normal  | Resolution:
 Keywords:  |  Actual Points:
Parent ID:  | Points:
 Reviewer:  iwakeh  |Sponsor:
+--

Comment (by iwakeh):

 I did comment and resolved comments that seemed to be agreement to reduce
 some clutter there.
 From one comment:
I think a storm-etherpad is best:
   1. our potential reviewers know how to handle it;
   2. the access can be fine grained;
   3. it has comments that allow providing replacement suggestions;
   4. it clearly marks the author; 5. login doesn't require some 'weird'
 accounts;
   6. the final product can be exported to Markdown and other formats, and
   7. last but not least, it is on Tor infrastructure.

 I can help moving there before the first language reviewer works with the
 doc.

 Another topic that needs more discussion outside of tiny comment-boxes:
   Another viewpoint derived from the discussion here:
   I think all 'shortcuts' should be actually a tutorial collection. "Hands
 on" data processing.
   The 'complete journey' is the 'How Metrics processes the data'.  In
 different sections only with cross-references.

 Maybe, we should just list the options we have so far and let the
 reviewers help.  They might even come up with some totally different neat
 idea here.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24217 [Metrics/Statistics]: Specify data format and aggregation process of new IPv6 relay statistics

[Tor Bug Tracker & Wiki]

#24217: Specify data format and aggregation process of new IPv6 relay statistics
+--
 Reporter:  karsten |  Owner:  karsten
 Type:  enhancement | Status:  needs_review
 Priority:  High|  Milestone:
Component:  Metrics/Statistics  |Version:
 Severity:  Normal  | Resolution:
 Keywords:  |  Actual Points:
Parent ID:  | Points:
 Reviewer:  iwakeh  |Sponsor:
+--

Comment (by karsten):

 I commented on the Google Doc. Do you receive notifications for that?

 Independent of these discussions, do you mind if I publish a PDF of the
 state by end of day to metrics-team@, so that we have something to
 reference in the January report for Sponsor 13?

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24217 [Metrics/Statistics]: Specify data format and aggregation process of new IPv6 relay statistics

[Tor Bug Tracker & Wiki]

#24217: Specify data format and aggregation process of new IPv6 relay statistics
+--
 Reporter:  karsten |  Owner:  karsten
 Type:  enhancement | Status:  needs_review
 Priority:  High|  Milestone:
Component:  Metrics/Statistics  |Version:
 Severity:  Normal  | Resolution:
 Keywords:  |  Actual Points:
Parent ID:  | Points:
 Reviewer:  iwakeh  |Sponsor:
+--

Comment (by iwakeh):

 Replying to [comment:9 karsten]:
 > Thanks for the quick feedback!
 >
 > I figured it's going to be much easier to discuss this content when it's
 on a Google Doc and not in Git, especially when we want to ask folks like
 t0mmy or our target audience to help us with comments, edits, or
 suggestions.

 Hmm, I added as first next step (there too):
   Agree on a format: the G-doc is very cumbersome to edit Let’s use
 a common format like LaTeX, Markdown, whatever.  Especially, if we want
 reviewers to comment rather than edit (as suggested below).  The more
 common formats will also be easier to transform and we should keep the git
 versioning.

 When we want comments and edits in the doc let's stay with markdown.
 Keeping git I find essential.  The editors/commenters don't need to use
 it, but it will be easier for us to keep track of versions.

 The shortcut/complete discussion should be resolved, too. (I commented in
 the G-doc)

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24217 [Metrics/Statistics]: Specify data format and aggregation process of new IPv6 relay statistics

[Tor Bug Tracker & Wiki]

#24217: Specify data format and aggregation process of new IPv6 relay statistics
+--
 Reporter:  karsten |  Owner:  karsten
 Type:  enhancement | Status:  needs_review
 Priority:  High|  Milestone:
Component:  Metrics/Statistics  |Version:
 Severity:  Normal  | Resolution:
 Keywords:  |  Actual Points:
Parent ID:  | Points:
 Reviewer:  iwakeh  |Sponsor:
+--

Comment (by iwakeh):

 Replying to [comment:9 karsten]:
 > Thanks for the quick feedback!
 >
 > I figured it's going to be much easier to discuss this content when it's
 on a Google Doc and not in Git, especially when we want to ask folks like
 t0mmy or our target audience to help us with comments, edits, or
 suggestions.
 >
 > I put everything in the following Google Doc, including your comments
 and my comments to yours:
 >
 > https://docs.google.com/document/d/19A98ymeidOcmHKl-
 3OUXkM8ZC7_VuooPTEZSW8DV7SI/edit?usp=sharing
 >

 Taking a look.  (Weird, I just checked my inbox and the last mail I
 received about this from from comment 3 ???)
 > Please take another look. There are some suggested next steps at the
 end. Thanks!

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24217 [Metrics/Statistics]: Specify data format and aggregation process of new IPv6 relay statistics

[Tor Bug Tracker & Wiki]

#24217: Specify data format and aggregation process of new IPv6 relay statistics
+--
 Reporter:  karsten |  Owner:  karsten
 Type:  enhancement | Status:  needs_review
 Priority:  High|  Milestone:
Component:  Metrics/Statistics  |Version:
 Severity:  Normal  | Resolution:
 Keywords:  |  Actual Points:
Parent ID:  | Points:
 Reviewer:  iwakeh  |Sponsor:
+--

Comment (by karsten):

 Thanks for the quick feedback!

 I figured it's going to be much easier to discuss this content when it's
 on a Google Doc and not in Git, especially when we want to ask folks like
 t0mmy or our target audience to help us with comments, edits, or
 suggestions.

 I put everything in the following Google Doc, including your comments and
 my comments to yours:

 https://docs.google.com/document/d/19A98ymeidOcmHKl-
 3OUXkM8ZC7_VuooPTEZSW8DV7SI/edit?usp=sharing

 Please take another look. There are some suggested next steps at the end.
 Thanks!

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24217 [Metrics/Statistics]: Specify data format and aggregation process of new IPv6 relay statistics

[Tor Bug Tracker & Wiki]

#24217: Specify data format and aggregation process of new IPv6 relay statistics
+--
 Reporter:  karsten |  Owner:  karsten
 Type:  enhancement | Status:  needs_review
 Priority:  High|  Milestone:
Component:  Metrics/Statistics  |Version:
 Severity:  Normal  | Resolution:
 Keywords:  |  Actual Points:
Parent ID:  | Points:
 Reviewer:  iwakeh  |Sponsor:
+--

Comment (by iwakeh):

 Please find two commits on [https://gitweb.torproject.org/user/iwakeh
 /metrics-web.git/log/?h=task-24217 my branch].

 Thanks for supplying the script!  I converted it to an Ant task and will
 create a new ticket for other scripts in this product.  Aiming at having
 all build steps in build.xml, no matter what final format we use the ant
 task should be adapted.

 Usage: `ant generate-reproducible-spec`  File will be in `.generated/spec
 /reproducible-metrics.html`

 The second commit adds comments and ideas to the spec file.  I'll add some
 questions to our meeting agenda too.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24217 [Metrics/Statistics]: Specify data format and aggregation process of new IPv6 relay statistics

[Tor Bug Tracker & Wiki]

#24217: Specify data format and aggregation process of new IPv6 relay statistics
+--
 Reporter:  karsten |  Owner:  karsten
 Type:  enhancement | Status:  needs_review
 Priority:  High|  Milestone:
Component:  Metrics/Statistics  |Version:
 Severity:  Normal  | Resolution:
 Keywords:  |  Actual Points:
Parent ID:  | Points:
 Reviewer:  iwakeh  |Sponsor:
+--

Comment (by karsten):

 Thanks, iwakeh!

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24217 [Metrics/Statistics]: Specify data format and aggregation process of new IPv6 relay statistics

[Tor Bug Tracker & Wiki]

#24217: Specify data format and aggregation process of new IPv6 relay statistics
+--
 Reporter:  karsten |  Owner:  karsten
 Type:  enhancement | Status:  needs_review
 Priority:  High|  Milestone:
Component:  Metrics/Statistics  |Version:
 Severity:  Normal  | Resolution:
 Keywords:  |  Actual Points:
Parent ID:  | Points:
 Reviewer:  iwakeh  |Sponsor:
+--
Changes (by iwakeh):

 * reviewer:   => iwakeh


Comment:

 Cool!
 Adding myself to the reviewer field for reference (and assuming that other
 can add their username there, too).
 Trying to get a first feedback done before tomorrows team-meeting.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24217 [Metrics/Statistics]: Specify data format and aggregation process of new IPv6 relay statistics

[Tor Bug Tracker & Wiki]

#24217: Specify data format and aggregation process of new IPv6 relay statistics
+--
 Reporter:  karsten |  Owner:  karsten
 Type:  enhancement | Status:  accepted
 Priority:  High|  Milestone:
Component:  Metrics/Statistics  |Version:
 Severity:  Normal  | Resolution:
 Keywords:  |  Actual Points:
Parent ID:  | Points:
 Reviewer:  |Sponsor:
+--
Changes (by karsten):

 * status:  needs_review => accepted
 * owner:  metrics-team => karsten


Comment:

 I guess I should accept the ticket, as I'll likely going to be working on
 it over the next week.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24217 [Metrics/Statistics]: Specify data format and aggregation process of new IPv6 relay statistics

[Tor Bug Tracker & Wiki]

#24217: Specify data format and aggregation process of new IPv6 relay statistics
+--
 Reporter:  karsten |  Owner:  karsten
 Type:  enhancement | Status:  needs_review
 Priority:  High|  Milestone:
Component:  Metrics/Statistics  |Version:
 Severity:  Normal  | Resolution:
 Keywords:  |  Actual Points:
Parent ID:  | Points:
 Reviewer:  |Sponsor:
+--
Changes (by karsten):

 * status:  accepted => needs_review


--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24217 [Metrics/Statistics]: Specify data format and aggregation process of new IPv6 relay statistics

[Tor Bug Tracker & Wiki]

#24217: Specify data format and aggregation process of new IPv6 relay statistics
+--
 Reporter:  karsten |  Owner:  metrics-team
 Type:  enhancement | Status:  needs_review
 Priority:  High|  Milestone:
Component:  Metrics/Statistics  |Version:
 Severity:  Normal  | Resolution:
 Keywords:  |  Actual Points:
Parent ID:  | Points:
 Reviewer:  |Sponsor:
+--
Changes (by karsten):

 * status:  new => needs_review
 * priority:  Medium => High


Comment:

 I made a start here by writing a draft for graphs in the Servers section
 of Tor Metrics. I did not bother with format and simply picked `.md` for
 now, with a script to convert that to `.html` for easier reading.

 I also came up with a different content structure, based on thinking a bit
 more about what would be doable and what would actually help the intended
 audience. It's supposed to be a start, with a lot of room left for future
 improvement. Don't be shy, I'm open to suggestions.

 Please review this [https://people.torproject.org/~karsten/volatile
 /reproducible-metrics.html first draft]. The source `.md` file is
 available for download [https://people.torproject.org/~karsten/volatile
 /reproducible-metrics.md here] and under version control
 [https://gitweb.torproject.org/karsten/metrics-web.git/log/?h=task-24217
 in my metrics-web task-24217 branch].

 Setting priority to high, because we'd ideally publish a draft of this by
 the end of the month to show that we're making real progress on this
 sponsor deliverable.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24217 [Metrics/Statistics]: Specify data format and aggregation process of new IPv6 relay statistics

[Tor Bug Tracker & Wiki]

#24217: Specify data format and aggregation process of new IPv6 relay statistics
+--
 Reporter:  karsten |  Owner:  metrics-team
 Type:  enhancement | Status:  new
 Priority:  Medium  |  Milestone:
Component:  Metrics/Statistics  |Version:
 Severity:  Normal  | Resolution:
 Keywords:  |  Actual Points:
Parent ID:  | Points:
 Reviewer:  |Sponsor:
+--

Comment (by iwakeh):

 See #24218 ([https://trac.torproject.org/projects/tor/raw-
 attachment/ticket/24218/data-spec-template.pdf attachment]) for a first
 content structure.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #24217 [Metrics/Statistics]: Specify data format and aggregation process of new IPv6 relay statistics

[Tor Bug Tracker & Wiki]

#24217: Specify data format and aggregation process of new IPv6 relay statistics
+--
 Reporter:  karsten |  Owner:  metrics-team
 Type:  enhancement | Status:  new
 Priority:  Medium  |  Milestone:
Component:  Metrics/Statistics  |Version:
 Severity:  Normal  | Resolution:
 Keywords:  |  Actual Points:
Parent ID:  | Points:
 Reviewer:  |Sponsor:
+--

Comment (by karsten):

 Including notes from yesterday's team meeting:

  - it might make sense to write the specification based on the prototype
 and comments and fresh memory of why decisions are made
  - still need to decide on the format (txt, latex, html, xml) and maybe
 prototype html export

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

[tor-bugs] #24217 [Metrics/Statistics]: Specify data format and aggregation process of new IPv6 relay statistics

[Tor Bug Tracker & Wiki]

#24217: Specify data format and aggregation process of new IPv6 relay statistics
+--
 Reporter:  karsten |  Owner:  metrics-team
 Type:  enhancement | Status:  new
 Priority:  Medium  |  Milestone:
Component:  Metrics/Statistics  |Version:
 Severity:  Normal  |   Keywords:
Actual Points:  |  Parent ID:
   Points:  |   Reviewer:
  Sponsor:  |
+--
 As soon as we know what graphs we should make for #23761, we'll have to 1)
 specify the data format of the CSV file we need to produce for that.

 And for Sponsor 13 we'll need to 2) specify the aggregation process, which
 will enable others to reproduce our results.

 I'll start with 1) as soon as we have green light from #23761, but I'd
 appreciate help with 2).

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs