Re: [OSM-talk] Geofabrik downloads post-licence-change

2012-04-13 Thread Stefan Keller
Hi,

2012/4/12 Stefan Keller sfkel...@gmail.com:
 Thank you for the answers.
 And many thanks too for all the unique webservices
 and the exceptional work you all are doing in the machinery halls.

 Yours, S.

One question related to this I've always wanted to ask you, is:
When I download the newest daily extract, like e.g.
switzerland.osm.pbf (timestamp usually around 4:00 AM),
and I look inside the db for the most recent added node,
this node has a creation-date of around 7 PM of the day before
(currently node 1711815745 7:10 PM).
How do you explain this delay of around 9 hours (= 7 PM till 4 AM next day)?
Which machinery is it behind which takes around 9 hours to process extracts?

Yours, S.

 2012/4/12 Richard Fairhurst rich...@systemed.net:
 Stefan Keller wrote:
 Am I right that there are currently no updates available since
 April 9th at /osm/ and there doesn't exist the new
 /openstreetmap/ directory neither because we are waiting for
 the OSM board's approval of the new license?

 No, it's nothing to do with OSM(F) board approval. As explained at
 http://blog.osmfoundation.org/2012/04/05/license-change-update-getting-it-right/
 , the coders working on the rebuild code are ironing out a few final issues
 before the process can begin.

 cheers
 Richard



 --
 View this message in context: 
 http://gis.19327.n5.nabble.com/Geofabrik-downloads-post-licence-change-tp5588668p5635061.html
 Sent from the General Discussion mailing list archive at Nabble.com.

 ___
 talk mailing list
 talk@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/talk

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk


Re: [OSM-talk] Geofabrik downloads post-licence-change

2012-04-13 Thread Frederik Ramm

Hi,

On 04/13/12 10:45, Stefan Keller wrote:

One question related to this I've always wanted to ask you, is:
When I download the newest daily extract, like e.g.
switzerland.osm.pbf (timestamp usually around 4:00 AM),
and I look inside the db for the most recent added node,
this node has a creation-date of around 7 PM of the day before
(currently node 1711815745 7:10 PM).


I blogged about this a while ago:
http://blog.geofabrik.de/?p=75

The process has changed a little meanwhile but basically it's still the 
same procedure.


Bye
Frederik

--
Frederik Ramm  ##  eMail frede...@remote.org  ##  N49°00'09 E008°23'33

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk


Re: [OSM-talk] Geofabrik downloads post-licence-change

2012-04-13 Thread Stefan Keller
2012/4/13 Frederik Ramm frede...@remote.org:
 Hi,


 On 04/13/12 10:45, Stefan Keller wrote:

 One question related to this I've always wanted to ask you, is:
 When I download the newest daily extract, like e.g.
 switzerland.osm.pbf (timestamp usually around 4:00 AM),
 and I look inside the db for the most recent added node,
 this node has a creation-date of around 7 PM of the day before
 (currently node 1711815745 7:10 PM).


 I blogged about this a while ago:
 http://blog.geofabrik.de/?p=75

 The process has changed a little meanwhile but basically it's still the same
 procedure.

Yes, I read that with interest.
But there still remain more than 3 hours unexplained.
You wrote there that the machinery at your office starts on 10:30 PM.
But the latest feature added into the extract dates usually 9 PM.

Yours, S.

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk


Re: [OSM-talk] Geofabrik downloads post-licence-change

2012-04-13 Thread Stefan Keller
I wrote:
 You wrote there that the machinery at your office starts on 10:30 PM.
 But the latest feature added into the extract dates usually 9 PM.

Sorry, I meant usually 7 PM not usually 9 PM:

S.

2012/4/13 Stefan Keller sfkel...@gmail.com:
 2012/4/13 Frederik Ramm frede...@remote.org:
 Hi,


 On 04/13/12 10:45, Stefan Keller wrote:

 One question related to this I've always wanted to ask you, is:
 When I download the newest daily extract, like e.g.
 switzerland.osm.pbf (timestamp usually around 4:00 AM),
 and I look inside the db for the most recent added node,
 this node has a creation-date of around 7 PM of the day before
 (currently node 1711815745 7:10 PM).


 I blogged about this a while ago:
 http://blog.geofabrik.de/?p=75

 The process has changed a little meanwhile but basically it's still the same
 procedure.

 Yes, I read that with interest.
 But there still remain more than 3 hours unexplained.
 You wrote there that the machinery at your office starts on 10:30 PM.
 But the latest feature added into the extract dates usually 9 PM.

 Yours, S.

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk


Re: [OSM-talk] Geofabrik downloads post-licence-change

2012-04-13 Thread Frederik Ramm

Hi,

On 04/13/2012 12:18 PM, Stefan Keller wrote:

But there still remain more than 3 hours unexplained.
You wrote there that the machinery at your office starts on 10:30 PM.
But the latest feature added into the extract dates usually 9 PM.


A number of things play into this:

* time at which I start the extract is not always constant, I change 
that from time to time


* the extracts used to be based on hourly diffs not minutelies (but 
currently use minutelies)


* time zone differences

Currently the extract job runs at 21:15 local time which means that all 
changes until approx. 21:15 local (19:15 UTC) should be included, and 
indeed you'll find node #1713202488 is present on the current extract.


Bye
Frederik

--
Frederik Ramm  ##  eMail frede...@remote.org  ##  N49°00'09 E008°23'33

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk


Re: [OSM-talk] Geofabrik downloads post-licence-change

2012-04-13 Thread mick
Frederick I just read your blog and I'm amazed the amount of effort and 
resources that go in to the download country files I have been taking for 
granted.

I feel we all owe you and your's a tremendous vote of thanks.

Mick

On Fri, 13 Apr 2012 10:47:51 +0200
Frederik Ramm frede...@remote.org wrote:

 Hi,
 
 On 04/13/12 10:45, Stefan Keller wrote:
  One question related to this I've always wanted to ask you, is:
  When I download the newest daily extract, like e.g.
  switzerland.osm.pbf (timestamp usually around 4:00 AM),
  and I look inside the db for the most recent added node,
  this node has a creation-date of around 7 PM of the day before
  (currently node 1711815745 7:10 PM).
 
 I blogged about this a while ago:
 http://blog.geofabrik.de/?p=75
 
 The process has changed a little meanwhile but basically it's still the 
 same procedure.
 
 Bye
 Frederik
 
 -- 
 Frederik Ramm  ##  eMail frede...@remote.org  ##  N49°00'09 E008°23'33
 
 ___
 talk mailing list
 talk@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/talk

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk


Re: [OSM-talk] Geofabrik downloads post-licence-change

2012-04-12 Thread Frederik Ramm

Hi,

On 04/12/12 10:02, Stefan Keller wrote:

Am I right that there are currently no updates available since April
9th at /osm/


A hiccup in the rsync process that I fixed this morning; new files will 
be available shortly.



and there doesn't exist the new /openstreetmap/ directory
neither


That's right.

I will probably amend my original plan slightly, adding to /osm (current 
CC-BY-SA data) and /openstreetmap (new ODbL data) a third URL named 
/osm-old or so, where I keep a pre-redaction-bot static CC-BY-SA version 
of everything.


Bye
Frederik

--
Frederik Ramm  ##  eMail frede...@remote.org  ##  N49°00'09 E008°23'33

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk


Re: [OSM-talk] Geofabrik downloads post-licence-change

2012-04-12 Thread Richard Fairhurst
Stefan Keller wrote:
 Am I right that there are currently no updates available since 
 April 9th at /osm/ and there doesn't exist the new 
 /openstreetmap/ directory neither because we are waiting for 
 the OSM board's approval of the new license?

No, it's nothing to do with OSM(F) board approval. As explained at
http://blog.osmfoundation.org/2012/04/05/license-change-update-getting-it-right/
, the coders working on the rebuild code are ironing out a few final issues
before the process can begin.

cheers
Richard



--
View this message in context: 
http://gis.19327.n5.nabble.com/Geofabrik-downloads-post-licence-change-tp5588668p5635061.html
Sent from the General Discussion mailing list archive at Nabble.com.

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk


Re: [OSM-talk] Geofabrik downloads post-licence-change

2012-04-12 Thread Stefan Keller
Thank you for the answers.
And many thanks too for all the unique webservices
and the exceptional work you all are doing in the machinery halls.

Yours, S.

2012/4/12 Richard Fairhurst rich...@systemed.net:
 Stefan Keller wrote:
 Am I right that there are currently no updates available since
 April 9th at /osm/ and there doesn't exist the new
 /openstreetmap/ directory neither because we are waiting for
 the OSM board's approval of the new license?

 No, it's nothing to do with OSM(F) board approval. As explained at
 http://blog.osmfoundation.org/2012/04/05/license-change-update-getting-it-right/
 , the coders working on the rebuild code are ironing out a few final issues
 before the process can begin.

 cheers
 Richard



 --
 View this message in context: 
 http://gis.19327.n5.nabble.com/Geofabrik-downloads-post-licence-change-tp5588668p5635061.html
 Sent from the General Discussion mailing list archive at Nabble.com.

 ___
 talk mailing list
 talk@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/talk

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk