[osmosis-dev] Support for reading and writing PBF files to/from STDIN, STDOUT, or named pipes.

2011-11-08 Thread Scott Crosby
My fork of osmosis at https://github.com/scrosby/osmosis supports reading and writing PBF files from pipes. You can access this by either using named pipes or by using the magic filename '-' to denote STDIN/STDOUT. Please test this functionality and report any problems. Scott

Re: [osmosis-dev] Cannot represent -1 as a char.

2011-03-08 Thread Scott Crosby
Brett, do you have any advice? In OsmosisBinaryParser, I'm using NOCHANGESET and NOVERSION when there's omitted metadata. Currently both are -1. The bug is because another serializer in osmosis is complaining that the version number is negative. We can set NOVERSION to 0, make that code more robus

Re: [osmosis-dev] Cannot represent -1 as a char.

2011-03-06 Thread Scott Crosby
> > then I get the exception: > > SEVERE: Thread for task 1-read-pbf failed > org.openstreetmap.osmosis.core.OsmosisRuntimeException: Cannot represent -1 > as a char. >    at > org.openstreetmap.osmosis.core.util.IntAsChar.intToChar(IntAsChar.java:35) >    at > org.openstreetmap.osmosis.core.domain

Re: [osmosis-dev] Improving completeWays/completeRelations performance

2011-02-18 Thread Scott Crosby
On Fri, Feb 18, 2011 at 2:57 AM, Frederik Ramm wrote: > Hi, > >   in the long run I'd like to change the Geofabrik extracts so that they > have the completeWays/completeRelations feature enabled. It's a pain because > that totally breaks the elegant and well-performing streaming mode in > Osmosis

Re: [osmosis-dev] osmpbf v1.1.1 jar released. It should fix the PBF-on-windows issues.

2011-01-26 Thread Scott Crosby
On Tue, Jan 25, 2011 at 11:37 PM, Scott Crosby wrote: > Over the last few months, several bugs have been reported where the > pbf reader seems to sometimes not work correctly on Windows. The bug > was caused by a 32-bit cleanness bug in the shared osmpbf library, > where the

[osmosis-dev] osmpbf v1.1.1 jar released. It should fix the PBF-on-windows issues.

2011-01-25 Thread Scott Crosby
Over the last few months, several bugs have been reported where the pbf reader seems to sometimes not work correctly on Windows. The bug was caused by a 32-bit cleanness bug in the shared osmpbf library, where the reader would erroneously sense the end of a file and cease reading. For whatever reas

[osmosis-dev] PBF version 1.1, a PBF conformance file, and changes to Osmosis's PBF support

2011-01-02 Thread Scott Crosby
I am releasing version 1.1 and have just pushed several changes to osmosis trunk. These changes don't effect the format, but may require minor changes to software that uses the *.proto definitions. Although it has been in trunk for a while, this is the first release where the generated C/C++ pr

Re: [osmosis-dev] pbf problems under windows

2010-12-15 Thread Scott Crosby
On Wed, Dec 15, 2010 at 11:10 AM, Chris66 wrote: > Am 15.12.2010 17:56, schrieb Henning Scholland: >> Sorry Scott, but I'm using a 64bit Win with a 64bit java. > > Me too. My test gave same results with 64 and 32 bit java > on my 64 bit win7. Regardless of this, it must be something related to 32

Re: [osmosis-dev] pbf problems under windows

2010-12-15 Thread Scott Crosby
On Wed, Dec 15, 2010 at 10:56 AM, Henning Scholland wrote: > Sorry Scott, but I'm using a 64bit Win with a 64bit java. Also I worked with > pbf-files larger than 5GB (uncompressed europe.pbf for example) in the past > without problems. So I think it isn't a problem of filesize. A 32-bit problem w

Re: [osmosis-dev] pbf problems under windows

2010-12-15 Thread Scott Crosby
On Wed, Dec 15, 2010 at 5:24 AM, Chris66 wrote: > Am 15.12.2010 11:48, schrieb Chris66: > >> Some more tests: >> >> NO effect (same sized output file) have: >> >> java u23 (32 Bit) >> -Xmx1024 setting >> -XX:-ReduceInitialCardMarks (gives 'unknown VM-option' error) >> osmosis V0.37 > > Interesting

Re: [osmosis-dev] pbf problems under windows

2010-12-14 Thread Scott Crosby
On Tue, Dec 14, 2010 at 2:10 AM, aighes wrote: > > Hello, > > I proceed the Geofabrik files of 13.12. > > europe.osm.pbf (Geofabrik): > * MD5: 9D278EE963925ED34701431B8573E0BF > * 4448335290 bytes Just to confirm, this file from geofabrik is broken? > > europe.osm.bz2 (Geofabrik): > * MD5: CD843

Re: [osmosis-dev] pbf problems under windows

2010-12-13 Thread Scott Crosby
On Mon, Dec 13, 2010 at 12:13 PM, Frederik Ramm wrote: > Hi, > > Scott Crosby wrote: >> >> If they do that conversion on windows, does that generate a pbf that >> has the same md5sum as the geofabrik generated file? (And if not, then >> I'd like both of th

Re: [osmosis-dev] pbf problems under windows

2010-12-13 Thread Scott Crosby
On Mon, Dec 13, 2010 at 2:12 AM, Frederik Ramm wrote: > Hi, > >   I have a number of reports where Windows users complain that they cannot > process my (osmosis-generated) .osm.pbf extracts under Windows. For some it > seems to break with country extracts but it seems that everybody has > problems

Re: [osmosis-dev] newbie installation question

2010-12-01 Thread Scott Crosby
On Wed, Dec 1, 2010 at 6:23 AM, Anthony wrote: > On Wed, Dec 1, 2010 at 2:56 AM, Peter Körner wrote: >> Am 01.12.2010 05:36, schrieb Anthony: >>> >>> Is this the right list for a newbie osmosis installation question, or >>> should I use a different list? >> >> Just ask your question, you'll be se

Re: [osmosis-dev] Protobuf OSMHeader format

2010-11-23 Thread Scott Crosby
On Tue, Nov 23, 2010 at 12:09 AM, Rainer Kluge wrote: > Hello, > > While trying to decode PBF files with a Perl script, I encounter problems > with the OSMHeader fileblock. The content of the uncompressed content of the > block is: > > 0a 1a 08 fe e3 86 8a 47 10 80 ae e9 da 4d 18 80 9c f8 eb ea 0

Re: [osmosis-dev] piping pbf

2010-11-09 Thread Scott Crosby
No reason, except that I hadn't written the command line parser to map '-' to System.in Scott ___ osmosis-dev mailing list osmosis-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/osmosis-dev

Re: [osmosis-dev] Setting Up an Eclipse Build-Environment

2010-08-21 Thread Scott Crosby
For when I ported the binary fileformat code to trunk, I configured one eclipse project for each subdirectory. (Well, only three subdirectories as I only needed the XML reader, core, and new binary projects.) It built. To get osmosis to run with the commands offered by the new plugin, I had to ha