I've dealt with the likes of that before. Illl be atvkeynoard this evening and take a look On Tue, Feb 28, 2017 at 2:22 PM Ian Young <i...@iangreenleaf.com> wrote:
> Yikes, is that one giant unterminated array? I feel like you're not going > to be able to parse that with most JSON tools because until the end > arrives, it's not really valid JSON. > > A lot of streaming libraries let you set a callback that responds to a > "chunk" of input after it has read a certain number of bytes on the > request, but it'll be tough to deal with if there's (likely) no guarantee > that the chunks line up to record boundaries. Maybe you can keep a buffer > of what you've received so far and pull as many valid hash objects off the > string as you can, and leave the rest to prepend to the next chunk. > > Good luck! 🙂 > > > On Tue, Feb 28, 2017, at 04:15 PM, Chris McCann wrote: > > I'm looking into processing a stream of aircraft position data provided > here: > > http://pub-vrs.adsbexchange.com:32005 > > This effectively returns a JSON array of data structures with > aircraft-reported information including latitude and longitude > positioning. There are typically about 6000-7000 "records" provided every > 5 seconds. > > How does one parse a stream like this? You can *curl *that endpoint and > see the data, I just can't sort out how to process each record into a JSON > object to then do other stuff with. > > I've tried Ruby, Python, and Elixir but haven't come up with a solution > yet. Anyone out there have experience parsing a stream like this? > > Cheers, > > Chris > > > -- > -- > SD Ruby mailing list > sdruby@googlegroups.com > http://groups.google.com/group/sdruby > --- > You received this message because you are subscribed to the Google Groups > "SD Ruby" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to sdruby+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > > > -- > -- > SD Ruby mailing list > sdruby@googlegroups.com > http://groups.google.com/group/sdruby > --- > You received this message because you are subscribed to the Google Groups > "SD Ruby" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to sdruby+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- Peter Fitzgibbons (224) 307-9689 -- -- SD Ruby mailing list sdruby@googlegroups.com http://groups.google.com/group/sdruby --- You received this message because you are subscribed to the Google Groups "SD Ruby" group. To unsubscribe from this group and stop receiving emails from it, send an email to sdruby+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
