Perhaps it is an obvious point, but I'll mention that like other Java libraries, it is possible to use libraries from the Java Big Data ecosystem e.g. Spark directly from Clojure using interop, or to consume Clojure code as part of processing infrastructure written in other JVM languages. We've had considerable success using both approaches. The experience with interop has been pretty smooth; the only significant hassles I recall having related to having to write serialization/deserialization logic that we would have gotten out of the box with Java classes and with AOT-compiled code interacting in strange ways with Hadoop's classloading (we never satisfactorily diagnosed this and eventually just stopped using AOT).
On Wednesday, October 18, 2017 at 6:03:11 AM UTC-5, Ray Miller wrote: > > Hi, > > Here at Metail we have been using Clojure for medium-sized data processing > on AWS EMR. We started out with Cascalog about 5 years ago, switched to > Parkour 2 years ago, and are now considering a move to Spark. > > My question is: is Clojure still a good choice for medium/large data > processing on EMR? > > This is partly prompted by the lack of activity on the Github repos. Are > the Parkour, Flambo and Sparkling libraries rock solid, or simply not > getting enough use to trigger bugs and feature requests? > > The #bigdata channel over on Clojurians slack is also suspiciously quiet, > as are many of the Google groups. > > Ray. > -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to clojure+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
