Re: Tools comparable to Luigi for Clojure or the JVM?

If it's hadoop, I would take a look at either cascalog or pigpen On Thursday, September 17, 2015 at 4:17:13 AM UTC+1, Christopher Small wrote: > > Check out prismatic's plumbing. Its a reall y lovely tool that among other > things

Tools comparable to Luigi for Clojure or the JVM?

Hi, I’m working on a project at work for which we’re currently considering a Python tool built by Spotify called Luigi[1]. Luigi is a tool for building data processing pipelines (hence the name). It’s capable of connecting to various processors such as Hadoop and is limited in scope to

Re: Tools comparable to Luigi for Clojure or the JVM?

Drake is similar to what you want and it is written in Clojure: https://github.com/Factual/drake -Ben On 9/16/15 12:12 PM, Max Countryman wrote: Hi, I’m working on a project at work for which we’re currently considering a Python tool built by Spotify called Luigi[1]. Luigi is a tool for

Tools comparable to Luigi for Clojure or the JVM?

Check out prismatic's plumbing. Its a reall y lovely tool that among other things let's you create directed graph structures representing computational pipelines, and then compile them into callable functions. It's has different compilers for profiling, lazy evaluation, parallelized computation