Re: Working with big datasets, merging two ordered lists by key

2014-03-14 Thread Frank Behrens
I am still working on the solution, (see gist ) and want to share my current thoughts. The problem is to process over a join on two big datasets (from different sources). Right now I a quite confident as I break the problem into smaller parts, and I am starting

Get a LAZY list of records from a database query ?

2014-03-14 Thread Frank Behrens
Hi, I wonder if its possible to convert this database query (its CLR) into a lazy sequence. The reader loop is wrapped in the opening and closing of the db-connection and reader. When i 'take a few records from the sequence, will then the connection be closed because it's getting out of scope

Re: Need help understanding a lazy sequence function

2014-03-10 Thread Frank Behrens
Hello, I'm trying to understand the lazyness, how they work, how to create them, how to avoid pre-realisation. Can someone point me to which documentation would be helpful, where do I find it ? Frank Am Montag, 10. März 2014 13:16:00 UTC+1 schrieb Asfand Yar Qazi: > > On Monday, 10 March 2014

Re: Working with big datasets, merging two ordered lists by key

2014-03-10 Thread Frank Behrens
out [fa fb])) (> 0 cmp) (recur (rest a) b (conj out [fa nil])) :else (recur a (rest b) (conj out [nil fb])) Am Montag, 10. März 2014 09:26:14 UTC+1 schrieb Frank Behrens: > > Thanks for your suggestions. > a for loop has to do 100.000 * 300.

Re: Working with big datasets, merging two ordered lists by key

2014-03-10 Thread Frank Behrens
t; > :when (= (first i) (first j))] >> > {(first i) (merge (second i) (second j))}) >> > >> > ({:id1 {:age 38, :name Frank'}} {:id3 {:age 18, :name Tim'}}) ;; result >> > from repl >> > >> > >> > >> > Hth >> &

Working with big datasets, merging two ordered lists by key

2014-03-09 Thread Frank Behrens
Hi, i'm investigating if clojure can be used to solve the challenges and problems we have at my day job better than ruby or powershell. A very common use case is validating data from different systems against some criteria. i believe clojure can be our silver bullet, but before that, it seems

Re: Getting started - overcoming my first obstacles

2014-03-09 Thread Frank Behrens
Dear Florian (or anybody), I really like how your post is so beautifully syntax highlighted. How did you do that ? nice day !, Frank (PS this Frank) -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googl