Re: A large Clojure deployment

2009-04-08 Thread dysinger
We have several TB of indexes w/ literally billions of documents and will be using clojure w/ hadoop soon. I appreciate the hadoop mapr job examples in clojure. This is great stuff. On Apr 7, 6:24 am, Stuart Sierra wrote: > Hi Sean, > > It's deployed on an Ubuntu server on Amazon EC2.  Just on

Re: A large Clojure deployment

2009-04-08 Thread Luc Prefontaine
Yep, looks like we where the first of hopefully many production implementations... It's quite funny, we are expanding the bus logic presently and without Clojure, I wonder how much effort and Java code it would have required us. We store rules in a database (hey Stuart, we really need one !:))),

Re: A large Clojure deployment

2009-04-08 Thread Abhishek Reddy
On 4/8/09, Baishampayan Ghose wrote: > > Excuse my ignorance, but which one is the first famous Clojure app? > That could be a reference to Luc Prefontaine's veterinarian hospital application. It got some press at InfoQ: http://www.infoq.com/news/2009/01/clojure_production -- Abhishek Reddy h

Re: A large Clojure deployment

2009-04-08 Thread Baishampayan Ghose
>> It's deployed on an Ubuntu server on Amazon EC2.  Just one server for >> now, but designed to scale to more.  No RDBMS! >> > > Awesome, Congratulations. I was hoping to be the 2nd "famous" Clojure > app, but it looks you beat me to it. :-) Excuse my ignorance, but which one is the first famous

Re: A large Clojure deployment

2009-04-07 Thread Stuart Sierra
There isn't an RDBMS mostly because I have an irrational prejudice against them. In this case, the content is mostly static. The Hadoop jobs process collection of source documents -- a few dozen GB, a big ol' mess of PDF, XML, JSON, even WordPerfect! -- and, many hours later, output two things:

Re: A large Clojure deployment

2009-04-07 Thread Allen Rohner
> It's deployed on an Ubuntu server on Amazon EC2.  Just one server for > now, but designed to scale to more.  No RDBMS! > Awesome, Congratulations. I was hoping to be the 2nd "famous" Clojure app, but it looks you beat me to it. :-) Can you go into detail about what/how you are persisting sinc

Re: A large Clojure deployment

2009-04-07 Thread Stuart Sierra
The java files were just stuff I'd already written in Java that I didn't feel like rewriting. -Stuart On Apr 7, 12:35 pm, Laurent PETIT wrote: > Waooh, congrats ! > > Surely an important step towards demonstrated to our employers the power and > presence of clojure ! > > Could you elaborate on

Re: A large Clojure deployment

2009-04-07 Thread Laurent PETIT
Waooh, congrats ! Surely an important step towards demonstrated to our employers the power and presence of clojure ! Could you elaborate on the rationale behind using java or clojure files ? In particular, was it more due to a (some) limitation(s) in the current abilities to generate java from cl

Re: A large Clojure deployment

2009-04-07 Thread Stuart Sierra
Hi Sean, It's deployed on an Ubuntu server on Amazon EC2. Just one server for now, but designed to scale to more. No RDBMS! I'm not using any Amazon services besides EC2 and S3, but I'm looking at SQS and SimpleDB. Deployment was pretty easy; my only problems have been non-Clojure- related.

Re: A large Clojure deployment

2009-04-07 Thread Michael Wood
On Tue, Apr 7, 2009 at 5:40 PM, David Nolen wrote: > Congrats! > Perhaps soon there should be a Projects Using Clojure section on the main > site? > Good way to get the word out that people are using Clojure in the "real > world" Sounds like a good idea to me. Maybe a "Powered by Clojure" logo

Re: A large Clojure deployment

2009-04-07 Thread David Nolen
Congrats! Perhaps soon there should be a Projects Using Clojure section on the main site? Good way to get the word out that people are using Clojure in the "real world" David On Tue, Apr 7, 2009 at 10:47 AM, Sean wrote: > > Okay wow... it'll take some time to fully appreciate this. > > Can yo

Re: A large Clojure deployment

2009-04-07 Thread Sean
Okay wow... it'll take some time to fully appreciate this. Can you comment on your hardware stack? How many servers are you using? Is there an RDBMS in there somewhere? How was deployment? Looks awesome, thanks for sharing! On Apr 7, 10:41 am, Stuart Sierra wrote: > Here: http://www.altla

A large Clojure deployment

2009-04-07 Thread Stuart Sierra
Here: http://www.altlaw.org/ About 4000 lines of Clojure code, 2500 of Java, powering a web site with well over a million pages, averaging around 10,000 visitors a day. Some of what I'm using: Restlet StringTemplate Solr Hadoop Apache Java Commons markdownj cpdetector JRuby Most of the code is