Thanks Asim for this suggestion. I wanted to do it but did not have the bandwidth to explore how to do it.. I am new to spark.. I usually do repl-driven dev for local apps... Have you done repl-driven using spark and clojure? do you have pointers as to how to do it.. I can explore if you tell me that there really are no problems in doing that.
Regards, Sunil. On Tue, Nov 3, 2015 at 12:48 AM, Asim Jalis <asimja...@gmail.com> wrote: > Hi Sunil, > > Here is something to think about. Can you use the REPL for your workflow > instead? > > If the changes are all in the Spark driver code you can run the driver > inside the REPL and then test out the changes in the REPL. Once you have > something that works you can save that and deploy an uberjar. > > Deploying an uberjar 4-5 times an hour feels like it goes against the > spirit of Clojure. > > Asim > > On Sun, Nov 1, 2015 at 10:10 PM, Sunil S Nandihalli < > sunil.nandiha...@gmail.com> wrote: > >> Hi Asim, >> I needed to run lein uberjar to submit the jar to run a distributed job >> on a apache-spark cluster. and my uberjar is currently taking anywhere >> from 2 to 4 minutes to finish. I have have had to run uberjar fairly >> frequently during my iterations ( 4 to 5 times in an hour) . I am new to >> spark. So I need to quickly iterate with changes in the code. >> >> Thanks for asking. >> Regards, >> Sunil. >> >> On Mon, Nov 2, 2015 at 6:09 AM, Asim Jalis <asimja...@gmail.com> wrote: >> >>> Hi Sunil, >>> >>> I am wondering why you want to speed up lein uberjar. >>> >>> How frequently do you need to run this? >>> >>> What is your use case and workflow around this? >>> >>> Thanks. >>> >>> Asim >>> >>> On Mon, Oct 26, 2015 at 2:04 AM, Sunil S Nandihalli < >>> sunil.nandiha...@gmail.com> wrote: >>> >>>> Hi Everybody, >>>> My lein uberjar takes about 2 minutes to run. It also recompiles all >>>> the clj files everytime. Is there a way to speedup lein-uberjar .. Or may >>>> be make it incremental? >>>> Thanks, >>>> Sunil. >>>> >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "Clojure" group. >>>> To post to this group, send email to clojure@googlegroups.com >>>> Note that posts from new members are moderated - please be patient with >>>> your first post. >>>> To unsubscribe from this group, send email to >>>> clojure+unsubscr...@googlegroups.com >>>> For more options, visit this group at >>>> http://groups.google.com/group/clojure?hl=en >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "Clojure" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to clojure+unsubscr...@googlegroups.com. >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "Clojure" group. >>> To post to this group, send email to clojure@googlegroups.com >>> Note that posts from new members are moderated - please be patient with >>> your first post. >>> To unsubscribe from this group, send email to >>> clojure+unsubscr...@googlegroups.com >>> For more options, visit this group at >>> http://groups.google.com/group/clojure?hl=en >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "Clojure" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to clojure+unsubscr...@googlegroups.com. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- >> You received this message because you are subscribed to the Google >> Groups "Clojure" group. >> To post to this group, send email to clojure@googlegroups.com >> Note that posts from new members are moderated - please be patient with >> your first post. >> To unsubscribe from this group, send email to >> clojure+unsubscr...@googlegroups.com >> For more options, visit this group at >> http://groups.google.com/group/clojure?hl=en >> --- >> You received this message because you are subscribed to the Google Groups >> "Clojure" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to clojure+unsubscr...@googlegroups.com. >> For more options, visit https://groups.google.com/d/optout. >> > > -- > You received this message because you are subscribed to the Google > Groups "Clojure" group. > To post to this group, send email to clojure@googlegroups.com > Note that posts from new members are moderated - please be patient with > your first post. > To unsubscribe from this group, send email to > clojure+unsubscr...@googlegroups.com > For more options, visit this group at > http://groups.google.com/group/clojure?hl=en > --- > You received this message because you are subscribed to the Google Groups > "Clojure" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to clojure+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to clojure+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
