registerTempTable is not a member of RDD on spark 1.2?

2015-03-23 Thread IT CTO
Hi, I am running spark when I use sc.version I get 1.2 but when I call registerTempTable(MyTable) I get error saying registedTempTable is not a member of RDD Why? -- Eran | CTO

Re: registerTempTable is not a member of RDD on spark 1.2?

2015-03-23 Thread IT CTO
: Programming Scala, 2nd Edition http://shop.oreilly.com/product/0636920033073.do (O'Reilly) Typesafe http://typesafe.com @deanwampler http://twitter.com/deanwampler http://polyglotprogramming.com On Mon, Mar 23, 2015 at 5:25 AM, IT CTO goi@gmail.com wrote: Hi, I am running spark when I

Re: Running Spark on a single machine

2014-03-17 Thread goi cto
, Mar 16, 2014 at 11:39 PM, goi cto goi@gmail.com wrote: Hi, I know it is probably not the purpose of spark but the syntax is easy and cool... I need to run some spark like code in memory on a single machine any pointers how to optimize it to run only on one machine? -- Eran | CTO

Running Spark on a single machine

2014-03-16 Thread goi cto
Hi, I know it is probably not the purpose of spark but the syntax is easy and cool... I need to run some spark like code in memory on a single machine any pointers how to optimize it to run only on one machine? -- Eran | CTO

How to work with ReduceByKey?

2014-03-13 Thread goi cto
ArrayListListString(2); combinedList.add(i1._2); combinedList.add(i2._2); return new Tuple2(count,combinedList); } any solution for that? -- Eran | CTO

Re: Problem with delete spark temp dir on spark 0.8.1

2014-03-04 Thread goi cto
. Eran On Tue, Mar 4, 2014 at 11:36 AM, Akhil Das ak...@mobipulse.in wrote: Hi, Try to clean your temp dir, System.getProperty(java.io.tmpdir) Also, Can you paste a longer stacktrace? Thanks Best Regards On Tue, Mar 4, 2014 at 2:55 PM, goi cto goi@gmail.com wrote: Hi, I am

Beginners Hadoop question

2014-03-03 Thread goi cto
) if we are using smaller files, how does my code needs to change to process all of the input files? Will Hadoop just copy the files to different servers or will it also split their content among servers? Any example will be great! -- Eran | CTO