Re: how to set task number?

2014-05-27 Thread qingyang li
1. On Sun, May 25, 2014 at 5:43 PM, qingyang li liqingyang1...@gmail.com wrote: hi, Mayur, thanks for replying. I know spark application should take all cores by default. My question is how to set task number on each core ? If one silce, one task, how can i set silce file size

Re: how to set task number?

2014-05-25 Thread qingyang li
hi, Mayur, thanks for replying. I know spark application should take all cores by default. My question is how to set task number on each core ? If one silce, one task, how can i set silce file size ? 2014-05-23 16:37 GMT+08:00 Mayur Rustagi mayur.rust...@gmail.com: How many cores do you see

Re: how to set task number?

2014-05-25 Thread Aaron Davidson
application should take all cores by default. My question is how to set task number on each core ? If one silce, one task, how can i set silce file size ? 2014-05-23 16:37 GMT+08:00 Mayur Rustagi mayur.rust...@gmail.com: How many cores do you see on your spark master (8080 port). By default spark

Re: how to set task number?

2014-05-25 Thread qingyang li
, available at port 1. On Sun, May 25, 2014 at 5:43 PM, qingyang li liqingyang1...@gmail.comwrote: hi, Mayur, thanks for replying. I know spark application should take all cores by default. My question is how to set task number on each core ? If one silce, one task, how can i set silce

Re: how to set task number?

2014-05-25 Thread Aaron Davidson
know spark application should take all cores by default. My question is how to set task number on each core ? If one silce, one task, how can i set silce file size ? 2014-05-23 16:37 GMT+08:00 Mayur Rustagi mayur.rust...@gmail.com: How many cores do you see on your spark master (8080 port

Re: how to set task number?

2014-05-25 Thread qingyang li
spark application should take all cores by default. My question is how to set task number on each core ? If one silce, one task, how can i set silce file size ? 2014-05-23 16:37 GMT+08:00 Mayur Rustagi mayur.rust...@gmail.com: How many cores do you see on your spark master (8080 port

Re: how to set task number?

2014-05-25 Thread Aaron Davidson
interface, available at port 1. On Sun, May 25, 2014 at 5:43 PM, qingyang li liqingyang1...@gmail.comwrote: hi, Mayur, thanks for replying. I know spark application should take all cores by default. My question is how to set task number on each core ? If one silce, one task, how can i

Re: how to set task number?

2014-05-25 Thread qingyang li
interface, available at port 1. On Sun, May 25, 2014 at 5:43 PM, qingyang li liqingyang1...@gmail.com wrote: hi, Mayur, thanks for replying. I know spark application should take all cores by default. My question is how to set task number on each core ? If one silce, one task, how can

Re: how to set task number?

2014-05-23 Thread Mayur Rustagi
as storage system and using to shark to query a table which is a bigtable, i have 5 machines as a spark cluster, there are 4 cores on each machine . My question is: 1. how to set task number on each core? 2. where to see how many partitions of one RDD?

how to set task number?

2014-05-22 Thread qingyang li
i am using tachyon as storage system and using to shark to query a table which is a bigtable, i have 5 machines as a spark cluster, there are 4 cores on each machine . My question is: 1. how to set task number on each core? 2. where to see how many partitions of one RDD?

Re: how to set task number?

2014-05-22 Thread qingyang li
cores on each machine . My question is: 1. how to set task number on each core? 2. where to see how many partitions of one RDD?

Re: how to set task number?

2014-05-22 Thread qingyang li
machines as a spark cluster, there are 4 cores on each machine . My question is: 1. how to set task number on each core? 2. where to see how many partitions of one RDD?