Using YARN w/o HDFS

2017-06-21 Thread Alaa Zubaidi (PDF)
Hi, Can we run Spark on YARN with out installing HDFS? If yes, where would HADOOP_CONF_DIR point to? Regards, -- *This message may contain confidential and privileged information. If it has been sent to you in error, please reply to advise the sender of the error and then immediately

Spark partitions from CassandraRDD

2015-09-03 Thread Alaa Zubaidi (PDF)
Hi, I testing Spark and Cassandra, Spark 1.4, Cassandra 2.1.7 cassandra spark connector 1.4, running in standalone mode. I am getting 4000 rows from Cassandra (4mb row), where the row keys are random. .. sc.cassandraTable[RES](keyspace,res_name).where(res_where).cache I am expecting that it

Re: Spark partitions from CassandraRDD

2015-09-03 Thread Alaa Zubaidi (PDF)
> > Partition when using CassandraRDD depends on your partition key in > Cassandra table. > > If you see only 1 partition in the RDD it means all the rows you have > selected have same partition_key in C* > > Thanks > Ankur > > > On Thu, Sep 3, 2015 at 11:54 AM, Ala