Real time incremental Update to Spark Graphs.

2017-04-19 Thread Siddharth Ubale
results from it. Kindly do let me know if this is possible. Thanks, Siddharth Ubale,

RE: Container exited with a non-zero exit code 1-SparkJOb on YARN

2016-01-21 Thread Siddharth Ubale
thing that whenever yarn allocates containers on the machine from where I am running the code the spark job runs else It always fails. Thanks, Siddharth Ubale -Original Message- From: Wellington Chevreuil [mailto:wellington.chevre...@gmail.com] Sent: Thursday, January 21, 2016 3:44 PM

Container exited with a non-zero exit code 1-SparkJOb on YARN

2016-01-20 Thread Siddharth Ubale
the above 2 issues. Thanks, Siddharth Ubale,

Container exited with a non-zero exit code 1-SparkJOb on YARN

2016-01-20 Thread Siddharth Ubale
the above 2 issues. Thanks, Siddharth Ubale,

RE: Spark App -Yarn-Cluster-Mode ===> Hadoop_conf_**.zip file.

2016-01-18 Thread Siddharth Ubale
guide me . I am submitting a Spark Streaming job whjic is reading from a Kafka topic and dumoing data in to hbase tables via Phoenix API. The job is behaving as expected in local mode. Thanks Siddharth Ubale From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Friday, January 15, 2016 8:08 PM

Spark App -Yarn-Cluster-Mode ===> Hadoop_conf_**.zip file.

2016-01-15 Thread Siddharth Ubale
.scala:111) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 16/01/15 19:23:53 INFO Utils: Shutdown hook called 16/01/15 19:23:53 INFO Utils: Deleting directory /tmp/spark-b6ebcb83-efff-432a-9a7a-b4764f482d81 java.lang.UNIXProcess$ProcessPipeOutputStream@7a0a6f73 1 Siddharth Ubale, Synchronized Communic

RE: Spark App -Yarn-Cluster-Mode ===> Hadoop_conf_**.zip file.

2016-01-15 Thread Siddharth Ubale
) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:483) Thanks, Siddharth From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Friday, January 15, 2016 7:43 PM To: Siddharth Ubale <siddharth

Re: real time Query engine Spark-SQL on Hbase

2015-05-02 Thread Siddharth Ubale
this. Thanks, Siddharth From: ayan guha guha.a...@gmail.com Sent: 01 May 2015 04:38 To: Ted Yu Cc: user@spark.apache.org; Siddharth Ubale; matei.zaha...@gmail.com; Prakash Hosalli; Amit Kumar Subject: Re: real time Query engine Spark-SQL on Hbase And if I may ask

real time Query engine Spark-SQL on Hbase

2015-04-30 Thread Siddharth Ubale
, Siddharth Ubale,

RDD generated on every query

2015-04-06 Thread Siddharth Ubale
Hi , In Spark Web Application the RDD is generating every time client is sending a query request. Is there any way where the RDD is compiled once and run query again and again on active SparkContext? Thanks, Siddharth Ubale, Synchronized Communications #43, Velankani Tech Park, Block No. II

Spark Performance -Hive or Hbase?

2015-03-25 Thread Siddharth Ubale
applied? Or every time while running the query we have to perform RDD Mapping and Apply schema? In this case I am using hbase tables to map the RDD. 2. Spark-SQL provides better performance when used with Hive or Hbase? Thanks, Siddharth Ubale, Synchronized Communications #43, Velankani Tech

Spark RDD mapped to Hbase to be updateable

2015-03-23 Thread Siddharth Ubale
updated as and when Hbase table reflects any change?? Thanks, Siddharth Ubale, Synchronized Communications #43, Velankani Tech Park, Block No. II, 3rd Floor, Electronic City Phase I, Bangalore – 560 100 Tel : +91 80 3202 4060 Web: www.syncoms.comhttp://www.syncoms.com/ [LogoNEWmohLARGE] London|Bangalore

Spark partial data in memory/and partial in disk

2015-02-27 Thread Siddharth Ubale
Hi, How do we manage putting partial data in to memory and partial into disk where data resides in hive table ? We have tried using the available documentation but unable to go ahead with above approach , we are only able to cache the entire table or uncache it. Thanks, Siddharth Ubale

Hive/Hbase for low latency

2015-02-11 Thread Siddharth Ubale
share ur views. Thanks, Siddharth Ubale,