[SPARK-5100][SQL] Spark Thrift server monitor page

2015-01-06 Thread Yi Tian
Hi, all I have create a JIRA ticket about adding a monitor page for Thrift server. https://issues.apache.org/jira/browse/SPARK-5100 Anyone could review the design doc, and give some advises? - To unsubscribe, e-mail:

Guava 11 dependency issue in Spark 1.2.0

2015-01-06 Thread Niranda Perera
Hi, I have been running a simple Spark app on a local spark cluster and I came across this error. Exception in thread main java.lang.NoSuchMethodError: com.google.common.hash.HashFunction.hashInt(I)Lcom/google/common/hash/HashCode; at org.apache.spark.util.collection.OpenHashSet.org

Re: Spark Streaming Data flow graph

2015-01-06 Thread François Garillot
Thanks a LOT for your answer ! I've updated the diagram, at the same address : https://www.dropbox.com/s/q79taoce2ywdmf1/SparkStreaming.pdf?dl=0 I've addressed your more straightforward remarks directly in the diagram. A couple questions: - the location of instances (Executor, Master, Driver) is

Reading Data Using TextFileStream

2015-01-06 Thread Jeniba Johnson
Hi Hari, Iam trying to read data from a file which is stored in HDFS. Using Flume the data is tailed and stored in HDFS. Now I want to read this data using TextFileStream. Using the below mentioned code Iam not able to fetch the Data from a file which is stored in HDFS. Can anyone help me

Re: [SPARK-5100][SQL] Spark Thrift server monitor page

2015-01-06 Thread Cheng Lian
Talked with Yi offline, personally I think this feature is pretty useful, and the design makes sense, and he's already got a running prototype. Yi, would you mind to open a PR for this? Thanks! Cheng On 1/6/15 5:25 PM, Yi Tian wrote: Hi, all I have create a JIRA ticket about adding a

Re: Reading Data Using TextFileStream

2015-01-06 Thread Akhil Das
I think you need to start your streaming job, then put the files there to get them read. textFileStream doesn't read the existing files i believe. Also are you sure the path is not the following? (no missing / in the beginning?) JavaDStreamString textStream = ssc.textFileStream(/user/

Re: jenkins redirect down (but jenkins is up!), lots of potential

2015-01-06 Thread shane knapp
the regular url is working now, thanks for your patience. On Mon, Jan 5, 2015 at 2:25 PM, Josh Rosen rosenvi...@gmail.com wrote: The pull request builder and SCM-polling builds appear to be working fine, but the links in pull request comments won't work because the AMP Lab webserver is still