Build spark failed with maven

Hi, all I got an ERROR when I build spark master branch with maven (commit: |2d1e916730492f5d61b97da6c483d3223ca44315|) |[INFO] [INFO] [INFO] Building Spark Project Catalyst 1.3.0-SNAPSHOT [INFO]

Is there any way to support multiple users executing SQL on thrift server?

Is there any way to support multiple users executing SQL on one thrift server? I think there are some problems for spark 1.2.0, for example: 1. Start thrift server with user A 2. Connect to thrift server via beeline with user B 3. Execute “insert into table dest select … from table src” then

[SPARK-5100][SQL] Spark Thrift server monitor page

Hi, all I have create a JIRA ticket about adding a monitor page for Thrift server. https://issues.apache.org/jira/browse/SPARK-5100 Anyone could review the design doc, and give some advises? - To unsubscribe, e-mail:

Is there any document to explain how to build the hive jars for spark?

Hi, all We found some bugs in hive-0.12, but we could not wait for hive community fixing them. We want to fix these bugs in our lab and build a new release which could be recognized by spark. As we know, spark depends on a special release of hive, like: |dependency

Re: How to use multi thread in RDD map function ?

: make sure you got enough memory on each node, more than SPARK_EXECUTOR_INSTANCES * SPARK_WORKER_MEMORY Best Regards, Yi Tian tianyi.asiai...@gmail.com On Sep 29, 2014, at 21:06, myasuka myas...@live.com wrote: Our cluster is a standalone cluster with 16 computing nodes, each node has 16

Re: Question about SparkSQL and Hive-on-Spark

Hi Reynold! Will sparkSQL strictly obey the HQL syntax ? For example, the cube function. In other words, the hiveContext of sparkSQL should only implement the subset of HQL features? Best Regards, Yi Tian tianyi.asiai...@gmail.com On Sep 23, 2014, at 15:49, Reynold Xin r

Question about SparkSQL and Hive-on-Spark

, Yi Tian tianyi.asiai...@gmail.com - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org

Re: Question about SparkSQL and Hive-on-Spark

Hi, Will We are planning to start implementing these functions. We hope that we could make a general design in following week. Best Regards, Yi Tian tianyi.asiai...@gmail.com On Sep 23, 2014, at 23:39, Will Benton wi...@redhat.com wrote: Hi Yi, I've had some interest in implementing

Re: [SPARK-3324] make yarn module as a unified maven jar project

/ is. On Sun, Aug 31, 2014 at 3:38 AM, Yi Tian tianyi.asiai...@gmail.com wrote: Hi everyone! I found the YARN module has nonstandard path structure like: ${SPARK_HOME} |--yarn |--alpha (contains yarn api support for 0.23 and 2.0.x) |--stable (contains yarn api support for 2.2

[SPARK-3324] make yarn module as a unified maven jar project

Hi everyone! I found the YARN module has nonstandard path structure like: ${SPARK_HOME} |--yarn |--alpha (contains yarn api support for 0.23 and 2.0.x) |--stable (contains yarn api support for 2.2 and later) | |--pom.xml (spark-yarn) |--common (Common codes not

Re: Compie error with XML elements

Hi, Devl! I got the same problem. You can try to upgrade your scala plugins to 0.41.2 It works on my mac. On Aug 12, 2014, at 15:19, Devl Devel devl.developm...@gmail.com wrote: When compiling the master checkout of spark. The Intellij compile fails with: Error:(45, 8) not found: