[jira] [Assigned] (SPARK-6693) add to string with max lines and width for matrix

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6693: --- Assignee: Apache Spark > add to string with max lines and width for matrix >

[jira] [Commented] (SPARK-6693) add to string with max lines and width for matrix

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394146#comment-14394146 ] Apache Spark commented on SPARK-6693: - User 'hhbyyh' has created a pull request for th

[jira] [Assigned] (SPARK-6693) add to string with max lines and width for matrix

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6693: --- Assignee: (was: Apache Spark) > add to string with max lines and width for matrix > -

[jira] [Commented] (SPARK-6664) Split Ordered RDD into multiple RDDs by keys (boundaries or intervals)

2015-04-02 Thread Florian Verhein (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394147#comment-14394147 ] Florian Verhein commented on SPARK-6664: I guess the other thing is - we can union

[jira] [Created] (SPARK-6693) add to string with max lines and width for matrix

2015-04-02 Thread yuhao yang (JIRA)
yuhao yang created SPARK-6693: - Summary: add to string with max lines and width for matrix Key: SPARK-6693 URL: https://issues.apache.org/jira/browse/SPARK-6693 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-6664) Split Ordered RDD into multiple RDDs by keys (boundaries or intervals)

2015-04-02 Thread Florian Verhein (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394141#comment-14394141 ] Florian Verhein commented on SPARK-6664: Thanks [~sowen]. I disagree :-) ...If y

[jira] [Assigned] (SPARK-5523) TaskMetrics and TaskInfo have innumerable copies of the hostname string

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5523: --- Assignee: (was: Apache Spark) > TaskMetrics and TaskInfo have innumerable copies of the h

[jira] [Assigned] (SPARK-5523) TaskMetrics and TaskInfo have innumerable copies of the hostname string

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5523: --- Assignee: Apache Spark > TaskMetrics and TaskInfo have innumerable copies of the hostname str

[jira] [Updated] (SPARK-6692) Make it possible to kill AM in YARN cluster mode when the client is terminated

2015-04-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6692: --- Assignee: Cheolsoo Park > Make it possible to kill AM in YARN cluster mode when the client is terminat

[jira] [Commented] (SPARK-6692) Make it possible to kill AM in YARN cluster mode when the client is terminated

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394135#comment-14394135 ] Apache Spark commented on SPARK-6692: - User 'piaozhexiu' has created a pull request fo

[jira] [Assigned] (SPARK-6692) Make it possible to kill AM in YARN cluster mode when the client is terminated

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6692: --- Assignee: (was: Apache Spark) > Make it possible to kill AM in YARN cluster mode when the

[jira] [Assigned] (SPARK-6692) Make it possible to kill AM in YARN cluster mode when the client is terminated

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6692: --- Assignee: Apache Spark > Make it possible to kill AM in YARN cluster mode when the client is

[jira] [Created] (SPARK-6692) Make it possible to kill AM in YARN cluster mode when the client is terminated

2015-04-02 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created SPARK-6692: Summary: Make it possible to kill AM in YARN cluster mode when the client is terminated Key: SPARK-6692 URL: https://issues.apache.org/jira/browse/SPARK-6692 Project:

[jira] [Closed] (SPARK-1095) Ensure all public methods return explicit types

2015-04-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-1095. -- Resolution: Duplicate > Ensure all public methods return explicit types > --

[jira] [Reopened] (SPARK-1095) Ensure all public methods return explicit types

2015-04-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reopened SPARK-1095: Assignee: Reynold Xin (was: prashant) > Ensure all public methods return explicit types > ---

[jira] [Updated] (SPARK-6691) Abstract and add a dynamic RateLimiter for Spark Streaming

2015-04-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-6691: --- Issue Type: Improvement (was: New Feature) > Abstract and add a dynamic RateLimiter for Spark Streami

[jira] [Created] (SPARK-6691) Abstract and add a dynamic RateLimiter for Spark Streaming

2015-04-02 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-6691: -- Summary: Abstract and add a dynamic RateLimiter for Spark Streaming Key: SPARK-6691 URL: https://issues.apache.org/jira/browse/SPARK-6691 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-6428) Add to style checker "public method must have explicit type defined"

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6428: --- Assignee: Apache Spark (was: Reynold Xin) > Add to style checker "public method must have ex

[jira] [Commented] (SPARK-6428) Add to style checker "public method must have explicit type defined"

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394121#comment-14394121 ] Apache Spark commented on SPARK-6428: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-6428) Add to style checker "public method must have explicit type defined"

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6428: --- Assignee: Reynold Xin (was: Apache Spark) > Add to style checker "public method must have ex

[jira] [Assigned] (SPARK-6211) Test Python Kafka API using Python unit tests

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6211: --- Assignee: Apache Spark (was: Saisai Shao) > Test Python Kafka API using Python unit tests >

[jira] [Assigned] (SPARK-6211) Test Python Kafka API using Python unit tests

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6211: --- Assignee: Saisai Shao (was: Apache Spark) > Test Python Kafka API using Python unit tests >

[jira] [Resolved] (SPARK-6621) Calling EventLoop.stop in EventLoop.onReceive and EventLoop.onError should call onStop

2015-04-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-6621. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull request

[jira] [Assigned] (SPARK-6621) Calling EventLoop.stop in EventLoop.onReceive and EventLoop.onError should call onStop

2015-04-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-6621: - Assignee: Josh Rosen > Calling EventLoop.stop in EventLoop.onReceive and EventLoop.onError should

[jira] [Updated] (SPARK-6621) Calling EventLoop.stop in EventLoop.onReceive and EventLoop.onError should call onStop

2015-04-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-6621: -- Assignee: Shixiong Zhu (was: Josh Rosen) > Calling EventLoop.stop in EventLoop.onReceive and EventLoop.

[jira] [Commented] (SPARK-6435) spark-shell --jars option does not add all jars to classpath

2015-04-02 Thread Masayoshi TSUZUKI (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394105#comment-14394105 ] Masayoshi TSUZUKI commented on SPARK-6435: -- Please try with double-quotation. (do

[jira] [Assigned] (SPARK-6690) spark-sql script ends up throwing Exception when event logging is enabled.

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6690: --- Assignee: (was: Apache Spark) > spark-sql script ends up throwing Exception when event lo

[jira] [Commented] (SPARK-6690) spark-sql script ends up throwing Exception when event logging is enabled.

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394094#comment-14394094 ] Apache Spark commented on SPARK-6690: - User 'sarutak' has created a pull request for t

[jira] [Assigned] (SPARK-6690) spark-sql script ends up throwing Exception when event logging is enabled.

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6690: --- Assignee: Apache Spark > spark-sql script ends up throwing Exception when event logging is en

[jira] [Updated] (SPARK-6690) spark-sql script ends up throwing Exception when event logging is enabled.

2015-04-02 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-6690: -- Component/s: (was: Scheduler) SQL > spark-sql script ends up throwing Excep

[jira] [Updated] (SPARK-6690) spark-sql script ends up throwing Exception when event logging is enabled.

2015-04-02 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-6690: -- Component/s: (was: SQL) Scheduler > spark-sql script ends up throwing Excep

[jira] [Commented] (SPARK-6665) Randomly Shuffle an RDD

2015-04-02 Thread Florian Verhein (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394089#comment-14394089 ] Florian Verhein commented on SPARK-6665: Thanks for the quick response [~sowen].

[jira] [Created] (SPARK-6690) spark-sql script ends up throwing Exception when event logging is enabled.

2015-04-02 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-6690: - Summary: spark-sql script ends up throwing Exception when event logging is enabled. Key: SPARK-6690 URL: https://issues.apache.org/jira/browse/SPARK-6690 Project: S

[jira] [Resolved] (SPARK-6345) Model update propagation during prediction in Streaming Regression

2015-04-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6345. -- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull re

[jira] [Updated] (SPARK-6640) Executor may connect to HeartbeartReceiver before it's setup in the driver side

2015-04-02 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6640: - Assignee: Shixiong Zhu > Executor may connect to HeartbeartReceiver before it's setup in the driver > sid

[jira] [Resolved] (SPARK-6575) Converted Parquet Metastore tables no longer cache metadata

2015-04-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6575. - Resolution: Fixed > Converted Parquet Metastore tables no longer cache metadata >

[jira] [Updated] (SPARK-6673) spark-shell.cmd can't start even when spark was built in Windows

2015-04-02 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6673: - Assignee: Masayoshi TSUZUKI > spark-shell.cmd can't start even when spark was built in Windows > -

[jira] [Updated] (SPARK-6673) spark-shell.cmd can't start even when spark was built in Windows

2015-04-02 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6673: - Target Version/s: 1.3.1, 1.4.0 > spark-shell.cmd can't start even when spark was built in Windows > --

[jira] [Updated] (SPARK-6673) spark-shell.cmd can't start even when spark was built in Windows

2015-04-02 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6673: - Priority: Blocker (was: Major) > spark-shell.cmd can't start even when spark was built in Windows > -

[jira] [Commented] (SPARK-6689) MiniYarnCLuster still test failed with hadoop-2.2

2015-04-02 Thread Zhang, Liye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394000#comment-14394000 ] Zhang, Liye commented on SPARK-6689: cc [~vanzin] [~srowen] > MiniYarnCLuster still t

[jira] [Updated] (SPARK-6689) MiniYarnCLuster still test failed with hadoop-2.2

2015-04-02 Thread Zhang, Liye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang, Liye updated SPARK-6689: --- Description: when running unit test *YarnClusterSuite* with *hadoop-2.2*, exception will throw becaus

[jira] [Created] (SPARK-6689) MiniYarnCLuster still test failed with hadoop-2.2

2015-04-02 Thread Zhang, Liye (JIRA)
Zhang, Liye created SPARK-6689: -- Summary: MiniYarnCLuster still test failed with hadoop-2.2 Key: SPARK-6689 URL: https://issues.apache.org/jira/browse/SPARK-6689 Project: Spark Issue Type: Test

[jira] [Closed] (SPARK-6650) ExecutorAllocationManager never stops

2015-04-02 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-6650. Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Assignee: Marcelo Vanzin > E

[jira] [Commented] (SPARK-765) Test suite should run Spark example programs

2015-04-02 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14393936#comment-14393936 ] Yu Ishikawa commented on SPARK-765: --- Hi [~joshrosen], In order to avoid misunderstanding,

[jira] [Assigned] (SPARK-6688) EventLoggingListener should always operate on resolved URIs

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6688: --- Assignee: (was: Apache Spark) > EventLoggingListener should always operate on resolved UR

[jira] [Commented] (SPARK-6688) EventLoggingListener should always operate on resolved URIs

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14393903#comment-14393903 ] Apache Spark commented on SPARK-6688: - User 'vanzin' has created a pull request for th

[jira] [Assigned] (SPARK-6688) EventLoggingListener should always operate on resolved URIs

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6688: --- Assignee: Apache Spark > EventLoggingListener should always operate on resolved URIs > --

[jira] [Created] (SPARK-6688) EventLoggingListener should always operate on resolved URIs

2015-04-02 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-6688: - Summary: EventLoggingListener should always operate on resolved URIs Key: SPARK-6688 URL: https://issues.apache.org/jira/browse/SPARK-6688 Project: Spark

[jira] [Resolved] (SPARK-6686) toDF column rename does not work when columns contain '.'

2015-04-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6686. - Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by p

[jira] [Assigned] (SPARK-5100) Spark Thrift server monitor page

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5100: --- Assignee: (was: Apache Spark) > Spark Thrift server monitor page > --

[jira] [Assigned] (SPARK-5100) Spark Thrift server monitor page

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5100: --- Assignee: Apache Spark > Spark Thrift server monitor page >

[jira] [Commented] (SPARK-6575) Converted Parquet Metastore tables no longer cache metadata

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14393881#comment-14393881 ] Apache Spark commented on SPARK-6575: - User 'yhuai' has created a pull request for thi

[jira] [Assigned] (SPARK-5817) UDTF column names didn't set properly

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5817: --- Assignee: (was: Apache Spark) > UDTF column names didn't set properly >

[jira] [Assigned] (SPARK-5817) UDTF column names didn't set properly

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5817: --- Assignee: Apache Spark > UDTF column names didn't set properly > ---

[jira] [Commented] (SPARK-6435) spark-shell --jars option does not add all jars to classpath

2015-04-02 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14393856#comment-14393856 ] Marcelo Vanzin commented on SPARK-6435: --- I haven't tested this on 1.3 so I can't com

[jira] [Assigned] (SPARK-5068) When the path not found in the hdfs,we can't get the result

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5068: --- Assignee: (was: Apache Spark) > When the path not found in the hdfs,we can't get the resu

[jira] [Assigned] (SPARK-5068) When the path not found in the hdfs,we can't get the result

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5068: --- Assignee: Apache Spark > When the path not found in the hdfs,we can't get the result > --

[jira] [Assigned] (SPARK-5213) Pluggable SQL Parser Support

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5213: --- Assignee: Apache Spark > Pluggable SQL Parser Support > > >

[jira] [Assigned] (SPARK-5213) Pluggable SQL Parser Support

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5213: --- Assignee: (was: Apache Spark) > Pluggable SQL Parser Support > --

[jira] [Assigned] (SPARK-6356) Support the ROLLUP/CUBE/GROUPING SETS/grouping() in SQLContext

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6356: --- Assignee: Apache Spark > Support the ROLLUP/CUBE/GROUPING SETS/grouping() in SQLContext > ---

[jira] [Assigned] (SPARK-6356) Support the ROLLUP/CUBE/GROUPING SETS/grouping() in SQLContext

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6356: --- Assignee: (was: Apache Spark) > Support the ROLLUP/CUBE/GROUPING SETS/grouping() in SQLCo

[jira] [Assigned] (SPARK-5938) Generate row from json efficiently

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5938: --- Assignee: Liang-Chi Hsieh (was: Apache Spark) > Generate row from json efficiently > ---

[jira] [Assigned] (SPARK-5938) Generate row from json efficiently

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5938: --- Assignee: Apache Spark (was: Liang-Chi Hsieh) > Generate row from json efficiently > ---

[jira] [Assigned] (SPARK-5753) add basic support to JDBCRDD for postgresql types: uuid, hstore, and array

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5753: --- Assignee: Apache Spark > add basic support to JDBCRDD for postgresql types: uuid, hstore, and

[jira] [Assigned] (SPARK-5753) add basic support to JDBCRDD for postgresql types: uuid, hstore, and array

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5753: --- Assignee: (was: Apache Spark) > add basic support to JDBCRDD for postgresql types: uuid,

[jira] [Assigned] (SPARK-6321) Adapt the number of partitions used by the Exchange rule to the cluster specifications

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6321: --- Assignee: (was: Apache Spark) > Adapt the number of partitions used by the Exchange rule

[jira] [Assigned] (SPARK-6321) Adapt the number of partitions used by the Exchange rule to the cluster specifications

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6321: --- Assignee: Apache Spark > Adapt the number of partitions used by the Exchange rule to the clus

[jira] [Assigned] (SPARK-5264) Support `drop temporary table [if exists]` DDL command

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5264: --- Assignee: Apache Spark > Support `drop temporary table [if exists]` DDL command > --

[jira] [Assigned] (SPARK-5264) Support `drop temporary table [if exists]` DDL command

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5264: --- Assignee: (was: Apache Spark) > Support `drop temporary table [if exists]` DDL command >

[jira] [Assigned] (SPARK-6067) Spark sql hive dynamic partitions job will fail if task fails

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6067: --- Assignee: (was: Apache Spark) > Spark sql hive dynamic partitions job will fail if task f

[jira] [Assigned] (SPARK-6067) Spark sql hive dynamic partitions job will fail if task fails

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6067: --- Assignee: Apache Spark > Spark sql hive dynamic partitions job will fail if task fails >

[jira] [Assigned] (SPARK-6201) INSET should coerce types

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6201: --- Assignee: (was: Apache Spark) > INSET should coerce types > - > >

[jira] [Assigned] (SPARK-6201) INSET should coerce types

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6201: --- Assignee: Apache Spark > INSET should coerce types > - > >

[jira] [Assigned] (SPARK-5129) make SqlContext support "select date +/- XX DAYS from table"

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5129: --- Assignee: Apache Spark > make SqlContext support "select date +/- XX DAYS from table" > ---

[jira] [Assigned] (SPARK-5129) make SqlContext support "select date +/- XX DAYS from table"

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5129: --- Assignee: (was: Apache Spark) > make SqlContext support "select date +/- XX DAYS from tab

[jira] [Resolved] (SPARK-6243) The Operation of match did not conside the scenarios that order.dataType does not match NativeType

2015-04-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6243. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4959 [https:/

[jira] [Assigned] (SPARK-5684) Key not found exception is thrown in case location of added partition to a parquet table is different than a path containing the partition values

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5684: --- Assignee: Apache Spark > Key not found exception is thrown in case location of added partitio

[jira] [Assigned] (SPARK-5684) Key not found exception is thrown in case location of added partition to a parquet table is different than a path containing the partition values

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5684: --- Assignee: (was: Apache Spark) > Key not found exception is thrown in case location of add

[jira] [Assigned] (SPARK-6006) Optimize count distinct in case of high cardinality columns

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6006: --- Assignee: (was: Apache Spark) > Optimize count distinct in case of high cardinality colum

[jira] [Assigned] (SPARK-6006) Optimize count distinct in case of high cardinality columns

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6006: --- Assignee: Apache Spark > Optimize count distinct in case of high cardinality columns > --

[jira] [Assigned] (SPARK-6130) support if not exists for insert overwrite into partition in hiveQl

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6130: --- Assignee: Apache Spark > support if not exists for insert overwrite into partition in hiveQl

[jira] [Assigned] (SPARK-6130) support if not exists for insert overwrite into partition in hiveQl

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6130: --- Assignee: (was: Apache Spark) > support if not exists for insert overwrite into partition

[jira] [Assigned] (SPARK-6034) DESCRIBE EXTENDED viewname is not supported for HiveContext

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6034: --- Assignee: Apache Spark > DESCRIBE EXTENDED viewname is not supported for HiveContext > --

[jira] [Assigned] (SPARK-6034) DESCRIBE EXTENDED viewname is not supported for HiveContext

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6034: --- Assignee: (was: Apache Spark) > DESCRIBE EXTENDED viewname is not supported for HiveConte

[jira] [Assigned] (SPARK-4699) Make caseSensitive configurable in Analyzer.scala

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4699: --- Assignee: (was: Apache Spark) > Make caseSensitive configurable in Analyzer.scala > -

[jira] [Assigned] (SPARK-4699) Make caseSensitive configurable in Analyzer.scala

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4699: --- Assignee: Apache Spark > Make caseSensitive configurable in Analyzer.scala >

[jira] [Assigned] (SPARK-5325) Simplifying Hive shim implementation

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5325: --- Assignee: (was: Apache Spark) > Simplifying Hive shim implementation > --

[jira] [Assigned] (SPARK-5325) Simplifying Hive shim implementation

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5325: --- Assignee: Apache Spark > Simplifying Hive shim implementation > -

[jira] [Assigned] (SPARK-5453) Use hive-site.xml to set class for adding custom filter for input files

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5453: --- Assignee: (was: Apache Spark) > Use hive-site.xml to set class for adding custom filter f

[jira] [Assigned] (SPARK-5453) Use hive-site.xml to set class for adding custom filter for input files

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5453: --- Assignee: Apache Spark > Use hive-site.xml to set class for adding custom filter for input fi

[jira] [Assigned] (SPARK-5215) concat support in sqlcontext

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5215: --- Assignee: Apache Spark > concat support in sqlcontext > > >

[jira] [Assigned] (SPARK-5215) concat support in sqlcontext

2015-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5215: --- Assignee: (was: Apache Spark) > concat support in sqlcontext > --

[jira] [Resolved] (SPARK-6670) HiveContext.analyze should throw UnsupportedOperationException instead of NotImplementedError

2015-04-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6670. - Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 > HiveContext.analy

[jira] [Updated] (SPARK-6669) Lock metastore client in analyzeTable

2015-04-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6669: Fix Version/s: 1.4.0 > Lock metastore client in analyzeTable > -

[jira] [Resolved] (SPARK-6669) Lock metastore client in analyzeTable

2015-04-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6669. - Resolution: Fixed Assignee: Yin Huai (was: Michael Armbrust) > Lock metastore clien

[jira] [Updated] (SPARK-6669) Lock metastore client in analyzeTable

2015-04-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6669: Fix Version/s: 1.3.1 > Lock metastore client in analyzeTable > -

[jira] [Resolved] (SPARK-6618) HiveMetastoreCatalog.lookupRelation should use fine-grained lock

2015-04-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6618. - Resolution: Fixed > HiveMetastoreCatalog.lookupRelation should use fine-grained lock > ---

[jira] [Updated] (SPARK-6608) Make DataFrame.rdd a lazy val

2015-04-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6608: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-6116 > Make DataFrame.rdd a lazy val >

[jira] [Created] (SPARK-6687) In the hadoop 0.23 profile, hadoop pulls in an older version of netty which conflicts with akka's netty

2015-04-02 Thread Sai Nishanth Parepally (JIRA)
Sai Nishanth Parepally created SPARK-6687: - Summary: In the hadoop 0.23 profile, hadoop pulls in an older version of netty which conflicts with akka's netty Key: SPARK-6687 URL: https://issues.apache.org/

[jira] [Resolved] (SPARK-6655) We need to read the schema of a data source table stored in spark.sql.sources.schema property

2015-04-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6655. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5313 [https:/

  1   2   3   >