[jira] [Commented] (SPARK-9725) spark sql query string field return empty/garbled string

2015-08-14 Thread Fei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698124#comment-14698124 ] Fei Wang commented on SPARK-9725: - good job :) > spark sql query string field return empt

[jira] [Commented] (SPARK-9734) java.lang.IllegalArgumentException: Don't know how to save StructField(sal,DecimalType(7,2),true) to JDBC

2015-08-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698121#comment-14698121 ] Davies Liu commented on SPARK-9734: --- [~rmullapudi] It's fixed by https://github.com/apac

[jira] [Resolved] (SPARK-9725) spark sql query string field return empty/garbled string

2015-08-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9725. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8210 [https://github.com/

[jira] [Resolved] (SPARK-9984) Create local physical operator interface

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9984. Resolution: Fixed Fix Version/s: 1.6.0 > Create local physical operator interface > -

[jira] [Updated] (SPARK-9986) Create a simple test framework for local operators

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9986: --- Assignee: Shixiong Zhu > Create a simple test framework for local operators >

[jira] [Updated] (SPARK-9935) EqualNullSafe not processed in OrcRelation

2015-08-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-9935: Summary: EqualNullSafe not processed in OrcRelation (was: EqualNotNull not processed in OrcRelation

[jira] [Updated] (SPARK-9814) EqualNullSafe not passing to data sources

2015-08-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-9814: Summary: EqualNullSafe not passing to data sources (was: EqualNotNull not passing to data sources)

[jira] [Updated] (SPARK-8887) Explicitly define which data types can be used as dynamic partition columns

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8887: --- Affects Version/s: 1.5.0 > Explicitly define which data types can be used as dynamic partition columns

[jira] [Resolved] (SPARK-8887) Explicitly define which data types can be used as dynamic partition columns

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8887. Resolution: Fixed Assignee: Yijie Shen (was: Cheng Lian) Fix Version/s: 1.6

[jira] [Resolved] (SPARK-9323) DataFrame.orderBy gives confusing analysis errors when ordering based on nested columns

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9323. Resolution: Fixed Assignee: Michael Armbrust Fix Version/s: 1.5.0 > DataFrame.orderB

[jira] [Resolved] (SPARK-9634) cleanup unnecessary Aliases in LogicalPlan at the end of analysis

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9634. Resolution: Fixed Assignee: Michael Armbrust Fix Version/s: 1.5.0 > cleanup unnecess

[jira] [Resolved] (SPARK-9934) Deprecate NIO ConnectionManager

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9934. Resolution: Fixed Fix Version/s: 1.5.0 > Deprecate NIO ConnectionManager > --

[jira] [Updated] (SPARK-9973) wrong buffle size

2015-08-14 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xukun updated SPARK-9973: - Description: When cache table in memory in spark sql, we allocate too more memory. InMemoryColumnarTableScan.clas

[jira] [Updated] (SPARK-9973) wrong buffle size

2015-08-14 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xukun updated SPARK-9973: - Description: When cache table in memory in spark sql allocate wrong buffer size (4+ size * columnType.defaultSize

[jira] [Commented] (SPARK-9971) MaxFunction not working correctly with columns containing Double.NaN

2015-08-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698078#comment-14698078 ] Yin Huai commented on SPARK-9971: - Seems our behaviors of min, max, sum, avg, and count ar

[jira] [Assigned] (SPARK-10008) Shuffle locality can take precedence over narrow dependencies for RDDs with both

2015-08-14 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia reassigned SPARK-10008: - Assignee: Matei Zaharia > Shuffle locality can take precedence over narrow dependencies

[jira] [Assigned] (SPARK-10008) Shuffle locality can take precedence over narrow dependencies for RDDs with both

2015-08-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10008: Assignee: Apache Spark > Shuffle locality can take precedence over narrow dependencies for

[jira] [Assigned] (SPARK-10008) Shuffle locality can take precedence over narrow dependencies for RDDs with both

2015-08-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10008: Assignee: (was: Apache Spark) > Shuffle locality can take precedence over narrow depen

[jira] [Commented] (SPARK-10008) Shuffle locality can take precedence over narrow dependencies for RDDs with both

2015-08-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698071#comment-14698071 ] Apache Spark commented on SPARK-10008: -- User 'mateiz' has created a pull request for

[jira] [Created] (SPARK-10008) Shuffle locality can take precedence over narrow dependencies for RDDs with both

2015-08-14 Thread Matei Zaharia (JIRA)
Matei Zaharia created SPARK-10008: - Summary: Shuffle locality can take precedence over narrow dependencies for RDDs with both Key: SPARK-10008 URL: https://issues.apache.org/jira/browse/SPARK-10008 Pr

[jira] [Created] (SPARK-10007) Update `NAMESPACE` file in SparkR for simple parameters functions

2015-08-14 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created SPARK-10007: --- Summary: Update `NAMESPACE` file in SparkR for simple parameters functions Key: SPARK-10007 URL: https://issues.apache.org/jira/browse/SPARK-10007 Project: Spark

[jira] [Updated] (SPARK-9974) SBT build: com.twitter:parquet-hadoop-bundle:1.6.0 is not packaged into the assembly jar

2015-08-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9974: -- Description: One of the consequence of this issue is that Parquet tables created in Hive are not access

[jira] [Updated] (SPARK-10006) Locality broken in spark 1.4.x for NewHadoopRDD

2015-08-14 Thread Robbie Russo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robbie Russo updated SPARK-10006: - Priority: Critical (was: Major) > Locality broken in spark 1.4.x for NewHadoopRDD >

[jira] [Created] (SPARK-10006) Locality broken in spark 1.4.x for NewHadoopRDD

2015-08-14 Thread Robbie Russo (JIRA)
Robbie Russo created SPARK-10006: Summary: Locality broken in spark 1.4.x for NewHadoopRDD Key: SPARK-10006 URL: https://issues.apache.org/jira/browse/SPARK-10006 Project: Spark Issue Type: B

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

2015-08-14 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698022#comment-14698022 ] Sudhakar Thota commented on SPARK-9776: --- my apologies it is SPARK-8064 > Another in

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

2015-08-14 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698021#comment-14698021 ] Sudhakar Thota commented on SPARK-9776: --- Thanks for correcting Sean. I did the gle

[jira] [Commented] (SPARK-9972) Add `struct`, `encode` and `decode` function in SparkR

2015-08-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698012#comment-14698012 ] Shivaram Venkataraman commented on SPARK-9972: -- [~yuu.ishik...@gmail.com] Why

[jira] [Updated] (SPARK-9972) Add `struct`, `encode` and `decode` function in SparkR

2015-08-14 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated SPARK-9972: --- Description: Support {{struct}} function on a DataFrame in SparkR. However, I think we need to improv

[jira] [Updated] (SPARK-9972) Add `struct`, `encode` and `decode` function in SparkR

2015-08-14 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated SPARK-9972: --- Description: Support {{struct}} function on a DataFrame in SparkR. However, I think we need to improv

[jira] [Created] (SPARK-10005) Parquet reader doesn't handle schema merging properly for nested structs

2015-08-14 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-10005: -- Summary: Parquet reader doesn't handle schema merging properly for nested structs Key: SPARK-10005 URL: https://issues.apache.org/jira/browse/SPARK-10005 Project: Spark

[jira] [Commented] (SPARK-9734) java.lang.IllegalArgumentException: Don't know how to save StructField(sal,DecimalType(7,2),true) to JDBC

2015-08-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697998#comment-14697998 ] Davies Liu commented on SPARK-9734: --- [~rmullapudi] Good catch! I will sending out a quic

[jira] [Resolved] (SPARK-9949) TakeOrderedAndProject returns wrong output attributes when project is pushed in to it

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9949. Resolution: Fixed Fix Version/s: 1.5.0 > TakeOrderedAndProject returns wrong output attribute

[jira] [Commented] (SPARK-8630) Prevent from checkpointing QueueInputDStream

2015-08-14 Thread Asim Jalis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697996#comment-14697996 ] Asim Jalis commented on SPARK-8630: --- I would like to recommend that this fix be reverted

[jira] [Commented] (SPARK-10004) Shuffle service should make sure applications are allowed to read shuffle data

2015-08-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697984#comment-14697984 ] Apache Spark commented on SPARK-10004: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-10004) Shuffle service should make sure applications are allowed to read shuffle data

2015-08-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10004: Assignee: (was: Apache Spark) > Shuffle service should make sure applications are allo

[jira] [Assigned] (SPARK-10004) Shuffle service should make sure applications are allowed to read shuffle data

2015-08-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10004: Assignee: Apache Spark > Shuffle service should make sure applications are allowed to read

[jira] [Created] (SPARK-10004) Shuffle service should make sure applications are allowed to read shuffle data

2015-08-14 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-10004: -- Summary: Shuffle service should make sure applications are allowed to read shuffle data Key: SPARK-10004 URL: https://issues.apache.org/jira/browse/SPARK-10004 Pr

[jira] [Assigned] (SPARK-10003) Improve readability of DAGScheduler

2015-08-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10003: Assignee: Apache Spark (was: Andrew Or) > Improve readability of DAGScheduler > -

[jira] [Assigned] (SPARK-10003) Improve readability of DAGScheduler

2015-08-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10003: Assignee: Andrew Or (was: Apache Spark) > Improve readability of DAGScheduler > -

[jira] [Commented] (SPARK-10003) Improve readability of DAGScheduler

2015-08-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697940#comment-14697940 ] Apache Spark commented on SPARK-10003: -- User 'andrewor14' has created a pull request

[jira] [Updated] (SPARK-9972) Add `struct`, `encode` and `decode` function in SparkR

2015-08-14 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated SPARK-9972: --- Summary: Add `struct`, `encode` and `decode` function in SparkR (was: Add `struct` function in SparkR

[jira] [Commented] (SPARK-9951) Example code for Multilayer Perceptron Classifier

2015-08-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697916#comment-14697916 ] Joseph K. Bradley commented on SPARK-9951: -- You probably know best. If you think

[jira] [Updated] (SPARK-10003) Improve readability of DAGScheduler

2015-08-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10003: -- Description: There are many opportunities for improving DAGScheduler's readability. This issue will rep

[jira] [Created] (SPARK-10003) Improve readability of DAGScheduler

2015-08-14 Thread Andrew Or (JIRA)
Andrew Or created SPARK-10003: - Summary: Improve readability of DAGScheduler Key: SPARK-10003 URL: https://issues.apache.org/jira/browse/SPARK-10003 Project: Spark Issue Type: Bug Compo

[jira] [Resolved] (SPARK-9968) BlockGenerator lock structure can cause lock starvation of the block updating thread

2015-08-14 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9968. -- Resolution: Fixed Fix Version/s: 1.5.0 > BlockGenerator lock structure can cause lock sta

[jira] [Assigned] (SPARK-7398) Add back-pressure to Spark Streaming (umbrella JIRA)

2015-08-14 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reassigned SPARK-7398: Assignee: Tathagata Das > Add back-pressure to Spark Streaming (umbrella JIRA) > --

[jira] [Commented] (SPARK-9951) Example code for Multilayer Perceptron Classifier

2015-08-14 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697902#comment-14697902 ] Alexander Ulanov commented on SPARK-9951: - I have this already, I plan to use it f

[jira] [Assigned] (SPARK-10001) Allow Ctrl-C in spark-shell to kill running job

2015-08-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10001: Assignee: Apache Spark > Allow Ctrl-C in spark-shell to kill running job > ---

[jira] [Assigned] (SPARK-10001) Allow Ctrl-C in spark-shell to kill running job

2015-08-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10001: Assignee: (was: Apache Spark) > Allow Ctrl-C in spark-shell to kill running job >

[jira] [Commented] (SPARK-10001) Allow Ctrl-C in spark-shell to kill running job

2015-08-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697895#comment-14697895 ] Apache Spark commented on SPARK-10001: -- User 'piaozhexiu' has created a pull request

[jira] [Commented] (SPARK-9686) Spark hive jdbc client cannot get table from metadata store

2015-08-14 Thread Tom Barber (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697881#comment-14697881 ] Tom Barber commented on SPARK-9686: --- Spent all afternoon trying to locate this nugget of

[jira] [Commented] (SPARK-9971) MaxFunction not working correctly with columns containing Double.NaN

2015-08-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697868#comment-14697868 ] Davies Liu commented on SPARK-9971: --- We had a long discussion about how to support NaN,

[jira] [Created] (SPARK-10002) SSH problem during Setup of Spark(1.3.0) cluster on EC2

2015-08-14 Thread Deepali Bhandari (JIRA)
Deepali Bhandari created SPARK-10002: Summary: SSH problem during Setup of Spark(1.3.0) cluster on EC2 Key: SPARK-10002 URL: https://issues.apache.org/jira/browse/SPARK-10002 Project: Spark

[jira] [Updated] (SPARK-10001) Allow Ctrl-C in spark-shell to kill running job

2015-08-14 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated SPARK-10001: -- Summary: Allow Ctrl-C in spark-shell to kill running job (was: Ctrl-C in spark-shell doesn't k

[jira] [Resolved] (SPARK-9966) Handle a couple of corner cases in the PID rate estimator

2015-08-14 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9966. -- Resolution: Fixed Fix Version/s: 1.5.0 > Handle a couple of corner cases in the PID rate

[jira] [Commented] (SPARK-10001) Ctrl-C in spark-shell doesn't kill running job

2015-08-14 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697850#comment-14697850 ] Cheolsoo Park commented on SPARK-10001: --- [~sowen], I am creating a subtask so that

[jira] [Commented] (SPARK-10001) Ctrl-C in spark-shell doesn't kill running job

2015-08-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697820#comment-14697820 ] Sean Owen commented on SPARK-10001: --- This is a duplicate of SPARK-7006 -- how is this d

[jira] [Updated] (SPARK-10001) Ctrl-C in spark-shell doesn't kill running job

2015-08-14 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated SPARK-10001: -- Affects Version/s: 1.4.1 Fix Version/s: (was: 1.4.1) > Ctrl-C in spark-shell doesn'

[jira] [Created] (SPARK-10001) Ctrl-C in spark-shell doesn't kill running job

2015-08-14 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created SPARK-10001: - Summary: Ctrl-C in spark-shell doesn't kill running job Key: SPARK-10001 URL: https://issues.apache.org/jira/browse/SPARK-10001 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-8670) Nested columns can't be referenced (but they can be selected)

2015-08-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8670. - Resolution: Fixed Fix Version/s: 1.5.0 > Nested columns can't be referenced (but th

[jira] [Resolved] (SPARK-9978) Window functions require partitionBy to work as expected

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9978. Resolution: Fixed Fix Version/s: 1.5.0 1.4.2 > Window functions require pa

[jira] [Commented] (SPARK-9323) DataFrame.orderBy gives confusing analysis errors when ordering based on nested columns

2015-08-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697732#comment-14697732 ] Apache Spark commented on SPARK-9323: - User 'marmbrus' has created a pull request for

[jira] [Commented] (SPARK-9634) cleanup unnecessary Aliases in LogicalPlan at the end of analysis

2015-08-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697731#comment-14697731 ] Apache Spark commented on SPARK-9634: - User 'marmbrus' has created a pull request for

[jira] [Commented] (SPARK-9902) Add Java and Python examples to user guide for 1-sample KS test

2015-08-14 Thread Jose Cambronero (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697733#comment-14697733 ] Jose Cambronero commented on SPARK-9902: [~fliang] sorry completely missed the upd

[jira] [Closed] (SPARK-9877) StandaloneRestServer NPE when submitting application

2015-08-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9877. Resolution: Fixed Assignee: Saisai Shao Fix Version/s: 1.5.0 > StandaloneRestServer NPE when

[jira] [Commented] (SPARK-7837) NPE when save as parquet in speculative tasks

2015-08-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697724#comment-14697724 ] Yin Huai commented on SPARK-7837: - When speculation is on, I can reproduce it every time I

[jira] [Assigned] (SPARK-9774) Add Python API for ml.regression.IsotonicRegression

2015-08-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9774: --- Assignee: Apache Spark > Add Python API for ml.regression.IsotonicRegression > --

[jira] [Commented] (SPARK-9774) Add Python API for ml.regression.IsotonicRegression

2015-08-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697721#comment-14697721 ] Apache Spark commented on SPARK-9774: - User 'holdenk' has created a pull request for t

[jira] [Assigned] (SPARK-9774) Add Python API for ml.regression.IsotonicRegression

2015-08-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9774: --- Assignee: (was: Apache Spark) > Add Python API for ml.regression.IsotonicRegression > ---

[jira] [Resolved] (SPARK-9948) Flaky test: o.a.s.AccumulatorSuite - internal accumulators

2015-08-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9948. -- Resolution: Fixed Fix Version/s: 1.5.0 > Flaky test: o.a.s.AccumulatorSuite - internal accumulato

[jira] [Commented] (SPARK-6152) Spark does not support Java 8 compiled Scala classes

2015-08-14 Thread Malcolm Greaves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697716#comment-14697716 ] Malcolm Greaves commented on SPARK-6152: Interesting [~ste...@apache.org]! What ki

[jira] [Resolved] (SPARK-9809) Task crashes because the internal accumulators are not properly initialized

2015-08-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9809. -- Resolution: Fixed Assignee: Carson Wang Fix Version/s: 1.5.0 Target Version/

[jira] [Updated] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-: --- Summary: RDD-like API on top of Catalyst/DataFrame (was: RDD-like API on top of Catalyst) > RDD-like

[jira] [Updated] (SPARK-10000) Consolidate cache memory management and execution memory management

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-1: Description: As a Spark user, I want Spark to manage the memory more intelligently so I do not nee

[jira] [Updated] (SPARK-9999) RDD-like API on top of Catalyst

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-: --- Description: The RDD API is very flexible, and as a result harder to optimize its execution in some c

[jira] [Updated] (SPARK-9999) RDD-like API on top of Catalyst

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-: --- Target Version/s: 1.6.0 > RDD-like API on top of Catalyst > --- > >

[jira] [Updated] (SPARK-9999) holder2

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-: --- Issue Type: Story (was: Sub-task) Parent: (was: SPARK-9983) > holder2 > --- > >

[jira] [Updated] (SPARK-9999) RDD-like API on top of Catalyst

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-: --- Summary: RDD-like API on top of Catalyst (was: holder2) > RDD-like API on top of Catalyst > -

[jira] [Updated] (SPARK-10000) Consolidate cache memory management and execution memory management

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-1: Component/s: (was: SQL) Spark Core Block Manager > Consolidat

[jira] [Issue Comment Deleted] (SPARK-10000) Consolidate cache memory management and execution memory management

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-1: Comment: was deleted (was: I don't get what this issue is :S How can we reproduce this?) > Consoli

[jira] [Updated] (SPARK-10000) Consolidate cache memory management and execution memory management

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-1: Target Version/s: 1.6.0 > Consolidate cache memory management and execution memory management > ---

[jira] [Updated] (SPARK-10000) Consolidate cache memory management and execution memory management

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-1: Issue Type: Story (was: Sub-task) Parent: (was: SPARK-9983) > Consolidate cache memory

[jira] [Updated] (SPARK-10000) Consolidate cache memory management and execution memory management

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-1: Summary: Consolidate cache memory management and execution memory management (was: holder3) > Con

[jira] [Updated] (SPARK-9998) Create local intersect operator

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9998: --- Summary: Create local intersect operator (was: holder1) > Create local intersect operator > -

[jira] [Commented] (SPARK-4038) Outlier Detection Algorithm for MLlib

2015-08-14 Thread Sorin Ciolofan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697690#comment-14697690 ] Sorin Ciolofan commented on SPARK-4038: --- Hello! Just want to add that k-means clust

[jira] [Commented] (SPARK-10000) holder3

2015-08-14 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697689#comment-14697689 ] Burak Yavuz commented on SPARK-1: - I don't get what this issue is :S How can we r

[jira] [Created] (SPARK-10000) holder3

2015-08-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-1: --- Summary: holder3 Key: SPARK-1 URL: https://issues.apache.org/jira/browse/SPARK-1 Project: Spark Issue Type: Sub-task Reporter: Reynold Xin

[jira] [Created] (SPARK-9997) Create local Expand operator

2015-08-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9997: -- Summary: Create local Expand operator Key: SPARK-9997 URL: https://issues.apache.org/jira/browse/SPARK-9997 Project: Spark Issue Type: Sub-task Compone

[jira] [Created] (SPARK-9999) holder2

2015-08-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-: -- Summary: holder2 Key: SPARK- URL: https://issues.apache.org/jira/browse/SPARK- Project: Spark Issue Type: Sub-task Reporter: Reynold Xin

[jira] [Updated] (SPARK-9997) Create local Expand operator

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9997: --- Component/s: (was: sq;) SQL > Create local Expand operator >

[jira] [Created] (SPARK-9998) holder1

2015-08-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9998: -- Summary: holder1 Key: SPARK-9998 URL: https://issues.apache.org/jira/browse/SPARK-9998 Project: Spark Issue Type: Sub-task Reporter: Reynold Xin

[jira] [Created] (SPARK-9996) Create local nested loop join operator

2015-08-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9996: -- Summary: Create local nested loop join operator Key: SPARK-9996 URL: https://issues.apache.org/jira/browse/SPARK-9996 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-9995) Create local Python evaluation operator

2015-08-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9995: -- Summary: Create local Python evaluation operator Key: SPARK-9995 URL: https://issues.apache.org/jira/browse/SPARK-9995 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-9988) Create local (external) sort operator

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9988: --- Description: Similar to the TungstenSort. > Create local (external) sort operator >

[jira] [Updated] (SPARK-9988) Create local (external) sort operator

2015-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9988: --- Summary: Create local (external) sort operator (was: Create local sort operator) > Create local (ext

[jira] [Created] (SPARK-9994) Create local TopK operator

2015-08-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9994: -- Summary: Create local TopK operator Key: SPARK-9994 URL: https://issues.apache.org/jira/browse/SPARK-9994 Project: Spark Issue Type: Sub-task Component

[jira] [Created] (SPARK-9993) Create local union operator

2015-08-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9993: -- Summary: Create local union operator Key: SPARK-9993 URL: https://issues.apache.org/jira/browse/SPARK-9993 Project: Spark Issue Type: Sub-task Componen

[jira] [Created] (SPARK-9992) Create local sample operator

2015-08-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9992: -- Summary: Create local sample operator Key: SPARK-9992 URL: https://issues.apache.org/jira/browse/SPARK-9992 Project: Spark Issue Type: Sub-task Compone

[jira] [Created] (SPARK-9991) Create local limit operator

2015-08-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9991: -- Summary: Create local limit operator Key: SPARK-9991 URL: https://issues.apache.org/jira/browse/SPARK-9991 Project: Spark Issue Type: Sub-task Componen

[jira] [Commented] (SPARK-9978) Window functions require partitionBy to work as expected

2015-08-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697660#comment-14697660 ] Apache Spark commented on SPARK-9978: - User 'davies' has created a pull request for th

  1   2   3   >