[jira] [Assigned] (SPARK-12270) JDBC Where clause comparison doesn't work for DB2 char(n)

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12270: Assignee: Apache Spark > JDBC Where clause comparison doesn't work for DB2 char(n) >

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

2015-12-15 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057580#comment-15057580 ] Josh Rosen commented on SPARK-11255: Hey, just curious: is 3.1.1 a hard requirement o

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

2015-12-15 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057603#comment-15057603 ] Sun Rui commented on SPARK-11255: - in http://spark.apache.org/docs/latest/, it is claimed

[jira] [Updated] (SPARK-9042) Spark SQL incompatibility if security is enforced on the Hive warehouse

2015-12-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9042: - Summary: Spark SQL incompatibility if security is enforced on the Hive warehouse (was: Spark SQL incompat

[jira] [Commented] (SPARK-11885) UDAF may nondeterministically generate wrong results

2015-12-15 Thread Milad Bourhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057641#comment-15057641 ] Milad Bourhani commented on SPARK-11885: Hi, I can no longer replicate the bug o

[jira] [Comment Edited] (SPARK-6521) Bypass network shuffle read if both endpoints are local

2015-12-15 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033016#comment-15033016 ] Takeshi Yamamuro edited comment on SPARK-6521 at 12/15/15 9:23 AM: -

[jira] [Created] (SPARK-12334) Support read from multiple input paths for orc file in DataFrameReader.orc

2015-12-15 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-12334: -- Summary: Support read from multiple input paths for orc file in DataFrameReader.orc Key: SPARK-12334 URL: https://issues.apache.org/jira/browse/SPARK-12334 Project: Spark

[jira] [Commented] (SPARK-8519) Blockify distance computation in k-means

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057720#comment-15057720 ] Apache Spark commented on SPARK-8519: - User 'yanboliang' has created a pull request fo

[jira] [Assigned] (SPARK-8519) Blockify distance computation in k-means

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8519: --- Assignee: (was: Apache Spark) > Blockify distance computation in k-means > --

[jira] [Assigned] (SPARK-8519) Blockify distance computation in k-means

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8519: --- Assignee: Apache Spark > Blockify distance computation in k-means > -

[jira] [Updated] (SPARK-12334) Support read from multiple input paths for orc file in DataFrameReader.orc

2015-12-15 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-12334: --- Component/s: PySpark > Support read from multiple input paths for orc file in DataFrameReader.orc > -

[jira] [Assigned] (SPARK-12334) Support read from multiple input paths for orc file in DataFrameReader.orc

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12334: Assignee: Apache Spark > Support read from multiple input paths for orc file in DataFrameR

[jira] [Assigned] (SPARK-12334) Support read from multiple input paths for orc file in DataFrameReader.orc

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12334: Assignee: (was: Apache Spark) > Support read from multiple input paths for orc file in

[jira] [Created] (SPARK-12335) CentralMomentAgg should be nullable

2015-12-15 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12335: -- Summary: CentralMomentAgg should be nullable Key: SPARK-12335 URL: https://issues.apache.org/jira/browse/SPARK-12335 Project: Spark Issue Type: Bug Com

[jira] [Assigned] (SPARK-8519) Blockify distance computation in k-means

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8519: --- Assignee: Apache Spark > Blockify distance computation in k-means > -

[jira] [Resolved] (SPARK-12325) Inappropriate error messages in DataFrame StatFunctions

2015-12-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12325. --- Resolution: Invalid [~Narine] I'm going to push back on this, since it's inappropriate to open a "Cr

[jira] [Commented] (SPARK-12332) Typo in ResetSystemProperties.scala's comments

2015-12-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057826#comment-15057826 ] Sean Owen commented on SPARK-12332: --- (I don't think this is worth your time for a JIRA,

[jira] [Assigned] (SPARK-12335) CentralMomentAgg should be nullable

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12335: Assignee: Apache Spark (was: Cheng Lian) > CentralMomentAgg should be nullable >

[jira] [Updated] (SPARK-12334) Support read from multiple input paths for orc file in DataFrameReader.orc

2015-12-15 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-12334: --- Affects Version/s: 1.6.0 Target Version/s: 1.6.1 > Support read from multiple input paths for or

[jira] [Commented] (SPARK-12332) Typo in ResetSystemProperties.scala's comments

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057835#comment-15057835 ] Apache Spark commented on SPARK-12332: -- User 'holdenk' has created a pull request fo

[jira] [Resolved] (SPARK-10157) Add ability to specify s3 bootstrap script to spark-ec2

2015-12-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10157. --- Resolution: Won't Fix > Add ability to specify s3 bootstrap script to spark-ec2 > ---

[jira] [Commented] (SPARK-12331) R^2 for regression through the origin

2015-12-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057863#comment-15057863 ] Sean Owen commented on SPARK-12331: --- I'd support this change, if you're willing to do t

[jira] [Created] (SPARK-12336) Outer join using multiple columns results in wrong nullability

2015-12-15 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12336: -- Summary: Outer join using multiple columns results in wrong nullability Key: SPARK-12336 URL: https://issues.apache.org/jira/browse/SPARK-12336 Project: Spark I

[jira] [Assigned] (SPARK-12336) Outer join using multiple columns results in wrong nullability

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12336: Assignee: Cheng Lian (was: Apache Spark) > Outer join using multiple columns results in w

[jira] [Assigned] (SPARK-12336) Outer join using multiple columns results in wrong nullability

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12336: Assignee: Apache Spark (was: Cheng Lian) > Outer join using multiple columns results in w

[jira] [Assigned] (SPARK-12336) Outer join using multiple columns results in wrong nullability

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12336: Assignee: Apache Spark (was: Cheng Lian) > Outer join using multiple columns results in w

[jira] [Created] (SPARK-12337) Implement dropDuplicates() method of DataFrame in SparkR

2015-12-15 Thread Sun Rui (JIRA)
Sun Rui created SPARK-12337: --- Summary: Implement dropDuplicates() method of DataFrame in SparkR Key: SPARK-12337 URL: https://issues.apache.org/jira/browse/SPARK-12337 Project: Spark Issue Type: Ne

[jira] [Created] (SPARK-12338) Support dropping duplicated rows on selected columns in DataFrame in R style

2015-12-15 Thread Sun Rui (JIRA)
Sun Rui created SPARK-12338: --- Summary: Support dropping duplicated rows on selected columns in DataFrame in R style Key: SPARK-12338 URL: https://issues.apache.org/jira/browse/SPARK-12338 Project: Spark

[jira] [Assigned] (SPARK-12337) Implement dropDuplicates() method of DataFrame in SparkR

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12337: Assignee: (was: Apache Spark) > Implement dropDuplicates() method of DataFrame in Spar

[jira] [Assigned] (SPARK-12337) Implement dropDuplicates() method of DataFrame in SparkR

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12337: Assignee: Apache Spark > Implement dropDuplicates() method of DataFrame in SparkR > --

[jira] [Resolved] (SPARK-12219) Spark 1.5.2 code does not build on Scala 2.11.7 with SBT assembly

2015-12-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12219. --- Resolution: Not A Problem master builds fine with SBT / Scala 2.11. Since building vs 2.11 is the iss

[jira] [Updated] (SPARK-12335) CentralMomentAgg should be nullable

2015-12-15 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12335: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-12323 > CentralMomentAgg should be nullable >

[jira] [Updated] (SPARK-12336) Outer join using multiple columns results in wrong nullability

2015-12-15 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12336: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-12323 > Outer join using multiple columns resu

[jira] [Updated] (SPARK-12332) Typo in ResetSystemProperties.scala's comments

2015-12-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12332: -- Assignee: holdenk Issue Type: Improvement (was: Bug) > Typo in ResetSystemProperties.scala's com

[jira] [Resolved] (SPARK-12332) Typo in ResetSystemProperties.scala's comments

2015-12-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12332. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10303 [https://github.co

[jira] [Updated] (SPARK-12263) IllegalStateException: Memory can't be 0 for SPARK_WORKER_MEMORY without unit

2015-12-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12263: -- Labels: starter (was: ) > IllegalStateException: Memory can't be 0 for SPARK_WORKER_MEMORY without uni

[jira] [Created] (SPARK-12339) NullPointerException on stage kill from web UI

2015-12-15 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-12339: --- Summary: NullPointerException on stage kill from web UI Key: SPARK-12339 URL: https://issues.apache.org/jira/browse/SPARK-12339 Project: Spark Issue Ty

[jira] [Created] (SPARK-12340) overstep the bounds of Int in SparkPlan.executeTake

2015-12-15 Thread QiangCai (JIRA)
QiangCai created SPARK-12340: Summary: overstep the bounds of Int in SparkPlan.executeTake Key: SPARK-12340 URL: https://issues.apache.org/jira/browse/SPARK-12340 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12340) overstep the bounds of Int in SparkPlan.executeTake

2015-12-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057994#comment-15057994 ] Sean Owen commented on SPARK-12340: --- [~QiangCai] without any info about a reproduction,

[jira] [Commented] (SPARK-5928) Remote Shuffle Blocks cannot be more than 2 GB

2015-12-15 Thread jeffonia Tung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057998#comment-15057998 ] jeffonia Tung commented on SPARK-5928: -- org.apache.spark.shuffle.FetchFailedException

[jira] [Commented] (SPARK-12340) overstep the bounds of Int in SparkPlan.executeTake

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058000#comment-15058000 ] Apache Spark commented on SPARK-12340: -- User 'QiangCai' has created a pull request f

[jira] [Comment Edited] (SPARK-5928) Remote Shuffle Blocks cannot be more than 2 GB

2015-12-15 Thread jeffonia Tung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057998#comment-15057998 ] jeffonia Tung edited comment on SPARK-5928 at 12/15/15 12:42 PM: ---

[jira] [Assigned] (SPARK-12340) overstep the bounds of Int in SparkPlan.executeTake

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12340: Assignee: Apache Spark > overstep the bounds of Int in SparkPlan.executeTake > ---

[jira] [Created] (SPARK-12341) The "comment" field of DESCRIBE result set should be nullable

2015-12-15 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12341: -- Summary: The "comment" field of DESCRIBE result set should be nullable Key: SPARK-12341 URL: https://issues.apache.org/jira/browse/SPARK-12341 Project: Spark Is

[jira] [Created] (SPARK-12342) Corr (Pearson correlation) should be nullable

2015-12-15 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12342: -- Summary: Corr (Pearson correlation) should be nullable Key: SPARK-12342 URL: https://issues.apache.org/jira/browse/SPARK-12342 Project: Spark Issue Type: Sub-tas

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

2015-12-15 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058055#comment-15058055 ] shane knapp commented on SPARK-11255: - fyi, i rebuilt plyr yesterday under 3.1.1 > R

[jira] [Commented] (SPARK-12219) Spark 1.5.2 code does not build on Scala 2.11.7 with SBT assembly

2015-12-15 Thread Rodrigo Boavida (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058083#comment-15058083 ] Rodrigo Boavida commented on SPARK-12219: - Just got everything running perfectly

[jira] [Assigned] (SPARK-12342) Corr (Pearson correlation) should be nullable

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12342: Assignee: Cheng Lian (was: Apache Spark) > Corr (Pearson correlation) should be nullable

[jira] [Assigned] (SPARK-12341) The "comment" field of DESCRIBE result set should be nullable

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12341: Assignee: Apache Spark (was: Cheng Lian) > The "comment" field of DESCRIBE result set sho

[jira] [Assigned] (SPARK-12342) Corr (Pearson correlation) should be nullable

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12342: Assignee: Apache Spark (was: Cheng Lian) > Corr (Pearson correlation) should be nullable

[jira] [Commented] (SPARK-12178) Expose reporting of StreamInputInfo for custom made streams

2015-12-15 Thread Rodrigo Boavida (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058121#comment-15058121 ] Rodrigo Boavida commented on SPARK-12178: - I plan onto to make my akka direct str

[jira] [Commented] (SPARK-12321) JSON format for logical/physical execution plans

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058178#comment-15058178 ] Apache Spark commented on SPARK-12321: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-4497) HiveThriftServer2 does not exit properly on failure

2015-12-15 Thread Yana Kadiyska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058324#comment-15058324 ] Yana Kadiyska commented on SPARK-4497: -- [~jeffzhang] I have moved on to 1.2 so I cann

[jira] [Commented] (SPARK-12061) Persist for Map/filter with Lambda Functions don't always read from Cache

2015-12-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058419#comment-15058419 ] Xiao Li commented on SPARK-12061: - Start working on it. Thanks! > Persist for Map/filter

[jira] [Commented] (SPARK-12010) Spark JDBC requires support for column-name-free INSERT syntax

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058409#comment-15058409 ] Apache Spark commented on SPARK-12010: -- User 'CK50' has created a pull request for t

[jira] [Resolved] (SPARK-4497) HiveThriftServer2 does not exit properly on failure

2015-12-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4497. -- Resolution: Cannot Reproduce > HiveThriftServer2 does not exit properly on failure > ---

[jira] [Commented] (SPARK-12263) IllegalStateException: Memory can't be 0 for SPARK_WORKER_MEMORY without unit

2015-12-15 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058429#comment-15058429 ] Neelesh Srinivas Salian commented on SPARK-12263: - I would like to work o

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

2015-12-15 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058459#comment-15058459 ] Josh Rosen commented on SPARK-11255: Just to be clear, my proposal was to bump from 3

[jira] [Created] (SPARK-12344) Remove env-based configurations

2015-12-15 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-12344: -- Summary: Remove env-based configurations Key: SPARK-12344 URL: https://issues.apache.org/jira/browse/SPARK-12344 Project: Spark Issue Type: Sub-task

[jira] [Reopened] (SPARK-11255) R Test build should run on R 3.1.1

2015-12-15 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp reopened SPARK-11255: - testing 3.1.2 on our staging instance right now. > R Test build should run on R 3.1.1 >

[jira] [Created] (SPARK-12343) Remove YARN Client / ClientArguments

2015-12-15 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-12343: -- Summary: Remove YARN Client / ClientArguments Key: SPARK-12343 URL: https://issues.apache.org/jira/browse/SPARK-12343 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-12331) R^2 for regression through the origin

2015-12-15 Thread Imran Younus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058439#comment-15058439 ] Imran Younus commented on SPARK-12331: -- Sure, I can take care of this. > R^2 for re

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058464#comment-15058464 ] Shivaram Venkataraman commented on SPARK-12327: --- Do you have a link to the

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

2015-12-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058456#comment-15058456 ] Shivaram Venkataraman commented on SPARK-11255: --- Yeah we could bump up the

[jira] [Updated] (SPARK-12336) Outer join using multiple columns results in wrong nullability

2015-12-15 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12336: Assignee: Cheng Lian (was: Apache Spark) > Outer join using multiple columns results in wrong null

[jira] [Commented] (SPARK-12325) Inappropriate error messages in DataFrame StatFunctions

2015-12-15 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058522#comment-15058522 ] Narine Kokhlikyan commented on SPARK-12325: --- Thank you for your generous kindne

[jira] [Updated] (SPARK-11255) R Test build should run on R 3.1.2

2015-12-15 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp updated SPARK-11255: Summary: R Test build should run on R 3.1.2 (was: R Test build should run on R 3.1.1) > R Test bu

[jira] [Commented] (SPARK-11885) UDAF may nondeterministically generate wrong results

2015-12-15 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058514#comment-15058514 ] Yin Huai commented on SPARK-11885: -- Thank you for the update! > UDAF may nondeterminist

[jira] [Commented] (SPARK-10347) Investigate the usage of normalizePath()

2015-12-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058520#comment-15058520 ] Shivaram Venkataraman commented on SPARK-10347: --- I think its a good idea to

[jira] [Commented] (SPARK-10312) Enhance SerDe to handle atomic vector

2015-12-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058478#comment-15058478 ] Shivaram Venkataraman commented on SPARK-10312: --- SInce the SerDe is an inte

[jira] [Created] (SPARK-12345) Mesos cluster mode is broken

2015-12-15 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12345: - Summary: Mesos cluster mode is broken Key: SPARK-12345 URL: https://issues.apache.org/jira/browse/SPARK-12345 Project: Spark Issue Type: Bug Components:

[jira] [Resolved] (SPARK-11808) Remove Bagel

2015-12-15 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11808. Resolution: Duplicate > Remove Bagel > > > Key: SPARK-11808 >

[jira] [Assigned] (SPARK-9886) Validate usages of Runtime.getRuntime.addShutdownHook

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9886: --- Assignee: Apache Spark > Validate usages of Runtime.getRuntime.addShutdownHook >

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.2

2015-12-15 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058613#comment-15058613 ] shane knapp commented on SPARK-11255: - on staging, i ran the following shell commands

[jira] [Assigned] (SPARK-12317) Support configurate value with unit(e.g. kb/mb/gb) in SQL

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12317: Assignee: Apache Spark > Support configurate value with unit(e.g. kb/mb/gb) in SQL > -

[jira] [Commented] (SPARK-12317) Support configurate value with unit(e.g. kb/mb/gb) in SQL

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058629#comment-15058629 ] Apache Spark commented on SPARK-12317: -- User 'kevinyu98' has created a pull request

[jira] [Assigned] (SPARK-12317) Support configurate value with unit(e.g. kb/mb/gb) in SQL

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12317: Assignee: Apache Spark > Support configurate value with unit(e.g. kb/mb/gb) in SQL > -

[jira] [Assigned] (SPARK-12317) Support configurate value with unit(e.g. kb/mb/gb) in SQL

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12317: Assignee: (was: Apache Spark) > Support configurate value with unit(e.g. kb/mb/gb) in

[jira] [Assigned] (SPARK-12317) Support configurate value with unit(e.g. kb/mb/gb) in SQL

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12317: Assignee: (was: Apache Spark) > Support configurate value with unit(e.g. kb/mb/gb) in

[jira] [Updated] (SPARK-10250) Scala PairRDDFunctions.groupByKey() should be fault-tolerant of single large groups

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10250: -- Summary: Scala PairRDDFunctions.groupByKey() should be fault-tolerant of single large groups (was: Sca

[jira] [Commented] (SPARK-12330) Mesos coarse executor does not cleanup blockmgr properly on termination if data is stored on disk

2015-12-15 Thread Charles Allen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058729#comment-15058729 ] Charles Allen commented on SPARK-12330: --- This is because the CoarseMesosSchedulerBa

[jira] [Updated] (SPARK-11293) Spillable collections leak shuffle memory

2015-12-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11293: -- Target Version/s: 1.6.0 (was: 1.5.3, 1.6.0) Since the back-port for 1.5 was cancelled, I think this is

[jira] [Resolved] (SPARK-11293) Spillable collections leak shuffle memory

2015-12-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11293. --- Resolution: Fixed > Spillable collections leak shuffle memory > -

[jira] [Updated] (SPARK-12345) Mesos cluster mode is broken

2015-12-15 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iulian Dragos updated SPARK-12345: -- Description: The same setup worked in 1.5.2 but is now failing for 1.6.0-RC2. The driver is co

[jira] [Commented] (SPARK-12330) Mesos coarse executor does not cleanup blockmgr properly on termination if data is stored on disk

2015-12-15 Thread Charles Allen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058819#comment-15058819 ] Charles Allen commented on SPARK-12330: --- Looks like the mesos coarse scheduler unde

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2015-12-15 Thread Dean Wampler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058856#comment-15058856 ] Dean Wampler commented on SPARK-12177: -- Since the new Kafka 0.9 consumer API support

[jira] [Assigned] (SPARK-12345) Mesos cluster mode is broken

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12345: Assignee: Apache Spark (was: Iulian Dragos) > Mesos cluster mode is broken >

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-15 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058873#comment-15058873 ] Iulian Dragos commented on SPARK-12345: --- [~skonto] pointed out this commit: https:

[jira] [Created] (SPARK-12346) GLM summary crashes with NoSuchElementException if attributes are missing names

2015-12-15 Thread Eric Liang (JIRA)
Eric Liang created SPARK-12346: -- Summary: GLM summary crashes with NoSuchElementException if attributes are missing names Key: SPARK-12346 URL: https://issues.apache.org/jira/browse/SPARK-12346 Project:

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058887#comment-15058887 ] Apache Spark commented on SPARK-12345: -- User 'dragos' has created a pull request for

[jira] [Assigned] (SPARK-8745) Remove GenerateProjection

2015-12-15 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-8745: - Assignee: Davies Liu > Remove GenerateProjection > - > >

[jira] [Commented] (SPARK-10915) Add support for UDAFs in Python

2015-12-15 Thread Tristan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058987#comment-15058987 ] Tristan commented on SPARK-10915: - Would the analogy to UDAF support in Python be lambdas

[jira] [Assigned] (SPARK-8745) Remove GenerateProjection

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8745: --- Assignee: Apache Spark (was: Davies Liu) > Remove GenerateProjection > -

[jira] [Assigned] (SPARK-8745) Remove GenerateProjection

2015-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8745: --- Assignee: Davies Liu (was: Apache Spark) > Remove GenerateProjection > -

[jira] [Created] (SPARK-12347) Write script to run all MLlib examples for testing

2015-12-15 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-12347: - Summary: Write script to run all MLlib examples for testing Key: SPARK-12347 URL: https://issues.apache.org/jira/browse/SPARK-12347 Project: Spark

[jira] [Commented] (SPARK-10915) Add support for UDAFs in Python

2015-12-15 Thread Justin Uang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059055#comment-15059055 ] Justin Uang commented on SPARK-10915: - An abstract base class would be fine, or somet

[jira] [Comment Edited] (SPARK-10915) Add support for UDAFs in Python

2015-12-15 Thread Justin Uang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059055#comment-15059055 ] Justin Uang edited comment on SPARK-10915 at 12/15/15 11:07 PM: ---

[jira] [Updated] (SPARK-12309) Use sqlContext from MLlibTestSparkContext for spark.ml test suites

2015-12-15 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12309: -- Shepherd: Joseph K. Bradley Assignee: Yanbo Liang Target Version

[jira] [Updated] (SPARK-12324) The documentation sidebar does not collapse properly

2015-12-15 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12324: -- Assignee: Timothy Hunter (was: Apache Spark) > The documentation sidebar does not coll

[jira] [Created] (SPARK-12348) PySpark _inferSchema crashes with incorrect exception on an empty RDD

2015-12-15 Thread Hurshal Patel (JIRA)
Hurshal Patel created SPARK-12348: - Summary: PySpark _inferSchema crashes with incorrect exception on an empty RDD Key: SPARK-12348 URL: https://issues.apache.org/jira/browse/SPARK-12348 Project: Spar

  1   2   >