[jira] [Created] (SPARK-12397) Improve error messages for data sources when they are not found

2015-12-16 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12397: --- Summary: Improve error messages for data sources when they are not found Key: SPARK-12397 URL: https://issues.apache.org/jira/browse/SPARK-12397 Project: Spark

[jira] [Commented] (SPARK-12397) Improve error messages for data sources when they are not found

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15061659#comment-15061659 ] Apache Spark commented on SPARK-12397: -- User 'rxin' has created a pull request for t

[jira] [Created] (SPARK-12398) Smart truncation of DataFrame / Dataset toString

2015-12-16 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12398: --- Summary: Smart truncation of DataFrame / Dataset toString Key: SPARK-12398 URL: https://issues.apache.org/jira/browse/SPARK-12398 Project: Spark Issue Type: Im

[jira] [Assigned] (SPARK-12393) Add read.text and write.text for SparkR

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12393: Assignee: Apache Spark > Add read.text and write.text for SparkR > ---

[jira] [Assigned] (SPARK-12393) Add read.text and write.text for SparkR

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12393: Assignee: (was: Apache Spark) > Add read.text and write.text for SparkR >

[jira] [Created] (SPARK-12399) Display correct error message when accessing REST API with an unknown app Id

2015-12-16 Thread Carson Wang (JIRA)
Carson Wang created SPARK-12399: --- Summary: Display correct error message when accessing REST API with an unknown app Id Key: SPARK-12399 URL: https://issues.apache.org/jira/browse/SPARK-12399 Project: S

[jira] [Created] (SPARK-12400) Avoid writing a shuffle file if a partition has no output (empty)

2015-12-16 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12400: --- Summary: Avoid writing a shuffle file if a partition has no output (empty) Key: SPARK-12400 URL: https://issues.apache.org/jira/browse/SPARK-12400 Project: Spark

[jira] [Commented] (SPARK-12399) Display correct error message when accessing REST API with an unknown app Id

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15061679#comment-15061679 ] Apache Spark commented on SPARK-12399: -- User 'carsonwang' has created a pull request

[jira] [Created] (SPARK-12361) Should set PYSPARK_DRIVER_PYTHON before python test

2015-12-16 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-12361: -- Summary: Should set PYSPARK_DRIVER_PYTHON before python test Key: SPARK-12361 URL: https://issues.apache.org/jira/browse/SPARK-12361 Project: Spark Issue Type: I

[jira] [Commented] (SPARK-12353) wrong output for countByValue and countByValueAndWindow

2015-12-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059675#comment-15059675 ] Sean Owen commented on SPARK-12353: --- Yeah, since the implementation is {code}

[jira] [Updated] (SPARK-12361) Should set PYSPARK_DRIVER_PYTHON before python test

2015-12-16 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-12361: --- Description: If PYSPARK_DRIVER_PYTHON is not set, python version mismatch exception may happen. And

[jira] [Updated] (SPARK-12361) Should set PYSPARK_DRIVER_PYTHON before python test

2015-12-16 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-12361: --- Description: If PYSPARK_DRIVER_PYTHON is not set, python version mismatch exception may happen (when

[jira] [Updated] (SPARK-12361) Should set PYSPARK_DRIVER_PYTHON before python test

2015-12-16 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-12361: --- Description: If PYSPARK_DRIVER_PYTHON is not set, python version mismatch exception may happen (when

[jira] [Commented] (SPARK-12361) Should set PYSPARK_DRIVER_PYTHON before python test

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059686#comment-15059686 ] Apache Spark commented on SPARK-12361: -- User 'zjffdu' has created a pull request for

[jira] [Assigned] (SPARK-12361) Should set PYSPARK_DRIVER_PYTHON before python test

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12361: Assignee: Apache Spark > Should set PYSPARK_DRIVER_PYTHON before python test > ---

[jira] [Assigned] (SPARK-12361) Should set PYSPARK_DRIVER_PYTHON before python test

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12361: Assignee: (was: Apache Spark) > Should set PYSPARK_DRIVER_PYTHON before python test >

[jira] [Created] (SPARK-12362) Inline a full-fledged SQL parser

2015-12-16 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12362: --- Summary: Inline a full-fledged SQL parser Key: SPARK-12362 URL: https://issues.apache.org/jira/browse/SPARK-12362 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-8585) Support LATERAL VIEW in Spark SQL parser

2015-12-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8585. Resolution: Duplicate > Support LATERAL VIEW in Spark SQL parser > -

[jira] [Updated] (SPARK-12362) Create a full-fledged built-in SQL parser

2015-12-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12362: Summary: Create a full-fledged built-in SQL parser (was: Inline a full-fledged SQL parser) > Crea

[jira] [Commented] (SPARK-6936) SQLContext.sql() caused deadlock in multi-thread env

2015-12-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059703#comment-15059703 ] Reynold Xin commented on SPARK-6936: Is this still a problem on the latest Spark? I th

[jira] [Closed] (SPARK-9379) org.apache.spark.sql.catalyst.SqlParser should be extensible easily

2015-12-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-9379. -- Resolution: Invalid I'm closing this ticket because we are going to remove the existing parser soon and

[jira] [Commented] (SPARK-12346) GLM summary crashes with NoSuchElementException if attributes are missing names

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059710#comment-15059710 ] Apache Spark commented on SPARK-12346: -- User 'ericl' has created a pull request for

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059717#comment-15059717 ] Iulian Dragos commented on SPARK-12345: --- There's isn't any {{SPARK_HOME}} set on an

[jira] [Assigned] (SPARK-12361) Should set PYSPARK_DRIVER_PYTHON before python test

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12361: Assignee: (was: Apache Spark) > Should set PYSPARK_DRIVER_PYTHON before python test >

[jira] [Assigned] (SPARK-12361) Should set PYSPARK_DRIVER_PYTHON before python test

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12361: Assignee: Apache Spark > Should set PYSPARK_DRIVER_PYTHON before python test > ---

[jira] [Updated] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

2015-12-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10620: Assignee: (was: Andrew Or) > Look into whether accumulator mechanism can replace TaskMetrics >

[jira] [Assigned] (SPARK-12346) GLM summary crashes with NoSuchElementException if attributes are missing names

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12346: Assignee: Apache Spark > GLM summary crashes with NoSuchElementException if attributes are

[jira] [Assigned] (SPARK-12346) GLM summary crashes with NoSuchElementException if attributes are missing names

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12346: Assignee: (was: Apache Spark) > GLM summary crashes with NoSuchElementException if att

[jira] [Created] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12363: --- Summary: PowerIterationClustering test case failed if we deprecated KMeans.setRuns Key: SPARK-12363 URL: https://issues.apache.org/jira/browse/SPARK-12363 Project: Spar

[jira] [Commented] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059753#comment-15059753 ] Yanbo Liang commented on SPARK-12363: - After I removed [this line|https://github.com

[jira] [Comment Edited] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059753#comment-15059753 ] Yanbo Liang edited comment on SPARK-12363 at 12/16/15 9:38 AM:

[jira] [Updated] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12363: Component/s: (was: GraphX) > PowerIterationClustering test case failed if we deprecated KMeans.

[jira] [Comment Edited] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059753#comment-15059753 ] Yanbo Liang edited comment on SPARK-12363 at 12/16/15 9:40 AM:

[jira] [Comment Edited] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059753#comment-15059753 ] Yanbo Liang edited comment on SPARK-12363 at 12/16/15 9:41 AM:

[jira] [Commented] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059763#comment-15059763 ] Yanbo Liang commented on SPARK-12363: - cc [~mengxr] [~josephkb] [~viirya] Would you m

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059769#comment-15059769 ] Stavros Kontopoulos commented on SPARK-12345: - Adding to [~dragos].(Mesos

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059778#comment-15059778 ] Saisai Shao commented on SPARK-12345: - A simple solution is to change the scripts to

[jira] [Commented] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059788#comment-15059788 ] Yanbo Liang commented on SPARK-12350: - I can reproduce this issue, but it not caused

[jira] [Comment Edited] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059788#comment-15059788 ] Yanbo Liang edited comment on SPARK-12350 at 12/16/15 10:15 AM: ---

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059812#comment-15059812 ] Sean Owen commented on SPARK-12345: --- Yeah, but why is {{SPARK_HOME}} copied across mach

[jira] [Commented] (SPARK-12180) DataFrame.join() in PySpark gives misleading exception when column name exists on both side

2015-12-16 Thread Daniel Thomas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059816#comment-15059816 ] Daniel Thomas commented on SPARK-12180: --- Here is the code. Without renaming the col

[jira] [Resolved] (SPARK-5269) BlockManager.dataDeserialize always creates a new serializer instance

2015-12-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5269. -- Resolution: Won't Fix Assignee: (was: Matt Cheah) > BlockManager.dataDeserialize always create

[jira] [Created] (SPARK-12364) Add ML example for SparkR

2015-12-16 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12364: --- Summary: Add ML example for SparkR Key: SPARK-12364 URL: https://issues.apache.org/jira/browse/SPARK-12364 Project: Spark Issue Type: Improvement Com

[jira] [Commented] (SPARK-12364) Add ML example for SparkR

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059835#comment-15059835 ] Apache Spark commented on SPARK-12364: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-12364) Add ML example for SparkR

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12364: Assignee: (was: Apache Spark) > Add ML example for SparkR > -

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2015-12-16 Thread Nikita Tarasenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059840#comment-15059840 ] Nikita Tarasenko commented on SPARK-12177: -- Current implementation doesn't inclu

[jira] [Assigned] (SPARK-12364) Add ML example for SparkR

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12364: Assignee: Apache Spark > Add ML example for SparkR > - > >

[jira] [Resolved] (SPARK-10114) Add optional getters to the spark.sql.Row

2015-12-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10114. --- Resolution: Duplicate > Add optional getters to the spark.sql.Row > -

[jira] [Created] (SPARK-12365) Use ShutdownHookManager where Runtime.getRuntime.addShutdownHook() is called

2015-12-16 Thread Ted Yu (JIRA)
Ted Yu created SPARK-12365: -- Summary: Use ShutdownHookManager where Runtime.getRuntime.addShutdownHook() is called Key: SPARK-12365 URL: https://issues.apache.org/jira/browse/SPARK-12365 Project: Spark

[jira] [Assigned] (SPARK-12365) Use ShutdownHookManager where Runtime.getRuntime.addShutdownHook() is called

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12365: Assignee: Apache Spark > Use ShutdownHookManager where Runtime.getRuntime.addShutdownHook(

[jira] [Commented] (SPARK-12365) Use ShutdownHookManager where Runtime.getRuntime.addShutdownHook() is called

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059861#comment-15059861 ] Apache Spark commented on SPARK-12365: -- User 'ted-yu' has created a pull request for

[jira] [Created] (SPARK-12366) IllegalArgumentException: requirement failed: File not found: ...sql/catalyst/expressions/GeneratedClass.class when df.show

2015-12-16 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-12366: --- Summary: IllegalArgumentException: requirement failed: File not found: ...sql/catalyst/expressions/GeneratedClass.class when df.show Key: SPARK-12366 URL: https://issues.apa

[jira] [Created] (SPARK-12367) NoSuchElementException during prediction with Random Forest Regressor

2015-12-16 Thread Eugene Morozov (JIRA)
Eugene Morozov created SPARK-12367: -- Summary: NoSuchElementException during prediction with Random Forest Regressor Key: SPARK-12367 URL: https://issues.apache.org/jira/browse/SPARK-12367 Project: Sp

[jira] [Updated] (SPARK-12367) NoSuchElementException during prediction with Random Forest Regressor

2015-12-16 Thread Eugene Morozov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Morozov updated SPARK-12367: --- Attachment: complete-stack-trace.log input.gz CodeThatGivesANo

[jira] [Updated] (SPARK-12367) NoSuchElementException during prediction with Random Forest Regressor

2015-12-16 Thread Eugene Morozov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Morozov updated SPARK-12367: --- Description: I'm consistently getting "java.util.NoSuchElementException: key not found: 1.0"

[jira] [Commented] (SPARK-10618) Refactoring and adding test for Mesos coarse-grained Scheduler

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059905#comment-15059905 ] Apache Spark commented on SPARK-10618: -- User 'SleepyThread' has created a pull reque

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059937#comment-15059937 ] Saisai Shao commented on SPARK-12345: - I think by default Spark Mesos implementation

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059954#comment-15059954 ] Saisai Shao commented on SPARK-12345: - Having a quick test by not exporting {{SPARK_H

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

2015-12-16 Thread Chandra Sekhar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059959#comment-15059959 ] Chandra Sekhar commented on SPARK-10625: Hi I built spark with the pull request n

[jira] [Assigned] (SPARK-12349) Make spark.ml PCAModel load backwards compatible

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12349: Assignee: (was: Apache Spark) > Make spark.ml PCAModel load backwards compatible > ---

[jira] [Commented] (SPARK-11759) Spark task on mesos with docker fails with sh: 1: /opt/spark/bin/spark-class: not found

2015-12-16 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060020#comment-15060020 ] Iulian Dragos commented on SPARK-11759: --- Are you using 1.6.0 release candidates, or

[jira] [Assigned] (SPARK-12349) Make spark.ml PCAModel load backwards compatible

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12349: Assignee: Apache Spark > Make spark.ml PCAModel load backwards compatible > --

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060035#comment-15060035 ] Saisai Shao commented on SPARK-12345: - Here is the one solution (https://github.com/

[jira] [Assigned] (SPARK-12349) Make spark.ml PCAModel load backwards compatible

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12349: Assignee: Apache Spark > Make spark.ml PCAModel load backwards compatible > --

[jira] [Assigned] (SPARK-12349) Make spark.ml PCAModel load backwards compatible

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12349: Assignee: (was: Apache Spark) > Make spark.ml PCAModel load backwards compatible > ---

[jira] [Assigned] (SPARK-12349) Make spark.ml PCAModel load backwards compatible

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12349: Assignee: (was: Apache Spark) > Make spark.ml PCAModel load backwards compatible > ---

[jira] [Assigned] (SPARK-12349) Make spark.ml PCAModel load backwards compatible

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12349: Assignee: Apache Spark > Make spark.ml PCAModel load backwards compatible > --

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Luc Bourlier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060153#comment-15060153 ] Luc Bourlier commented on SPARK-12345: -- I have almost the same fix, which is the sam

[jira] [Comment Edited] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Luc Bourlier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060153#comment-15060153 ] Luc Bourlier edited comment on SPARK-12345 at 12/16/15 3:33 PM: ---

[jira] [Created] (SPARK-12368) Better doc for the binary classification evaluator setMetricName method

2015-12-16 Thread Benjamin Fradet (JIRA)
Benjamin Fradet created SPARK-12368: --- Summary: Better doc for the binary classification evaluator setMetricName method Key: SPARK-12368 URL: https://issues.apache.org/jira/browse/SPARK-12368 Project

[jira] [Commented] (SPARK-12368) Better doc for the binary classification evaluator setMetricName method

2015-12-16 Thread Benjamin Fradet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060167#comment-15060167 ] Benjamin Fradet commented on SPARK-12368: - I've started working on this. > Bette

[jira] [Commented] (SPARK-9042) Spark SQL incompatibility if security is enforced on the Hive warehouse

2015-12-16 Thread Charmee Patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060177#comment-15060177 ] Charmee Patel commented on SPARK-9042: -- I don't agree with closing this issue. We h

[jira] [Updated] (SPARK-12368) Better doc for the binary classification evaluator' metricName

2015-12-16 Thread Benjamin Fradet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Fradet updated SPARK-12368: Summary: Better doc for the binary classification evaluator' metricName (was: Better doc f

[jira] [Commented] (SPARK-9042) Spark SQL incompatibility if security is enforced on the Hive warehouse

2015-12-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060185#comment-15060185 ] Sean Owen commented on SPARK-9042: -- As I say -- AFAIK this problem is resolved by enablin

[jira] [Commented] (SPARK-9042) Spark SQL incompatibility if security is enforced on the Hive warehouse

2015-12-16 Thread Charmee Patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060196#comment-15060196 ] Charmee Patel commented on SPARK-9042: -- Sentry plugin is only managing access to HDFS

[jira] [Commented] (SPARK-9042) Spark SQL incompatibility if security is enforced on the Hive warehouse

2015-12-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060201#comment-15060201 ] Sean Owen commented on SPARK-9042: -- Yea, this is coming from our support. (Can we take th

[jira] [Updated] (SPARK-12288) Support UnsafeRow in Coalesce/Except/Intersect

2015-12-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12288: --- Assignee: Xiao Li > Support UnsafeRow in Coalesce/Except/Intersect >

[jira] [Updated] (SPARK-12293) Support UnsafeRow in LocalTableScan

2015-12-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12293: --- Assignee: Liang-Chi Hsieh (was: Apache Spark) > Support UnsafeRow in LocalTableScan > --

[jira] [Commented] (SPARK-9042) Spark SQL incompatibility if security is enforced on the Hive warehouse

2015-12-16 Thread Andrew Ray (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060208#comment-15060208 ] Andrew Ray commented on SPARK-9042: --- Sean, I think there are a couple issues going on he

[jira] [Created] (SPARK-12369) ataFrameReader fails on globbing parquet paths

2015-12-16 Thread Yana Kadiyska (JIRA)
Yana Kadiyska created SPARK-12369: - Summary: ataFrameReader fails on globbing parquet paths Key: SPARK-12369 URL: https://issues.apache.org/jira/browse/SPARK-12369 Project: Spark Issue Type:

[jira] [Updated] (SPARK-12369) DataFrameReader fails on globbing parquet paths

2015-12-16 Thread Yana Kadiyska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yana Kadiyska updated SPARK-12369: -- Summary: DataFrameReader fails on globbing parquet paths (was: ataFrameReader fails on globbin

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060213#comment-15060213 ] Davies Liu commented on SPARK-12179: I think this UDF is not thread safe, rowNum and

[jira] [Updated] (SPARK-12369) DataFrameReader fails on globbing parquet paths

2015-12-16 Thread Yana Kadiyska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yana Kadiyska updated SPARK-12369: -- Description: Start with a list of parquet paths where some or all do not exist: {noformat} val

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060217#comment-15060217 ] Davies Liu commented on SPARK-12179: Which version of Spark are you using? > Spark

[jira] [Comment Edited] (SPARK-12179) Spark SQL get different result with the same code

2015-12-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060217#comment-15060217 ] Davies Liu edited comment on SPARK-12179 at 12/16/15 4:04 PM: -

[jira] [Commented] (SPARK-11478) ML StringIndexer return inconsistent schema

2015-12-16 Thread Wojciech Jurczyk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060210#comment-15060210 ] Wojciech Jurczyk commented on SPARK-11478: -- Any progress on this, [~yanboliang]?

[jira] [Commented] (SPARK-9042) Spark SQL incompatibility if security is enforced on the Hive warehouse

2015-12-16 Thread Charmee Patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060219#comment-15060219 ] Charmee Patel commented on SPARK-9042: -- Yes, we can take it back to cloudera land. I

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2015-12-16 Thread Tom Waterhouse (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060218#comment-15060218 ] Tom Waterhouse commented on SPARK-12177: SSL is very important for our deployment

[jira] [Commented] (SPARK-9042) Spark SQL incompatibility if security is enforced on the Hive warehouse

2015-12-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060223#comment-15060223 ] Sean Owen commented on SPARK-9042: -- OK, could be. I'm updating this by request from more

[jira] [Updated] (SPARK-12370) Documentation should link to examples from its own release version

2015-12-16 Thread Brian London (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian London updated SPARK-12370: - Issue Type: Improvement (was: Bug) > Documentation should link to examples from its own release

[jira] [Created] (SPARK-12370) Documentation should link to examples from its own release version

2015-12-16 Thread Brian London (JIRA)
Brian London created SPARK-12370: Summary: Documentation should link to examples from its own release version Key: SPARK-12370 URL: https://issues.apache.org/jira/browse/SPARK-12370 Project: Spark

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Luc Bourlier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060239#comment-15060239 ] Luc Bourlier commented on SPARK-12345: -- I tested our usual test cases with my change

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060236#comment-15060236 ] Iulian Dragos commented on SPARK-12345: --- I'd prefer filtering it at at the submit s

[jira] [Resolved] (SPARK-6936) SQLContext.sql() caused deadlock in multi-thread env

2015-12-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6936. - Resolution: Fixed Fix Version/s: 1.5.0 > SQLContext.sql() caused deadlock in multi-

[jira] [Commented] (SPARK-12368) Better doc for the binary classification evaluator' metricName

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060279#comment-15060279 ] Apache Spark commented on SPARK-12368: -- User 'BenFradet' has created a pull request

[jira] [Assigned] (SPARK-12289) Support UnsafeRow in TakeOrderedAndProject/Limit

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12289: Assignee: Apache Spark > Support UnsafeRow in TakeOrderedAndProject/Limit > --

[jira] [Commented] (SPARK-12289) Support UnsafeRow in TakeOrderedAndProject/Limit

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060287#comment-15060287 ] Apache Spark commented on SPARK-12289: -- User 'viirya' has created a pull request for

[jira] [Created] (SPARK-12371) Make sure Dataset nullability conforms to its underlying logical plan

2015-12-16 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12371: -- Summary: Make sure Dataset nullability conforms to its underlying logical plan Key: SPARK-12371 URL: https://issues.apache.org/jira/browse/SPARK-12371 Project: Spark

[jira] [Assigned] (SPARK-12371) Make sure Dataset nullability conforms to its underlying logical plan

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12371: Assignee: Apache Spark (was: Cheng Lian) > Make sure Dataset nullability conforms to its

[jira] [Commented] (SPARK-12360) Support using 64-bit long type in SparkR

2015-12-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060381#comment-15060381 ] Shivaram Venkataraman commented on SPARK-12360: --- The lack of 64 bit numbers

  1   2   3   4   >