[jira] [Commented] (SPARK-12066) spark sql throw java.lang.ArrayIndexOutOfBoundsException when use table.* with join

2015-12-22 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067719#comment-15067719 ] Ricky Yang commented on SPARK-12066: Problems have been confirmed,There is a line of

[jira] [Commented] (SPARK-12247) Documentation for spark.ml's ALS and collaborative filtering in general

2015-12-22 Thread Benjamin Fradet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067726#comment-15067726 ] Benjamin Fradet commented on SPARK-12247: - [~thunterdb] Do you think I should als

[jira] [Resolved] (SPARK-12296) Feature parity for pyspark.mllib StandardScalerModel

2015-12-22 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath resolved SPARK-12296. Resolution: Fixed Fix Version/s: 2.0.0 > Feature parity for pyspark.mllib StandardSc

[jira] [Commented] (SPARK-12296) Feature parity for pyspark.mllib StandardScalerModel

2015-12-22 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067725#comment-15067725 ] Nick Pentreath commented on SPARK-12296: Issue resolved by pull request 10298 htt

[jira] [Created] (SPARK-12477) [SQL] Tungsten projection fails for null values in array fields

2015-12-22 Thread Pierre Borckmans (JIRA)
Pierre Borckmans created SPARK-12477: Summary: [SQL] Tungsten projection fails for null values in array fields Key: SPARK-12477 URL: https://issues.apache.org/jira/browse/SPARK-12477 Project: Spar

[jira] [Resolved] (SPARK-12446) Add unit tests for JDBCRDD internal functions

2015-12-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12446. - Resolution: Fixed Assignee: Takeshi Yamamuro (was: Apache Spark) Fix Version/s: 2

[jira] [Updated] (SPARK-12477) [SQL] Tungsten projection fails for null values in array fields

2015-12-22 Thread Pierre Borckmans (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pierre Borckmans updated SPARK-12477: - Description: Accessing null elements in an array field fails when tungsten is enabled. T

[jira] [Updated] (SPARK-12446) Add unit tests for JDBCRDD internal functions

2015-12-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12446: Affects Version/s: (was: 1.5.2) > Add unit tests for JDBCRDD internal functions > -

[jira] [Commented] (SPARK-12459) Add ExpressionDescription to string functions

2015-12-22 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067769#comment-15067769 ] Huaxin Gao commented on SPARK-12459: I will work on this one. Thanks! > Add Expressi

[jira] [Commented] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

2015-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067776#comment-15067776 ] Sean Owen commented on SPARK-12453: --- I'd prefer to make this a subset of SPARK-12269. T

[jira] [Commented] (SPARK-12269) Update aws-java-sdk version

2015-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1506#comment-1506 ] Sean Owen commented on SPARK-12269: --- NB: https://issues.apache.org/jira/browse/SPARK-12

[jira] [Assigned] (SPARK-12440) Avoid setCheckpointDir warning when filesystem is not local

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12440: Assignee: Apache Spark > Avoid setCheckpointDir warning when filesystem is not local > ---

[jira] [Commented] (SPARK-12356) Implement unhandledFilter interface for ORC

2015-12-22 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067923#comment-15067923 ] Hyukjin Kwon commented on SPARK-12356: -- Actually, I am not too sure if we have to im

[jira] [Commented] (SPARK-12477) [SQL] Tungsten projection fails for null values in array fields

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067942#comment-15067942 ] Apache Spark commented on SPARK-12477: -- User 'pierre-borckmans' has created a pull r

[jira] [Updated] (SPARK-12477) [SQL] Tungsten projection fails for null values in array fields

2015-12-22 Thread Pierre Borckmans (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pierre Borckmans updated SPARK-12477: - Description: Accessing null elements in an array field fails when tungsten is enabled. It

[jira] [Commented] (SPARK-1253) Need to load mapred-site.xml for reading mapreduce.application.classpath

2015-12-22 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067962#comment-15067962 ] Devaraj K commented on SPARK-1253: -- [~sandyr], Do you want to work on this issue? I would

[jira] [Commented] (SPARK-9600) DataFrameWriter.saveAsTable always writes data to "/user/hive/warehouse"

2015-12-22 Thread Furcy Pin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067972#comment-15067972 ] Furcy Pin commented on SPARK-9600: -- Hi, I would like to reopen this issue as I ran into

[jira] [Resolved] (SPARK-12371) Make sure non-nullable arguments of NewInstance don't receive null input data

2015-12-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-12371. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10331 [https://github.

[jira] [Created] (SPARK-12478) Top level case class field of a Dataset can't be null

2015-12-22 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12478: -- Summary: Top level case class field of a Dataset can't be null Key: SPARK-12478 URL: https://issues.apache.org/jira/browse/SPARK-12478 Project: Spark Issue Type:

[jira] [Updated] (SPARK-12478) Dataset fields whose types are case classs can't be null

2015-12-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12478: --- Summary: Dataset fields whose types are case classs can't be null (was: Top level case class field o

[jira] [Updated] (SPARK-12478) Dataset fields of product types can't be null

2015-12-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12478: --- Summary: Dataset fields of product types can't be null (was: Dataset fields whose types are case cla

[jira] [Assigned] (SPARK-12478) Dataset fields of product types can't be null

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12478: Assignee: Apache Spark (was: Cheng Lian) > Dataset fields of product types can't be null

[jira] [Commented] (SPARK-12478) Dataset fields of product types can't be null

2015-12-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068043#comment-15068043 ] Cheng Lian commented on SPARK-12478: [~marmbrus] I guess this issue probably doesn't

[jira] [Closed] (SPARK-12444) A lightweight Scala DSL for schema construction

2015-12-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian closed SPARK-12444. -- Resolution: Won't Fix > A lightweight Scala DSL for schema construction > -

[jira] [Commented] (SPARK-12478) Dataset fields of product types can't be null

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068052#comment-15068052 ] Apache Spark commented on SPARK-12478: -- User 'liancheng' has created a pull request

[jira] [Updated] (SPARK-1253) Need to load mapred-site.xml for reading mapreduce.application.classpath

2015-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1253: - Assignee: (was: Sandy Ryza) I'm 99% sure Sandy was never working on it, so have unassigned it. I am al

[jira] [Commented] (SPARK-12319) Address endian specific problems surfaced in 1.6

2015-12-22 Thread Tim Preece (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068176#comment-15068176 ] Tim Preece commented on SPARK-12319: [~marmbrus] Hi Michael, I think this may be a pr

[jira] [Commented] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

2015-12-22 Thread Alex Freydel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068191#comment-15068191 ] Alex Freydel commented on SPARK-10528: -- agree. on win 7 x64 > spark-shell throws ja

[jira] [Created] (SPARK-12479) sparkR collect on GroupedData throws R error "missing value where TRUE/FALSE needed"

2015-12-22 Thread Paulo Magalhaes (JIRA)
Paulo Magalhaes created SPARK-12479: --- Summary: sparkR collect on GroupedData throws R error "missing value where TRUE/FALSE needed" Key: SPARK-12479 URL: https://issues.apache.org/jira/browse/SPARK-12479

[jira] [Created] (SPARK-12480) add Hash expression that can calculate hash value for a group of expressions

2015-12-22 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-12480: --- Summary: add Hash expression that can calculate hash value for a group of expressions Key: SPARK-12480 URL: https://issues.apache.org/jira/browse/SPARK-12480 Project: S

[jira] [Assigned] (SPARK-12480) add Hash expression that can calculate hash value for a group of expressions

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12480: Assignee: Apache Spark > add Hash expression that can calculate hash value for a group of

[jira] [Assigned] (SPARK-12480) add Hash expression that can calculate hash value for a group of expressions

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12480: Assignee: (was: Apache Spark) > add Hash expression that can calculate hash value for

[jira] [Assigned] (SPARK-12480) add Hash expression that can calculate hash value for a group of expressions

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12480: Assignee: Apache Spark > add Hash expression that can calculate hash value for a group of

[jira] [Commented] (SPARK-12480) add Hash expression that can calculate hash value for a group of expressions

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068268#comment-15068268 ] Apache Spark commented on SPARK-12480: -- User 'cloud-fan' has created a pull request

[jira] [Updated] (SPARK-12479) sparkR collect on GroupedData throws R error "missing value where TRUE/FALSE needed"

2015-12-22 Thread Paulo Magalhaes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paulo Magalhaes updated SPARK-12479: Description: sparkR collect on GroupedData throws "missing value where TRUE/FALSE needed"

[jira] [Commented] (SPARK-9600) DataFrameWriter.saveAsTable always writes data to "/user/hive/warehouse"

2015-12-22 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068333#comment-15068333 ] Yin Huai commented on SPARK-9600: - {{df.write.saveAsTable("t2")}} writes data to the curre

[jira] [Assigned] (SPARK-12368) Better doc for the binary classification evaluator' metricName

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12368: Assignee: (was: Apache Spark) > Better doc for the binary classification evaluator' me

[jira] [Assigned] (SPARK-12368) Better doc for the binary classification evaluator' metricName

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12368: Assignee: Apache Spark > Better doc for the binary classification evaluator' metricName >

[jira] [Commented] (SPARK-12351) Add documentation of submitting Mesos jobs with cluster mode

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068360#comment-15068360 ] Apache Spark commented on SPARK-12351: -- User 'tnachen' has created a pull request fo

[jira] [Updated] (SPARK-3369) Java mapPartitions Iterator->Iterable is inconsistent with Scala's Iterator->Iterator

2015-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3369: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-11806 > Java mapPartitions Iterator->Iterab

[jira] [Assigned] (SPARK-3369) Java mapPartitions Iterator->Iterable is inconsistent with Scala's Iterator->Iterator

2015-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-3369: Assignee: Sean Owen (was: Apache Spark) > Java mapPartitions Iterator->Iterable is inconsistent wi

[jira] [Created] (SPARK-12481) Remove usage of Hadoop deprecated APIs and reflection that supported 1.x

2015-12-22 Thread Sean Owen (JIRA)
Sean Owen created SPARK-12481: - Summary: Remove usage of Hadoop deprecated APIs and reflection that supported 1.x Key: SPARK-12481 URL: https://issues.apache.org/jira/browse/SPARK-12481 Project: Spark

[jira] [Commented] (SPARK-11855) Catalyst breaks backwards compatibility in branch-1.6

2015-12-22 Thread Santiago M. Mola (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068396#comment-15068396 ] Santiago M. Mola commented on SPARK-11855: -- I will not have time to finish this

[jira] [Created] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

2015-12-22 Thread Kyle Sutton (JIRA)
Kyle Sutton created SPARK-12482: --- Summary: CLONE - Spark fileserver not started on same IP as using spark.driver.host Key: SPARK-12482 URL: https://issues.apache.org/jira/browse/SPARK-12482 Project: Spa

[jira] [Commented] (SPARK-9271) Concurrency bug triggered by partition predicate push-down

2015-12-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068434#comment-15068434 ] Cheng Lian commented on SPARK-9271: --- I only observed this issue in the context of PR #74

[jira] [Resolved] (SPARK-9271) Concurrency bug triggered by partition predicate push-down

2015-12-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-9271. --- Resolution: Cannot Reproduce > Concurrency bug triggered by partition predicate push-down > --

[jira] [Commented] (SPARK-12449) Pushing down arbitrary logical plans to data sources

2015-12-22 Thread Yan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068447#comment-15068447 ] Yan commented on SPARK-12449: - A few thoughts on the capabilities of this "CatalystSource Int

[jira] [Updated] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

2015-12-22 Thread Kyle Sutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Description: The issue of the file server starting up on the default IP instead of the IP address

[jira] [Updated] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

2015-12-22 Thread Kyle Sutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Affects Version/s: 1.5.2 > CLONE - Spark fileserver not started on same IP as using spark.driver.ho

[jira] [Updated] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

2015-12-22 Thread Kyle Sutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Description: The issue of the file server using the default IP instead of the IP address configure

[jira] [Updated] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

2015-12-22 Thread Kyle Sutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Description: The issue of the file server using the default IP instead of the IP address configure

[jira] [Updated] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

2015-12-22 Thread Kyle Sutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Description: The issue of the file server using the default IP instead of the IP address configure

[jira] [Updated] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

2015-12-22 Thread Kyle Sutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Description: The issue of the file server using the default IP instead of the IP address configure

[jira] [Resolved] (SPARK-12475) Upgrade Zinc from 0.3.5.3 to 0.3.9

2015-12-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12475. Resolution: Fixed Assignee: Josh Rosen (was: Apache Spark) Fix Version/s: 2.0.0 Fi

[jira] [Updated] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

2015-12-22 Thread Kyle Sutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Description: The issue of the file server using the default IP instead of the IP address configure

[jira] [Updated] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

2015-12-22 Thread Kyle Sutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Description: The issue of the file server using the default IP instead of the IP address configure

[jira] [Resolved] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

2015-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12482. --- Resolution: Duplicate There's no value in cloning the issue. Write on the original one, and reopen if

[jira] [Assigned] (SPARK-12477) [SQL] Tungsten projection fails for null values in array fields

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12477: Assignee: Apache Spark > [SQL] Tungsten projection fails for null values in array fields >

[jira] [Resolved] (SPARK-12456) Add ExpressionDescription to misc functions

2015-12-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12456. - Resolution: Fixed Assignee: Xiu(Joe) Guo Fix Version/s: 2.0.0 > Add ExpressionDes

[jira] [Commented] (SPARK-1865) Improve behavior of cleanup of disk state

2015-12-22 Thread Charles Allen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068542#comment-15068542 ] Charles Allen commented on SPARK-1865: -- This is compounded by the fact that some of t

[jira] [Updated] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

2015-12-22 Thread Kyle Sutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Description: The issue of the file server using the default IP instead of the IP address configure

[jira] [Updated] (SPARK-12482) Spark fileserver not started on same IP as using spark.driver.host

2015-12-22 Thread Kyle Sutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Summary: Spark fileserver not started on same IP as using spark.driver.host (was: CLONE - Spark fi

[jira] [Updated] (SPARK-12482) Spark fileserver not started on same IP as configured in spark.driver.host

2015-12-22 Thread Kyle Sutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Summary: Spark fileserver not started on same IP as configured in spark.driver.host (was: Spark fi

[jira] [Reopened] (SPARK-12482) Spark fileserver not started on same IP as configured in spark.driver.host

2015-12-22 Thread Kyle Sutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton reopened SPARK-12482: - Reopening SPARK-6476, since it's still an issue > Spark fileserver not started on same IP as configu

[jira] [Commented] (SPARK-12482) Spark fileserver not started on same IP as configured in spark.driver.host

2015-12-22 Thread Kyle Sutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068562#comment-15068562 ] Kyle Sutton commented on SPARK-12482: - Wasn't able to reopen the original one, so tri

[jira] [Reopened] (SPARK-6476) Spark fileserver not started on same IP as using spark.driver.host

2015-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-6476: -- > Spark fileserver not started on same IP as using spark.driver.host > -

[jira] [Resolved] (SPARK-12482) Spark fileserver not started on same IP as configured in spark.driver.host

2015-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12482. --- Resolution: Duplicate I reopened the other one and reclosed this. Please see Rares's comments there

[jira] [Commented] (SPARK-12482) Spark fileserver not started on same IP as configured in spark.driver.host

2015-12-22 Thread Kyle Sutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068565#comment-15068565 ] Kyle Sutton commented on SPARK-12482: - Actually, how do I reopen a ticket I didn't wr

[jira] [Commented] (SPARK-12482) Spark fileserver not started on same IP as configured in spark.driver.host

2015-12-22 Thread Kyle Sutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068568#comment-15068568 ] Kyle Sutton commented on SPARK-12482: - Thanks! I did. I think he's saying that file

[jira] [Commented] (SPARK-6476) Spark fileserver not started on same IP as using spark.driver.host

2015-12-22 Thread Kyle Sutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068572#comment-15068572 ] Kyle Sutton commented on SPARK-6476: The issue of the file server using the default IP

[jira] [Assigned] (SPARK-12462) Add ExpressionDescription to misc non-aggregate functions

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12462: Assignee: (was: Apache Spark) > Add ExpressionDescription to misc non-aggregate functi

[jira] [Assigned] (SPARK-12462) Add ExpressionDescription to misc non-aggregate functions

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12462: Assignee: Apache Spark > Add ExpressionDescription to misc non-aggregate functions > -

[jira] [Comment Edited] (SPARK-6476) Spark fileserver not started on same IP as using spark.driver.host

2015-12-22 Thread Kyle Sutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068572#comment-15068572 ] Kyle Sutton edited comment on SPARK-6476 at 12/22/15 7:14 PM: --

[jira] [Assigned] (SPARK-12462) Add ExpressionDescription to misc non-aggregate functions

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12462: Assignee: Apache Spark > Add ExpressionDescription to misc non-aggregate functions > -

[jira] [Commented] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

2015-12-22 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068627#comment-15068627 ] Maciej Bryński commented on SPARK-11437: [~davies] Are you sure that this patch i

[jira] [Comment Edited] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

2015-12-22 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068627#comment-15068627 ] Maciej Bryński edited comment on SPARK-11437 at 12/22/15 7:44 PM: -

[jira] [Comment Edited] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

2015-12-22 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068627#comment-15068627 ] Maciej Bryński edited comment on SPARK-11437 at 12/22/15 7:45 PM: -

[jira] [Created] (SPARK-12483) Data Frame as() does not work in Java

2015-12-22 Thread Andrew Davidson (JIRA)
Andrew Davidson created SPARK-12483: --- Summary: Data Frame as() does not work in Java Key: SPARK-12483 URL: https://issues.apache.org/jira/browse/SPARK-12483 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12483) Data Frame as() does not work in Java

2015-12-22 Thread Andrew Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Davidson updated SPARK-12483: Attachment: SPARK_12483_unitTest.java add a unit test file > Data Frame as() does not wor

[jira] [Updated] (SPARK-12483) Data Frame as() does not work in Java

2015-12-22 Thread Andrew Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Davidson updated SPARK-12483: Attachment: (was: SPARK_12483_unitTest.java) > Data Frame as() does not work in Java >

[jira] [Issue Comment Deleted] (SPARK-12483) Data Frame as() does not work in Java

2015-12-22 Thread Andrew Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Davidson updated SPARK-12483: Comment: was deleted (was: add a unit test file ) > Data Frame as() does not work in Java

[jira] [Updated] (SPARK-12483) Data Frame as() does not work in Java

2015-12-22 Thread Andrew Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Davidson updated SPARK-12483: Attachment: SPARK_12483_unitTest.java added a unit test file > Data Frame as() does not wo

[jira] [Commented] (SPARK-12462) Add ExpressionDescription to misc non-aggregate functions

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068670#comment-15068670 ] Apache Spark commented on SPARK-12462: -- User 'xguo27' has created a pull request for

[jira] [Comment Edited] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

2015-12-22 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068627#comment-15068627 ] Maciej Bryński edited comment on SPARK-11437 at 12/22/15 8:24 PM: -

[jira] [Created] (SPARK-12484) DataFrame withColumn() does not work in Java

2015-12-22 Thread Andrew Davidson (JIRA)
Andrew Davidson created SPARK-12484: --- Summary: DataFrame withColumn() does not work in Java Key: SPARK-12484 URL: https://issues.apache.org/jira/browse/SPARK-12484 Project: Spark Issue Type

[jira] [Updated] (SPARK-12484) DataFrame withColumn() does not work in Java

2015-12-22 Thread Andrew Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Davidson updated SPARK-12484: Attachment: UDFTest.java Add a unit test file > DataFrame withColumn() does not work in Ja

[jira] [Commented] (SPARK-12484) DataFrame withColumn() does not work in Java

2015-12-22 Thread Andrew Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068684#comment-15068684 ] Andrew Davidson commented on SPARK-12484: - you can find some more back ground on

[jira] [Commented] (SPARK-12470) Incorrect calculation of row size in o.a.s.sql.catalyst.expressions.codegen.GenerateUnsafeRowJoiner

2015-12-22 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068693#comment-15068693 ] Pete Robbins commented on SPARK-12470: -- I'm fairly sure the code in my PR is correct

[jira] [Commented] (SPARK-12484) DataFrame withColumn() does not work in Java

2015-12-22 Thread Andrew Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068696#comment-15068696 ] Andrew Davidson commented on SPARK-12484: - What I am really trying to do is rewri

[jira] [Commented] (SPARK-12484) DataFrame withColumn() does not work in Java

2015-12-22 Thread Andrew Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068698#comment-15068698 ] Andrew Davidson commented on SPARK-12484: - releated issue https://issues.apache.o

[jira] [Updated] (SPARK-12485) Rename "dynamic allocation" to "elastic scaling"

2015-12-22 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12485: -- Target Version/s: 2.0.0 > Rename "dynamic allocation" to "elastic scaling" > --

[jira] [Created] (SPARK-12485) Rename "dynamic allocation" to "elastic scaling"

2015-12-22 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12485: - Summary: Rename "dynamic allocation" to "elastic scaling" Key: SPARK-12485 URL: https://issues.apache.org/jira/browse/SPARK-12485 Project: Spark Issue Type: Sub-ta

[jira] [Assigned] (SPARK-12414) Remove closure serializer

2015-12-22 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-12414: - Assignee: Andrew Or > Remove closure serializer > - > >

[jira] [Created] (SPARK-12486) Executors are not always terminated successfully by the worker.

2015-12-22 Thread Nong Li (JIRA)
Nong Li created SPARK-12486: --- Summary: Executors are not always terminated successfully by the worker. Key: SPARK-12486 URL: https://issues.apache.org/jira/browse/SPARK-12486 Project: Spark Issue

[jira] [Created] (SPARK-12487) Add docs for Kafka message handler

2015-12-22 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-12487: Summary: Add docs for Kafka message handler Key: SPARK-12487 URL: https://issues.apache.org/jira/browse/SPARK-12487 Project: Spark Issue Type: Documentation

[jira] [Assigned] (SPARK-12487) Add docs for Kafka message handler

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12487: Assignee: Shixiong Zhu (was: Apache Spark) > Add docs for Kafka message handler > ---

[jira] [Commented] (SPARK-12485) Rename "dynamic allocation" to "elastic scaling"

2015-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068731#comment-15068731 ] Sean Owen commented on SPARK-12485: --- I must say I don't think that's worth it. Both ter

[jira] [Assigned] (SPARK-12487) Add docs for Kafka message handler

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12487: Assignee: Apache Spark (was: Shixiong Zhu) > Add docs for Kafka message handler > ---

[jira] [Created] (SPARK-12488) LDA Describe Topics Generates Invalid Term IDs

2015-12-22 Thread Ilya Ganelin (JIRA)
Ilya Ganelin created SPARK-12488: Summary: LDA Describe Topics Generates Invalid Term IDs Key: SPARK-12488 URL: https://issues.apache.org/jira/browse/SPARK-12488 Project: Spark Issue Type: Bu

[jira] [Commented] (SPARK-12487) Add docs for Kafka message handler

2015-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068748#comment-15068748 ] Apache Spark commented on SPARK-12487: -- User 'zsxwing' has created a pull request fo

  1   2   >