[jira] [Assigned] (SPARK-12480) add Hash expression that can calculate hash value for a group of expressions

[ https://issues.apache.org/jira/browse/SPARK-12480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12480: Assignee: Apache Spark > add Hash expression that can calculate hash value for a group of

[jira] [Assigned] (SPARK-12480) add Hash expression that can calculate hash value for a group of expressions

[ https://issues.apache.org/jira/browse/SPARK-12480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12480: Assignee: (was: Apache Spark) > add Hash expression that can calculate hash value for

[jira] [Commented] (SPARK-12480) add Hash expression that can calculate hash value for a group of expressions

[ https://issues.apache.org/jira/browse/SPARK-12480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068268#comment-15068268 ] Apache Spark commented on SPARK-12480: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-12479) sparkR collect on GroupedData throws R error "missing value where TRUE/FALSE needed"

Paulo Magalhaes created SPARK-12479: --- Summary: sparkR collect on GroupedData throws R error "missing value where TRUE/FALSE needed" Key: SPARK-12479 URL: https://issues.apache.org/jira/browse/SPARK-12479

[jira] [Created] (SPARK-12480) add Hash expression that can calculate hash value for a group of expressions

Wenchen Fan created SPARK-12480: --- Summary: add Hash expression that can calculate hash value for a group of expressions Key: SPARK-12480 URL: https://issues.apache.org/jira/browse/SPARK-12480 Project:

[jira] [Assigned] (SPARK-12480) add Hash expression that can calculate hash value for a group of expressions

[ https://issues.apache.org/jira/browse/SPARK-12480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12480: Assignee: Apache Spark > add Hash expression that can calculate hash value for a group of

[jira] [Updated] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Description: The issue of the file server using the default IP instead of the IP address

[jira] [Resolved] (SPARK-12456) Add ExpressionDescription to misc functions

[ https://issues.apache.org/jira/browse/SPARK-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12456. - Resolution: Fixed Assignee: Xiu(Joe) Guo Fix Version/s: 2.0.0 > Add

[jira] [Commented] (SPARK-12482) Spark fileserver not started on same IP as configured in spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068562#comment-15068562 ] Kyle Sutton commented on SPARK-12482: - Wasn't able to reopen the original one, so tried cloning to

[jira] [Comment Edited] (SPARK-6476) Spark fileserver not started on same IP as using spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-6476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068572#comment-15068572 ] Kyle Sutton edited comment on SPARK-6476 at 12/22/15 7:14 PM: -- The issue of

[jira] [Updated] (SPARK-12488) LDA describeTopics() Generates Invalid Term IDs

[ https://issues.apache.org/jira/browse/SPARK-12488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilya Ganelin updated SPARK-12488: - Description: When running the LDA model, and using the describeTopics function, invalid values

[jira] [Resolved] (SPARK-12471) Spark daemons should log their pid in the log file

[ https://issues.apache.org/jira/browse/SPARK-12471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12471. - Resolution: Fixed Assignee: Nong Li (was: Apache Spark) Fix Version/s: 2.0.0 >

[jira] [Resolved] (SPARK-12475) Upgrade Zinc from 0.3.5.3 to 0.3.9

[ https://issues.apache.org/jira/browse/SPARK-12475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12475. Resolution: Fixed Assignee: Josh Rosen (was: Apache Spark) Fix Version/s: 2.0.0

[jira] [Updated] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Description: The issue of the file server using the default IP instead of the IP address

[jira] [Commented] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

[ https://issues.apache.org/jira/browse/SPARK-11437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068627#comment-15068627 ] Maciej Bryński commented on SPARK-11437: [~davies] Are you sure that this patch is OK ? Right

[jira] [Created] (SPARK-12483) Data Frame as() does not work in Java

Andrew Davidson created SPARK-12483: --- Summary: Data Frame as() does not work in Java Key: SPARK-12483 URL: https://issues.apache.org/jira/browse/SPARK-12483 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

[ https://issues.apache.org/jira/browse/SPARK-11437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068627#comment-15068627 ] Maciej Bryński edited comment on SPARK-11437 at 12/22/15 8:24 PM: --

[jira] [Assigned] (SPARK-12477) [SQL] Tungsten projection fails for null values in array fields

[ https://issues.apache.org/jira/browse/SPARK-12477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12477: Assignee: Apache Spark > [SQL] Tungsten projection fails for null values in array fields

[jira] [Updated] (SPARK-12482) Spark fileserver not started on same IP as using spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Summary: Spark fileserver not started on same IP as using spark.driver.host (was: CLONE - Spark

[jira] [Comment Edited] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

[ https://issues.apache.org/jira/browse/SPARK-11437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068627#comment-15068627 ] Maciej Bryński edited comment on SPARK-11437 at 12/22/15 7:45 PM: --

[jira] [Commented] (SPARK-12462) Add ExpressionDescription to misc non-aggregate functions

[ https://issues.apache.org/jira/browse/SPARK-12462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068670#comment-15068670 ] Apache Spark commented on SPARK-12462: -- User 'xguo27' has created a pull request for this issue:

[jira] [Commented] (SPARK-12484) DataFrame withColumn() does not work in Java

[ https://issues.apache.org/jira/browse/SPARK-12484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068696#comment-15068696 ] Andrew Davidson commented on SPARK-12484: - What I am really trying to do is rewrite the following

[jira] [Updated] (SPARK-12485) Rename "dynamic allocation" to "elastic scaling"

[ https://issues.apache.org/jira/browse/SPARK-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12485: -- Target Version/s: 2.0.0 > Rename "dynamic allocation" to "elastic scaling" >

[jira] [Updated] (SPARK-12488) LDA Describe Topics Generates Invalid Term IDs

[ https://issues.apache.org/jira/browse/SPARK-12488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilya Ganelin updated SPARK-12488: - Description: When running the LDA model, and using the describeTopics function, invalid values

[jira] [Updated] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Description: The issue of the file server using the default IP instead of the IP address

[jira] [Commented] (SPARK-1865) Improve behavior of cleanup of disk state

[ https://issues.apache.org/jira/browse/SPARK-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068542#comment-15068542 ] Charles Allen commented on SPARK-1865: -- This is compounded by the fact that some of the shutdown

[jira] [Updated] (SPARK-12483) Data Frame as() does not work in Java

[ https://issues.apache.org/jira/browse/SPARK-12483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Davidson updated SPARK-12483: Attachment: SPARK_12483_unitTest.java added a unit test file > Data Frame as() does not

[jira] [Commented] (SPARK-12488) LDA describeTopics() Generates Invalid Term IDs

[ https://issues.apache.org/jira/browse/SPARK-12488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068761#comment-15068761 ] Ilya Ganelin commented on SPARK-12488: -- @jkbradley Would love your feedback here. Thanks! > LDA

[jira] [Commented] (SPARK-12482) Spark fileserver not started on same IP as configured in spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068568#comment-15068568 ] Kyle Sutton commented on SPARK-12482: - Thanks! I did. I think he's saying that fileserver is

[jira] [Updated] (SPARK-12484) DataFrame withColumn() does not work in Java

[ https://issues.apache.org/jira/browse/SPARK-12484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Davidson updated SPARK-12484: Attachment: UDFTest.java Add a unit test file > DataFrame withColumn() does not work in

[jira] [Created] (SPARK-12486) Executors are not always terminated successfully by the worker.

Nong Li created SPARK-12486: --- Summary: Executors are not always terminated successfully by the worker. Key: SPARK-12486 URL: https://issues.apache.org/jira/browse/SPARK-12486 Project: Spark Issue

[jira] [Updated] (SPARK-12488) LDA describeTopics() Generates Invalid Term IDs

[ https://issues.apache.org/jira/browse/SPARK-12488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilya Ganelin updated SPARK-12488: - Summary: LDA describeTopics() Generates Invalid Term IDs (was: LDA Describe Topics Generates

[jira] [Updated] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Description: The issue of the file server using the default IP instead of the IP address

[jira] [Commented] (SPARK-12484) DataFrame withColumn() does not work in Java

[ https://issues.apache.org/jira/browse/SPARK-12484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068698#comment-15068698 ] Andrew Davidson commented on SPARK-12484: - releated issue

[jira] [Created] (SPARK-12488) LDA Describe Topics Generates Invalid Term IDs

Ilya Ganelin created SPARK-12488: Summary: LDA Describe Topics Generates Invalid Term IDs Key: SPARK-12488 URL: https://issues.apache.org/jira/browse/SPARK-12488 Project: Spark Issue Type:

[jira] [Commented] (SPARK-12487) Add docs for Kafka message handler

[ https://issues.apache.org/jira/browse/SPARK-12487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068748#comment-15068748 ] Apache Spark commented on SPARK-12487: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Created] (SPARK-12489) Fix minor issues found by Findbugs

Shixiong Zhu created SPARK-12489: Summary: Fix minor issues found by Findbugs Key: SPARK-12489 URL: https://issues.apache.org/jira/browse/SPARK-12489 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-12490) Don't use Javascript for web UI's paginated table navigation controls

[ https://issues.apache.org/jira/browse/SPARK-12490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12490: Assignee: Apache Spark (was: Josh Rosen) > Don't use Javascript for web UI's paginated

[jira] [Updated] (SPARK-12102) Cast a non-nullable struct field to a nullable field during analysis

[ https://issues.apache.org/jira/browse/SPARK-12102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12102: - Target Version/s: (was: 1.6.0) > Cast a non-nullable struct field to a nullable field during analysis

[jira] [Commented] (SPARK-12483) Data Frame as() does not work in Java

[ https://issues.apache.org/jira/browse/SPARK-12483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069020#comment-15069020 ] Xiao Li commented on SPARK-12483: - That means, it is not a bug. Thanks! > Data Frame as() does not work

[jira] [Commented] (SPARK-12483) Data Frame as() does not work in Java

[ https://issues.apache.org/jira/browse/SPARK-12483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069027#comment-15069027 ] Andrew Davidson commented on SPARK-12483: - Hi Xiao thanks for looking at the issue is there a

[jira] [Commented] (SPARK-12478) Dataset fields of product types can't be null

[ https://issues.apache.org/jira/browse/SPARK-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069044#comment-15069044 ] Cheng Lian commented on SPARK-12478: I'm leaving this ticket open since we also need to backport this

[jira] [Commented] (SPARK-10486) Spark intermittently fails to recover from a worker failure (in standalone mode)

[ https://issues.apache.org/jira/browse/SPARK-10486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069054#comment-15069054 ] Liang Chen commented on SPARK-10486: I meet the same problem > Spark intermittently fails to recover

[jira] [Assigned] (SPARK-12468) getParamMap in Pyspark ML API returns empty dictionary in example for Documentation

[ https://issues.apache.org/jira/browse/SPARK-12468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12468: Assignee: Apache Spark > getParamMap in Pyspark ML API returns empty dictionary in

[jira] [Assigned] (SPARK-12468) getParamMap in Pyspark ML API returns empty dictionary in example for Documentation

[ https://issues.apache.org/jira/browse/SPARK-12468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12468: Assignee: (was: Apache Spark) > getParamMap in Pyspark ML API returns empty

[jira] [Comment Edited] (SPARK-12061) Persist for Map/filter with Lambda Functions don't always read from Cache

[ https://issues.apache.org/jira/browse/SPARK-12061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058419#comment-15058419 ] Xiao Li edited comment on SPARK-12061 at 12/23/15 12:22 AM: The logical

[jira] [Updated] (SPARK-12386) Setting "spark.executor.port" leads to NPE in SparkEnv

[ https://issues.apache.org/jira/browse/SPARK-12386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12386: - Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 >

[jira] [Updated] (SPARK-12410) "." and "|" used for String.split directly

[ https://issues.apache.org/jira/browse/SPARK-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12410: - Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 >

[jira] [Commented] (SPARK-12484) DataFrame withColumn() does not work in Java

[ https://issues.apache.org/jira/browse/SPARK-12484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069025#comment-15069025 ] Xiao Li commented on SPARK-12484: - Please check the email answer by [~zjffdu] Thanks! > DataFrame

[jira] [Updated] (SPARK-12429) Update documentation to show how to use accumulators and broadcasts with Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-12429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-12429: -- Assignee: Shixiong Zhu (was: Apache Spark) > Update documentation to show how to use

[jira] [Resolved] (SPARK-12429) Update documentation to show how to use accumulators and broadcasts with Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-12429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-12429. --- Resolution: Fixed Fix Version/s: 1.6.0 > Update documentation to show how to use

[jira] [Commented] (SPARK-12483) Data Frame as() does not work in Java

[ https://issues.apache.org/jira/browse/SPARK-12483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069055#comment-15069055 ] Xiao Li commented on SPARK-12483: - Hi, Andy, See this example: {code} DataFrame df = hc.range(0,

[jira] [Commented] (SPARK-12484) DataFrame withColumn() does not work in Java

[ https://issues.apache.org/jira/browse/SPARK-12484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069061#comment-15069061 ] Andrew Davidson commented on SPARK-12484: - Hi Xiao thanks for looking into this Andy >

[jira] [Assigned] (SPARK-12468) getParamMap in Pyspark ML API returns empty dictionary in example for Documentation

[ https://issues.apache.org/jira/browse/SPARK-12468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12468: Assignee: (was: Apache Spark) > getParamMap in Pyspark ML API returns empty

[jira] [Assigned] (SPARK-12468) getParamMap in Pyspark ML API returns empty dictionary in example for Documentation

[ https://issues.apache.org/jira/browse/SPARK-12468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12468: Assignee: Apache Spark > getParamMap in Pyspark ML API returns empty dictionary in

[jira] [Updated] (SPARK-12376) Spark Streaming Java8APISuite fails in assertOrderInvariantEquals method

[ https://issues.apache.org/jira/browse/SPARK-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12376: - Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 >

[jira] [Updated] (SPARK-11749) Duplicate creating the RDD in file stream when recovering from checkpoint data

[ https://issues.apache.org/jira/browse/SPARK-11749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-11749: - Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 >

[jira] [Updated] (SPARK-12386) Setting "spark.executor.port" leads to NPE in SparkEnv

[ https://issues.apache.org/jira/browse/SPARK-12386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12386: - Target Version/s: 1.6.0 (was: 1.6.1, 2.0.0) > Setting "spark.executor.port" leads to NPE in

[jira] [Updated] (SPARK-11749) Duplicate creating the RDD in file stream when recovering from checkpoint data

[ https://issues.apache.org/jira/browse/SPARK-11749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-11749: - Affects Version/s: (was: 1.5.0) 1.6.0 > Duplicate creating the RDD in

[jira] [Updated] (SPARK-12220) Make Utils.fetchFile support files that contain special characters

[ https://issues.apache.org/jira/browse/SPARK-12220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12220: - Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 >

[jira] [Commented] (SPARK-12483) Data Frame as() does not work in Java

[ https://issues.apache.org/jira/browse/SPARK-12483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069019#comment-15069019 ] Xiao Li commented on SPARK-12483: - {code}as{code} is used to return a new DataFrame with an alias set.

[jira] [Updated] (SPARK-12478) Dataset fields of product types can't be null

[ https://issues.apache.org/jira/browse/SPARK-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12478: --- Labels: backport-needed (was: ) > Dataset fields of product types can't be null >

[jira] [Updated] (SPARK-12482) Spark fileserver not started on same IP as configured in spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Summary: Spark fileserver not started on same IP as configured in spark.driver.host (was: Spark

[jira] [Reopened] (SPARK-12482) Spark fileserver not started on same IP as configured in spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton reopened SPARK-12482: - Reopening SPARK-6476, since it's still an issue > Spark fileserver not started on same IP as

[jira] [Commented] (SPARK-6476) Spark fileserver not started on same IP as using spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-6476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068572#comment-15068572 ] Kyle Sutton commented on SPARK-6476: The issue of the file server using the default IP instead of the

[jira] [Comment Edited] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

[ https://issues.apache.org/jira/browse/SPARK-11437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068627#comment-15068627 ] Maciej Bryński edited comment on SPARK-11437 at 12/22/15 7:44 PM: --

[jira] [Updated] (SPARK-12483) Data Frame as() does not work in Java

[ https://issues.apache.org/jira/browse/SPARK-12483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Davidson updated SPARK-12483: Attachment: SPARK_12483_unitTest.java add a unit test file > Data Frame as() does not

[jira] [Created] (SPARK-12484) DataFrame withColumn() does not work in Java

Andrew Davidson created SPARK-12484: --- Summary: DataFrame withColumn() does not work in Java Key: SPARK-12484 URL: https://issues.apache.org/jira/browse/SPARK-12484 Project: Spark Issue

[jira] [Commented] (SPARK-12484) DataFrame withColumn() does not work in Java

[ https://issues.apache.org/jira/browse/SPARK-12484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068684#comment-15068684 ] Andrew Davidson commented on SPARK-12484: - you can find some more back ground on the email thread

[jira] [Commented] (SPARK-12470) Incorrect calculation of row size in o.a.s.sql.catalyst.expressions.codegen.GenerateUnsafeRowJoiner

[ https://issues.apache.org/jira/browse/SPARK-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068693#comment-15068693 ] Pete Robbins commented on SPARK-12470: -- I'm fairly sure the code in my PR is correct but it is

[jira] [Assigned] (SPARK-12489) Fix minor issues found by Findbugs

[ https://issues.apache.org/jira/browse/SPARK-12489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12489: Assignee: (was: Apache Spark) > Fix minor issues found by Findbugs >

[jira] [Assigned] (SPARK-12489) Fix minor issues found by Findbugs

[ https://issues.apache.org/jira/browse/SPARK-12489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12489: Assignee: Apache Spark > Fix minor issues found by Findbugs >

[jira] [Created] (SPARK-12491) UDAF result differs in SQL if alias is used

Tristan created SPARK-12491: --- Summary: UDAF result differs in SQL if alias is used Key: SPARK-12491 URL: https://issues.apache.org/jira/browse/SPARK-12491 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-12102) Cast a non-nullable struct field to a nullable field during analysis

[ https://issues.apache.org/jira/browse/SPARK-12102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12102. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10156

[jira] [Updated] (SPARK-12102) Cast a non-nullable struct field to a nullable field during analysis

[ https://issues.apache.org/jira/browse/SPARK-12102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12102: - Assignee: Dilip Biswal > Cast a non-nullable struct field to a nullable field during analysis >

[jira] [Comment Edited] (SPARK-12470) Incorrect calculation of row size in o.a.s.sql.catalyst.expressions.codegen.GenerateUnsafeRowJoiner

[ https://issues.apache.org/jira/browse/SPARK-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068693#comment-15068693 ] Pete Robbins edited comment on SPARK-12470 at 12/22/15 9:47 PM: I'm

[jira] [Commented] (SPARK-12247) Documentation for spark.ml's ALS and collaborative filtering in general

[ https://issues.apache.org/jira/browse/SPARK-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068908#comment-15068908 ] Timothy Hunter commented on SPARK-12247: It seems to me that the calculation of false positives

[jira] [Resolved] (SPARK-12487) Add docs for Kafka message handler

[ https://issues.apache.org/jira/browse/SPARK-12487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-12487. --- Resolution: Fixed Fix Version/s: 1.6.0 > Add docs for Kafka message handler >

[jira] [Created] (SPARK-12490) Don't use Javascript for web UI's paginated table navigation controls

Josh Rosen created SPARK-12490: -- Summary: Don't use Javascript for web UI's paginated table navigation controls Key: SPARK-12490 URL: https://issues.apache.org/jira/browse/SPARK-12490 Project: Spark

[jira] [Commented] (SPARK-12490) Don't use Javascript for web UI's paginated table navigation controls

[ https://issues.apache.org/jira/browse/SPARK-12490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068802#comment-15068802 ] Apache Spark commented on SPARK-12490: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-12488) LDA describeTopics() Generates Invalid Term IDs

[ https://issues.apache.org/jira/browse/SPARK-12488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068827#comment-15068827 ] Ilya Ganelin commented on SPARK-12488: -- Further investigation identifies the issue as stemming from

[jira] [Updated] (SPARK-12441) Fixing missingInput in all Logical/Physical operators

[ https://issues.apache.org/jira/browse/SPARK-12441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12441: Summary: Fixing missingInput in all Logical/Physical operators (was: Fixing missingInput in

[jira] [Resolved] (SPARK-12482) Spark fileserver not started on same IP as configured in spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12482. --- Resolution: Duplicate I reopened the other one and reclosed this. Please see Rares's comments there

[jira] [Reopened] (SPARK-6476) Spark fileserver not started on same IP as using spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-6476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-6476: -- > Spark fileserver not started on same IP as using spark.driver.host >

[jira] [Commented] (SPARK-12482) Spark fileserver not started on same IP as configured in spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068565#comment-15068565 ] Kyle Sutton commented on SPARK-12482: - Actually, how do I reopen a ticket I didn't write? > Spark

[jira] [Assigned] (SPARK-12462) Add ExpressionDescription to misc non-aggregate functions

[ https://issues.apache.org/jira/browse/SPARK-12462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12462: Assignee: (was: Apache Spark) > Add ExpressionDescription to misc non-aggregate

[jira] [Assigned] (SPARK-12462) Add ExpressionDescription to misc non-aggregate functions

[ https://issues.apache.org/jira/browse/SPARK-12462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12462: Assignee: Apache Spark > Add ExpressionDescription to misc non-aggregate functions >

[jira] [Comment Edited] (SPARK-12488) LDA describeTopics() Generates Invalid Term IDs

[ https://issues.apache.org/jira/browse/SPARK-12488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068761#comment-15068761 ] Ilya Ganelin edited comment on SPARK-12488 at 12/22/15 9:32 PM:

[jira] [Updated] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Description: The issue of the file server starting up on the default IP instead of the IP address

[jira] [Updated] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Description: The issue of the file server using the default IP instead of the IP address

[jira] [Updated] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Affects Version/s: 1.5.2 > CLONE - Spark fileserver not started on same IP as using

[jira] [Updated] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Description: The issue of the file server using the default IP instead of the IP address

[jira] [Updated] (SPARK-12482) CLONE - Spark fileserver not started on same IP as using spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Sutton updated SPARK-12482: Description: The issue of the file server using the default IP instead of the IP address

[jira] [Assigned] (SPARK-12479) sparkR collect on GroupedData throws R error "missing value where TRUE/FALSE needed"

[ https://issues.apache.org/jira/browse/SPARK-12479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12479: Assignee: (was: Apache Spark) > sparkR collect on GroupedData throws R error

[jira] [Commented] (SPARK-12479) sparkR collect on GroupedData throws R error "missing value where TRUE/FALSE needed"

[ https://issues.apache.org/jira/browse/SPARK-12479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069092#comment-15069092 ] Apache Spark commented on SPARK-12479: -- User 'paulomagalhaes' has created a pull request for this

[jira] [Commented] (SPARK-12385) Push projection into Join

[ https://issues.apache.org/jira/browse/SPARK-12385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069133#comment-15069133 ] Xiao Li commented on SPARK-12385: - I will work on it, if nobody starts it. Thanks! > Push projection

[jira] [Resolved] (SPARK-11164) Add InSet pushdown filter back for Parquet

[ https://issues.apache.org/jira/browse/SPARK-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-11164. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10278

[jira] [Updated] (SPARK-11164) Add InSet pushdown filter back for Parquet

[ https://issues.apache.org/jira/browse/SPARK-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-11164: --- Assignee: Xiao Li > Add InSet pushdown filter back for Parquet >

[jira] [Created] (SPARK-12492) SQL page of Spark-sql is always blank

meiyoula created SPARK-12492: Summary: SQL page of Spark-sql is always blank Key: SPARK-12492 URL: https://issues.apache.org/jira/browse/SPARK-12492 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-12479) sparkR collect on GroupedData throws R error "missing value where TRUE/FALSE needed"

[ https://issues.apache.org/jira/browse/SPARK-12479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12479: Assignee: (was: Apache Spark) > sparkR collect on GroupedData throws R error

  1   2   >