[jira] [Assigned] (SPARK-16986) "Started" time, "Completed" time and "Last Updated" time in history server UI are not user local time

[ https://issues.apache.org/jira/browse/SPARK-16986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16986: Assignee: (was: Apache Spark) > "Started" time, "Completed" time and "Last Updated"

[jira] [Assigned] (SPARK-16986) "Started" time, "Completed" time and "Last Updated" time in history server UI are not user local time

[ https://issues.apache.org/jira/browse/SPARK-16986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16986: Assignee: Apache Spark > "Started" time, "Completed" time and "Last Updated" time in

[jira] [Commented] (SPARK-16986) "Started" time, "Completed" time and "Last Updated" time in history server UI are not user local time

[ https://issues.apache.org/jira/browse/SPARK-16986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414764#comment-15414764 ] Apache Spark commented on SPARK-16986: -- User 'Sherry302' has created a pull request for this issue:

[jira] [Commented] (SPARK-16391) KeyValueGroupedDataset.reduceGroups should support partial aggregation

[ https://issues.apache.org/jira/browse/SPARK-16391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414752#comment-15414752 ] Apache Spark commented on SPARK-16391: -- User 'rxin' has created a pull request for this issue:

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414716#comment-15414716 ] Apache Spark commented on SPARK-16522: -- User 'sun-rui' has created a pull request for this issue:

[jira] [Created] (SPARK-16986) "Started" time, "Completed" time and "Last Updated" time in history server UI are not user local time

Weiqing Yang created SPARK-16986: Summary: "Started" time, "Completed" time and "Last Updated" time in history server UI are not user local time Key: SPARK-16986 URL:

[jira] [Commented] (SPARK-4235) Add union data type support

[ https://issues.apache.org/jira/browse/SPARK-4235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414711#comment-15414711 ] Dongjoon Hyun commented on SPARK-4235: -- This issue seems to mention Hive UnionTypes.

[jira] [Closed] (SPARK-6273) Got error when one table's alias name is the same with other table's column name

[ https://issues.apache.org/jira/browse/SPARK-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-6273. Resolution: Fixed Fix Version/s: 2.0.0 > Got error when one table's alias name is the same

[jira] [Comment Edited] (SPARK-6273) Got error when one table's alias name is the same with other table's column name

[ https://issues.apache.org/jira/browse/SPARK-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414706#comment-15414706 ] Dongjoon Hyun edited comment on SPARK-6273 at 8/10/16 5:12 AM: --- It seems to

[jira] [Commented] (SPARK-6273) Got error when one table's alias name is the same with other table's column name

[ https://issues.apache.org/jira/browse/SPARK-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414706#comment-15414706 ] Dongjoon Hyun commented on SPARK-6273: -- It seems to be resolved in 1.3 according to SPARK-5278. Spark

[jira] [Closed] (SPARK-2578) OUTER JOINs cause ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-2578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-2578. Resolution: Fixed Fix Version/s: 2.0.0 It's resolved. > OUTER JOINs cause

[jira] [Commented] (SPARK-2578) OUTER JOINs cause ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-2578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414703#comment-15414703 ] Dongjoon Hyun commented on SPARK-2578: -- Now, Spark 2.0 supports the scenario without exceptions.

[jira] [Assigned] (SPARK-16985) SQL Output maybe overrided

[ https://issues.apache.org/jira/browse/SPARK-16985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16985: Assignee: Apache Spark > SQL Output maybe overrided > -- > >

[jira] [Commented] (SPARK-16985) SQL Output maybe overrided

[ https://issues.apache.org/jira/browse/SPARK-16985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414668#comment-15414668 ] Apache Spark commented on SPARK-16985: -- User 'shenh062326' has created a pull request for this

[jira] [Assigned] (SPARK-16985) SQL Output maybe overrided

[ https://issues.apache.org/jira/browse/SPARK-16985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16985: Assignee: (was: Apache Spark) > SQL Output maybe overrided >

[jira] [Closed] (SPARK-16977) start spark-shell with yarn mode error

[ https://issues.apache.org/jira/browse/SPARK-16977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shijinkui closed SPARK-16977. - Resolution: Won't Fix > start spark-shell with yarn mode error > --

[jira] [Updated] (SPARK-16977) start spark-shell with yarn mode error

[ https://issues.apache.org/jira/browse/SPARK-16977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shijinkui updated SPARK-16977: -- Issue Type: Temp (was: Bug) > start spark-shell with yarn mode error >

[jira] [Commented] (SPARK-16985) SQL Output maybe overrided

[ https://issues.apache.org/jira/browse/SPARK-16985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414644#comment-15414644 ] Hong Shen commented on SPARK-16985: --- The reason is the output file use

[jira] [Updated] (SPARK-16985) SQL Output maybe overrided

[ https://issues.apache.org/jira/browse/SPARK-16985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated SPARK-16985: -- Description: In our cluster, sometimes the sql output maybe overrided. When I submit some sql, all

[jira] [Created] (SPARK-16985) SQL Output maybe overrided

Hong Shen created SPARK-16985: - Summary: SQL Output maybe overrided Key: SPARK-16985 URL: https://issues.apache.org/jira/browse/SPARK-16985 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-16984) executeTake tries all partitions if first parition is empty

[ https://issues.apache.org/jira/browse/SPARK-16984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414571#comment-15414571 ] Apache Spark commented on SPARK-16984: -- User 'robert3005' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16984) executeTake tries all partitions if first parition is empty

[ https://issues.apache.org/jira/browse/SPARK-16984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16984: Assignee: Apache Spark > executeTake tries all partitions if first parition is empty >

[jira] [Assigned] (SPARK-16984) executeTake tries all partitions if first parition is empty

[ https://issues.apache.org/jira/browse/SPARK-16984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16984: Assignee: (was: Apache Spark) > executeTake tries all partitions if first parition is

[jira] [Created] (SPARK-16984) executeTake tries all partitions if first parition is empty

Robert Kruszewski created SPARK-16984: - Summary: executeTake tries all partitions if first parition is empty Key: SPARK-16984 URL: https://issues.apache.org/jira/browse/SPARK-16984 Project: Spark

[jira] [Commented] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414544#comment-15414544 ] gagan taneja commented on SPARK-15345: -- i was annoyed by this bug but fortunately found the

[jira] [Commented] (SPARK-3162) Train DecisionTree locally when possible

[ https://issues.apache.org/jira/browse/SPARK-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414484#comment-15414484 ] Siddharth Murching commented on SPARK-3162: --- [~josephkb] I'd like to work on this if possible -

[jira] [Commented] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414481#comment-15414481 ] Saisai Shao commented on SPARK-16966: - Here is the code in {{SparkSubmitArguments}} to handle the

[jira] [Comment Edited] (SPARK-16883) SQL decimal type is not properly cast to number when collecting SparkDataFrame

[ https://issues.apache.org/jira/browse/SPARK-16883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414476#comment-15414476 ] Miao Wang edited comment on SPARK-16883 at 8/10/16 12:03 AM: - OK.I will try

[jira] [Commented] (SPARK-16883) SQL decimal type is not properly cast to number when collecting SparkDataFrame

[ https://issues.apache.org/jira/browse/SPARK-16883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414476#comment-15414476 ] Miao Wang commented on SPARK-16883: --- OK.I will try both. For the frontend solution, I can create a

[jira] [Commented] (SPARK-16900) Complete-mode output for file sinks

[ https://issues.apache.org/jira/browse/SPARK-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414455#comment-15414455 ] Vladimir Feinberg commented on SPARK-16900: --- Alternatively, if we could have some way of

[jira] [Commented] (SPARK-16883) SQL decimal type is not properly cast to number when collecting SparkDataFrame

[ https://issues.apache.org/jira/browse/SPARK-16883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414446#comment-15414446 ] Shivaram Venkataraman commented on SPARK-16883: --- Yeah I see that - The change I am

[jira] [Commented] (SPARK-16883) SQL decimal type is not properly cast to number when collecting SparkDataFrame

[ https://issues.apache.org/jira/browse/SPARK-16883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414432#comment-15414432 ] Miao Wang commented on SPARK-16883: --- I think it is because [x: double, y: decimal(10,0)]

[jira] [Closed] (SPARK-3998) Add offset limit to SqlParser.scala

[ https://issues.apache.org/jira/browse/SPARK-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-3998. Resolution: Won't Fix The `offset` clause in SQL has the same functionality with `drop` in Scala.

[jira] [Commented] (SPARK-16883) SQL decimal type is not properly cast to number when collecting SparkDataFrame

[ https://issues.apache.org/jira/browse/SPARK-16883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414422#comment-15414422 ] Shivaram Venkataraman commented on SPARK-16883: --- Hmm why do we want to serialize it as a

[jira] [Commented] (SPARK-16883) SQL decimal type is not properly cast to number when collecting SparkDataFrame

[ https://issues.apache.org/jira/browse/SPARK-16883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414420#comment-15414420 ] Miao Wang commented on SPARK-16883: --- [~shivaram] What do you think about my proposed solution? > SQL

[jira] [Commented] (SPARK-16552) Store the Inferred Schemas into External Catalog Tables when Creating Tables

[ https://issues.apache.org/jira/browse/SPARK-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414417#comment-15414417 ] Apache Spark commented on SPARK-16552: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Commented] (SPARK-16883) SQL decimal type is not properly cast to number when collecting SparkDataFrame

[ https://issues.apache.org/jira/browse/SPARK-16883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414416#comment-15414416 ] Miao Wang commented on SPARK-16883: --- I add some debug information in SerDe.scala, as shown below:

[jira] [Assigned] (SPARK-16983) Add `prettyName` to row_number, dense_rank, percent_rank, cume_dist

[ https://issues.apache.org/jira/browse/SPARK-16983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16983: Assignee: Apache Spark > Add `prettyName` to row_number, dense_rank, percent_rank,

[jira] [Commented] (SPARK-16983) Add `prettyName` to row_number, dense_rank, percent_rank, cume_dist

[ https://issues.apache.org/jira/browse/SPARK-16983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414398#comment-15414398 ] Apache Spark commented on SPARK-16983: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-16983) Add `prettyName` to row_number, dense_rank, percent_rank, cume_dist

[ https://issues.apache.org/jira/browse/SPARK-16983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16983: Assignee: (was: Apache Spark) > Add `prettyName` to row_number, dense_rank,

[jira] [Closed] (SPARK-16982) Failure to build Spark 1.6

[ https://issues.apache.org/jira/browse/SPARK-16982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haifeng Li closed SPARK-16982. -- > Failure to build Spark 1.6 > -- > > Key: SPARK-16982 >

[jira] [Updated] (SPARK-16983) Add `prettyName` to row_number, dense_rank, percent_rank, cume_dist

[ https://issues.apache.org/jira/browse/SPARK-16983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16983: -- Description: Currently, two-word window functions like `row_number`, `dense_rank`,

[jira] [Created] (SPARK-16983) Add `prettyName` to row_number, dense_rank, percent_rank, cume_dist

Dongjoon Hyun created SPARK-16983: - Summary: Add `prettyName` to row_number, dense_rank, percent_rank, cume_dist Key: SPARK-16983 URL: https://issues.apache.org/jira/browse/SPARK-16983 Project: Spark

[jira] [Resolved] (SPARK-16982) Failure to build Spark 1.6

[ https://issues.apache.org/jira/browse/SPARK-16982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16982. --- Resolution: Invalid This doesn't even specify an error. The 1.6 branch test builds pass, so it is

[jira] [Updated] (SPARK-16982) Failure to build Spark 1.6

[ https://issues.apache.org/jira/browse/SPARK-16982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haifeng Li updated SPARK-16982: --- Description: When I ran the command to build spark branch-1.6 pulled from the github: build/sbt

[jira] [Created] (SPARK-16982) Failure to build Spark 1.6

Haifeng Li created SPARK-16982: -- Summary: Failure to build Spark 1.6 Key: SPARK-16982 URL: https://issues.apache.org/jira/browse/SPARK-16982 Project: Spark Issue Type: Bug Reporter:

[jira] [Commented] (SPARK-16093) Spark2.0 take no effect after set spark.sql.autoBroadcastJoinThreshold = 1

[ https://issues.apache.org/jira/browse/SPARK-16093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414361#comment-15414361 ] Davies Liu commented on SPARK-16093: It also could be possible that the stat of Hive table is broken

[jira] [Commented] (SPARK-16093) Spark2.0 take no effect after set spark.sql.autoBroadcastJoinThreshold = 1

[ https://issues.apache.org/jira/browse/SPARK-16093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414360#comment-15414360 ] Davies Liu commented on SPARK-16093: Could you `set spark.sql.autoBroadcastJoinThreshold` to verify

[jira] [Commented] (SPARK-16766) TakeOrderedAndProjectExec easily cause OOM

[ https://issues.apache.org/jira/browse/SPARK-16766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414345#comment-15414345 ] Davies Liu commented on SPARK-16766: What's the use case of this queue? I'd imagine that it's not

[jira] [Updated] (SPARK-16766) TakeOrderedAndProjectExec easily cause OOM

[ https://issues.apache.org/jira/browse/SPARK-16766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-16766: --- Priority: Minor (was: Critical) > TakeOrderedAndProjectExec easily cause OOM >

[jira] [Created] (SPARK-16981) For CSV files nullValue is not respected for Date/Time data type

Lev created SPARK-16981: --- Summary: For CSV files nullValue is not respected for Date/Time data type Key: SPARK-16981 URL: https://issues.apache.org/jira/browse/SPARK-16981 Project: Spark Issue Type:

[jira] [Commented] (SPARK-6832) Handle partial reads in SparkR JVM to worker communication

[ https://issues.apache.org/jira/browse/SPARK-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414262#comment-15414262 ] Shivaram Venkataraman commented on SPARK-6832: -- [~KrishnaKalyan3] Thanks for looking at this

[jira] [Assigned] (SPARK-10601) Spark SQL - Support for MINUS

[ https://issues.apache.org/jira/browse/SPARK-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10601: Assignee: Apache Spark > Spark SQL - Support for MINUS > - >

[jira] [Commented] (SPARK-10601) Spark SQL - Support for MINUS

[ https://issues.apache.org/jira/browse/SPARK-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414221#comment-15414221 ] Apache Spark commented on SPARK-10601: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-10601) Spark SQL - Support for MINUS

[ https://issues.apache.org/jira/browse/SPARK-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10601: Assignee: (was: Apache Spark) > Spark SQL - Support for MINUS >

[jira] [Commented] (SPARK-16921) RDD/DataFrame persist() and cache() should return Python context managers

[ https://issues.apache.org/jira/browse/SPARK-16921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414176#comment-15414176 ] holdenk commented on SPARK-16921: - Sounds good :) Was thinking it might bake sense to do the same with

[jira] [Commented] (SPARK-10868) monotonicallyIncreasingId() supports offset for indexing

[ https://issues.apache.org/jira/browse/SPARK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414164#comment-15414164 ] Ted Yu commented on SPARK-10868: I can pick up this one if Martin hasn't started working on it. >

[jira] [Assigned] (SPARK-10868) monotonicallyIncreasingId() supports offset for indexing

[ https://issues.apache.org/jira/browse/SPARK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10868: Assignee: (was: Apache Spark) > monotonicallyIncreasingId() supports offset for

[jira] [Assigned] (SPARK-10868) monotonicallyIncreasingId() supports offset for indexing

[ https://issues.apache.org/jira/browse/SPARK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10868: Assignee: Apache Spark > monotonicallyIncreasingId() supports offset for indexing >

[jira] [Commented] (SPARK-10868) monotonicallyIncreasingId() supports offset for indexing

[ https://issues.apache.org/jira/browse/SPARK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414162#comment-15414162 ] Apache Spark commented on SPARK-10868: -- User 'tedyu' has created a pull request for this issue:

[jira] [Commented] (SPARK-10601) Spark SQL - Support for MINUS

[ https://issues.apache.org/jira/browse/SPARK-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414118#comment-15414118 ] Dongjoon Hyun commented on SPARK-10601: --- Thank you, [~hvanhovell]! > Spark SQL - Support for MINUS

[jira] [Commented] (SPARK-10601) Spark SQL - Support for MINUS

[ https://issues.apache.org/jira/browse/SPARK-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414074#comment-15414074 ] Herman van Hovell commented on SPARK-10601: --- Go for it. > Spark SQL - Support for MINUS >

[jira] [Commented] (SPARK-16921) RDD/DataFrame persist() and cache() should return Python context managers

[ https://issues.apache.org/jira/browse/SPARK-16921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414067#comment-15414067 ] Nicholas Chammas commented on SPARK-16921: -- [~holdenk] - Probably won't be able to do it myself

[jira] [Commented] (SPARK-10601) Spark SQL - Support for MINUS

[ https://issues.apache.org/jira/browse/SPARK-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414054#comment-15414054 ] Dongjoon Hyun commented on SPARK-10601: --- Oh, then, it's rarely used but we can have this to improve

[jira] [Commented] (SPARK-10627) Regularization for artificial neural networks

[ https://issues.apache.org/jira/browse/SPARK-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414040#comment-15414040 ] Ruben Janssen commented on SPARK-10627: --- [~avulanov] That's why I asked if it would be possible to

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414044#comment-15414044 ] Sean Owen commented on SPARK-16522: --- OK, I think it's more accurate to leave it Fixed for 2.1.0, and

[jira] [Updated] (SPARK-16905) Support SQL DDL: MSCK REPAIR TABLE

[ https://issues.apache.org/jira/browse/SPARK-16905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-16905: --- Fix Version/s: 2.0.1 > Support SQL DDL: MSCK REPAIR TABLE > -- > >

[jira] [Assigned] (SPARK-16522) [MESOS] Spark application throws exception on exit

[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16522: Assignee: Sun Rui (was: Apache Spark) > [MESOS] Spark application throws exception on

[jira] [Assigned] (SPARK-16522) [MESOS] Spark application throws exception on exit

[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16522: Assignee: Apache Spark (was: Sun Rui) > [MESOS] Spark application throws exception on

[jira] [Reopened] (SPARK-16522) [MESOS] Spark application throws exception on exit

[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt reopened SPARK-16522: - Reopening so we can track this until it's merged into the 2.0 branch. Also changed the fix

[jira] [Updated] (SPARK-16522) [MESOS] Spark application throws exception on exit

[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-16522: Fix Version/s: (was: 2.1.0) 2.0.1 > [MESOS] Spark application

[jira] [Updated] (SPARK-16905) Support SQL DDL: MSCK REPAIR TABLE

[ https://issues.apache.org/jira/browse/SPARK-16905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-16905: --- Issue Type: Bug (was: New Feature) > Support SQL DDL: MSCK REPAIR TABLE >

[jira] [Commented] (SPARK-16967) Collect Mesos support code into a module/profile

[ https://issues.apache.org/jira/browse/SPARK-16967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414004#comment-15414004 ] Michael Gummelt commented on SPARK-16967: - Will do > Collect Mesos support code into a

[jira] [Commented] (SPARK-12909) Spark on Mesos accessing Secured HDFS w/Kerberos

[ https://issues.apache.org/jira/browse/SPARK-12909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413999#comment-15413999 ] Michael Gummelt commented on SPARK-12909: - I agree. I just spoke with Reynold about this. I'll

[jira] [Commented] (SPARK-6832) Handle partial reads in SparkR JVM to worker communication

[ https://issues.apache.org/jira/browse/SPARK-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413972#comment-15413972 ] Krishna Kalyan commented on SPARK-6832: --- [~shivaram] I see that changes need to made in

[jira] [Commented] (SPARK-15354) Topology aware block replication strategies

[ https://issues.apache.org/jira/browse/SPARK-15354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413969#comment-15413969 ] Davies Liu commented on SPARK-15354: Should we make sure that there will be two copy on same host (ip

[jira] [Commented] (SPARK-16962) Unsafe accesses (Platform.getLong()) not supported on unaligned boundaries in SPARC/Solaris

[ https://issues.apache.org/jira/browse/SPARK-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413970#comment-15413970 ] Suman Somasundar commented on SPARK-16962: -- We are working on a fix for this issue. I will

[jira] [Resolved] (SPARK-16956) Make ApplicationState.MAX_NUM_RETRY configurable

[ https://issues.apache.org/jira/browse/SPARK-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-16956. Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 1.6.3

[jira] [Updated] (SPARK-16980) Load only catalog table partition metadata required to answer a query

[ https://issues.apache.org/jira/browse/SPARK-16980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Allman updated SPARK-16980: --- Description: Currently, when a user reads from a partitioned Hive table whose metadata are

[jira] [Created] (SPARK-16980) Load only catalog table partition metadata required to answer a query

Michael Allman created SPARK-16980: -- Summary: Load only catalog table partition metadata required to answer a query Key: SPARK-16980 URL: https://issues.apache.org/jira/browse/SPARK-16980 Project:

[jira] [Commented] (SPARK-16921) RDD/DataFrame persist() and cache() should return Python context managers

[ https://issues.apache.org/jira/browse/SPARK-16921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413935#comment-15413935 ] holdenk commented on SPARK-16921: - [~nchammas] are you planning on working on this yourself or would it

[jira] [Closed] (SPARK-16971) Strip trailing zeros for decimals when using show() API in Dataset

[ https://issues.apache.org/jira/browse/SPARK-16971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-16971. --- Resolution: Won't Fix > Strip trailing zeros for decimals when using show() API in Dataset >

[jira] [Commented] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413921#comment-15413921 ] Weiqing Yang commented on SPARK-16966: -- Yes, it will be the name of the class executing. > App Name

[jira] [Commented] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413866#comment-15413866 ] Sean Owen commented on SPARK-16966: --- It will be the name of the class executing, right? All that sounds

[jira] [Resolved] (SPARK-16905) Support SQL DDL: MSCK REPAIR TABLE

[ https://issues.apache.org/jira/browse/SPARK-16905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-16905. Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14500

[jira] [Comment Edited] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413852#comment-15413852 ] Weiqing Yang edited comment on SPARK-16966 at 8/9/16 5:04 PM: -- Thanks for

[jira] [Commented] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413852#comment-15413852 ] Weiqing Yang commented on SPARK-16966: -- Thanks for the quick feedback. If "--name" is not

[jira] [Commented] (SPARK-10601) Spark SQL - Support for MINUS

[ https://issues.apache.org/jira/browse/SPARK-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413824#comment-15413824 ] Herman van Hovell commented on SPARK-10601: --- I am impartial to this one. It doesn't seem like

[jira] [Commented] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413823#comment-15413823 ] Sean Owen commented on SPARK-16966: --- OK, that explains that part then, thanks. The rest makes sense

[jira] [Resolved] (SPARK-16950) fromOffsets parameter in Kafka's Direct Streams does not work in python3

[ https://issues.apache.org/jira/browse/SPARK-16950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-16950. Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Commented] (SPARK-16951) Alternative implementation of NOT IN to Anti-join

[ https://issues.apache.org/jira/browse/SPARK-16951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413817#comment-15413817 ] Herman van Hovell commented on SPARK-16951: --- If you read the paper a bit further along (second

[jira] [Comment Edited] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413810#comment-15413810 ] Weiqing Yang edited comment on SPARK-16966 at 8/9/16 4:39 PM: -- In the tests,

[jira] [Comment Edited] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413810#comment-15413810 ] Weiqing Yang edited comment on SPARK-16966 at 8/9/16 4:34 PM: -- In the tests,

[jira] [Commented] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413810#comment-15413810 ] Weiqing Yang commented on SPARK-16966: -- In the tests, I modified

[jira] [Comment Edited] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413810#comment-15413810 ] Weiqing Yang edited comment on SPARK-16966 at 8/9/16 4:35 PM: -- In the tests,

[jira] [Commented] (SPARK-16951) Alternative implementation of NOT IN to Anti-join

[ https://issues.apache.org/jira/browse/SPARK-16951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413773#comment-15413773 ] Nattavut Sutyanyong commented on SPARK-16951: - I found this

[jira] [Comment Edited] (SPARK-16951) Alternative implementation of NOT IN to Anti-join

[ https://issues.apache.org/jira/browse/SPARK-16951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413753#comment-15413753 ] Nattavut Sutyanyong edited comment on SPARK-16951 at 8/9/16 3:55 PM: -

[jira] [Closed] (SPARK-16979) Enable overriding application ID in metric name

[ https://issues.apache.org/jira/browse/SPARK-16979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathaniel Braun closed SPARK-16979. --- Resolution: Fixed > Enable overriding application ID in metric name >

[jira] [Created] (SPARK-16979) Enable overriding application ID in metric name

Nathaniel Braun created SPARK-16979: --- Summary: Enable overriding application ID in metric name Key: SPARK-16979 URL: https://issues.apache.org/jira/browse/SPARK-16979 Project: Spark Issue

[jira] [Commented] (SPARK-10601) Spark SQL - Support for MINUS

[ https://issues.apache.org/jira/browse/SPARK-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413735#comment-15413735 ] Dongjoon Hyun commented on SPARK-10601: --- Hi, [~hvanhovell]. How do you think about this? Is it

  1   2   >