[jira] [Resolved] (SPARK-25727) makeCopy failed in InMemoryRelation

2018-10-13 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25727. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22715 [https://

[jira] [Commented] (SPARK-25714) Null Handling in the Optimizer rule BooleanSimplification

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649260#comment-16649260 ] Apache Spark commented on SPARK-25714: -- User 'gatorsmile' has created a pull reques

[jira] [Commented] (SPARK-25714) Null Handling in the Optimizer rule BooleanSimplification

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649243#comment-16649243 ] Apache Spark commented on SPARK-25714: -- User 'gatorsmile' has created a pull reques

[jira] [Commented] (SPARK-25372) Deprecate Yarn-specific configs in regards to keytab login for SparkSubmit

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649220#comment-16649220 ] Apache Spark commented on SPARK-25372: -- User 'gatorsmile' has created a pull reques

[jira] [Resolved] (SPARK-25726) Flaky test: SaveIntoDataSourceCommandSuite.`simpleString is redacted`

2018-10-13 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25726. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.4.0

[jira] [Updated] (SPARK-25727) makeCopy failed in InMemoryRelation

2018-10-13 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25727: Description: {code} val data = Seq(100).toDF("count").cache() data.queryExecution.optimizedPlan.to

[jira] [Commented] (SPARK-25727) makeCopy failed in InMemoryRelation

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649150#comment-16649150 ] Apache Spark commented on SPARK-25727: -- User 'gatorsmile' has created a pull reques

[jira] [Commented] (SPARK-25727) makeCopy failed in InMemoryRelation

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649149#comment-16649149 ] Apache Spark commented on SPARK-25727: -- User 'gatorsmile' has created a pull reques

[jira] [Assigned] (SPARK-25727) makeCopy failed in InMemoryRelation

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25727: Assignee: Apache Spark (was: Xiao Li) > makeCopy failed in InMemoryRelation > --

[jira] [Assigned] (SPARK-25727) makeCopy failed in InMemoryRelation

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25727: Assignee: Xiao Li (was: Apache Spark) > makeCopy failed in InMemoryRelation > --

[jira] [Created] (SPARK-25727) makeCopy failed in InMemoryRelation

2018-10-13 Thread Xiao Li (JIRA)
Xiao Li created SPARK-25727: --- Summary: makeCopy failed in InMemoryRelation Key: SPARK-25727 URL: https://issues.apache.org/jira/browse/SPARK-25727 Project: Spark Issue Type: Bug Component

[jira] [Updated] (SPARK-25372) Deprecate Yarn-specific configs in regards to keytab login for SparkSubmit

2018-10-13 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25372: Labels: release-notes (was: ) > Deprecate Yarn-specific configs in regards to keytab login for SparkSubmi

[jira] [Assigned] (SPARK-25726) Flaky test: SaveIntoDataSourceCommandSuite.`simpleString is redacted`

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25726: Assignee: (was: Apache Spark) > Flaky test: SaveIntoDataSourceCommandSuite.`simpleStr

[jira] [Commented] (SPARK-25726) Flaky test: SaveIntoDataSourceCommandSuite.`simpleString is redacted`

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649122#comment-16649122 ] Apache Spark commented on SPARK-25726: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-25726) Flaky test: SaveIntoDataSourceCommandSuite.`simpleString is redacted`

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25726: Assignee: Apache Spark > Flaky test: SaveIntoDataSourceCommandSuite.`simpleString is reda

[jira] [Updated] (SPARK-25726) Flaky test: SaveIntoDataSourceCommandSuite.`simpleString is redacted`

2018-10-13 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25726: -- Description: The test case fails because the used password string `123` matches `@41230802`. 

[jira] [Created] (SPARK-25726) Flaky test: SaveIntoDataSourceCommandSuite.`simpleString is redacted`

2018-10-13 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-25726: - Summary: Flaky test: SaveIntoDataSourceCommandSuite.`simpleString is redacted` Key: SPARK-25726 URL: https://issues.apache.org/jira/browse/SPARK-25726 Project: Spar

[jira] [Updated] (SPARK-25711) Allow history server to show usage and remove deprecated options

2018-10-13 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25711: -- Summary: Allow history server to show usage and remove deprecated options (was: Allow history

[jira] [Resolved] (SPARK-25711) Allow history server to show usage and remove deprecated options

2018-10-13 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25711. --- Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 3.0.0 This is reso

[jira] [Commented] (SPARK-23375) Optimizer should remove unneeded Sort

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649077#comment-16649077 ] Apache Spark commented on SPARK-23375: -- User 'gatorsmile' has created a pull reques

[jira] [Commented] (SPARK-23375) Optimizer should remove unneeded Sort

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649076#comment-16649076 ] Apache Spark commented on SPARK-23375: -- User 'gatorsmile' has created a pull reques

[jira] [Commented] (SPARK-25720) Support auto refresh page for the WEBUI

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649051#comment-16649051 ] Apache Spark commented on SPARK-25720: -- User 'shahidki31' has created a pull reques

[jira] [Assigned] (SPARK-25720) Support auto refresh page for the WEBUI

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25720: Assignee: (was: Apache Spark) > Support auto refresh page for the WEBUI > ---

[jira] [Commented] (SPARK-25720) Support auto refresh page for the WEBUI

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649050#comment-16649050 ] Apache Spark commented on SPARK-25720: -- User 'shahidki31' has created a pull reques

[jira] [Assigned] (SPARK-25720) Support auto refresh page for the WEBUI

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25720: Assignee: Apache Spark > Support auto refresh page for the WEBUI > --

[jira] [Assigned] (SPARK-25691) Analyzer rule "AliasViewChild" does not stabilize

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25691: Assignee: Apache Spark > Analyzer rule "AliasViewChild" does not stabilize >

[jira] [Assigned] (SPARK-25691) Analyzer rule "AliasViewChild" does not stabilize

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25691: Assignee: (was: Apache Spark) > Analyzer rule "AliasViewChild" does not stabilize > -

[jira] [Commented] (SPARK-25691) Analyzer rule "AliasViewChild" does not stabilize

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649036#comment-16649036 ] Apache Spark commented on SPARK-25691: -- User 'mgaido91' has created a pull request

[jira] [Commented] (SPARK-25691) Analyzer rule "AliasViewChild" does not stabilize

2018-10-13 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649035#comment-16649035 ] Marco Gaido commented on SPARK-25691: - I think this is actually an instance of a big

[jira] [Commented] (SPARK-18134) SQL: MapType in Group BY and Joins not working

2018-10-13 Thread jin xing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16648880#comment-16648880 ] jin xing commented on SPARK-18134: -- [~maropu] I split this JIRA to two subtasks: SPARK-

[jira] [Created] (SPARK-25725) Add a new expression "SortMaps" to sort the entries inside a "MapData"

2018-10-13 Thread jin xing (JIRA)
jin xing created SPARK-25725: Summary: Add a new expression "SortMaps" to sort the entries inside a "MapData" Key: SPARK-25725 URL: https://issues.apache.org/jira/browse/SPARK-25725 Project: Spark

[jira] [Assigned] (SPARK-25724) Add sorting functionality in MapType

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25724: Assignee: Apache Spark > Add sorting functionality in MapType > -

[jira] [Assigned] (SPARK-25724) Add sorting functionality in MapType

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25724: Assignee: (was: Apache Spark) > Add sorting functionality in MapType > --

[jira] [Commented] (SPARK-25724) Add sorting functionality in MapType

2018-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16648878#comment-16648878 ] Apache Spark commented on SPARK-25724: -- User 'jinxing64' has created a pull request

[jira] [Created] (SPARK-25724) Add sorting functionality in MapType

2018-10-13 Thread jin xing (JIRA)
jin xing created SPARK-25724: Summary: Add sorting functionality in MapType Key: SPARK-25724 URL: https://issues.apache.org/jira/browse/SPARK-25724 Project: Spark Issue Type: Sub-task C

[jira] [Commented] (SPARK-25723) dataset.show() , scala.MatchError: 23.25 (of class java.lang.Double)

2018-10-13 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16648807#comment-16648807 ] Marco Gaido commented on SPARK-25723: - Can you please provide a reproducer? > datas