[jira] [Created] (SPARK-29970) open/close state is not preserved for Timelineview

Kousuke Saruta created SPARK-29970: -- Summary: open/close state is not preserved for Timelineview Key: SPARK-29970 URL: https://issues.apache.org/jira/browse/SPARK-29970 Project: Spark Issue

[jira] [Created] (SPARK-29971) Multiple possible buffer leaks in TransportFrameDecoder and TransportCipher

Norman Maurer created SPARK-29971: - Summary: Multiple possible buffer leaks in TransportFrameDecoder and TransportCipher Key: SPARK-29971 URL: https://issues.apache.org/jira/browse/SPARK-29971 Project

[jira] [Updated] (SPARK-29971) Multiple possible buffer leaks in TransportFrameDecoder and TransportCipher

[ https://issues.apache.org/jira/browse/SPARK-29971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Norman Maurer updated SPARK-29971: -- External issue URL: https://github.com/apache/spark/pull/26609 > Multiple possible buffer leak

[jira] [Commented] (SPARK-29971) Multiple possible buffer leaks in TransportFrameDecoder and TransportCipher

[ https://issues.apache.org/jira/browse/SPARK-29971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16978206#comment-16978206 ] Norman Maurer commented on SPARK-29971: --- PR for a fix is here: https://github.com

[jira] [Commented] (SPARK-29971) Multiple possible buffer leaks in TransportFrameDecoder and TransportCipher

[ https://issues.apache.org/jira/browse/SPARK-29971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16978207#comment-16978207 ] Norman Maurer commented on SPARK-29971: --- I am pretty sure the same bug exists in a

[jira] [Comment Edited] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16977236#comment-16977236 ] WuZeyi edited comment on SPARK-29553 at 11/20/19 12:22 PM: --- [~

[jira] [Assigned] (SPARK-29968) Remove the Predicate code from SparkPlan

[ https://issues.apache.org/jira/browse/SPARK-29968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29968: --- Assignee: Takeshi Yamamuro > Remove the Predicate code from SparkPlan > ---

[jira] [Resolved] (SPARK-29968) Remove the Predicate code from SparkPlan

[ https://issues.apache.org/jira/browse/SPARK-29968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29968. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26604 [https://gith

[jira] [Commented] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16978426#comment-16978426 ] Sean R. Owen commented on SPARK-29553: -- How is your cluster run, BTW? Setting this

[jira] [Created] (SPARK-29972) Manage/trace all spark sessions

Lantao Jin created SPARK-29972: -- Summary: Manage/trace all spark sessions Key: SPARK-29972 URL: https://issues.apache.org/jira/browse/SPARK-29972 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-29972) Manage/trace all spark sessions

[ https://issues.apache.org/jira/browse/SPARK-29972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16978455#comment-16978455 ] Lantao Jin commented on SPARK-29972: I am going to work on this. > Manage/trace all

[jira] [Created] (SPARK-29973) Use nano time to calculate 'processedRowsPerSecond' to avoid 'NaN'/'Infinity'

Genmao Yu created SPARK-29973: - Summary: Use nano time to calculate 'processedRowsPerSecond' to avoid 'NaN'/'Infinity' Key: SPARK-29973 URL: https://issues.apache.org/jira/browse/SPARK-29973 Project: Spar

[jira] [Commented] (SPARK-29972) Manage/trace all spark sessions

[ https://issues.apache.org/jira/browse/SPARK-29972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16978461#comment-16978461 ] Sean R. Owen commented on SPARK-29972: -- I am not sure we want to do this. What if I

[jira] [Resolved] (SPARK-28751) Imporve java serializer deserialization performance

[ https://issues.apache.org/jira/browse/SPARK-28751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-28751. -- Resolution: Won't Fix See PR > Imporve java serializer deserialization performance >

[jira] [Assigned] (SPARK-18409) LSH approxNearestNeighbors should use approxQuantile instead of sort

[ https://issues.apache.org/jira/browse/SPARK-18409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-18409: Assignee: Huaxin Gao > LSH approxNearestNeighbors should use approxQuantile instead of so

[jira] [Resolved] (SPARK-29894) Add Codegen Stage Id to Spark plan graphs in Web UI SQL Tab

[ https://issues.apache.org/jira/browse/SPARK-29894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29894. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26519 [https://gith

[jira] [Assigned] (SPARK-29894) Add Codegen Stage Id to Spark plan graphs in Web UI SQL Tab

[ https://issues.apache.org/jira/browse/SPARK-29894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29894: --- Assignee: Luca Canali > Add Codegen Stage Id to Spark plan graphs in Web UI SQL Tab > -

[jira] [Created] (SPARK-29974) Submitting with application jar on HA HDFS

Christopher Meier created SPARK-29974: - Summary: Submitting with application jar on HA HDFS Key: SPARK-29974 URL: https://issues.apache.org/jira/browse/SPARK-29974 Project: Spark Issue T

[jira] [Commented] (SPARK-29974) Submitting with application jar on HA HDFS

[ https://issues.apache.org/jira/browse/SPARK-29974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16978567#comment-16978567 ] Kent Yao commented on SPARK-29974: -- https://github.com/apache/spark/pull/25695 here is

[jira] [Assigned] (SPARK-29951) Make the behavior of Postgre dialect independent of ansi mode config

[ https://issues.apache.org/jira/browse/SPARK-29951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29951: --- Assignee: Yuanjian Li > Make the behavior of Postgre dialect independent of ansi mode confi

[jira] [Resolved] (SPARK-29951) Make the behavior of Postgre dialect independent of ansi mode config

[ https://issues.apache.org/jira/browse/SPARK-29951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29951. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26584 [https://gith

[jira] [Created] (SPARK-29975) introduce --CONFIG_DIM directive

Wenchen Fan created SPARK-29975: --- Summary: introduce --CONFIG_DIM directive Key: SPARK-29975 URL: https://issues.apache.org/jira/browse/SPARK-29975 Project: Spark Issue Type: Test Com

[jira] [Created] (SPARK-29976) Allow speculation even if there is only one task

Yuchen Huo created SPARK-29976: -- Summary: Allow speculation even if there is only one task Key: SPARK-29976 URL: https://issues.apache.org/jira/browse/SPARK-29976 Project: Spark Issue Type: Impr

[jira] [Updated] (SPARK-27558) NPE in TaskCompletionListener due to Spark OOM in UnsafeExternalSorter causing tasks to hang

[ https://issues.apache.org/jira/browse/SPARK-27558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-27558: - Fix Version/s: 3.0.0 2.4.5 > NPE in TaskCompletionListener due to Spark OOM i

[jira] [Resolved] (SPARK-29911) Cache table may memory leak when session closed

[ https://issues.apache.org/jira/browse/SPARK-29911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29911. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26543 [https://gi

[jira] [Assigned] (SPARK-29911) Cache table may memory leak when session closed

[ https://issues.apache.org/jira/browse/SPARK-29911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-29911: Assignee: Lantao Jin > Cache table may memory leak when session closed >

[jira] [Created] (SPARK-29977) Remove newMutableProjection/newOrdering/newNaturalAscendingOrdering from SparkPlan

Takeshi Yamamuro created SPARK-29977: Summary: Remove newMutableProjection/newOrdering/newNaturalAscendingOrdering from SparkPlan Key: SPARK-29977 URL: https://issues.apache.org/jira/browse/SPARK-29977

[jira] [Updated] (SPARK-29977) Remove newMutableProjection/newOrdering/newNaturalAscendingOrdering from SparkPlan

[ https://issues.apache.org/jira/browse/SPARK-29977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-29977: - Description: This is to refactor {{SparkPlan}} code; it mainly intends to remove  {{newM

[jira] [Created] (SPARK-29978) Add a test to check `json_tuple` does not truncate results

Hyukjin Kwon created SPARK-29978: Summary: Add a test to check `json_tuple` does not truncate results Key: SPARK-29978 URL: https://issues.apache.org/jira/browse/SPARK-29978 Project: Spark Is

[jira] [Updated] (SPARK-29978) Add a test to check `json_tuple` does not truncate results

[ https://issues.apache.org/jira/browse/SPARK-29978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29978: - Component/s: Tests > Add a test to check `json_tuple` does not truncate results > --

[jira] [Resolved] (SPARK-29978) Add a test to check `json_tuple` does not truncate results

[ https://issues.apache.org/jira/browse/SPARK-29978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29978. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26613 [https://gi

[jira] [Assigned] (SPARK-29978) Add a test to check `json_tuple` does not truncate results

[ https://issues.apache.org/jira/browse/SPARK-29978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-29978: Assignee: Maxim Gekk > Add a test to check `json_tuple` does not truncate results > -

[jira] [Assigned] (SPARK-29961) Implement typeof builtin function

[ https://issues.apache.org/jira/browse/SPARK-29961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-29961: Assignee: Kent Yao > Implement typeof builtin function >

[jira] [Resolved] (SPARK-29961) Implement typeof builtin function

[ https://issues.apache.org/jira/browse/SPARK-29961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29961. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26599 [https://gi

[jira] [Commented] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16978889#comment-16978889 ] WuZeyi commented on SPARK-29553: I use Hibench to run it on only one machine on Yarn.  T

[jira] [Comment Edited] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16978889#comment-16978889 ] WuZeyi edited comment on SPARK-29553 at 11/21/19 1:42 AM: -- [~sr

[jira] [Updated] (SPARK-29979) Add property key constants in Table and SupportsNamespaces

[ https://issues.apache.org/jira/browse/SPARK-29979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Fuwang updated SPARK-29979: -- Summary: Add property key constants in Table and SupportsNamespaces (was: Add property constants in T

[jira] [Updated] (SPARK-29979) Add property constants in Table and SupportsNamespaces

[ https://issues.apache.org/jira/browse/SPARK-29979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Fuwang updated SPARK-29979: -- Description: Currently, for  > Add property constants in Table and SupportsNamespaces > --

[jira] [Created] (SPARK-29979) Add property constants in Table and SupportsNamespaces

Hu Fuwang created SPARK-29979: - Summary: Add property constants in Table and SupportsNamespaces Key: SPARK-29979 URL: https://issues.apache.org/jira/browse/SPARK-29979 Project: Spark Issue Type:

[jira] [Commented] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16978893#comment-16978893 ] Sean R. Owen commented on SPARK-29553: -- That's not what I'm asking. How are your cl

[jira] [Updated] (SPARK-29979) Add property key constants in Table and SupportsNamespaces

[ https://issues.apache.org/jira/browse/SPARK-29979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Fuwang updated SPARK-29979: -- Description: Currently, some basic/reserved keys (eg. "location", "comment") of table and namespace pr

[jira] [Commented] (SPARK-29967) KMeans support instance weighting

[ https://issues.apache.org/jira/browse/SPARK-29967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16978897#comment-16978897 ] zhengruifeng commented on SPARK-29967: -- [~srowen]   Hi, Owen how would you think of

[jira] [Updated] (SPARK-29979) Add basic/reserved property key constants in Table and SupportsNamespaces

[ https://issues.apache.org/jira/browse/SPARK-29979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Fuwang updated SPARK-29979: -- Summary: Add basic/reserved property key constants in Table and SupportsNamespaces (was: Add property

[jira] [Commented] (SPARK-29967) KMeans support instance weighting

[ https://issues.apache.org/jira/browse/SPARK-29967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16978905#comment-16978905 ] Sean R. Owen commented on SPARK-29967: -- Is it necessary to move the implementation?

[jira] [Created] (SPARK-29980) Whitespaces handling for Cast and BinaryOperation between StringType and NumericTypes

Kent Yao created SPARK-29980: Summary: Whitespaces handling for Cast and BinaryOperation between StringType and NumericTypes Key: SPARK-29980 URL: https://issues.apache.org/jira/browse/SPARK-29980 Project

[jira] [Commented] (SPARK-29967) KMeans support instance weighting

[ https://issues.apache.org/jira/browse/SPARK-29967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16978942#comment-16978942 ] zhengruifeng commented on SPARK-29967: -- [~srowen] I suggested move the impl, since

[jira] [Resolved] (SPARK-29980) Whitespaces handling for Cast and BinaryOperation between StringType and NumericTypes

[ https://issues.apache.org/jira/browse/SPARK-29980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29980. -- Resolution: Duplicate > Whitespaces handling for Cast and BinaryOperation between StringType a

[jira] [Created] (SPARK-29981) Add `hive-1.2` and `hive-2.3` profiles

Dongjoon Hyun created SPARK-29981: - Summary: Add `hive-1.2` and `hive-2.3` profiles Key: SPARK-29981 URL: https://issues.apache.org/jira/browse/SPARK-29981 Project: Spark Issue Type: Improvem

[jira] [Updated] (SPARK-29981) Add `hive-1.2` and `hive-2.3` profiles

[ https://issues.apache.org/jira/browse/SPARK-29981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29981: -- Component/s: (was: SQL) > Add `hive-1.2` and `hive-2.3` profiles > ---

[jira] [Commented] (SPARK-29967) KMeans support instance weighting

[ https://issues.apache.org/jira/browse/SPARK-29967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16978952#comment-16978952 ] Sean R. Owen commented on SPARK-29967: -- Yes, I think that is a fine idea, but nothi

[jira] [Updated] (SPARK-29892) Add built-in Array Functions: array_cat

[ https://issues.apache.org/jira/browse/SPARK-29892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-29892: --- Parent: SPARK-27764 Issue Type: Sub-task (was: Improvement) > Add built-in Array Functions:

[jira] [Updated] (SPARK-29891) Add built-in Array Functions: array_length

[ https://issues.apache.org/jira/browse/SPARK-29891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-29891: --- Parent: SPARK-27764 Issue Type: Sub-task (was: Improvement) > Add built-in Array Functions:

[jira] [Created] (SPARK-29982) Add built-in Array Functions: array_append

jiaan.geng created SPARK-29982: -- Summary: Add built-in Array Functions: array_append Key: SPARK-29982 URL: https://issues.apache.org/jira/browse/SPARK-29982 Project: Spark Issue Type: Improvemen

[jira] [Updated] (SPARK-29982) Add built-in Array Functions: array_append

[ https://issues.apache.org/jira/browse/SPARK-29982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-29982: --- Parent: SPARK-27764 Issue Type: Sub-task (was: Improvement) > Add built-in Array Functions:

[jira] [Updated] (SPARK-29982) Add built-in Array Functions: array_append

[ https://issues.apache.org/jira/browse/SPARK-29982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-29982: --- Description: |{{array_append}}{{(}}{{anyarray}}{{, }}{{anyelement}}{{)}}|{{anyarray}}|append an ele

[jira] [Commented] (SPARK-29982) Add built-in Array Functions: array_append

[ https://issues.apache.org/jira/browse/SPARK-29982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16979008#comment-16979008 ] jiaan.geng commented on SPARK-29982: I'm on working. > Add built-in Array Functions

[jira] [Assigned] (SPARK-29885) Improve the exception message when reading the daemon port

[ https://issues.apache.org/jira/browse/SPARK-29885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-29885: Assignee: jiaan.geng > Improve the exception message when reading the daemon port > -

[jira] [Resolved] (SPARK-29885) Improve the exception message when reading the daemon port

[ https://issues.apache.org/jira/browse/SPARK-29885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29885. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26510 [https://gi

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16979050#comment-16979050 ] zhao bo commented on SPARK-29106: - Hi [~shaneknapp], I had success to build apache/arro

[jira] [Created] (SPARK-29983) Add an independent config for an optional INTERVAL clause

Takeshi Yamamuro created SPARK-29983: Summary: Add an independent config for an optional INTERVAL clause Key: SPARK-29983 URL: https://issues.apache.org/jira/browse/SPARK-29983 Project: Spark