[jira] [Resolved] (SPARK-16559) Got java.lang.ArithmeticException when Num of Buckets is Set to Zero

2016-10-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-16559. - Resolution: Fixed > Got java.lang.ArithmeticException when Num of Buckets is Set to Zero >

[jira] [Updated] (SPARK-18003) RDD zipWithIndex generate wrong result when one partition contains more than 2147483647 records.

2016-10-18 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-18003: --- Description: RDD zipWithIndex generate wrong result when one partition contains more than

[jira] [Commented] (SPARK-16559) Got java.lang.ArithmeticException when Num of Buckets is Set to Zero

2016-10-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587713#comment-15587713 ] Xiao Li commented on SPARK-16559: - Yeah, resolved. > Got java.lang.ArithmeticException when Num of

[jira] [Assigned] (SPARK-16559) Got java.lang.ArithmeticException when Num of Buckets is Set to Zero

2016-10-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-16559: --- Assignee: Xiao Li > Got java.lang.ArithmeticException when Num of Buckets is Set to Zero >

[jira] [Commented] (SPARK-16559) Got java.lang.ArithmeticException when Num of Buckets is Set to Zero

2016-10-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587711#comment-15587711 ] Dongjoon Hyun commented on SPARK-16559: --- Hi, [~smilegator]. It seems to be resolved in your PR,

[jira] [Assigned] (SPARK-18003) RDD zipWithIndex generate wrong result when one partition contains more than 2147483647 records.

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18003: Assignee: Apache Spark > RDD zipWithIndex generate wrong result when one partition

[jira] [Assigned] (SPARK-18003) RDD zipWithIndex generate wrong result when one partition contains more than 2147483647 records.

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18003: Assignee: (was: Apache Spark) > RDD zipWithIndex generate wrong result when one

[jira] [Commented] (SPARK-18003) RDD zipWithIndex generate wrong result when one partition contains more than 2147483647 records.

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587706#comment-15587706 ] Apache Spark commented on SPARK-18003: -- User 'WeichenXu123' has created a pull request for this

[jira] [Updated] (SPARK-18003) RDD zipWithIndex generate wrong result when one partition contains more than 2147483647 records.

2016-10-18 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-18003: --- Component/s: Spark Core > RDD zipWithIndex generate wrong result when one partition contains more

[jira] [Created] (SPARK-18003) RDD zipWithIndex generate wrong result when one partition contains more than 2147483647 records.

2016-10-18 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-18003: -- Summary: RDD zipWithIndex generate wrong result when one partition contains more than 2147483647 records. Key: SPARK-18003 URL: https://issues.apache.org/jira/browse/SPARK-18003

[jira] [Commented] (SPARK-17630) jvm-exit-on-fatal-error handler for spark.rpc.netty like there is available for akka

2016-10-18 Thread Mario Briggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587664#comment-15587664 ] Mario Briggs commented on SPARK-17630: -- [~zsxwing] thanks much. any pointers on how/where to add

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587659#comment-15587659 ] Jiang Xingbo commented on SPARK-17982: -- You are right, just made a mistake. Sorry for that! > Spark

[jira] [Comment Edited] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

2016-10-18 Thread Saikat Kanjilal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587627#comment-15587627 ] Saikat Kanjilal edited comment on SPARK-9487 at 10/19/16 4:24 AM: --

[jira] [Comment Edited] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

2016-10-18 Thread Saikat Kanjilal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587627#comment-15587627 ] Saikat Kanjilal edited comment on SPARK-9487 at 10/19/16 4:24 AM: --

[jira] [Commented] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

2016-10-18 Thread Saikat Kanjilal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587627#comment-15587627 ] Saikat Kanjilal commented on SPARK-9487: [~holdenk] finally getting time to look at this, so I am

[jira] [Commented] (SPARK-17985) Bump commons-lang3 version to 3.5.

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587625#comment-15587625 ] Apache Spark commented on SPARK-17985: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-18002) Prune unnecessary IsNotNull predicates from Filter

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587624#comment-15587624 ] Apache Spark commented on SPARK-18002: -- User 'viirya' has created a pull request for this issue:

[jira] [Updated] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

2016-10-18 Thread Saikat Kanjilal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saikat Kanjilal updated SPARK-9487: --- Attachment: ContextCleanerSuiteResults > Use the same num. worker threads in Scala/Python

[jira] [Assigned] (SPARK-18002) Prune unnecessary IsNotNull predicates from Filter

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18002: Assignee: Apache Spark > Prune unnecessary IsNotNull predicates from Filter >

[jira] [Assigned] (SPARK-18002) Prune unnecessary IsNotNull predicates from Filter

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18002: Assignee: (was: Apache Spark) > Prune unnecessary IsNotNull predicates from Filter >

[jira] [Updated] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

2016-10-18 Thread Saikat Kanjilal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saikat Kanjilal updated SPARK-9487: --- Attachment: HeartbeatReceiverSuiteResults > Use the same num. worker threads in Scala/Python

[jira] [Resolved] (SPARK-18001) Broke link to R DataFrame In sql-programming-guide

2016-10-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18001. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.2 > Broke link to R

[jira] [Updated] (SPARK-18001) Broke link to R DataFrame In sql-programming-guide

2016-10-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18001: Assignee: Tommy Yu > Broke link to R DataFrame In sql-programming-guide >

[jira] [Created] (SPARK-18002) Prune unnecessary IsNotNull predicates from Filter

2016-10-18 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-18002: --- Summary: Prune unnecessary IsNotNull predicates from Filter Key: SPARK-18002 URL: https://issues.apache.org/jira/browse/SPARK-18002 Project: Spark

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587583#comment-15587583 ] Dongjoon Hyun commented on SPARK-17982: --- Hi, [~tafra...@gmail.com]. I made a PR for you. It handles

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587579#comment-15587579 ] Dongjoon Hyun commented on SPARK-17982: --- Hi, [~jiangxb]. I think Spark supports that like MySQL

[jira] [Assigned] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17982: Assignee: (was: Apache Spark) > Spark 2.0.0 CREATE VIEW statement fails ::

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587573#comment-15587573 ] Apache Spark commented on SPARK-17982: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-17892) Query in CTAS is Optimized Twice (branch-2.0)

2016-10-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587574#comment-15587574 ] Dongjoon Hyun commented on SPARK-17892: --- Sorry. It's my mistake. > Query in CTAS is Optimized

[jira] [Assigned] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17982: Assignee: Apache Spark > Spark 2.0.0 CREATE VIEW statement fails ::

[jira] [Commented] (SPARK-17892) Query in CTAS is Optimized Twice (branch-2.0)

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587567#comment-15587567 ] Apache Spark commented on SPARK-17892: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-17999) Add getPreferredLocations for KafkaSourceRDD

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17999: Assignee: (was: Apache Spark) > Add getPreferredLocations for KafkaSourceRDD >

[jira] [Assigned] (SPARK-17999) Add getPreferredLocations for KafkaSourceRDD

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17999: Assignee: Apache Spark > Add getPreferredLocations for KafkaSourceRDD >

[jira] [Assigned] (SPARK-17997) Aggregation function for counting distinct values for multiple intervals

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17997: Assignee: (was: Apache Spark) > Aggregation function for counting distinct values for

[jira] [Assigned] (SPARK-17997) Aggregation function for counting distinct values for multiple intervals

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17997: Assignee: Apache Spark > Aggregation function for counting distinct values for multiple

[jira] [Commented] (SPARK-17997) Aggregation function for counting distinct values for multiple intervals

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587548#comment-15587548 ] Apache Spark commented on SPARK-17997: -- User 'wzhfy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18001) Broke link to R DataFrame In sql-programming-guide

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18001: Assignee: Apache Spark > Broke link to R DataFrame In sql-programming-guide >

[jira] [Assigned] (SPARK-18001) Broke link to R DataFrame In sql-programming-guide

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18001: Assignee: (was: Apache Spark) > Broke link to R DataFrame In sql-programming-guide >

[jira] [Commented] (SPARK-18001) Broke link to R DataFrame In sql-programming-guide

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587539#comment-15587539 ] Apache Spark commented on SPARK-18001: -- User 'Wenpei' has created a pull request for this issue:

[jira] [Resolved] (SPARK-17873) ALTER TABLE ... RENAME TO ... should allow users to specify database in destination table name

2016-10-18 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-17873. -- Resolution: Fixed Fix Version/s: 2.1.0 This issue has been resolved by

[jira] [Commented] (SPARK-17987) ML Evaluator fails to handle null values in the dataset

2016-10-18 Thread bo song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587530#comment-15587530 ] bo song commented on SPARK-17987: - There is a common case in cross validation, suppose f1 is a

[jira] [Updated] (SPARK-17873) ALTER TABLE ... RENAME TO ... should allow users to specify database in destination table name

2016-10-18 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-17873: - Assignee: Wenchen Fan (was: Apache Spark) > ALTER TABLE ... RENAME TO ... should allow users to specify

[jira] [Created] (SPARK-18001) Broke link to R DataFrame In sql-programming-guide

2016-10-18 Thread Tommy Yu (JIRA)
Tommy Yu created SPARK-18001: Summary: Broke link to R DataFrame In sql-programming-guide Key: SPARK-18001 URL: https://issues.apache.org/jira/browse/SPARK-18001 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-17074) generate histogram information for column

2016-10-18 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-17074: - Description: We support two kinds of histograms: - Equi-width histogram: We have a fixed

[jira] [Commented] (SPARK-17984) Add support for numa aware feature

2016-10-18 Thread quanfuwang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587472#comment-15587472 ] quanfuwang commented on SPARK-17984: Thanks. Yes, I'm considering not to bring the dependency on

[jira] [Created] (SPARK-18000) Aggregation function for computing endpoints for numeric histograms

2016-10-18 Thread Zhenhua Wang (JIRA)
Zhenhua Wang created SPARK-18000: Summary: Aggregation function for computing endpoints for numeric histograms Key: SPARK-18000 URL: https://issues.apache.org/jira/browse/SPARK-18000 Project: Spark

[jira] [Created] (SPARK-17999) Add getPreferredLocations for KafkaSourceRDD

2016-10-18 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-17999: --- Summary: Add getPreferredLocations for KafkaSourceRDD Key: SPARK-17999 URL: https://issues.apache.org/jira/browse/SPARK-17999 Project: Spark Issue Type:

[jira] [Commented] (SPARK-10872) Derby error (XSDB6) when creating new HiveContext after restarting SparkContext

2016-10-18 Thread Angus Gerry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587461#comment-15587461 ] Angus Gerry commented on SPARK-10872: - Will do. Thanks mate :). > Derby error (XSDB6) when creating

[jira] [Commented] (SPARK-17984) Add support for numa aware feature

2016-10-18 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587459#comment-15587459 ] Saisai Shao commented on SPARK-17984: - NUMA should be supported by most commodity servers as well as

[jira] [Updated] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17982: -- Description: The following statement fails in the spark shell . {noformat} scala>

[jira] [Created] (SPARK-17998) Reading Parquet files coalesces parts into too few in-memory partitions

2016-10-18 Thread Shea Parkes (JIRA)
Shea Parkes created SPARK-17998: --- Summary: Reading Parquet files coalesces parts into too few in-memory partitions Key: SPARK-17998 URL: https://issues.apache.org/jira/browse/SPARK-17998 Project: Spark

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587433#comment-15587433 ] Jiang Xingbo commented on SPARK-17982: -- Would you please give a example that it works? Thanks! >

[jira] [Created] (SPARK-17997) Aggregation function for counting distinct values for multiple intervals

2016-10-18 Thread Zhenhua Wang (JIRA)
Zhenhua Wang created SPARK-17997: Summary: Aggregation function for counting distinct values for multiple intervals Key: SPARK-17997 URL: https://issues.apache.org/jira/browse/SPARK-17997 Project:

[jira] [Assigned] (SPARK-17996) catalog.getFunction(name) returns wrong result for a permanent function

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17996: Assignee: Herman van Hovell (was: Apache Spark) > catalog.getFunction(name) returns

[jira] [Commented] (SPARK-17996) catalog.getFunction(name) returns wrong result for a permanent function

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587425#comment-15587425 ] Apache Spark commented on SPARK-17996: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17996) catalog.getFunction(name) returns wrong result for a permanent function

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17996: Assignee: Apache Spark (was: Herman van Hovell) > catalog.getFunction(name) returns

[jira] [Comment Edited] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587420#comment-15587420 ] Jiang Xingbo edited comment on SPARK-17982 at 10/19/16 2:22 AM:

[jira] [Updated] (SPARK-17980) Fix refreshByPath for converted Hive tables

2016-10-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17980: Assignee: Eric Liang > Fix refreshByPath for converted Hive tables >

[jira] [Resolved] (SPARK-17980) Fix refreshByPath for converted Hive tables

2016-10-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17980. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15521

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587420#comment-15587420 ] Jiang Xingbo commented on SPARK-17982: -- [~dongjoon] In your examples there is a misleading part:

[jira] [Commented] (SPARK-17984) Add support for numa aware feature

2016-10-18 Thread quanfuwang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587374#comment-15587374 ] quanfuwang commented on SPARK-17984: Normal servers support NUMA, but I'm considering to abstract it

[jira] [Created] (SPARK-17996) catalog.getFunction(name) returns wrong result for a permanent function

2016-10-18 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-17996: - Summary: catalog.getFunction(name) returns wrong result for a permanent function Key: SPARK-17996 URL: https://issues.apache.org/jira/browse/SPARK-17996

[jira] [Comment Edited] (SPARK-17995) Use new attributes for columns from outer joins

2016-10-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587348#comment-15587348 ] Wenchen Fan edited comment on SPARK-17995 at 10/19/16 1:46 AM: --- Can we just

[jira] [Commented] (SPARK-17995) Use new attributes for columns from outer joins

2016-10-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587348#comment-15587348 ] Wenchen Fan commented on SPARK-17995: - Can we just add a `newOuterJoinAttrs: Seq[Attribute]`

[jira] [Commented] (SPARK-17637) Packed scheduling for Spark tasks across executors

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587307#comment-15587307 ] Apache Spark commented on SPARK-17637: -- User 'zhzhan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17985) Bump commons-lang3 version to 3.5.

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17985: Assignee: Takuya Ueshin (was: Apache Spark) > Bump commons-lang3 version to 3.5. >

[jira] [Assigned] (SPARK-17985) Bump commons-lang3 version to 3.5.

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17985: Assignee: Apache Spark (was: Takuya Ueshin) > Bump commons-lang3 version to 3.5. >

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587239#comment-15587239 ] Dongjoon Hyun commented on SPARK-17982: --- I'll make a PR for this today. > Spark 2.0.0 CREATE VIEW

[jira] [Comment Edited] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587222#comment-15587222 ] Dongjoon Hyun edited comment on SPARK-17982 at 10/19/16 12:55 AM: --

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587222#comment-15587222 ] Dongjoon Hyun commented on SPARK-17982: --- Sorry, [~tafra...@gmail.com]. Now, I understand what you

[jira] [Updated] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

2016-10-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-14393: - Affects Version/s: 2.0.0 2.0.1 > monotonicallyIncreasingId not

[jira] [Updated] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

2016-10-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-14393: -- Labels: correctness (was: ) > monotonicallyIncreasingId not monotonically increasing with

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587124#comment-15587124 ] Dongjoon Hyun commented on SPARK-17982: --- I'll investigate it for you, [~tafra...@gmail.com]. >

[jira] [Commented] (SPARK-17994) Add back a file status cache for catalog tables

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587106#comment-15587106 ] Apache Spark commented on SPARK-17994: -- User 'ericl' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17994) Add back a file status cache for catalog tables

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17994: Assignee: (was: Apache Spark) > Add back a file status cache for catalog tables >

[jira] [Assigned] (SPARK-17994) Add back a file status cache for catalog tables

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17994: Assignee: Apache Spark > Add back a file status cache for catalog tables >

[jira] [Assigned] (SPARK-17993) Spark spews a slew of harmless but annoying warning messages from Parquet when reading parquet files written by older versions of Parquet-mr

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17993: Assignee: Apache Spark > Spark spews a slew of harmless but annoying warning messages

[jira] [Assigned] (SPARK-17993) Spark spews a slew of harmless but annoying warning messages from Parquet when reading parquet files written by older versions of Parquet-mr

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17993: Assignee: (was: Apache Spark) > Spark spews a slew of harmless but annoying warning

[jira] [Commented] (SPARK-17993) Spark spews a slew of harmless but annoying warning messages from Parquet when reading parquet files written by older versions of Parquet-mr

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586987#comment-15586987 ] Apache Spark commented on SPARK-17993: -- User 'mallman' has created a pull request for this issue:

[jira] [Commented] (SPARK-17630) jvm-exit-on-fatal-error handler for spark.rpc.netty like there is available for akka

2016-10-18 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586979#comment-15586979 ] Shixiong Zhu commented on SPARK-17630: -- Yeah, I think we can set up SparkUncaughtExceptionHandler

[jira] [Commented] (SPARK-17995) Use new attributes for columns from outer joins

2016-10-18 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586972#comment-15586972 ] Ryan Blue commented on SPARK-17995: --- [~cloud_fan] and [~yhuai], I'd like to help fix this, but I'm not

[jira] [Created] (SPARK-17995) Use new attributes for columns from outer joins

2016-10-18 Thread Ryan Blue (JIRA)
Ryan Blue created SPARK-17995: - Summary: Use new attributes for columns from outer joins Key: SPARK-17995 URL: https://issues.apache.org/jira/browse/SPARK-17995 Project: Spark Issue Type:

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Franck Tago (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586918#comment-15586918 ] Franck Tago commented on SPARK-17982: - Updated the Title of the Jira . I looked at the

[jira] [Updated] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Franck Tago (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Franck Tago updated SPARK-17982: Summary: Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze

[jira] [Commented] (SPARK-17993) Spark spews a slew of harmless but annoying warning messages from Parquet when reading parquet files written by older versions of Parquet-mr

2016-10-18 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586897#comment-15586897 ] Michael Allman commented on SPARK-17993: cc [~ekhliang] I think I have a fix for this. I'm going

[jira] [Commented] (SPARK-17992) HiveClient.getPartitionsByFilter throws an exception for some unsupported filters when hive.metastore.try.direct.sql=false

2016-10-18 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586892#comment-15586892 ] Michael Allman commented on SPARK-17992: cc [~ekhliang] [~cloud_fan] >

[jira] [Commented] (SPARK-17990) ALTER TABLE ... ADD PARTITION does not play nice with mixed-case partition column names

2016-10-18 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586888#comment-15586888 ] Michael Allman commented on SPARK-17990: CC [~ekhliang] [~cloud_fan] > ALTER TABLE ... ADD

[jira] [Commented] (SPARK-17711) Compress rolled executor logs

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586842#comment-15586842 ] Apache Spark commented on SPARK-17711: -- User 'loneknightpy' has created a pull request for this

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails when select statement contains limit clause

2016-10-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586829#comment-15586829 ] Dongjoon Hyun commented on SPARK-17982: --- Hi, [~tafra...@gmail.com]. Could you update your JIRA

[jira] [Comment Edited] (SPARK-12149) Executor UI improvement suggestions - Color UI

2016-10-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586725#comment-15586725 ] Reynold Xin edited comment on SPARK-12149 at 10/18/16 9:31 PM: --- So I looked

[jira] [Commented] (SPARK-12149) Executor UI improvement suggestions - Color UI

2016-10-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586725#comment-15586725 ] Reynold Xin commented on SPARK-12149: - So I looked at the UI today and I have to say the color code

[jira] [Commented] (SPARK-15708) Tasks table in Detailed Stage page shows ip instead of hostname under Executor ID/Host

2016-10-18 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586703#comment-15586703 ] Alex Bozarth commented on SPARK-15708: -- I have not seen this recently so it was possibly

[jira] [Assigned] (SPARK-13275) With dynamic allocation, executors appear to be added before job starts

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13275: Assignee: (was: Apache Spark) > With dynamic allocation, executors appear to be added

[jira] [Commented] (SPARK-13275) With dynamic allocation, executors appear to be added before job starts

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586680#comment-15586680 ] Apache Spark commented on SPARK-13275: -- User 'ajbozarth' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13275) With dynamic allocation, executors appear to be added before job starts

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13275: Assignee: Apache Spark > With dynamic allocation, executors appear to be added before job

[jira] [Commented] (SPARK-15769) Add Encoder for input type to Aggregator

2016-10-18 Thread Koert Kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586654#comment-15586654 ] Koert Kuipers commented on SPARK-15769: --- what i really want is to be able to use Aggregator in

[jira] [Resolved] (SPARK-17841) Kafka 0.10 commitQueue needs to be drained

2016-10-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17841. - Resolution: Fixed Assignee: Cody Koeninger Fix Version/s: 2.1.0

[jira] [Comment Edited] (SPARK-17985) Bump commons-lang3 version to 3.5.

2016-10-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586644#comment-15586644 ] Reynold Xin edited comment on SPARK-17985 at 10/18/16 8:59 PM: --- The patch

[jira] [Reopened] (SPARK-17985) Bump commons-lang3 version to 3.5.

2016-10-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reopened SPARK-17985: - The patch was reverted due to build failures in Hadoop 2.2: Actually I'm seeing the following

[jira] [Commented] (SPARK-17731) Metrics for Structured Streaming

2016-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586621#comment-15586621 ] Apache Spark commented on SPARK-17731: -- User 'tdas' has created a pull request for this issue:

  1   2   3   >