[jira] [Commented] (SPARK-16137) Random Forest wrapper in SparkR

2016-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601037#comment-15601037 ] Apache Spark commented on SPARK-16137: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-18070) binary operator should not consider nullability when comparing input types

2016-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18070: Assignee: Apache Spark (was: Wenchen Fan) > binary operator should not consider

[jira] [Commented] (SPARK-18070) binary operator should not consider nullability when comparing input types

2016-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601009#comment-15601009 ] Apache Spark commented on SPARK-18070: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18070) binary operator should not consider nullability when comparing input types

2016-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18070: Assignee: Wenchen Fan (was: Apache Spark) > binary operator should not consider

[jira] [Created] (SPARK-18070) binary operator should not consider nullability when comparing input types

2016-10-23 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-18070: --- Summary: binary operator should not consider nullability when comparing input types Key: SPARK-18070 URL: https://issues.apache.org/jira/browse/SPARK-18070 Project:

[jira] [Closed] (SPARK-12180) DataFrame.join() in PySpark gives misleading exception when column name exists on both side

2016-10-23 Thread Jagadeesan A S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadeesan A S closed SPARK-12180. -- Resolution: Cannot Reproduce > DataFrame.join() in PySpark gives misleading exception when

[jira] [Commented] (SPARK-15487) Spark Master UI to reverse proxy Application and Workers UI

2016-10-23 Thread Gurvinder (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600938#comment-15600938 ] Gurvinder commented on SPARK-15487: --- The setting needs to be set for all the application, master and

[jira] [Resolved] (SPARK-12451) Regexp functions don't support patterns containing '*/'

2016-10-23 Thread Jagadeesan A S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadeesan A S resolved SPARK-12451. Resolution: Duplicate > Regexp functions don't support patterns containing '*/' >

[jira] [Commented] (SPARK-18062) ProbabilisticClassificationModel.normalizeToProbabilitiesInPlace should return probabilities when given all-0 vector

2016-10-23 Thread Peng Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600926#comment-15600926 ] Peng Meng commented on SPARK-18062: --- This relate to how to understand all-0 rawPrediction, all classes

[jira] [Assigned] (SPARK-18067) SortMergeJoin adds shuffle if join predicates have non partitioned columns

2016-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18067: Assignee: (was: Apache Spark) > SortMergeJoin adds shuffle if join predicates have

[jira] [Commented] (SPARK-18067) SortMergeJoin adds shuffle if join predicates have non partitioned columns

2016-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600923#comment-15600923 ] Apache Spark commented on SPARK-18067: -- User 'tejasapatil' has created a pull request for this

[jira] [Assigned] (SPARK-18067) SortMergeJoin adds shuffle if join predicates have non partitioned columns

2016-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18067: Assignee: Apache Spark > SortMergeJoin adds shuffle if join predicates have non

[jira] [Updated] (SPARK-18067) SortMergeJoin adds shuffle if join predicates have non partitioned columns

2016-10-23 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-18067: Summary: SortMergeJoin adds shuffle if join predicates have non partitioned columns (was: Adding

[jira] [Comment Edited] (SPARK-16845) org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificOrdering" grows beyond 64 KB

2016-10-23 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600728#comment-15600728 ] Liwei Lin edited comment on SPARK-16845 at 10/24/16 3:52 AM: - Hi [~dondrake]

[jira] [Assigned] (SPARK-18069) Many examples in Python docstrings are incomplete

2016-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18069: Assignee: Apache Spark > Many examples in Python docstrings are incomplete >

[jira] [Commented] (SPARK-18069) Many examples in Python docstrings are incomplete

2016-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600830#comment-15600830 ] Apache Spark commented on SPARK-18069: -- User 'mortada' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18069) Many examples in Python docstrings are incomplete

2016-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18069: Assignee: (was: Apache Spark) > Many examples in Python docstrings are incomplete >

[jira] [Created] (SPARK-18069) Many examples in Python docstrings are incomplete

2016-10-23 Thread Mortada Mehyar (JIRA)
Mortada Mehyar created SPARK-18069: -- Summary: Many examples in Python docstrings are incomplete Key: SPARK-18069 URL: https://issues.apache.org/jira/browse/SPARK-18069 Project: Spark Issue

[jira] [Comment Edited] (SPARK-18067) Adding filter after SortMergeJoin creates unnecessary shuffle

2016-10-23 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600824#comment-15600824 ] Tejas Patil edited comment on SPARK-18067 at 10/24/16 3:35 AM: ---

[jira] [Commented] (SPARK-18067) Adding filter after SortMergeJoin creates unnecessary shuffle

2016-10-23 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600824#comment-15600824 ] Tejas Patil commented on SPARK-18067: - [~hvanhovell] : Tagging you since you have context of this

[jira] [Commented] (SPARK-18067) Adding filter after SortMergeJoin creates unnecessary shuffle

2016-10-23 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600820#comment-15600820 ] Tejas Patil commented on SPARK-18067: - The predicate `value1 === value2` is pushed down to the Join

[jira] [Comment Edited] (SPARK-18067) Adding filter after SortMergeJoin creates unnecessary shuffle

2016-10-23 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600788#comment-15600788 ] Tejas Patil edited comment on SPARK-18067 at 10/24/16 3:12 AM: --- You could

[jira] [Commented] (SPARK-18067) Adding filter after SortMergeJoin creates unnecessary shuffle

2016-10-23 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600788#comment-15600788 ] Tejas Patil commented on SPARK-18067: - You could do : {norformat} val joinedOutput =

[jira] [Commented] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-23 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600732#comment-15600732 ] Stephane Maarek commented on SPARK-18068: - I see TimestampType is a wrapper for

[jira] [Commented] (SPARK-16845) org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificOrdering" grows beyond 64 KB

2016-10-23 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600728#comment-15600728 ] Liwei Lin commented on SPARK-16845: --- The other solution is still under discussion & in progress. It'd

[jira] [Updated] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-23 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephane Maarek updated SPARK-18068: Priority: Major (was: Critical) > Spark SQL doesn't parse some ISO 8601 formatted dates >

[jira] [Commented] (SPARK-15487) Spark Master UI to reverse proxy Application and Workers UI

2016-10-23 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600710#comment-15600710 ] Matthew Farrellee commented on SPARK-15487: --- try just setting the proxy url to "/" > Spark

[jira] [Updated] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-23 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephane Maarek updated SPARK-18068: Description: The following fail, but shouldn't according to the ISO 8601 standard (seconds

[jira] [Commented] (SPARK-13331) AES support for over-the-wire encryption

2016-10-23 Thread Junjie Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600705#comment-15600705 ] Junjie Chen commented on SPARK-13331: - Hi [~vanzin] I have updated the latest patch, Could you

[jira] [Updated] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-23 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephane Maarek updated SPARK-18068: Description: The following fail, but shouldn't according to the ISO 8601 standard (seconds

[jira] [Created] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-23 Thread Stephane Maarek (JIRA)
Stephane Maarek created SPARK-18068: --- Summary: Spark SQL doesn't parse some ISO 8601 formatted dates Key: SPARK-18068 URL: https://issues.apache.org/jira/browse/SPARK-18068 Project: Spark

[jira] [Commented] (SPARK-18064) Spark SQL can't load default config file

2016-10-23 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600483#comment-15600483 ] Hyukjin Kwon commented on SPARK-18064: -- Could you please fill up the JIRA description? I would like

[jira] [Updated] (SPARK-18067) Adding filter after SortMergeJoin creates unnecessary shuffle

2016-10-23 Thread Paul Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Jones updated SPARK-18067: --- Description: Basic setup {code} scala> case class Data1(key: String, value1: Int) scala> case class

[jira] [Created] (SPARK-18067) Adding filter after SortMergeJoin creates unnecessary shuffle

2016-10-23 Thread Paul Jones (JIRA)
Paul Jones created SPARK-18067: -- Summary: Adding filter after SortMergeJoin creates unnecessary shuffle Key: SPARK-18067 URL: https://issues.apache.org/jira/browse/SPARK-18067 Project: Spark

[jira] [Commented] (SPARK-15487) Spark Master UI to reverse proxy Application and Workers UI

2016-10-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-15487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600365#comment-15600365 ] Cédric Hernalsteens commented on SPARK-15487: - While it works great to proxy to the slave

[jira] [Assigned] (SPARK-18066) Add Pool usage policies test coverage for FIFO & FAIR Schedulers

2016-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18066: Assignee: Apache Spark > Add Pool usage policies test coverage for FIFO & FAIR Schedulers

[jira] [Assigned] (SPARK-18066) Add Pool usage policies test coverage for FIFO & FAIR Schedulers

2016-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18066: Assignee: (was: Apache Spark) > Add Pool usage policies test coverage for FIFO & FAIR

[jira] [Commented] (SPARK-18066) Add Pool usage policies test coverage for FIFO & FAIR Schedulers

2016-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600310#comment-15600310 ] Apache Spark commented on SPARK-18066: -- User 'erenavsarogullari' has created a pull request for this

[jira] [Updated] (SPARK-18066) Add Pool usage policies test coverage for FIFO & FAIR Schedulers

2016-10-23 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-18066: --- Summary: Add Pool usage policies test coverage for FIFO & FAIR Schedulers (was: Add

[jira] [Updated] (SPARK-18066) Add Pool usage policies test coverage to FIFO & FAIR Schedulers

2016-10-23 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-18066: --- Description: The following Pool usage cases need to have Unit test coverage : -

[jira] [Updated] (SPARK-18066) Add Pool usage policies test coverage to FIFO & FAIR Schedulers

2016-10-23 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-18066: --- Description: The following Pool usage cases need to have Unit test coverage : -

[jira] [Created] (SPARK-18066) Add Pool usage policies test coverage to FIFO & FAIR Schedulers

2016-10-23 Thread Eren Avsarogullari (JIRA)
Eren Avsarogullari created SPARK-18066: -- Summary: Add Pool usage policies test coverage to FIFO & FAIR Schedulers Key: SPARK-18066 URL: https://issues.apache.org/jira/browse/SPARK-18066 Project:

[jira] [Updated] (SPARK-18058) AnalysisException may be thrown when union two DFs whose struct fields have different nullability

2016-10-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18058: -- Fix Version/s: 2.0.2 > AnalysisException may be thrown when union two DFs whose struct

[jira] [Commented] (SPARK-18065) Spark 2 allows filter/where on columns not in current schema

2016-10-23 Thread Matthew Scruggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600088#comment-15600088 ] Matthew Scruggs commented on SPARK-18065: - Makes sense [~hvanhovell], but the change in behavior

[jira] [Commented] (SPARK-18058) AnalysisException may be thrown when union two DFs whose struct fields have different nullability

2016-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600060#comment-15600060 ] Apache Spark commented on SPARK-18058: -- User 'CodingCat' has created a pull request for this issue:

[jira] [Resolved] (SPARK-18058) AnalysisException may be thrown when union two DFs whose struct fields have different nullability

2016-10-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18058. --- Resolution: Fixed Assignee: Nan Zhu Fix Version/s: 2.1.0 >

[jira] [Commented] (SPARK-17495) Hive hash implementation

2016-10-23 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15599977#comment-15599977 ] Tejas Patil commented on SPARK-17495: - [~rxin] : Sorry about that. In my original PR I intentionally

[jira] [Commented] (SPARK-17495) Hive hash implementation

2016-10-23 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15599965#comment-15599965 ] Tejas Patil commented on SPARK-17495: - [~hvanhovell] : There were two datatypes that I had added TODO

[jira] [Commented] (SPARK-18065) Spark 2 allows filter/where on columns not in current schema

2016-10-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15599951#comment-15599951 ] Herman van Hovell commented on SPARK-18065: --- This is - unfortunately - not really a bug. The

[jira] [Updated] (SPARK-15453) FileSourceScanExec to extract `outputOrdering` information

2016-10-23 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-15453: Summary: FileSourceScanExec to extract `outputOrdering` information (was: Improve join planning

[jira] [Commented] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

2016-10-23 Thread Saikat Kanjilal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15599904#comment-15599904 ] Saikat Kanjilal commented on SPARK-9487: Ping on this, [~holdenk] can you let me know if I can

[jira] [Comment Edited] (SPARK-15487) Spark Master UI to reverse proxy Application and Workers UI

2016-10-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-15487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15599856#comment-15599856 ] Cédric Hernalsteens edited comment on SPARK-15487 at 10/23/16 3:49 PM:

[jira] [Updated] (SPARK-18065) Spark 2 allows filter/where on columns not in current schema

2016-10-23 Thread Matthew Scruggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Scruggs updated SPARK-18065: Description: I noticed in Spark 2 (unlike 1.6) it's possible to use filter/where on a

[jira] [Commented] (SPARK-15487) Spark Master UI to reverse proxy Application and Workers UI

2016-10-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-15487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15599856#comment-15599856 ] Cédric Hernalsteens commented on SPARK-15487: - I'm glad to see that the PR went through.

[jira] [Created] (SPARK-18065) Spark 2 allows filter/where on columns not in current schema

2016-10-23 Thread Matthew Scruggs (JIRA)
Matthew Scruggs created SPARK-18065: --- Summary: Spark 2 allows filter/where on columns not in current schema Key: SPARK-18065 URL: https://issues.apache.org/jira/browse/SPARK-18065 Project: Spark

[jira] [Created] (SPARK-18064) Spark SQL can't load default config file

2016-10-23 Thread darion yaphet (JIRA)
darion yaphet created SPARK-18064: - Summary: Spark SQL can't load default config file Key: SPARK-18064 URL: https://issues.apache.org/jira/browse/SPARK-18064 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-16881) Migrate Mesos configs to use ConfigEntry

2016-10-23 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15599682#comment-15599682 ] Sandeep Singh commented on SPARK-16881: --- I can work on this. > Migrate Mesos configs to use

[jira] [Updated] (SPARK-17123) Performing set operations that combine string and date / timestamp columns may result in generated projection code which doesn't compile

2016-10-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17123: -- Fix Version/s: 2.0.2 > Performing set operations that combine string and date /

[jira] [Commented] (SPARK-18027) .sparkStaging not clean on RM ApplicationNotFoundException

2016-10-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15599551#comment-15599551 ] Sean Owen commented on SPARK-18027: --- OK, though Spark will consider the app failed in this case no

[jira] [Resolved] (SPARK-18045) Move `HiveDataFrameAnalyticsSuite` to package `sql`

2016-10-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18045. --- Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.1.0 > Move

[jira] [Resolved] (SPARK-18038) Move output partitioning definition from UnaryNodeExec to its children

2016-10-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18038. --- Resolution: Fixed Fix Version/s: 2.1.0 > Move output partitioning definition

[jira] [Commented] (SPARK-17495) Hive hash implementation

2016-10-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15599523#comment-15599523 ] Herman van Hovell commented on SPARK-17495: --- O? Which data types are we missing? > Hive hash

[jira] [Commented] (SPARK-17123) Performing set operations that combine string and date / timestamp columns may result in generated projection code which doesn't compile

2016-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15599444#comment-15599444 ] Apache Spark commented on SPARK-17123: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.1.0

2016-10-23 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15599386#comment-15599386 ] Liwei Lin commented on SPARK-18057: --- Cool ! > Update structured streaming kafka from 10.0.1 to 10.1.0

[jira] [Commented] (SPARK-15233) Spark task metrics should include hdfs read write latency

2016-10-23 Thread Yuance Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15599290#comment-15599290 ] Yuance Li commented on SPARK-15233: --- What's new about this issue? Thx > Spark task metrics should

[jira] [Commented] (SPARK-17495) Hive hash implementation

2016-10-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15599246#comment-15599246 ] Reynold Xin commented on SPARK-17495: - [~tejasp] I am going to reopen this. I just realized the

[jira] [Reopened] (SPARK-17495) Hive hash implementation

2016-10-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reopened SPARK-17495: - > Hive hash implementation > > > Key: SPARK-17495 >