[jira] [Updated] (SPARK-10186) Add support for more postgres column types

2015-11-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10186: Assignee: Marius Van Niekerk > Add support for more postgres column types > ---

[jira] [Commented] (SPARK-11803) Dataset self join returns incorrect result

2015-11-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010418#comment-15010418 ] Xiao Li commented on SPARK-11803: - After implementing the prototype, it can generate the

[jira] [Commented] (SPARK-11792) SizeEstimator cannot provide a good size estimation of UnsafeHashedRelations

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010414#comment-15010414 ] Apache Spark commented on SPARK-11792: -- User 'davies' has created a pull request for

[jira] [Resolved] (SPARK-11728) Replace example code in ml-ensembles.md using include_example

2015-11-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11728. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9716 [https://gi

[jira] [Commented] (SPARK-6787) Model export/import for spark.ml: estimators under ml.feature (I)

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010409#comment-15010409 ] Apache Spark commented on SPARK-6787: - User 'mengxr' has created a pull request for th

[jira] [Assigned] (SPARK-6787) Model export/import for spark.ml: estimators under ml.feature (I)

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6787: --- Assignee: Xiangrui Meng (was: Apache Spark) > Model export/import for spark.ml: estimators u

[jira] [Assigned] (SPARK-6787) Model export/import for spark.ml: estimators under ml.feature (I)

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6787: --- Assignee: Apache Spark (was: Xiangrui Meng) > Model export/import for spark.ml: estimators u

[jira] [Comment Edited] (SPARK-9552) Dynamic allocation kills busy executors on race condition

2015-11-17 Thread Jie Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010393#comment-15010393 ] Jie Huang edited comment on SPARK-9552 at 11/18/15 7:22 AM: on

[jira] [Commented] (SPARK-9552) Dynamic allocation kills busy executors on race condition

2015-11-17 Thread Jie Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010393#comment-15010393 ] Jie Huang commented on SPARK-9552: -- one follow up, please check: hhttps://github.com/apac

[jira] [Resolved] (SPARK-11643) inserting date with leading zero inserts null example '0001-12-10'

2015-11-17 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11643. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9701 [https://github.c

[jira] [Commented] (SPARK-11772) DataFrame.show() fails with non-ASCII strings

2015-11-17 Thread Greg Baker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010386#comment-15010386 ] Greg Baker commented on SPARK-11772: Yes... I guess it's not sensible to blame this o

[jira] [Updated] (SPARK-7013) Add unit test for spark.ml StandardScaler

2015-11-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7013: - Target Version/s: 1.6.0 > Add unit test for spark.ml StandardScaler >

[jira] [Updated] (SPARK-7013) Add unit test for spark.ml StandardScaler

2015-11-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7013: - Assignee: RoyGao > Add unit test for spark.ml StandardScaler > ---

[jira] [Resolved] (SPARK-7013) Add unit test for spark.ml StandardScaler

2015-11-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7013. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 6665 [https://githu

[jira] [Updated] (SPARK-7341) Fix the flaky test: org.apache.spark.streaming.InputStreamsSuite.socket input stream

2015-11-17 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7341: - Target Version/s: (was: 1.6.0) > Fix the flaky test: org.apache.spark.streaming.InputStreamsSuit

[jira] [Resolved] (SPARK-11761) Prevent the call to StreamingContext#stop() in the listener bus's thread

2015-11-17 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-11761. --- Resolution: Fixed Assignee: Ted Yu Fix Version/s: 1.6.0 > Prevent the call to

[jira] [Commented] (SPARK-11772) DataFrame.show() fails with non-ASCII strings

2015-11-17 Thread kevin yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010358#comment-15010358 ] kevin yu commented on SPARK-11772: -- Hello Greg: Glad you find solution. Can we close thi

[jira] [Commented] (SPARK-11617) MEMORY LEAK: ByteBuf.release() was not called before it's garbage-collected

2015-11-17 Thread LingZhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010355#comment-15010355 ] LingZhou commented on SPARK-11617: -- You are right. After increasing spark.yarn.executor

[jira] [Commented] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-11-17 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010353#comment-15010353 ] hujiayin commented on SPARK-4036: - Hi Sasaki, I'm not sure if you worked on it as the jira

[jira] [Assigned] (SPARK-11809) Switch the default Mesos mode to coarse-grained mode

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11809: Assignee: Apache Spark (was: Reynold Xin) > Switch the default Mesos mode to coarse-grain

[jira] [Assigned] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4036: --- Assignee: Kai Sasaki (was: Apache Spark) > Add Conditional Random Fields (CRF) algorithm to

[jira] [Assigned] (SPARK-11809) Switch the default Mesos mode to coarse-grained mode

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11809: Assignee: Reynold Xin (was: Apache Spark) > Switch the default Mesos mode to coarse-grain

[jira] [Commented] (SPARK-11809) Switch the default Mesos mode to coarse-grained mode

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010354#comment-15010354 ] Apache Spark commented on SPARK-11809: -- User 'rxin' has created a pull request for t

[jira] [Updated] (SPARK-11809) Switch the default Mesos mode to coarse-grained mode

2015-11-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11809: Labels: releasenotes (was: ) > Switch the default Mesos mode to coarse-grained mode >

[jira] [Created] (SPARK-11809) Switch the default Mesos mode to coarse-grained mode

2015-11-17 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11809: --- Summary: Switch the default Mesos mode to coarse-grained mode Key: SPARK-11809 URL: https://issues.apache.org/jira/browse/SPARK-11809 Project: Spark Issue Type

[jira] [Assigned] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4036: --- Assignee: Apache Spark (was: Kai Sasaki) > Add Conditional Random Fields (CRF) algorithm to

[jira] [Commented] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010351#comment-15010351 ] Apache Spark commented on SPARK-4036: - User 'HuJiayin' has created a pull request for

[jira] [Commented] (SPARK-11803) Dataset self join returns incorrect result

2015-11-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010345#comment-15010345 ] Xiao Li commented on SPARK-11803: - Sure, I can try it, but I have to say I am unable to c

[jira] [Commented] (SPARK-11808) Remove Bagel

2015-11-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010339#comment-15010339 ] Reynold Xin commented on SPARK-11808: - To contributors: please don't submit any pull

[jira] [Commented] (SPARK-11807) Remove support for Hadoop < 2.2 (i.e. Hadoop 1 and 2.0)

2015-11-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010338#comment-15010338 ] Reynold Xin commented on SPARK-11807: - To contributors: please don't submit any pull

[jira] [Created] (SPARK-11808) Remove Bagel

2015-11-17 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11808: --- Summary: Remove Bagel Key: SPARK-11808 URL: https://issues.apache.org/jira/browse/SPARK-11808 Project: Spark Issue Type: Sub-task Components: GraphX

[jira] [Assigned] (SPARK-11808) Remove Bagel

2015-11-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-11808: --- Assignee: Reynold Xin > Remove Bagel > > > Key: SPARK-11808 >

[jira] [Assigned] (SPARK-11807) Remove support for Hadoop < 2.2 (i.e. Hadoop 1 and 2.0)

2015-11-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-11807: --- Assignee: Reynold Xin > Remove support for Hadoop < 2.2 (i.e. Hadoop 1 and 2.0) > --

[jira] [Created] (SPARK-11807) Remove support for Hadoop < 2.2 (i.e. Hadoop 1 and 2.0)

2015-11-17 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11807: --- Summary: Remove support for Hadoop < 2.2 (i.e. Hadoop 1 and 2.0) Key: SPARK-11807 URL: https://issues.apache.org/jira/browse/SPARK-11807 Project: Spark Issue T

[jira] [Commented] (SPARK-11803) Dataset self join returns incorrect result

2015-11-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010329#comment-15010329 ] Reynold Xin commented on SPARK-11803: - Please submit a pull request if you can figure

[jira] [Created] (SPARK-11806) Spark 2.0 deprecations and removals

2015-11-17 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11806: --- Summary: Spark 2.0 deprecations and removals Key: SPARK-11806 URL: https://issues.apache.org/jira/browse/SPARK-11806 Project: Spark Issue Type: Umbrella

[jira] [Commented] (SPARK-9820) NullPointerException that causes failure to request executors.

2015-11-17 Thread Hailong Wen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010324#comment-15010324 ] Hailong Wen commented on SPARK-9820: Hi guys, we encountered the same problem in our p

[jira] [Resolved] (SPARK-11755) SparkR can not output help information for SparkR:::predict

2015-11-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11755. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-11755) SparkR can not output help information for SparkR:::predict

2015-11-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11755: -- Assignee: Yanbo Liang > SparkR can not output help information for SparkR:::pre

[jira] [Commented] (SPARK-11803) Dataset self join returns incorrect result

2015-11-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010315#comment-15010315 ] Xiao Li commented on SPARK-11803: - I believe this must be an urgent issue. This is my fir

[jira] [Updated] (SPARK-6787) Model export/import for spark.ml: estimators under ml.feature (I)

2015-11-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6787: - Summary: Model export/import for spark.ml: estimators under ml.feature (I) (was: Model export/imp

[jira] [Updated] (SPARK-6787) Model export/import for spark.ml: estimators under ml.feature (1)

2015-11-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6787: - Description: Add read/write support to the following estimators under spark.ml: * CountVectorizer

[jira] [Updated] (SPARK-6787) Model export/import for spark.ml: estimators under ml.feature (1)

2015-11-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6787: - Summary: Model export/import for spark.ml: estimators under ml.feature (1) (was: Model export/imp

[jira] [Updated] (SPARK-6787) Model export/import for spark.ml: estimators under ml.feature (1)

2015-11-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6787: - Assignee: Xiangrui Meng > Model export/import for spark.ml: estimators under ml.feature (1) >

[jira] [Updated] (SPARK-6787) Model export/import for spark.ml: estimators under ml.feature (1)

2015-11-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6787: - Description: * CountVectorizer * IDF * MinMaxScaler * StandardScaler * StringIndexer > Model expo

[jira] [Updated] (SPARK-6787) Model export/import for spark.ml: estimators under ml.feature (1)

2015-11-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6787: - Target Version/s: 1.6.0 > Model export/import for spark.ml: estimators under ml.feature (1) >

[jira] [Assigned] (SPARK-11805) SpillableIterator should free the in-memory sorter while spilling

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11805: Assignee: Apache Spark (was: Davies Liu) > SpillableIterator should free the in-memory so

[jira] [Assigned] (SPARK-11805) SpillableIterator should free the in-memory sorter while spilling

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11805: Assignee: Davies Liu (was: Apache Spark) > SpillableIterator should free the in-memory so

[jira] [Commented] (SPARK-11805) SpillableIterator should free the in-memory sorter while spilling

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010306#comment-15010306 ] Apache Spark commented on SPARK-11805: -- User 'davies' has created a pull request for

[jira] [Updated] (SPARK-11726) Legacy Netty-RPC based submission in standalone mode does not work

2015-11-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11726: -- Assignee: Jacek Lewandowski (was: Jacek Laskowski) > Legacy Netty-RPC based submission in standalone m

[jira] [Commented] (SPARK-11726) Legacy Netty-RPC based submission in standalone mode does not work

2015-11-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010288#comment-15010288 ] Andrew Or commented on SPARK-11726: --- oops, fixed > Legacy Netty-RPC based submission i

[jira] [Resolved] (SPARK-11797) collect, first, and take should use encoders for serialization

2015-11-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11797. - Resolution: Fixed Fix Version/s: 1.6.0 > collect, first, and take should use encoders for

[jira] [Assigned] (SPARK-11795) org.apache.spark.sql.AnalysisException: Can't extract value from a#12

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11795: Assignee: (was: Apache Spark) > org.apache.spark.sql.AnalysisException: Can't extract

[jira] [Commented] (SPARK-11795) org.apache.spark.sql.AnalysisException: Can't extract value from a#12

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010281#comment-15010281 ] Apache Spark commented on SPARK-11795: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-11795) org.apache.spark.sql.AnalysisException: Can't extract value from a#12

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11795: Assignee: Apache Spark > org.apache.spark.sql.AnalysisException: Can't extract value from

[jira] [Commented] (SPARK-11803) Dataset self join returns incorrect result

2015-11-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010267#comment-15010267 ] Xiao Li commented on SPARK-11803: - We need to detect if this is a self join in the functi

[jira] [Comment Edited] (SPARK-9686) Spark Thrift server doesn't return correct JDBC metadata

2015-11-17 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010244#comment-15010244 ] Navis edited comment on SPARK-9686 at 11/18/15 5:06 AM: [~lian che

[jira] [Commented] (SPARK-9686) Spark Thrift server doesn't return correct JDBC metadata

2015-11-17 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010244#comment-15010244 ] Navis commented on SPARK-9686: -- @Cheng Lian Sorry, I've confused "remote metastore" with "re

[jira] [Commented] (SPARK-11759) Spark task on mesos with docker fails with sh: 1: /opt/spark/bin/spark-class: not found

2015-11-17 Thread Balaji Ramamoorthy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010243#comment-15010243 ] Balaji Ramamoorthy commented on SPARK-11759: I do see the same behavior. I h

[jira] [Commented] (SPARK-11726) Legacy Netty-RPC based submission in standalone mode does not work

2015-11-17 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010238#comment-15010238 ] Jacek Lewandowski commented on SPARK-11726: --- btw [~andrewor14] - you messed ass

[jira] [Commented] (SPARK-11803) Dataset self join returns incorrect result

2015-11-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010230#comment-15010230 ] Xiao Li commented on SPARK-11803: - We need to assign a new expression ID the conflicting

[jira] [Commented] (SPARK-11633) HiveContext throws TreeNode Exception : Failed to Copy Node

2015-11-17 Thread Saurabh Santhosh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010228#comment-15010228 ] Saurabh Santhosh commented on SPARK-11633: -- [~smilegator] Tried with your change

[jira] [Created] (SPARK-11805) SpillableIterator should free the in-memory sorter while spilling

2015-11-17 Thread Davies Liu (JIRA)
Davies Liu created SPARK-11805: -- Summary: SpillableIterator should free the in-memory sorter while spilling Key: SPARK-11805 URL: https://issues.apache.org/jira/browse/SPARK-11805 Project: Spark

[jira] [Updated] (SPARK-11081) Make spark-core pull in Jersey and javax.ws.rs dependencies separately for easier overriding

2015-11-17 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-11081: --- Description: As seen from this thread (https://mail-archives.apache.org/mod_mbox/spark-user/201510.m

[jira] [Updated] (SPARK-11081) Make spark-core pull in Jersey and javax.ws.rs dependencies separately for easier overriding

2015-11-17 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-11081: --- Description: As seen from this thread (https://mail-archives.apache.org/mod_mbox/spark-user/201510.m

[jira] [Updated] (SPARK-11081) Make spark-core pull in Jersey and javax.ws.rs dependencies separately for easier overriding

2015-11-17 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-11081: --- Description: As seen from this thread (https://mail-archives.apache.org/mod_mbox/spark-user/201510.m

[jira] [Updated] (SPARK-11081) Make spark-core pull in Jersey and javax.ws.rs dependencies separately for easier overriding

2015-11-17 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-11081: --- Description: As seen from this thread (https://mail-archives.apache.org/mod_mbox/spark-user/201510.m

[jira] [Updated] (SPARK-11081) Make spark-core pull in Jersey and javax.ws.rs dependencies separately for easier overriding

2015-11-17 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-11081: --- Description: As seen from this thread (https://mail-archives.apache.org/mod_mbox/spark-user/201510.m

[jira] [Updated] (SPARK-11081) Make spark-core pull in Jersey and javax.ws.rs dependencies separately for easier overriding

2015-11-17 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-11081: --- Description: As seen from this thread (https://mail-archives.apache.org/mod_mbox/spark-user/201510.m

[jira] [Updated] (SPARK-11081) Make spark-core pull in Jersey and javax.ws.rs dependencies separately for easier overriding

2015-11-17 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-11081: --- Summary: Make spark-core pull in Jersey and javax.ws.rs dependencies separately for easier overriding

[jira] [Comment Edited] (SPARK-11803) Dataset self join returns incorrect result

2015-11-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010181#comment-15010181 ] Xiao Li edited comment on SPARK-11803 at 11/18/15 4:14 AM: --- The

[jira] [Commented] (SPARK-11803) Dataset self join returns incorrect result

2015-11-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010181#comment-15010181 ] Xiao Li commented on SPARK-11803: - The optimized plan is wrong. Project [value#1 AS _1#

[jira] [Assigned] (SPARK-11804) Exception raise when using Jdbc predicates option in PySpark

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11804: Assignee: (was: Apache Spark) > Exception raise when using Jdbc predicates option in P

[jira] [Commented] (SPARK-11803) Dataset self join returns incorrect result

2015-11-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010177#comment-15010177 ] Xiao Li commented on SPARK-11803: - Not sure if this has been assigned. I can try it tonig

[jira] [Assigned] (SPARK-11804) Exception raise when using Jdbc predicates option in PySpark

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11804: Assignee: Apache Spark > Exception raise when using Jdbc predicates option in PySpark > --

[jira] [Commented] (SPARK-11804) Exception raise when using Jdbc predicates option in PySpark

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010178#comment-15010178 ] Apache Spark commented on SPARK-11804: -- User 'zjffdu' has created a pull request for

[jira] [Updated] (SPARK-11804) Exception raise when using Jdbc predicates option in PySpark

2015-11-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11804: --- Priority: Major (was: Minor) > Exception raise when using Jdbc predicates option in PySpark > --

[jira] [Assigned] (SPARK-11791) Flaky test: org.apache.spark.streaming.util.BatchedWriteAheadLogSuite.BatchedWriteAheadLog

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11791: Assignee: (was: Apache Spark) > Flaky test: > org.apache.spark.streaming.util.Batched

[jira] [Commented] (SPARK-11791) Flaky test: org.apache.spark.streaming.util.BatchedWriteAheadLogSuite.BatchedWriteAheadLog

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010175#comment-15010175 ] Apache Spark commented on SPARK-11791: -- User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-11791) Flaky test: org.apache.spark.streaming.util.BatchedWriteAheadLogSuite.BatchedWriteAheadLog

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11791: Assignee: Apache Spark > Flaky test: > org.apache.spark.streaming.util.BatchedWriteAheadL

[jira] [Updated] (SPARK-11737) String may not be serialized correctly with Kyro

2015-11-17 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11737: --- Fix Version/s: (was: 1.5.2) 1.5.3 > String may not be serialized correctly wit

[jira] [Resolved] (SPARK-11737) String may not be serialized correctly with Kyro

2015-11-17 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11737. Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull reque

[jira] [Comment Edited] (SPARK-11770) Spark SQL field resolution error in GROUP BY HAVING clause

2015-11-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010157#comment-15010157 ] Xiao Li edited comment on SPARK-11770 at 11/18/15 3:48 AM: --- Hi,

[jira] [Comment Edited] (SPARK-11770) Spark SQL field resolution error in GROUP BY HAVING clause

2015-11-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010157#comment-15010157 ] Xiao Li edited comment on SPARK-11770 at 11/18/15 3:48 AM: --- Hi,

[jira] [Comment Edited] (SPARK-11770) Spark SQL field resolution error in GROUP BY HAVING clause

2015-11-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010157#comment-15010157 ] Xiao Li edited comment on SPARK-11770 at 11/18/15 3:49 AM: --- Hi,

[jira] [Comment Edited] (SPARK-11770) Spark SQL field resolution error in GROUP BY HAVING clause

2015-11-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010157#comment-15010157 ] Xiao Li edited comment on SPARK-11770 at 11/18/15 3:47 AM: --- Hi,

[jira] [Comment Edited] (SPARK-11770) Spark SQL field resolution error in GROUP BY HAVING clause

2015-11-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010157#comment-15010157 ] Xiao Li edited comment on SPARK-11770 at 11/18/15 3:47 AM: --- Hi,

[jira] [Commented] (SPARK-11770) Spark SQL field resolution error in GROUP BY HAVING clause

2015-11-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010157#comment-15010157 ] Xiao Li commented on SPARK-11770: - Hi, [~simeons] I am unable to reproduce your issue. C

[jira] [Resolved] (SPARK-11583) Make MapStatus use less memory uage

2015-11-17 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11583. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9746 [https://github.c

[jira] [Resolved] (SPARK-11016) Spark fails when running with a task that requires a more recent version of RoaringBitmaps

2015-11-17 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11016. Resolution: Fixed Issue resolved by pull request 9748 [https://github.com/apache/spark/pull/9748]

[jira] [Commented] (SPARK-11804) Exception raise when using Jdbc predicates option in PySpark

2015-11-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010140#comment-15010140 ] Jeff Zhang commented on SPARK-11804: It is a bug in PySpark, working on it. > Excep

[jira] [Updated] (SPARK-11804) Exception raise when using Jdbc predicates option in PySpark

2015-11-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11804: --- Priority: Minor (was: Major) > Exception raise when using Jdbc predicates option in PySpark > --

[jira] [Created] (SPARK-11804) Exception raise when using Jdbc predicates option in PySpark

2015-11-17 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-11804: -- Summary: Exception raise when using Jdbc predicates option in PySpark Key: SPARK-11804 URL: https://issues.apache.org/jira/browse/SPARK-11804 Project: Spark Iss

[jira] [Commented] (SPARK-6727) Model export/import for spark.ml: HashingTF

2015-11-17 Thread Earthson Lu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010111#comment-15010111 ] Earthson Lu commented on SPARK-6727: It’s fine:)  I can give some help when the API i

[jira] [Resolved] (SPARK-11793) Dataset should set the resolved encoders internally for maps

2015-11-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11793. - Resolution: Fixed Fix Version/s: 1.6.0 > Dataset should set the resolved encoders internal

[jira] [Commented] (SPARK-11793) Dataset should set the resolved encoders internally for maps

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010109#comment-15010109 ] Apache Spark commented on SPARK-11793: -- User 'rxin' has created a pull request for t

[jira] [Updated] (SPARK-11339) Fix and document the list of functions in R base package that are masked by functions with same name in SparkR

2015-11-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-11339: - Summary: Fix and document the list of functions in R base package that are masked by functions wi

[jira] [Created] (SPARK-11803) Dataset self join returns incorrect result

2015-11-17 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11803: --- Summary: Dataset self join returns incorrect result Key: SPARK-11803 URL: https://issues.apache.org/jira/browse/SPARK-11803 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-11802) Kryo-based encoder for opaque types

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11802: Assignee: Reynold Xin (was: Apache Spark) > Kryo-based encoder for opaque types > ---

[jira] [Assigned] (SPARK-11802) Kryo-based encoder for opaque types

2015-11-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11802: Assignee: Apache Spark (was: Reynold Xin) > Kryo-based encoder for opaque types > ---

  1   2   3   4   >