[jira] [Assigned] (SPARK-21278) Upgrade to Py4J 0.10.5

[ https://issues.apache.org/jira/browse/SPARK-21278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21278: Assignee: Apache Spark > Upgrade to Py4J 0.10.5 > -- > >

[jira] [Commented] (SPARK-21278) Upgrade to Py4J 0.10.5

[ https://issues.apache.org/jira/browse/SPARK-21278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071493#comment-16071493 ] Apache Spark commented on SPARK-21278: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-21278) Upgrade to Py4J 0.10.5

[ https://issues.apache.org/jira/browse/SPARK-21278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21278: Assignee: (was: Apache Spark) > Upgrade to Py4J 0.10.5 > -- > >

[jira] [Created] (SPARK-21278) Upgrade to Py4J 0.10.5

Dongjoon Hyun created SPARK-21278: - Summary: Upgrade to Py4J 0.10.5 Key: SPARK-21278 URL: https://issues.apache.org/jira/browse/SPARK-21278 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-20256) Fail to start SparkContext/SparkSession with Hive support enabled when user does not have read/write privilege to Hive metastore warehouse dir

[ https://issues.apache.org/jira/browse/SPARK-20256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20256: Assignee: Apache Spark > Fail to start SparkContext/SparkSession with Hive support

[jira] [Commented] (SPARK-20256) Fail to start SparkContext/SparkSession with Hive support enabled when user does not have read/write privilege to Hive metastore warehouse dir

[ https://issues.apache.org/jira/browse/SPARK-20256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071459#comment-16071459 ] Apache Spark commented on SPARK-20256: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-20256) Fail to start SparkContext/SparkSession with Hive support enabled when user does not have read/write privilege to Hive metastore warehouse dir

[ https://issues.apache.org/jira/browse/SPARK-20256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20256: Assignee: (was: Apache Spark) > Fail to start SparkContext/SparkSession with Hive

[jira] [Commented] (SPARK-21244) KMeans applied to processed text day clumps almost all documents into one cluster

[ https://issues.apache.org/jira/browse/SPARK-21244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071447#comment-16071447 ] Nassir commented on SPARK-21244: Hi, The pyspark k-means implementation is on the same 20 newsgroup

[jira] [Commented] (SPARK-20256) Fail to start SparkContext/SparkSession with Hive support enabled when user does not have read/write privilege to Hive metastore warehouse dir

[ https://issues.apache.org/jira/browse/SPARK-20256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071414#comment-16071414 ] Dongjoon Hyun commented on SPARK-20256: --- Hi, [~xwu0226]. Are you still preparing a unit test case?

[jira] [Updated] (SPARK-21267) Improvements to the Structured Streaming programming guide

[ https://issues.apache.org/jira/browse/SPARK-21267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-21267: - Target Version/s: (was: 2.2.0) > Improvements to the Structured Streaming programming

[jira] [Commented] (SPARK-15526) Shade JPMML

[ https://issues.apache.org/jira/browse/SPARK-15526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071392#comment-16071392 ] Villu Ruusmann commented on SPARK-15526: This issue is responsible for >95% of support requests

[jira] [Commented] (SPARK-15533) Deprecate Dataset.explode

[ https://issues.apache.org/jira/browse/SPARK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071325#comment-16071325 ] Reynold Xin commented on SPARK-15533: - Just use a star. On Sat, Jul 1, 2017 at 9:33 AM Sagara

[jira] [Created] (SPARK-21277) Spark is invoking an incorrect serializer after UDAF completion

Erik Erlandson created SPARK-21277: -- Summary: Spark is invoking an incorrect serializer after UDAF completion Key: SPARK-21277 URL: https://issues.apache.org/jira/browse/SPARK-21277 Project: Spark

[jira] [Commented] (SPARK-15533) Deprecate Dataset.explode

[ https://issues.apache.org/jira/browse/SPARK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071297#comment-16071297 ] Sagara Paranagama commented on SPARK-15533: --- But what if my dataframe contained over 50

[jira] [Resolved] (SPARK-21170) Utils.tryWithSafeFinallyAndFailureCallbacks throws IllegalArgumentException: Self-suppression not permitted

[ https://issues.apache.org/jira/browse/SPARK-21170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21170. --- Resolution: Fixed Assignee: Devaraj K Fix Version/s: 2.3.0 2.2.1

[jira] [Commented] (SPARK-21186) PySpark with --packages fails to import library due to lack of pythonpath to .ivy2/jars/*.jar

[ https://issues.apache.org/jira/browse/SPARK-21186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071254#comment-16071254 ] Jeff Zhang commented on SPARK-21186: I think this is due to how spark-deep-learning distribute its

[jira] [Commented] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071229#comment-16071229 ] Fei Shao commented on SPARK-21206: -- The window size is correct. The oldRDDs and newRDDs is incorrect. >

[jira] [Commented] (SPARK-21176) Master UI hangs with spark.ui.reverseProxy=true if the master node has many CPUs

[ https://issues.apache.org/jira/browse/SPARK-21176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071176#comment-16071176 ] Apache Spark commented on SPARK-21176: -- User 'aosagie' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071110#comment-16071110 ] Fei Shao edited comment on SPARK-21206 at 7/1/17 9:33 AM: -- [~srowen] This issue

[jira] [Resolved] (SPARK-21244) KMeans applied to processed text day clumps almost all documents into one cluster

[ https://issues.apache.org/jira/browse/SPARK-21244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21244. --- Resolution: Not A Problem > KMeans applied to processed text day clumps almost all documents into

[jira] [Resolved] (SPARK-21233) Support pluggable offset storage

[ https://issues.apache.org/jira/browse/SPARK-21233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21233. --- Resolution: Not A Problem > Support pluggable offset storage > > >

[jira] [Commented] (SPARK-21266) Support schema a DDL-formatted string in dapply/gapply/from_json

[ https://issues.apache.org/jira/browse/SPARK-21266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071117#comment-16071117 ] Apache Spark commented on SPARK-21266: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-21266) Support schema a DDL-formatted string in dapply/gapply/from_json

[ https://issues.apache.org/jira/browse/SPARK-21266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21266: Assignee: (was: Apache Spark) > Support schema a DDL-formatted string in

[jira] [Assigned] (SPARK-21266) Support schema a DDL-formatted string in dapply/gapply/from_json

[ https://issues.apache.org/jira/browse/SPARK-21266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21266: Assignee: Apache Spark > Support schema a DDL-formatted string in dapply/gapply/from_json

[jira] [Assigned] (SPARK-21078) JobHistory applications synchronized is invalid

[ https://issues.apache.org/jira/browse/SPARK-21078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21078: Assignee: (was: Apache Spark) > JobHistory applications synchronized is invalid >

[jira] [Commented] (SPARK-21078) JobHistory applications synchronized is invalid

[ https://issues.apache.org/jira/browse/SPARK-21078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071115#comment-16071115 ] Apache Spark commented on SPARK-21078: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21078) JobHistory applications synchronized is invalid

[ https://issues.apache.org/jira/browse/SPARK-21078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21078: Assignee: Apache Spark > JobHistory applications synchronized is invalid >

[jira] [Commented] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071110#comment-16071110 ] Fei Shao commented on SPARK-21206: -- [~srowen] Here is the case I want to express: !screenshot-2.png!

[jira] [Updated] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Shao updated SPARK-21206: - Attachment: screenshot-2.png > the window slice of Dstream is wrong >

[jira] [Updated] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Shao updated SPARK-21206: - Attachment: screenshot-1.png > the window slice of Dstream is wrong >

[jira] [Commented] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071105#comment-16071105 ] Sean Owen commented on SPARK-21206: --- I'm still not clear what you're saying, even after formatting the

[jira] [Comment Edited] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16062284#comment-16062284 ] Sean Owen edited comment on SPARK-21206 at 7/1/17 8:40 AM: --- [~srowen] I am

[jira] [Comment Edited] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16062284#comment-16062284 ] Fei Shao edited comment on SPARK-21206 at 7/1/17 8:38 AM: -- [~srowen] I am

[jira] [Comment Edited] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16062284#comment-16062284 ] Fei Shao edited comment on SPARK-21206 at 7/1/17 8:30 AM: -- [~srowen] I am

[jira] [Commented] (SPARK-4131) Support "Writing data into the filesystem from queries"

[ https://issues.apache.org/jira/browse/SPARK-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071073#comment-16071073 ] Santhavathi S commented on SPARK-4131: -- The requirement is to have this available in SQL. > Support

[jira] [Commented] (SPARK-20602) Adding LBFGS optimizer and Squared_hinge loss for LinearSVC

[ https://issues.apache.org/jira/browse/SPARK-20602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071065#comment-16071065 ] Yanbo Liang commented on SPARK-20602: - I'd like to shepherd this task and target this for 2.3.

[jira] [Updated] (SPARK-20602) Adding LBFGS optimizer and Squared_hinge loss for LinearSVC

[ https://issues.apache.org/jira/browse/SPARK-20602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-20602: Shepherd: Yanbo Liang Target Version/s: 2.3.0 > Adding LBFGS optimizer and

[jira] [Assigned] (SPARK-20602) Adding LBFGS optimizer and Squared_hinge loss for LinearSVC

[ https://issues.apache.org/jira/browse/SPARK-20602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang reassigned SPARK-20602: --- Assignee: yuhao yang > Adding LBFGS optimizer and Squared_hinge loss for LinearSVC >

[jira] [Resolved] (SPARK-21275) Update GLM test to use supportedFamilyNames

[ https://issues.apache.org/jira/browse/SPARK-21275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-21275. - Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.3.0 > Update GLM test