[jira] [Updated] (SPARK-21363) Prevent column name duplication in temporary view

2017-08-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21363: Target Version/s: 3.0.0 > Prevent column name duplication in temporary view > -

[jira] [Commented] (SPARK-21363) Prevent column name duplication in temporary view

2017-08-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126869#comment-16126869 ] Xiao Li commented on SPARK-21363: - We need to revisit whether we should support duplicate

[jira] [Commented] (SPARK-21732) Lazily init hive metastore client

2017-08-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126866#comment-16126866 ] Xiao Li commented on SPARK-21732: - https://github.com/apache/spark/pull/18944 > Lazily i

[jira] [Resolved] (SPARK-21732) Lazily init hive metastore client

2017-08-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21732. - Resolution: Fixed Fix Version/s: 2.3.0 > Lazily init hive metastore client > -

[jira] [Commented] (SPARK-21724) Missing since information in the documentation of date functions

2017-08-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126864#comment-16126864 ] Xiao Li commented on SPARK-21724: - https://github.com/apache/spark/pull/18939 > Missing

[jira] [Resolved] (SPARK-21724) Missing since information in the documentation of date functions

2017-08-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21724. - Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.3.0 > Missing since information

[jira] [Commented] (SPARK-21363) Prevent column name duplication in temporary view

2017-08-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126849#comment-16126849 ] Takeshi Yamamuro commented on SPARK-21363: -- We couldn't fix this in 2.x releases

[jira] [Commented] (SPARK-21363) Prevent column name duplication in temporary view

2017-08-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126847#comment-16126847 ] Takeshi Yamamuro commented on SPARK-21363: -- This pr is: https://github.com/apach

[jira] [Commented] (SPARK-12664) Expose raw prediction scores in MultilayerPerceptronClassificationModel

2017-08-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126743#comment-16126743 ] Yanbo Liang commented on SPARK-12664: - [~josephkb] Please go ahead. Thanks for taking

[jira] [Updated] (SPARK-21733) ERROR executor.CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM

2017-08-14 Thread Jepson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jepson updated SPARK-21733: --- Description: Kafka+Spark streaming ,throw these error: {code:java} 17/08/15 09:34:14 INFO memory.MemoryStore

[jira] [Commented] (SPARK-4131) Support "Writing data into the filesystem from queries"

2017-08-14 Thread xinzhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126723#comment-16126723 ] xinzhang commented on SPARK-4131: - any progress here? > Support "Writing data into the fi

[jira] [Updated] (SPARK-21733) ERROR executor.CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM

2017-08-14 Thread Jepson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jepson updated SPARK-21733: --- Description: Kafka+Spark streaming ,throw these error: {code:java} 17/08/15 09:34:14 INFO memory.MemoryStore

[jira] [Created] (SPARK-21733) ERROR executor.CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM

2017-08-14 Thread Jepson (JIRA)
Jepson created SPARK-21733: -- Summary: ERROR executor.CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM Key: SPARK-21733 URL: https://issues.apache.org/jira/browse/SPARK-21733 Project: Spark Issue

[jira] [Comment Edited] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

2017-08-14 Thread xinzhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16108303#comment-16108303 ] xinzhang edited comment on SPARK-21067 at 8/15/17 1:09 AM: --- hi

[jira] [Comment Edited] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

2017-08-14 Thread xinzhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16108303#comment-16108303 ] xinzhang edited comment on SPARK-21067 at 8/15/17 1:07 AM: --- hi

[jira] [Comment Edited] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

2017-08-14 Thread xinzhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16119310#comment-16119310 ] xinzhang edited comment on SPARK-21067 at 8/15/17 1:04 AM: --- hi

[jira] [Updated] (SPARK-21732) Lazily init hive metastore client

2017-08-14 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-21732: - Description: Right now when the hive metastore server is down, we cannot create SparkSession. It

[jira] [Created] (SPARK-21732) Lazily init hive metastore client

2017-08-14 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-21732: Summary: Lazily init hive metastore client Key: SPARK-21732 URL: https://issues.apache.org/jira/browse/SPARK-21732 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-21617) ALTER TABLE...ADD COLUMNS broken in Hive 2.1 for DS tables

2017-08-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126657#comment-16126657 ] Marcelo Vanzin commented on SPARK-21617: https://github.com/apache/spark/pull/188

[jira] [Commented] (SPARK-19372) Code generation for Filter predicate including many OR conditions exceeds JVM method size limit

2017-08-14 Thread poplav (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126618#comment-16126618 ] poplav commented on SPARK-19372: I opened a PR for backporting this at https://github.co

[jira] [Created] (SPARK-21731) Upgrade scalastyle to 0.9

2017-08-14 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-21731: -- Summary: Upgrade scalastyle to 0.9 Key: SPARK-21731 URL: https://issues.apache.org/jira/browse/SPARK-21731 Project: Spark Issue Type: Task Comp

[jira] [Updated] (SPARK-18278) SPIP: Support native submission of spark jobs to a kubernetes cluster

2017-08-14 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-18278: --- Attachment: (was: SPARK-18278 - Spark on Kubernetes Design Proposal.pdf) > SPIP: Support native s

[jira] [Commented] (SPARK-12664) Expose raw prediction scores in MultilayerPerceptronClassificationModel

2017-08-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126583#comment-16126583 ] Joseph K. Bradley commented on SPARK-12664: --- [~yanboliang] I can take over shep

[jira] [Updated] (SPARK-12664) Expose raw prediction scores in MultilayerPerceptronClassificationModel

2017-08-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12664: -- Shepherd: Joseph K. Bradley (was: Yanbo Liang) > Expose raw prediction scores in Multi

[jira] [Commented] (SPARK-21718) Heavy log of type: "Skipping partition based on stats ..."

2017-08-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126575#comment-16126575 ] Xiao Li commented on SPARK-21718: - [~meox] Please submit a PR to fix this. https://githu

[jira] [Updated] (SPARK-21721) Memory leak in org.apache.spark.sql.hive.execution.InsertIntoHiveTable

2017-08-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21721: Affects Version/s: 2.0.2 2.2.0 > Memory leak in org.apache.spark.sql.hive.execution.

[jira] [Updated] (SPARK-21721) Memory leak in org.apache.spark.sql.hive.execution.InsertIntoHiveTable

2017-08-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21721: Priority: Critical (was: Major) > Memory leak in org.apache.spark.sql.hive.execution.InsertIntoHiveTable >

[jira] [Created] (SPARK-21730) Consider officially dropping PyPy pre-2.5 support

2017-08-14 Thread holdenk (JIRA)
holdenk created SPARK-21730: --- Summary: Consider officially dropping PyPy pre-2.5 support Key: SPARK-21730 URL: https://issues.apache.org/jira/browse/SPARK-21730 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-21730) Consider officially dropping PyPy pre-2.5 support

2017-08-14 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-21730: Issue Type: Improvement (was: Bug) > Consider officially dropping PyPy pre-2.5 support > -

[jira] [Created] (SPARK-21729) Generic test for ProbabilisticClassifier to ensure consistent output columns

2017-08-14 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-21729: - Summary: Generic test for ProbabilisticClassifier to ensure consistent output columns Key: SPARK-21729 URL: https://issues.apache.org/jira/browse/SPARK-21729

[jira] [Resolved] (SPARK-21696) State Store can't handle corrupted snapshots

2017-08-14 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-21696. --- Resolution: Fixed Fix Version/s: 3.0.0 2.2.1 Issue resolved by pull

[jira] [Created] (SPARK-21728) Allow SparkSubmit to use logging

2017-08-14 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-21728: -- Summary: Allow SparkSubmit to use logging Key: SPARK-21728 URL: https://issues.apache.org/jira/browse/SPARK-21728 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-18838) High latency of event processing for large jobs

2017-08-14 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126402#comment-16126402 ] Miles Crawford commented on SPARK-18838: [~imranr] We do runs tens of thousands o

[jira] [Commented] (SPARK-21715) History Server should not respond history page html content multiple times for only one http request

2017-08-14 Thread Ye Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126398#comment-16126398 ] Ye Zhou commented on SPARK-21715: - Pull Request: https://github.com/apache/spark/pull/189

[jira] [Resolved] (SPARK-6680) Be able to specifie IP for spark-shell(spark driver) blocker for Docker integration

2017-08-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-6680. --- Resolution: Duplicate > Be able to specifie IP for spark-shell(spark driver) blocker for Docke

[jira] [Resolved] (SPARK-21668) Ability to run driver programs within a container

2017-08-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-21668. Resolution: Duplicate > Ability to run driver programs within a container > ---

[jira] [Updated] (SPARK-21715) History Server should not respond history page html content multiple times for only one http request

2017-08-14 Thread Ye Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ye Zhou updated SPARK-21715: Summary: History Server should not respond history page html content multiple times for only one http reque

[jira] [Updated] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2017-08-14 Thread Neil McQuarrie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neil McQuarrie updated SPARK-21727: --- Description: Previously [posted|https://stackoverflow.com/questions/45056973/sparkr-datafram

[jira] [Updated] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2017-08-14 Thread Neil McQuarrie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neil McQuarrie updated SPARK-21727: --- Description: Previously [posted|https://stackoverflow.com/questions/45056973/sparkr-datafram

[jira] [Updated] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2017-08-14 Thread Neil McQuarrie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neil McQuarrie updated SPARK-21727: --- Description: Previously [posted|https://stackoverflow.com/questions/45056973/sparkr-datafram

[jira] [Updated] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2017-08-14 Thread Neil McQuarrie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neil McQuarrie updated SPARK-21727: --- Description: Previously [posted|https://stackoverflow.com/questions/45056973/sparkr-datafram

[jira] [Updated] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2017-08-14 Thread Neil McQuarrie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neil McQuarrie updated SPARK-21727: --- Description: Previously [posted|https://stackoverflow.com/questions/45056973/sparkr-datafram

[jira] [Updated] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2017-08-14 Thread Neil McQuarrie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neil McQuarrie updated SPARK-21727: --- Description: Previously [posted|https://stackoverflow.com/questions/45056973/sparkr-datafram

[jira] [Created] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2017-08-14 Thread Neil McQuarrie (JIRA)
Neil McQuarrie created SPARK-21727: -- Summary: Operating on an ArrayType in a SparkR DataFrame throws error Key: SPARK-21727 URL: https://issues.apache.org/jira/browse/SPARK-21727 Project: Spark

[jira] [Comment Edited] (SPARK-18838) High latency of event processing for large jobs

2017-08-14 Thread Jason Dunkelberger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126022#comment-16126022 ] Jason Dunkelberger edited comment on SPARK-18838 at 8/14/17 6:55 PM: --

[jira] [Commented] (SPARK-19372) Code generation for Filter predicate including many OR conditions exceeds JVM method size limit

2017-08-14 Thread poplav (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126182#comment-16126182 ] poplav commented on SPARK-19372: Hi, [~kiszk] I met this failure also. Is it possible to

[jira] [Created] (SPARK-21726) Check for structural integrity of the plan in QO in test mode

2017-08-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-21726: --- Summary: Check for structural integrity of the plan in QO in test mode Key: SPARK-21726 URL: https://issues.apache.org/jira/browse/SPARK-21726 Project: Spark

[jira] [Commented] (SPARK-21726) Check for structural integrity of the plan in QO in test mode

2017-08-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126115#comment-16126115 ] Reynold Xin commented on SPARK-21726: - cc [~viirya] would you be interested in doing

[jira] [Commented] (SPARK-18838) High latency of event processing for large jobs

2017-08-14 Thread Jason Dunkelberger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126030#comment-16126030 ] Jason Dunkelberger commented on SPARK-18838: I just realized I have diverged

[jira] [Commented] (SPARK-14927) DataFrame. saveAsTable creates RDD partitions but not Hive partitions

2017-08-14 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126026#comment-16126026 ] Chaoyu Tang commented on SPARK-14927: - I was not able to reproduce the issue as repor

[jira] [Commented] (SPARK-18838) High latency of event processing for large jobs

2017-08-14 Thread Jason Dunkelberger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126022#comment-16126022 ] Jason Dunkelberger commented on SPARK-18838: It's been about a week now, and

[jira] [Resolved] (SPARK-19471) [SQL]A confusing NullPointerException when creating table

2017-08-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-19471. - Resolution: Fixed Fix Version/s: 2.3.0 > [SQL]A confusing NullPointerException when creating table

[jira] [Assigned] (SPARK-19471) [SQL]A confusing NullPointerException when creating table

2017-08-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-19471: --- Assignee: Feng Zhu > [SQL]A confusing NullPointerException when creating table > ---

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-08-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16125922#comment-16125922 ] Marcelo Vanzin commented on SPARK-18085: If your only problem is how fast to load

[jira] [Commented] (SPARK-21658) Adds the default None for value in na.replace in PySpark to match

2017-08-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16125906#comment-16125906 ] Hyukjin Kwon commented on SPARK-21658: -- I can't assign this JIRA to this account ^,

[jira] [Assigned] (SPARK-21658) Adds the default None for value in na.replace in PySpark to match

2017-08-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-21658: Assignee: Hyukjin Kwon > Adds the default None for value in na.replace in PySpark to match

[jira] [Assigned] (SPARK-21658) Adds the default None for value in na.replace in PySpark to match

2017-08-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-21658: Assignee: (was: Hyukjin Kwon) > Adds the default None for value in na.replace in PySpa

[jira] [Commented] (SPARK-21658) Adds the default None for value in na.replace in PySpark to match

2017-08-14 Thread Chin Han Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16125898#comment-16125898 ] Chin Han Yu commented on SPARK-21658: - [~hyukjin.kwon] Hi, here is my JIRA account.

[jira] [Resolved] (SPARK-21658) Adds the default None for value in na.replace in PySpark to match

2017-08-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21658. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18895 [https://git

[jira] [Resolved] (SPARK-21563) Race condition when serializing TaskDescriptions and adding jars

2017-08-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21563. - Resolution: Fixed Assignee: Andrew Ash Fix Version/s: 2.3.0 2.2

[jira] [Commented] (SPARK-12837) Spark driver requires large memory space for serialized results even there are no data collected to the driver

2017-08-14 Thread Todd Leo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16125726#comment-16125726 ] Todd Leo commented on SPARK-12837: -- [~cloud_fan] Is there a ticket tracking "driver-free

[jira] [Issue Comment Deleted] (SPARK-21034) Allow filter pushdown filters through non deterministic functions for columns involved in groupby / join

2017-08-14 Thread Abhijit Bhole (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhijit Bhole updated SPARK-21034: -- Comment: was deleted (was: In FilterPushdownSuite.scala, it seems this should have been handled

[jira] [Commented] (SPARK-21034) Allow filter pushdown filters through non deterministic functions for columns involved in groupby / join

2017-08-14 Thread Abhijit Bhole (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16125619#comment-16125619 ] Abhijit Bhole commented on SPARK-21034: --- In FilterPushdownSuite.scala, it seems thi

[jira] [Updated] (SPARK-21725) spark thriftserver insert overwrite table partition select

2017-08-14 Thread xinzhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xinzhang updated SPARK-21725: - Description: use thriftserver create table with partitions. session 1: SET hive.default.fileformat=Parq

[jira] [Updated] (SPARK-21725) spark thriftserver insert overwrite table partition select

2017-08-14 Thread xinzhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xinzhang updated SPARK-21725: - Description: use thriftserver create table with partitions. session 1: SET hive.default.fileformat=Parq

[jira] [Created] (SPARK-21725) spark thriftserver insert overwrite table partition select

2017-08-14 Thread xinzhang (JIRA)
xinzhang created SPARK-21725: Summary: spark thriftserver insert overwrite table partition select Key: SPARK-21725 URL: https://issues.apache.org/jira/browse/SPARK-21725 Project: Spark Issue Ty

[jira] [Commented] (SPARK-21724) Missing since information in the documentation of date functions

2017-08-14 Thread panbingkun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16125520#comment-16125520 ] panbingkun commented on SPARK-21724: In DescribeFunctionCommand info.getSince > Miss

[jira] [Created] (SPARK-21724) Missing since information in the documentation of date functions

2017-08-14 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-21724: Summary: Missing since information in the documentation of date functions Key: SPARK-21724 URL: https://issues.apache.org/jira/browse/SPARK-21724 Project: Spark

[jira] [Created] (SPARK-21723) Can't write LibSVM - key not found: numFeatures

2017-08-14 Thread JIRA
Jan Vršovský created SPARK-21723: Summary: Can't write LibSVM - key not found: numFeatures Key: SPARK-21723 URL: https://issues.apache.org/jira/browse/SPARK-21723 Project: Spark Issue Type: B

[jira] [Commented] (SPARK-21688) performance improvement in mllib SVM with native BLAS

2017-08-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16125407#comment-16125407 ] Sean Owen commented on SPARK-21688: --- Solving part of the problem is better than none at

[jira] [Commented] (SPARK-21688) performance improvement in mllib SVM with native BLAS

2017-08-14 Thread Vincent (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16125353#comment-16125353 ] Vincent commented on SPARK-21688: - sorry for late reply. Yes, It's simple and easy to ch

[jira] [Commented] (SPARK-9104) expose network layer memory usage in shuffle part

2017-08-14 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16125331#comment-16125331 ] Saisai Shao commented on SPARK-9104: I think it is quite useful to get the memory deta