[jira] [Created] (SPARK-16090) Improve method grouping in SparkR generated docs

2016-06-20 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16090: - Summary: Improve method grouping in SparkR generated docs Key: SPARK-16090 URL: https://issues.apache.org/jira/browse/SPARK-16090 Project: Spark Issue Type

[jira] [Commented] (SPARK-15177) SparkR 2.0 QA: New R APIs and API docs for mllib.R

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341245#comment-15341245 ] Apache Spark commented on SPARK-15177: -- User 'mengxr' has created a pull request for

[jira] [Commented] (SPARK-15917) Define the number of executors in standalone mode with an easy-to-use property

2016-06-20 Thread Jonathan Taws (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341244#comment-15341244 ] Jonathan Taws commented on SPARK-15917: --- Any thoughts on that ? CC [~srowen] & [~va

[jira] [Updated] (SPARK-16089) Spark2.0 doesn't support the certain static partition SQL statment as "insert overwrite table targetTB PARTITION (partition field=xx) select field1,field2,...,partition

2016-06-20 Thread marymwu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] marymwu updated SPARK-16089: Attachment: StaticPartitionSQLStatementError.png > Spark2.0 doesn't support the certain static partition SQ

[jira] [Created] (SPARK-16089) Spark2.0 doesn't support the certain static partition SQL statment as "insert overwrite table targetTB PARTITION (partition field=xx) select field1,field2,...,partition

2016-06-20 Thread marymwu (JIRA)
marymwu created SPARK-16089: --- Summary: Spark2.0 doesn't support the certain static partition SQL statment as "insert overwrite table targetTB PARTITION (partition field=xx) select field1,field2,...,partition field from sourceTB where partition field=x

[jira] [Assigned] (SPARK-16082) Refactor dapply's/dapplyCollect's documentation - remove duplicated comments

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16082: Assignee: Apache Spark > Refactor dapply's/dapplyCollect's documentation - remove duplicat

[jira] [Assigned] (SPARK-16082) Refactor dapply's/dapplyCollect's documentation - remove duplicated comments

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16082: Assignee: (was: Apache Spark) > Refactor dapply's/dapplyCollect's documentation - remo

[jira] [Commented] (SPARK-16082) Refactor dapply's/dapplyCollect's documentation - remove duplicated comments

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341233#comment-15341233 ] Apache Spark commented on SPARK-16082: -- User 'NarineK' has created a pull request fo

[jira] [Commented] (SPARK-15987) PostgreSQL CITEXT type JDBC support

2016-06-20 Thread Nipun Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341216#comment-15341216 ] Nipun Agarwal commented on SPARK-15987: --- What is the work around for this? How can

[jira] [Commented] (SPARK-16087) Spark Hangs When Using Union With Persisted Hadoop RDD

2016-06-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341209#comment-15341209 ] Sean Owen commented on SPARK-16087: --- I can't reproduce this on Spark 1.6.1. It runs and

[jira] [Resolved] (SPARK-15894) Add doc to control #partition for input files

2016-06-20 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-15894. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13797 [https://github.

[jira] [Commented] (SPARK-10186) Add support for more postgres column types

2016-06-20 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341193#comment-15341193 ] Takeshi Yamamuro commented on SPARK-10186: -- See SPARK-15987 > Add support for m

[jira] [Commented] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

2016-06-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341182#comment-15341182 ] Sean Owen commented on SPARK-16083: --- The heap dump seems to show a 55MB heap only. I am

[jira] [Commented] (SPARK-16084) Minor javadoc issue with "Describe" table in the parser

2016-06-20 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341177#comment-15341177 ] Bo Meng commented on SPARK-16084: - Got it ! > Minor javadoc issue with "Describe" table

[jira] [Commented] (SPARK-10186) Add support for more postgres column types

2016-06-20 Thread Nipun Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341181#comment-15341181 ] Nipun Agarwal commented on SPARK-10186: --- I have just a single column of type citext

[jira] [Commented] (SPARK-16084) Minor javadoc issue with "Describe" table in the parser

2016-06-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341171#comment-15341171 ] Sean Owen commented on SPARK-16084: --- Don't email, but just open a PR. > Minor javadoc

[jira] [Commented] (SPARK-16084) Minor javadoc issue with "Describe" table in the parser

2016-06-20 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341167#comment-15341167 ] Bo Meng commented on SPARK-16084: - Ok! I will do next time by sending to the mailing list

[jira] [Closed] (SPARK-16068) ml model import jpmml which includes wrong jaxb-impl version 2.2.7

2016-06-20 Thread weijie.tong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weijie.tong closed SPARK-16068. --- > ml model import jpmml which includes wrong jaxb-impl version 2.2.7 > --

[jira] [Commented] (SPARK-16068) ml model import jpmml which includes wrong jaxb-impl version 2.2.7

2016-06-20 Thread weijie.tong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341153#comment-15341153 ] weijie.tong commented on SPARK-16068: - ok > ml model import jpmml which includes wro

[jira] [Commented] (SPARK-16084) Minor javadoc issue with "Describe" table in the parser

2016-06-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341145#comment-15341145 ] Sean Owen commented on SPARK-16084: --- This is covered in https://cwiki.apache.org/confl

[jira] [Commented] (SPARK-16085) Spark stand-alone ui redirects to RM application master UI for yarn-client mode

2016-06-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341144#comment-15341144 ] Sean Owen commented on SPARK-16085: --- I can't reproduce this. I have Spark 1.6 here and

[jira] [Commented] (SPARK-16088) Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341142#comment-15341142 ] Shivaram Venkataraman commented on SPARK-16088: --- Why don't we convert these

[jira] [Commented] (SPARK-16084) Minor javadoc issue with "Describe" table in the parser

2016-06-20 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341141#comment-15341141 ] Bo Meng commented on SPARK-16084: - [~sowen] Please let me know how to handle it next time

[jira] [Resolved] (SPARK-16068) ml model import jpmml which includes wrong jaxb-impl version 2.2.7

2016-06-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16068. --- Resolution: Not A Problem No, updating JPMML in the 1.6.x line could potentially cause an app to brea

[jira] [Updated] (SPARK-16084) Minor javadoc issue with "Describe" table in the parser

2016-06-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16084: -- Priority: Trivial (was: Minor) Issue Type: Improvement (was: Bug) This doesn't need a JIRA > M

[jira] [Commented] (SPARK-16088) Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341126#comment-15341126 ] Felix Cheung commented on SPARK-16088: -- Not clear what should be the right behavior

[jira] [Commented] (SPARK-13792) Limit logging of bad records

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341123#comment-15341123 ] Apache Spark commented on SPARK-13792: -- User 'rxin' has created a pull request for t

[jira] [Updated] (SPARK-16088) Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-16088: - Description: Since they uses SparkContext? > Deprecate setJobGroup, clearJobGroup, cancelJobGroup

[jira] [Updated] (SPARK-16088) Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-16088: - Summary: Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API (was: Remove setJo

[jira] [Commented] (SPARK-10186) Add support for more postgres column types

2016-06-20 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341121#comment-15341121 ] Takeshi Yamamuro commented on SPARK-10186: -- What's the schema of `xyz`? what's t

[jira] [Commented] (SPARK-15746) SchemaUtils.checkColumnType with VectorUDT prints instance details in error message

2016-06-20 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341110#comment-15341110 ] Miao Wang commented on SPARK-15746: --- Just noticed your reply. I will start work on it.

[jira] [Comment Edited] (SPARK-16032) Audit semantics of various insertion operations related to partitioned tables

2016-06-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15340001#comment-15340001 ] Yin Huai edited comment on SPARK-16032 at 6/21/16 5:11 AM: --- I a

[jira] [Resolved] (SPARK-16025) Document OFF_HEAP storage level in 2.0

2016-06-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16025. - Resolution: Fixed Assignee: Eric Liang Fix Version/s: 2.0.0 > Document OFF_HEAP s

[jira] [Resolved] (SPARK-16044) input_file_name() returns empty strings in data sources based on NewHadoopRDD.

2016-06-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16044. - Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.0.0 > input_file_name()

[jira] [Resolved] (SPARK-16074) Expose VectorUDT/MatrixUDT in a public API

2016-06-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16074. - Resolution: Fixed Fix Version/s: 2.0.0 > Expose VectorUDT/MatrixUDT in a public API >

[jira] [Resolved] (SPARK-16058) JDBC Source: Wrong Results when lowerBound is larger than upperBound in Column Partitioning

2016-06-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16058. - Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 > JDBC Source: Wrong Res

[jira] [Resolved] (SPARK-16056) java.lang.ArithmeticException when numPartitions is zero in JDBC source

2016-06-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16056. - Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 > java.lang.ArithmeticEx

[jira] [Resolved] (SPARK-16057) JDBC source: Wrong Partition Generation when numPartitions is More than the number of rows between upper and lower bounds

2016-06-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16057. - Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 > JDBC source: Wrong Par

[jira] [Resolved] (SPARK-13792) Limit logging of bad records

2016-06-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13792. - Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 2.0.0 > Limit logging of b

[jira] [Commented] (SPARK-10186) Add support for more postgres column types

2016-06-20 Thread Nipun Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341070#comment-15341070 ] Nipun Agarwal commented on SPARK-10186: --- I run spark in pyspark as ./bin/pyspark --

[jira] [Commented] (SPARK-15863) Update SQL programming guide for Spark 2.0

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341065#comment-15341065 ] Apache Spark commented on SPARK-15863: -- User 'felixcheung' has created a pull reques

[jira] [Commented] (SPARK-16088) Remove setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341036#comment-15341036 ] Apache Spark commented on SPARK-16088: -- User 'felixcheung' has created a pull reques

[jira] [Assigned] (SPARK-16088) Remove setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16088: Assignee: (was: Apache Spark) > Remove setJobGroup, clearJobGroup, cancelJobGroup from

[jira] [Assigned] (SPARK-16088) Remove setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16088: Assignee: Apache Spark > Remove setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

[jira] [Created] (SPARK-16088) Remove setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-16088: Summary: Remove setJobGroup, clearJobGroup, cancelJobGroup from SparkR API Key: SPARK-16088 URL: https://issues.apache.org/jira/browse/SPARK-16088 Project: Spark

[jira] [Resolved] (SPARK-15294) Add pivot functionality to SparkR

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15294. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.0.0

[jira] [Reopened] (SPARK-16068) ml model import jpmml which includes wrong jaxb-impl version 2.2.7

2016-06-20 Thread weijie.tong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weijie.tong reopened SPARK-16068: - wish to exclude the jaxb-impl artifact in ML pom.xml > ml model import jpmml which includes wrong

[jira] [Commented] (SPARK-16068) ml model import jpmml which includes wrong jaxb-impl version 2.2.7

2016-06-20 Thread weijie.tong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341023#comment-15341023 ] weijie.tong commented on SPARK-16068: - Now ,I exclude the jaxb-impl artifact in the M

[jira] [Commented] (SPARK-16032) Audit semantics of various insertion operations related to partitioned tables

2016-06-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341021#comment-15341021 ] Yin Huai commented on SPARK-16032: -- [~rdblue] Thank you for your feedback. Those are gre

[jira] [Assigned] (SPARK-15894) Add doc to control #partition for input files

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15894: Assignee: Takeshi Yamamuro (was: Apache Spark) > Add doc to control #partition for input

[jira] [Commented] (SPARK-15894) Add doc to control #partition for input files

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341016#comment-15341016 ] Apache Spark commented on SPARK-15894: -- User 'maropu' has created a pull request for

[jira] [Resolved] (SPARK-16086) Python UDF failed when there is no arguments

2016-06-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-16086. Resolution: Fixed Fix Version/s: 1.6.2 1.5.3 2.0.0 Iss

[jira] [Assigned] (SPARK-15894) Add doc to control #partition for input files

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15894: Assignee: Apache Spark (was: Takeshi Yamamuro) > Add doc to control #partition for input

[jira] [Assigned] (SPARK-7159) Support multiclass logistic regression in spark.ml

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7159: --- Assignee: DB Tsai (was: Apache Spark) > Support multiclass logistic regression in spark.ml >

[jira] [Commented] (SPARK-7159) Support multiclass logistic regression in spark.ml

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15340987#comment-15340987 ] Apache Spark commented on SPARK-7159: - User 'sethah' has created a pull request for th

[jira] [Assigned] (SPARK-7159) Support multiclass logistic regression in spark.ml

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7159: --- Assignee: Apache Spark (was: DB Tsai) > Support multiclass logistic regression in spark.ml >

[jira] [Commented] (SPARK-16032) Audit semantics of various insertion operations related to partitioned tables

2016-06-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15340966#comment-15340966 ] Wenchen Fan commented on SPARK-16032: - > The pre-insert checks currently live in the

[jira] [Updated] (SPARK-15894) Add doc to control #partition for input files

2016-06-20 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-15894: --- Assignee: Takeshi Yamamuro > Add doc to control #partition for input files >

[jira] [Commented] (SPARK-16068) ml model import jpmml which includes wrong jaxb-impl version 2.2.7

2016-06-20 Thread weijie.tong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15340949#comment-15340949 ] weijie.tong commented on SPARK-16068: - hi Sean Owen,at least I think we maybe need to

[jira] [Commented] (SPARK-16032) Audit semantics of various insertion operations related to partitioned tables

2016-06-20 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15340929#comment-15340929 ] Ryan Blue commented on SPARK-16032: --- Overall, I'm *-1* on these changes going into Spar

[jira] [Commented] (SPARK-13792) Limit logging of bad records

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15340885#comment-15340885 ] Apache Spark commented on SPARK-13792: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-11227) Spark1.5+ HDFS HA mode throw java.net.UnknownHostException: nameservice1

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11227: Assignee: (was: Apache Spark) > Spark1.5+ HDFS HA mode throw java.net.UnknownHostExcep

[jira] [Assigned] (SPARK-11227) Spark1.5+ HDFS HA mode throw java.net.UnknownHostException: nameservice1

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11227: Assignee: Apache Spark > Spark1.5+ HDFS HA mode throw java.net.UnknownHostException: names

[jira] [Updated] (SPARK-13510) Shuffle may throw FetchFailedException: Direct buffer memory

2016-06-20 Thread Hong Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated SPARK-13510: -- Attachment: spark-13510.diff Add FetchStream for shuffle, if the fetch file is bigger than spark.shuff

[jira] [Updated] (SPARK-15968) HiveMetastoreCatalog does not correctly validate partitioned metastore relation when searching the internal table cache

2016-06-20 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Allman updated SPARK-15968: --- Description: The {{getCached}} method of {{HiveMetastoreCatalog}} computes {{pathsInMetastore

[jira] [Commented] (SPARK-16032) Audit semantics of various insertion operations related to partitioned tables

2016-06-20 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15340797#comment-15340797 ] Ryan Blue commented on SPARK-16032: --- I'm going to put review comments here because the

[jira] [Assigned] (SPARK-15574) Python meta-algorithms in Scala

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15574: Assignee: Apache Spark > Python meta-algorithms in Scala > ---

[jira] [Commented] (SPARK-15574) Python meta-algorithms in Scala

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15340788#comment-15340788 ] Apache Spark commented on SPARK-15574: -- User 'yinxusen' has created a pull request f

[jira] [Assigned] (SPARK-15574) Python meta-algorithms in Scala

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15574: Assignee: (was: Apache Spark) > Python meta-algorithms in Scala >

[jira] [Updated] (SPARK-16087) Spark Hangs When Using Union With Persisted Hadoop RDD

2016-06-20 Thread Kevin Conaway (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Conaway updated SPARK-16087: -- Attachment: SPARK-16087.dump.log Attaching thread dump > Spark Hangs When Using Union With Per

[jira] [Commented] (SPARK-16080) Config archive not properly added to YARN classpath

2016-06-20 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15340722#comment-15340722 ] Jonathan Kelly commented on SPARK-16080: [~vanzin], thank you very much for the q

[jira] [Updated] (SPARK-16086) Python UDF failed when there is no arguments

2016-06-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-16086: --- Description: {code} >>> sqlContext.registerFunction("f", lambda : "a") >>> sqlContext.sql("select f()

[jira] [Commented] (SPARK-16086) Python UDF failed when there is no arguments

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15340713#comment-15340713 ] Apache Spark commented on SPARK-16086: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-16086) Python UDF failed when there is no arguments

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16086: Assignee: Apache Spark (was: Davies Liu) > Python UDF failed when there is no arguments >

[jira] [Assigned] (SPARK-16086) Python UDF failed when there is no arguments

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16086: Assignee: Davies Liu (was: Apache Spark) > Python UDF failed when there is no arguments >

[jira] [Updated] (SPARK-16086) Python UDF failed when there is no arguments

2016-06-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-16086: --- Affects Version/s: 1.5.2 > Python UDF failed when there is no arguments > ---

[jira] [Resolved] (SPARK-16009) DataFrameRead.json(path) compatibility broken with Spark 1.6

2016-06-20 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-16009. -- Resolution: Fixed Fix Version/s: 2.0.0 > DataFrameRead.json(path) compatibility broken w

[jira] [Updated] (SPARK-16087) Spark Hangs When Using Union With Persisted Hadoop RDD

2016-06-20 Thread Kevin Conaway (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Conaway updated SPARK-16087: -- Attachment: SPARK-16087.log Attaching output from running this sample. You can see that it hang

[jira] [Updated] (SPARK-16087) Spark Hangs When Using Union With Persisted Hadoop RDD

2016-06-20 Thread Kevin Conaway (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Conaway updated SPARK-16087: -- Attachment: part-0 > Spark Hangs When Using Union With Persisted Hadoop RDD > -

[jira] [Updated] (SPARK-16087) Spark Hangs When Using Union With Persisted Hadoop RDD

2016-06-20 Thread Kevin Conaway (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Conaway updated SPARK-16087: -- Attachment: part-1 > Spark Hangs When Using Union With Persisted Hadoop RDD > -

[jira] [Created] (SPARK-16087) Spark Hangs When Using Union With Persisted Hadoop RDD

2016-06-20 Thread Kevin Conaway (JIRA)
Kevin Conaway created SPARK-16087: - Summary: Spark Hangs When Using Union With Persisted Hadoop RDD Key: SPARK-16087 URL: https://issues.apache.org/jira/browse/SPARK-16087 Project: Spark Issu

[jira] [Resolved] (SPARK-16079) PySpark ML classification missing import of DecisionTreeRegressionModel for GBTClassificationModel

2016-06-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16079. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13787 [https://g

[jira] [Updated] (SPARK-16079) PySpark ML classification missing import of DecisionTreeRegressionModel for GBTClassificationModel

2016-06-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16079: -- Assignee: Bryan Cutler > PySpark ML classification missing import of DecisionTreeRegressionMode

[jira] [Updated] (SPARK-16079) PySpark ML classification missing import of DecisionTreeRegressionModel for GBTClassificationModel

2016-06-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16079: -- Affects Version/s: 2.0.0 > PySpark ML classification missing import of DecisionTreeRegressionMo

[jira] [Commented] (SPARK-16074) Expose VectorUDT/MatrixUDT in a public API

2016-06-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15340642#comment-15340642 ] Xiangrui Meng commented on SPARK-16074: --- Picked option 2) because we don't have any

[jira] [Created] (SPARK-16086) Python UDF failed when there is no arguments

2016-06-20 Thread Davies Liu (JIRA)
Davies Liu created SPARK-16086: -- Summary: Python UDF failed when there is no arguments Key: SPARK-16086 URL: https://issues.apache.org/jira/browse/SPARK-16086 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-16085) Spark stand-alone ui redirects to RM application master UI for yarn-client mode

2016-06-20 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated SPARK-16085: --- Affects Version/s: 1.6.1 > Spark stand-alone ui redirects to RM application master UI for yarn-client

[jira] [Created] (SPARK-16085) Spark stand-alone ui redirects to RM application master UI for yarn-client mode

2016-06-20 Thread Yesha Vora (JIRA)
Yesha Vora created SPARK-16085: -- Summary: Spark stand-alone ui redirects to RM application master UI for yarn-client mode Key: SPARK-16085 URL: https://issues.apache.org/jira/browse/SPARK-16085 Project:

[jira] [Assigned] (SPARK-16080) Config archive not properly added to YARN classpath

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16080: Assignee: Apache Spark > Config archive not properly added to YARN classpath > ---

[jira] [Assigned] (SPARK-16080) Config archive not properly added to YARN classpath

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16080: Assignee: (was: Apache Spark) > Config archive not properly added to YARN classpath >

[jira] [Commented] (SPARK-16080) Config archive not properly added to YARN classpath

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15340602#comment-15340602 ] Apache Spark commented on SPARK-16080: -- User 'vanzin' has created a pull request for

[jira] [Updated] (SPARK-16084) Minor javadoc issue with "Describe" table in the parser

2016-06-20 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Meng updated SPARK-16084: Summary: Minor javadoc issue with "Describe" table in the parser (was: Minor issue with "Describe" table i

[jira] [Updated] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

2016-06-20 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-16083: --- Attachment: 27814004000_spark_heap_2016-06-17_12-05.hprof.gz > spark HistoryServer memory inc

[jira] [Assigned] (SPARK-16084) Minor issue with "Describe" table in the parser

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16084: Assignee: Apache Spark > Minor issue with "Describe" table in the parser > ---

[jira] [Assigned] (SPARK-16084) Minor issue with "Describe" table in the parser

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16084: Assignee: (was: Apache Spark) > Minor issue with "Describe" table in the parser >

[jira] [Commented] (SPARK-16084) Minor issue with "Describe" table in the parser

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15340597#comment-15340597 ] Apache Spark commented on SPARK-16084: -- User 'bomeng' has created a pull request for

[jira] [Updated] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

2016-06-20 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-16083: --- Attachment: spark-spark-org.apache.spark.deploy.history.HistoryServer-1-testbic1on5l.out.4 >

[jira] [Updated] (SPARK-16082) Refactor dapply's/dapplyCollect's documentation - remove duplicated comments

2016-06-20 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-16082: -- Description: Currently when we generate R documentation for dapply and dapplyCollect we

[jira] [Updated] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

2016-06-20 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-16083: --- Attachment: 27814.004.000.sparkhistoryservermemory.log.1 > spark HistoryServer memory increas

[jira] [Created] (SPARK-16084) Minor issue with "Describe" table in the parser

2016-06-20 Thread Bo Meng (JIRA)
Bo Meng created SPARK-16084: --- Summary: Minor issue with "Describe" table in the parser Key: SPARK-16084 URL: https://issues.apache.org/jira/browse/SPARK-16084 Project: Spark Issue Type: Bug

  1   2   3   >