[jira] [Resolved] (SPARK-8551) Python example code for elastic net

2015-06-29 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-8551. Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6946 [https://github.com/apache

[jira] [Updated] (SPARK-8551) Python example code for elastic net

2015-06-29 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-8551: --- Assignee: Shuo Xiang > Python example code for elastic net > --- > >

[jira] [Resolved] (SPARK-8720) PR #7036 breaks branch-1.4 because of a malformed comment

2015-06-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8720. -- Resolution: Fixed Fix Version/s: 1.4.1 Target Version/s: (was: 1.4.2) > PR #7036 brea

[jira] [Updated] (SPARK-8720) PR #7036 breaks branch-1.4 because of a malformed comment

2015-06-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8720: - Assignee: Andrew Or > PR #7036 breaks branch-1.4 because of a malformed comment >

[jira] [Updated] (SPARK-8434) Add a "pretty" parameter to show

2015-06-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8434: --- Issue Type: Sub-task (was: New Feature) Parent: SPARK-6116 > Add a "pretty" parameter to show

[jira] [Resolved] (SPARK-8434) Add a "pretty" parameter to show

2015-06-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8434. Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.5.0 > Add a "pretty" param

[jira] [Resolved] (SPARK-8611) Standalone Cluster WebUI's REST URI field is wrong on protocol

2015-06-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8611. -- Resolution: Not A Problem > Standalone Cluster WebUI's REST URI field is wrong on protocol > --

[jira] [Updated] (SPARK-8363) Move sqrt into math

2015-06-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8363: --- Labels: (was: missing-python) > Move sqrt into math > --- > > Key: S

[jira] [Commented] (SPARK-8363) Move sqrt into math

2015-06-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607595#comment-14607595 ] Reynold Xin commented on SPARK-8363: Yup ... let me remove the tag. > Move sqrt into

[jira] [Commented] (SPARK-8363) Move sqrt into math

2015-06-29 Thread Tarek Auel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607592#comment-14607592 ] Tarek Auel commented on SPARK-8363: --- [~rxin] I guess the python api does exist: https://

[jira] [Commented] (SPARK-8248) string function: length

2015-06-29 Thread Tarek Auel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607585#comment-14607585 ] Tarek Auel commented on SPARK-8248: --- I added the python api: https://issues.apache.org/j

[jira] [Commented] (SPARK-8217) math function: log2

2015-06-29 Thread Tarek Auel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607587#comment-14607587 ] Tarek Auel commented on SPARK-8217: --- I added the python api: https://issues.apache.org/j

[jira] [Assigned] (SPARK-8727) Add missing python api

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8727: --- Assignee: (was: Apache Spark) > Add missing python api > -- > >

[jira] [Commented] (SPARK-8234) misc function: md5

2015-06-29 Thread Tarek Auel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607586#comment-14607586 ] Tarek Auel commented on SPARK-8234: --- I added the python api: https://issues.apache.org/j

[jira] [Commented] (SPARK-8212) math function: e

2015-06-29 Thread Tarek Auel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607589#comment-14607589 ] Tarek Auel commented on SPARK-8212: --- I added the python api: https://issues.apache.org/j

[jira] [Commented] (SPARK-8215) math function: pi

2015-06-29 Thread Tarek Auel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607588#comment-14607588 ] Tarek Auel commented on SPARK-8215: --- I added the python api: https://issues.apache.org/j

[jira] [Assigned] (SPARK-8727) Add missing python api

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8727: --- Assignee: Apache Spark > Add missing python api > -- > >

[jira] [Commented] (SPARK-8727) Add missing python api

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607584#comment-14607584 ] Apache Spark commented on SPARK-8727: - User 'tarekauel' has created a pull request for

[jira] [Created] (SPARK-8727) Add missing python api

2015-06-29 Thread Tarek Auel (JIRA)
Tarek Auel created SPARK-8727: - Summary: Add missing python api Key: SPARK-8727 URL: https://issues.apache.org/jira/browse/SPARK-8727 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-8227) math function: unhex

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607579#comment-14607579 ] Apache Spark commented on SPARK-8227: - User 'zhichao-li' has created a pull request fo

[jira] [Commented] (SPARK-8415) Jenkins compilation spends lots of time re-resolving dependencies and waiting to acquire Ivy cache lock

2015-06-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607577#comment-14607577 ] Josh Rosen commented on SPARK-8415: --- It looks like this problem occurs when a huge numbe

[jira] [Closed] (SPARK-8618) Obtain hbase token retries many times when having hbase class but no hbase configuration

2015-06-29 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula closed SPARK-8618. --- Resolution: Invalid > Obtain hbase token retries many times when having hbase class but no hbase > configurat

[jira] [Commented] (SPARK-701) Wrong SPARK_MEM setting with different EC2 master and worker machine types

2015-06-29 Thread Stefano Parmesan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607561#comment-14607561 ] Stefano Parmesan commented on SPARK-701: Posting the link to the new issue for refe

[jira] [Created] (SPARK-8726) Wrong spark.executor.memory when using different EC2 master and worker machine types

2015-06-29 Thread Stefano Parmesan (JIRA)
Stefano Parmesan created SPARK-8726: --- Summary: Wrong spark.executor.memory when using different EC2 master and worker machine types Key: SPARK-8726 URL: https://issues.apache.org/jira/browse/SPARK-8726

[jira] [Commented] (SPARK-8726) Wrong spark.executor.memory when using different EC2 master and worker machine types

2015-06-29 Thread Stefano Parmesan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607560#comment-14607560 ] Stefano Parmesan commented on SPARK-8726: - Apparently the {{default_spark_mem}} va

[jira] [Created] (SPARK-8725) Test modules in topological order in dev/run-tests and python/run-tests

2015-06-29 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-8725: - Summary: Test modules in topological order in dev/run-tests and python/run-tests Key: SPARK-8725 URL: https://issues.apache.org/jira/browse/SPARK-8725 Project: Spark

[jira] [Commented] (SPARK-5161) Parallelize Python test execution

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607538#comment-14607538 ] Apache Spark commented on SPARK-5161: - User 'JoshRosen' has created a pull request for

[jira] [Updated] (SPARK-8650) Use the user-specified app name priority in SparkSQLCLIDriver or HiveThriftServer2

2015-06-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8650: Assignee: Yadong Qi > Use the user-specified app name priority in SparkSQLCLIDriver or > HiveThriftServer2

[jira] [Resolved] (SPARK-8650) Use the user-specified app name priority in SparkSQLCLIDriver or HiveThriftServer2

2015-06-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-8650. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7030 [https://github.com/apac

[jira] [Resolved] (SPARK-8721) Rename ExpectsInputTypes => AutoCastInputTypes

2015-06-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8721. Resolution: Fixed Fix Version/s: 1.5.0 > Rename ExpectsInputTypes => AutoCastInputTypes > ---

[jira] [Commented] (SPARK-8415) Jenkins compilation spends lots of time re-resolving dependencies and waiting to acquire Ivy cache lock

2015-06-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607205#comment-14607205 ] Josh Rosen commented on SPARK-8415: --- Here's an example of a build that spent lots of tim

[jira] [Created] (SPARK-8724) Need documentation on how to deploy or use SparkR in Spark 1.4.0+

2015-06-29 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-8724: --- Summary: Need documentation on how to deploy or use SparkR in Spark 1.4.0+ Key: SPARK-8724 URL: https://issues.apache.org/jira/browse/SPARK-8724 Project: Spark

[jira] [Commented] (SPARK-8653) Add constraint for Children expression for data type

2015-06-29 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607195#comment-14607195 ] Cheng Hao commented on SPARK-8653: -- [~rxin] I'll agree that we need to rename the trait.

[jira] [Commented] (SPARK-8277) SparkR createDataFrame is slow

2015-06-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607190#comment-14607190 ] Felix Cheung commented on SPARK-8277: - what would be a better approach? Would it work

[jira] [Commented] (SPARK-8723) improve code gen for divide and remainder

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607145#comment-14607145 ] Apache Spark commented on SPARK-8723: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-8723) improve code gen for divide and remainder

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8723: --- Assignee: (was: Apache Spark) > improve code gen for divide and remainder > -

[jira] [Assigned] (SPARK-8723) improve code gen for divide and remainder

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8723: --- Assignee: Apache Spark > improve code gen for divide and remainder >

[jira] [Created] (SPARK-8723) improve code gen for divide and remainder

2015-06-29 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-8723: -- Summary: improve code gen for divide and remainder Key: SPARK-8723 URL: https://issues.apache.org/jira/browse/SPARK-8723 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-5161) Parallelize Python test execution

2015-06-29 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-5161. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7031 [https://github.com/

[jira] [Commented] (SPARK-8041) Consistently pass SparkR library directory to SparkR application

2015-06-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606996#comment-14606996 ] Felix Cheung commented on SPARK-8041: - I've done some work to automatically get the RL

[jira] [Commented] (SPARK-6836) RDD APIs missing in SparkR

2015-06-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606993#comment-14606993 ] Felix Cheung commented on SPARK-6836: - +1 on randomSplit - probably need that for repr

[jira] [Commented] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

2015-06-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606991#comment-14606991 ] Josh Rosen commented on SPARK-1517: --- [~felixcheung], nightly doc builds are already bein

[jira] [Commented] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

2015-06-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606961#comment-14606961 ] Felix Cheung commented on SPARK-1517: - Does this handle SparkR doc build (Which requir

[jira] [Updated] (SPARK-8366) When task fails and append a new one, the ExecutorAllocationManager can't sense the new tasks

2015-06-29 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated SPARK-8366: Description: I use the *dynamic executor allocation* function. Then one executor is killed, all running task

[jira] [Updated] (SPARK-8687) Spark on yarn-client mode can't send `spark.yarn.credentials.file` to executor.

2015-06-29 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-8687: Summary: Spark on yarn-client mode can't send `spark.yarn.credentials.file` to executor. (was: Spar

[jira] [Commented] (SPARK-8722) PR merge script should warn when merging a PR that has failed tests

2015-06-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606928#comment-14606928 ] Josh Rosen commented on SPARK-8722: --- Also, this feature needs to block on being able to

[jira] [Commented] (SPARK-8592) CoarseGrainedExecutorBackend: Cannot register with driver => NPE

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606927#comment-14606927 ] Apache Spark commented on SPARK-8592: - User 'xuchenCN' has created a pull request for

[jira] [Commented] (SPARK-8722) PR merge script should warn when merging a PR that has failed tests

2015-06-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606925#comment-14606925 ] Josh Rosen commented on SPARK-8722: --- If we wanted to get _really_ fancy, we could warn w

[jira] [Created] (SPARK-8722) PR merge script should warn when merging a PR that has failed tests

2015-06-29 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-8722: - Summary: PR merge script should warn when merging a PR that has failed tests Key: SPARK-8722 URL: https://issues.apache.org/jira/browse/SPARK-8722 Project: Spark

[jira] [Commented] (SPARK-8703) Add CountVectorizer as a ml transformer to convert document to words count vector

2015-06-29 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606909#comment-14606909 ] yuhao yang commented on SPARK-8703: --- Appreciate the suggestion. I've sent an update to u

[jira] [Commented] (SPARK-8653) Add constraint for Children expression for data type

2015-06-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606904#comment-14606904 ] Reynold Xin commented on SPARK-8653: I think a better way to do this is to have a trai

[jira] [Assigned] (SPARK-8721) Rename ExpectsInputTypes => AutoCastInputTypes

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8721: --- Assignee: Reynold Xin (was: Apache Spark) > Rename ExpectsInputTypes => AutoCastInputTypes >

[jira] [Commented] (SPARK-8721) Rename ExpectsInputTypes => AutoCastInputTypes

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606901#comment-14606901 ] Apache Spark commented on SPARK-8721: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-8721) Rename ExpectsInputTypes => AutoCastInputTypes

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8721: --- Assignee: Apache Spark (was: Reynold Xin) > Rename ExpectsInputTypes => AutoCastInputTypes >

[jira] [Created] (SPARK-8721) Rename ExpectsInputTypes => AutoCastInputTypes

2015-06-29 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8721: -- Summary: Rename ExpectsInputTypes => AutoCastInputTypes Key: SPARK-8721 URL: https://issues.apache.org/jira/browse/SPARK-8721 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-8236) misc function: crc32

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606890#comment-14606890 ] Apache Spark commented on SPARK-8236: - User 'qiansl127' has created a pull request for

[jira] [Resolved] (SPARK-8031) Version number written to Hive metastore is "0.13.1aa" instead of "0.13.1a"

2015-06-29 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi resolved SPARK-8031. Resolution: Fixed Fixed in 1.5.0 > Version number written to Hive metastore is "0.13.1aa" instead o

[jira] [Closed] (SPARK-8031) Version number written to Hive metastore is "0.13.1aa" instead of "0.13.1a"

2015-06-29 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi closed SPARK-8031. -- > Version number written to Hive metastore is "0.13.1aa" instead of "0.13.1a" >

[jira] [Reopened] (SPARK-8031) Version number written to Hive metastore is "0.13.1aa" instead of "0.13.1a"

2015-06-29 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi reopened SPARK-8031: > Version number written to Hive metastore is "0.13.1aa" instead of "0.13.1a" >

[jira] [Commented] (SPARK-6129) Add a section in user guide for model evaluation

2015-06-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606871#comment-14606871 ] Joseph K. Bradley commented on SPARK-6129: -- Please do, thanks! > Add a section i

[jira] [Commented] (SPARK-5571) LDA should handle text as well

2015-06-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606869#comment-14606869 ] Joseph K. Bradley commented on SPARK-5571: -- Thanks for your interest! The API sh

[jira] [Updated] (SPARK-7674) R-like stats for ML models

2015-06-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7674: - Shepherd: Joseph K. Bradley > R-like stats for ML models > -- > >

[jira] [Updated] (SPARK-8308) add missing save load for python doc example and tune down MatrixFactorization iterations

2015-06-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8308: - Shepherd: Joseph K. Bradley > add missing save load for python doc example and tune down

[jira] [Commented] (SPARK-8119) HeartbeatReceiver should not adjust application executor resources

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606853#comment-14606853 ] Apache Spark commented on SPARK-8119: - User 'andrewor14' has created a pull request fo

[jira] [Updated] (SPARK-8119) HeartbeatReceiver should not adjust application executor resources

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8119: - Component/s: (was: Scheduler) > HeartbeatReceiver should not adjust application executor resources > -

[jira] [Updated] (SPARK-8119) HeartbeatReceiver should not adjust application executor resources

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8119: - Component/s: Spark Core > HeartbeatReceiver should not adjust application executor resources > ---

[jira] [Updated] (SPARK-8715) ArrayOutOfBoundsException for DataFrameStatSuite.crosstab

2015-06-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8715: Assignee: Burak Yavuz > ArrayOutOfBoundsException for DataFrameStatSuite.crosstab >

[jira] [Resolved] (SPARK-7667) MLlib Python API consistency check

2015-06-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7667. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6856 [https

[jira] [Resolved] (SPARK-8669) Parquet 1.7 files that store binary enums crash when inferring schema

2015-06-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8669. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7048 [https:/

[jira] [Resolved] (SPARK-8715) ArrayOutOfBoundsException for DataFrameStatSuite.crosstab

2015-06-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-8715. - Resolution: Fixed Fix Version/s: 1.5.0 1.4.2 Issue resolved by pull request 7100

[jira] [Updated] (SPARK-8457) Documentation for N-Gram feature transformer

2015-06-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8457: - Assignee: Feynman Liang Target Version/s: 1.5.0 > Documentation for N-Gram fea

[jira] [Updated] (SPARK-8456) Python API for N-Gram Feature Transformer

2015-06-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8456: - Assignee: Feynman Liang > Python API for N-Gram Feature Transformer >

[jira] [Resolved] (SPARK-8456) Python API for N-Gram Feature Transformer

2015-06-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-8456. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6960 [https

[jira] [Commented] (SPARK-8450) PySpark write.parquet raises Unsupported datatype DecimalType()

2015-06-29 Thread Yuri Saito (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606812#comment-14606812 ] Yuri Saito commented on SPARK-8450: --- When {{createDataFrame}} is called(via *PySpark*),

[jira] [Assigned] (SPARK-8450) PySpark write.parquet raises Unsupported datatype DecimalType()

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8450: --- Assignee: Apache Spark > PySpark write.parquet raises Unsupported datatype DecimalType() > --

[jira] [Commented] (SPARK-8450) PySpark write.parquet raises Unsupported datatype DecimalType()

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606809#comment-14606809 ] Apache Spark commented on SPARK-8450: - User 'x1-' has created a pull request for this

[jira] [Assigned] (SPARK-8450) PySpark write.parquet raises Unsupported datatype DecimalType()

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8450: --- Assignee: (was: Apache Spark) > PySpark write.parquet raises Unsupported datatype Decimal

[jira] [Updated] (SPARK-8119) HeartbeatReceiver should not adjust application executor resources

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8119: - Summary: HeartbeatReceiver should not adjust application executor resources (was: HeartbeatReceiver shoul

[jira] [Commented] (SPARK-8720) PR #7036 breaks branch-1.4 because of a malformed comment

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606805#comment-14606805 ] Apache Spark commented on SPARK-8720: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-8720) PR #7036 breaks branch-1.4 because of a malformed comment

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8720: --- Assignee: (was: Apache Spark) > PR #7036 breaks branch-1.4 because of a malformed comment

[jira] [Commented] (SPARK-8437) Using directory path without wildcard for filename slow for large number of files with wholeTextFiles and binaryFiles

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606807#comment-14606807 ] Andrew Or commented on SPARK-8437: -- Re-opening because the patch was reverted. > Using d

[jira] [Reopened] (SPARK-8437) Using directory path without wildcard for filename slow for large number of files with wholeTextFiles and binaryFiles

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-8437: -- > Using directory path without wildcard for filename slow for large number of > files with wholeTextFiles a

[jira] [Assigned] (SPARK-8720) PR #7036 breaks branch-1.4 because of a malformed comment

2015-06-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8720: --- Assignee: Apache Spark > PR #7036 breaks branch-1.4 because of a malformed comment >

[jira] [Updated] (SPARK-8437) Using directory path without wildcard for filename slow for large number of files with wholeTextFiles and binaryFiles

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8437: - Fix Version/s: (was: 1.4.2) (was: 1.5.0) > Using directory path without wildcar

[jira] [Created] (SPARK-8720) PR #7036 breaks branch-1.4 because of a malformed comment

2015-06-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-8720: - Summary: PR #7036 breaks branch-1.4 because of a malformed comment Key: SPARK-8720 URL: https://issues.apache.org/jira/browse/SPARK-8720 Project: Spark Issue Type:

[jira] [Updated] (SPARK-8119) Spark will set total executor when some executors fail.

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8119: - Description: DynamicAllocation will set the total executor to a little number when it wants to kill some

[jira] [Updated] (SPARK-8119) HeartbeatReceiver should not call sc.killExecutor

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8119: - Summary: HeartbeatReceiver should not call sc.killExecutor (was: Spark will set total executor when some

[jira] [Created] (SPARK-8719) Adding Python support for 1-sample, 2-sided Kolmogorov Smirnov Test

2015-06-29 Thread Jose Cambronero (JIRA)
Jose Cambronero created SPARK-8719: -- Summary: Adding Python support for 1-sample, 2-sided Kolmogorov Smirnov Test Key: SPARK-8719 URL: https://issues.apache.org/jira/browse/SPARK-8719 Project: Spark

[jira] [Updated] (SPARK-8715) ArrayOutOfBoundsException for DataFrameStatSuite.crosstab

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8715: - Labels: flaky-test (was: ) > ArrayOutOfBoundsException for DataFrameStatSuite.crosstab >

[jira] [Updated] (SPARK-8653) Add constraint for Children expression for data type

2015-06-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8653: Shepherd: Reynold Xin > Add constraint for Children expression for data type > -

[jira] [Updated] (SPARK-8657) Fail to upload conf archive to viewfs

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8657: - Target Version/s: 1.5.0 (was: 1.5.0, 1.4.2) > Fail to upload conf archive to viewfs > ---

[jira] [Updated] (SPARK-8657) Fail to upload conf archive to viewfs

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8657: - Affects Version/s: (was: 1.4.2) (was: 1.4.1) > Fail to upload conf archive

[jira] [Updated] (SPARK-8657) Fail to upload conf archive to viewfs

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8657: - Fix Version/s: (was: 1.4.2) > Fail to upload conf archive to viewfs >

[jira] [Updated] (SPARK-8657) Fail to upload conf archive to viewfs

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8657: - Target Version/s: 1.5.0, 1.4.2 (was: 1.4.2) > Fail to upload conf archive to viewfs > ---

[jira] [Closed] (SPARK-8019) [SparkR] Create worker R processes with a command other then Rscript

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8019. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > [SparkR] Create worker R p

[jira] [Closed] (SPARK-8410) Hive VersionsSuite RuntimeException

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8410. Resolution: Fixed Fix Version/s: 1.4.2 1.5.0 Target Version/s: 1.5.0,

[jira] [Closed] (SPARK-8475) SparkSubmit with Ivy jars is very slow to load with no internet access

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8475. Resolution: Fixed Fix Version/s: 1.4.2 1.5.0 > SparkSubmit with Ivy jars is very s

[jira] [Updated] (SPARK-8475) SparkSubmit with Ivy jars is very slow to load with no internet access

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8475: - Assignee: Burak Yavuz > SparkSubmit with Ivy jars is very slow to load with no internet access > -

[jira] [Closed] (SPARK-8437) Using directory path without wildcard for filename slow for large number of files with wholeTextFiles and binaryFiles

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8437. Resolution: Fixed Assignee: Sean Owen Fix Version/s: 1.4.2 1.5

[jira] [Commented] (SPARK-8437) Using directory path without wildcard for filename slow for large number of files with wholeTextFiles and binaryFiles

2015-06-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606721#comment-14606721 ] Andrew Or commented on SPARK-8437: -- The merged PR involves only documentation changes. I

  1   2   3   4   >