[jira] [Commented] (SPARK-8646) PySpark does not run on YARN

[ https://issues.apache.org/jira/browse/SPARK-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604014#comment-14604014 ] Juliet Hougland commented on SPARK-8646: When I configure spark to use my virtuale

[jira] [Resolved] (SPARK-8512) Web UI Inconsistent with History Server in Standalone Mode

[ https://issues.apache.org/jira/browse/SPARK-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8512. -- Resolution: Invalid (You might also look at recent JIRAs about finding the state of incomplete apps whi

[jira] [Updated] (SPARK-3629) Improvements to YARN doc

[ https://issues.apache.org/jira/browse/SPARK-3629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3629: - Assignee: Neelesh Srinivas Salian Priority: Minor (was: Major) > Improvements to YARN doc > -

[jira] [Resolved] (SPARK-3629) Improvements to YARN doc

[ https://issues.apache.org/jira/browse/SPARK-3629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3629. -- Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Issue resolved by pull request 69

[jira] [Commented] (SPARK-8667) Improve Spark UI behavior at scale

[ https://issues.apache.org/jira/browse/SPARK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604000#comment-14604000 ] Patrick Wendell commented on SPARK-8667: Thanks Sean. I looked for a while for an

[jira] [Resolved] (SPARK-8667) Improve Spark UI behavior at scale

[ https://issues.apache.org/jira/browse/SPARK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-8667. Resolution: Duplicate > Improve Spark UI behavior at scale > ---

[jira] [Resolved] (SPARK-8639) Instructions for executing jekyll in docs/README.md could be slightly more clear, typo in docs/api.md

[ https://issues.apache.org/jira/browse/SPARK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8639. -- Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Issue resolved by pull request 70

[jira] [Commented] (SPARK-8424) Add blacklist mechanism for task scheduler and Yarn container allocation

[ https://issues.apache.org/jira/browse/SPARK-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603995#comment-14603995 ] Sean Owen commented on SPARK-8424: -- [~jerryshao] I don't think this umbrella JIRA is usef

[jira] [Resolved] (SPARK-4609) Job can not finish if there is one bad slave in clusters

[ https://issues.apache.org/jira/browse/SPARK-4609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4609. -- Resolution: Duplicate > Job can not finish if there is one bad slave in clusters > -

[jira] [Updated] (SPARK-8663) Dirver will be hang if there is a job submit during SparkContex stop Interval

[ https://issues.apache.org/jira/browse/SPARK-8663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8663: - Fix Version/s: (was: 1.2.2) (was: 1.3.0) [~yuemeng] do not set Fix Version. Ple

[jira] [Updated] (SPARK-2015) Spark UI issues at scale

[ https://issues.apache.org/jira/browse/SPARK-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2015: --- Target Version/s: 1.5.0 > Spark UI issues at scale > > > Key:

[jira] [Commented] (SPARK-3650) Triangle Count handles reverse edges incorrectly

[ https://issues.apache.org/jira/browse/SPARK-3650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603992#comment-14603992 ] Sean Owen commented on SPARK-3650: -- [~robineast] looks like https://github.com/apache/spa

[jira] [Resolved] (SPARK-2319) Number of tasks on executors become negative after executor failures

[ https://issues.apache.org/jira/browse/SPARK-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2319. -- Resolution: Fixed Fix Version/s: 1.4.0 Given the many fixes related to negative executors from 1.

[jira] [Commented] (SPARK-8667) Improve Spark UI behavior at scale

[ https://issues.apache.org/jira/browse/SPARK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603989#comment-14603989 ] Sean Owen commented on SPARK-8667: -- [~pwendell] there are a some old tickets and an old u

[jira] [Resolved] (SPARK-8666) checkpointing does not take advantage of persisted/cached RDDs

[ https://issues.apache.org/jira/browse/SPARK-8666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8666. -- Resolution: Duplicate > checkpointing does not take advantage of persisted/cached RDDs > ---

[jira] [Commented] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

[ https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603986#comment-14603986 ] Sean Owen commented on SPARK-8582: -- [~glenn.stryc...@gmail.com] in these cases please clo

[jira] [Commented] (SPARK-5997) Increase partition count without performing a shuffle

[ https://issues.apache.org/jira/browse/SPARK-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603985#comment-14603985 ] Sean Owen commented on SPARK-5997: -- Coalescing to 1 partition doesn't avoid the problem,

[jira] [Commented] (SPARK-8646) PySpark does not run on YARN

[ https://issues.apache.org/jira/browse/SPARK-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603973#comment-14603973 ] Lianhui Wang commented on SPARK-8646: - from [~juliet] 's logs, i think you miss python

[jira] [Commented] (SPARK-8657) Fail to upload conf archive to viewfs

[ https://issues.apache.org/jira/browse/SPARK-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603920#comment-14603920 ] Apache Spark commented on SPARK-8657: - User 'litao-buptsse' has created a pull request

[jira] [Created] (SPARK-8676) After TGT expires, Thrift Server get "No invalid credentials" exception

Tao Wang created SPARK-8676: --- Summary: After TGT expires, Thrift Server get "No invalid credentials" exception Key: SPARK-8676 URL: https://issues.apache.org/jira/browse/SPARK-8676 Project: Spark

[jira] [Commented] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603913#comment-14603913 ] Matt Cheah commented on SPARK-8167: --- One thought is to have, whenever a task fails from

[jira] [Commented] (SPARK-8649) Mapr repository is not defined properly

[ https://issues.apache.org/jira/browse/SPARK-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603896#comment-14603896 ] Ashok Kumar commented on SPARK-8649: Updated pom.xml with correct repository url i.e

[jira] [Commented] (SPARK-4678) A SQL query with subquery fails with TreeNodeException

[ https://issues.apache.org/jira/browse/SPARK-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603884#comment-14603884 ] Sudhakar Thota commented on SPARK-4678: --- Hi Tsuyoshi, There was a SQL framing issu

[jira] [Updated] (SPARK-4678) A SQL query with subquery fails with TreeNodeException

[ https://issues.apache.org/jira/browse/SPARK-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-4678: -- Attachment: spark-4678-1.rtf > A SQL query with subquery fails with TreeNodeException >

[jira] [Commented] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603881#comment-14603881 ] Jonathan Kelly commented on SPARK-8332: --- Actually, it seems like it may have been th

[jira] [Updated] (SPARK-8675) Executors created by LocalBackend won't get the same classpath as other executor backends

[ https://issues.apache.org/jira/browse/SPARK-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Min Zhou updated SPARK-8675: Description: AFAIK, some spark application always use LocalBackend to do some local initiatives, spark sql

[jira] [Updated] (SPARK-8675) Executors created by LocalBackend won't get the same classpath as other executor backends

[ https://issues.apache.org/jira/browse/SPARK-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Min Zhou updated SPARK-8675: Affects Version/s: 1.4.0 > Executors created by LocalBackend won't get the same classpath as other > execut

[jira] [Updated] (SPARK-8675) Executors created by LocalBackend won't get the same classpath as other executor backends

[ https://issues.apache.org/jira/browse/SPARK-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Min Zhou updated SPARK-8675: Description: AFAIK, some spark application always use LocalBackend to do some local initiatives, spark sql

[jira] [Updated] (SPARK-8675) Executors created by LocalBackend won't get the same classpath as other executor backends

[ https://issues.apache.org/jira/browse/SPARK-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Min Zhou updated SPARK-8675: Summary: Executors created by LocalBackend won't get the same classpath as other executor backends (was: E

[jira] [Created] (SPARK-8675) Executors of a LocalBackend don't get the same classpath as other executor backend

Min Zhou created SPARK-8675: --- Summary: Executors of a LocalBackend don't get the same classpath as other executor backend Key: SPARK-8675 URL: https://issues.apache.org/jira/browse/SPARK-8675 Project: Spar

[jira] [Updated] (SPARK-8675) Executors created by LocalBackend won't get the same classpath as other executor backend

[ https://issues.apache.org/jira/browse/SPARK-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Min Zhou updated SPARK-8675: Summary: Executors created by LocalBackend won't get the same classpath as other executor backend (was: Ex

[jira] [Commented] (SPARK-8670) Nested columns can't be referenced (but they can be selected)

[ https://issues.apache.org/jira/browse/SPARK-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603866#comment-14603866 ] Reynold Xin commented on SPARK-8670: Is this specific to Python? > Nested columns can

[jira] [Commented] (SPARK-4678) A SQL query with subquery fails with TreeNodeException

[ https://issues.apache.org/jira/browse/SPARK-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603861#comment-14603861 ] Sudhakar Thota commented on SPARK-4678: --- I would like to work on this. > A SQL quer

[jira] [Closed] (SPARK-6064) Checking data types when resolving types

[ https://issues.apache.org/jira/browse/SPARK-6064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zeng closed SPARK-6064. --- Resolution: Fixed > Checking data types when resolving types > > >

[jira] [Commented] (SPARK-8597) DataFrame partitionBy memory pressure scales extremely poorly

[ https://issues.apache.org/jira/browse/SPARK-8597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603816#comment-14603816 ] Matt Cheah commented on SPARK-8597: --- Cool, a coworker and I think we have something simi

[jira] [Assigned] (SPARK-8673) Launcher: add support for monitoring launched applications

[ https://issues.apache.org/jira/browse/SPARK-8673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8673: --- Assignee: Apache Spark > Launcher: add support for monitoring launched applications > ---

[jira] [Assigned] (SPARK-8673) Launcher: add support for monitoring launched applications

[ https://issues.apache.org/jira/browse/SPARK-8673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8673: --- Assignee: (was: Apache Spark) > Launcher: add support for monitoring launched application

[jira] [Commented] (SPARK-8673) Launcher: add support for monitoring launched applications

[ https://issues.apache.org/jira/browse/SPARK-8673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603815#comment-14603815 ] Apache Spark commented on SPARK-8673: - User 'vanzin' has created a pull request for th

[jira] [Resolved] (SPARK-8607) SparkR - Third party jars are not being added to classpath in SparkRBackend

[ https://issues.apache.org/jira/browse/SPARK-8607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8607. -- Resolution: Fixed Fix Version/s: (was: 1.4.0) 1.5.0

[jira] [Updated] (SPARK-8607) SparkR - Third party jars are not being added to classpath in SparkRBackend

[ https://issues.apache.org/jira/browse/SPARK-8607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8607: - Assignee: Chris Freeman > SparkR - Third party jars are not being added to classpa

[jira] [Created] (SPARK-8674) 2-sample, 2-sided Kolmogorov Smirnov Test Implementation

Jose Cambronero created SPARK-8674: -- Summary: 2-sample, 2-sided Kolmogorov Smirnov Test Implementation Key: SPARK-8674 URL: https://issues.apache.org/jira/browse/SPARK-8674 Project: Spark Is

[jira] [Commented] (SPARK-6764) Add wheel package support for PySpark

[ https://issues.apache.org/jira/browse/SPARK-6764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603785#comment-14603785 ] Punya Biswal commented on SPARK-6764: - Some packages need to be installed on workers,

[jira] [Created] (SPARK-8673) Launcher: add support for monitoring launched applications

Marcelo Vanzin created SPARK-8673: - Summary: Launcher: add support for monitoring launched applications Key: SPARK-8673 URL: https://issues.apache.org/jira/browse/SPARK-8673 Project: Spark Is

[jira] [Updated] (SPARK-4988) "Create table ..as select ..from..order by .. limit 10" report error when one col is a Decimal

[ https://issues.apache.org/jira/browse/SPARK-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-4988: -- Attachment: spark-4988-1.txt SQL statements and data > "Create table ..as select ..from..order

[jira] [Commented] (SPARK-4988) "Create table ..as select ..from..order by .. limit 10" report error when one col is a Decimal

[ https://issues.apache.org/jira/browse/SPARK-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603766#comment-14603766 ] Sudhakar Thota commented on SPARK-4988: --- Both the spark-sql statements are working.

[jira] [Commented] (SPARK-8671) Add isotonic regression to the pipeline API

[ https://issues.apache.org/jira/browse/SPARK-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603763#comment-14603763 ] Martin Zapletal commented on SPARK-8671: Sure. Please assign it to me and I will s

[jira] [Comment Edited] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603751#comment-14603751 ] Jonathan Kelly edited comment on SPARK-8332 at 6/26/15 11:15 PM: ---

[jira] [Commented] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603751#comment-14603751 ] Jonathan Kelly commented on SPARK-8332: --- I was running into the same issue, so I mad

[jira] [Assigned] (SPARK-8130) spark.files.useFetchCache should be off by default

[ https://issues.apache.org/jira/browse/SPARK-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8130: --- Assignee: (was: Apache Spark) > spark.files.useFetchCache should be off by default >

[jira] [Assigned] (SPARK-8130) spark.files.useFetchCache should be off by default

[ https://issues.apache.org/jira/browse/SPARK-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8130: --- Assignee: Apache Spark > spark.files.useFetchCache should be off by default > ---

[jira] [Commented] (SPARK-8130) spark.files.useFetchCache should be off by default

[ https://issues.apache.org/jira/browse/SPARK-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603742#comment-14603742 ] Apache Spark commented on SPARK-8130: - User 'piganesh' has created a pull request for

[jira] [Assigned] (SPARK-8623) Hadoop RDDs fail to properly serialize configuration

[ https://issues.apache.org/jira/browse/SPARK-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8623: --- Assignee: Sandy Ryza (was: Apache Spark) > Hadoop RDDs fail to properly serialize configurat

[jira] [Commented] (SPARK-8623) Hadoop RDDs fail to properly serialize configuration

[ https://issues.apache.org/jira/browse/SPARK-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603699#comment-14603699 ] Apache Spark commented on SPARK-8623: - User 'sryza' has created a pull request for thi

[jira] [Assigned] (SPARK-8623) Hadoop RDDs fail to properly serialize configuration

[ https://issues.apache.org/jira/browse/SPARK-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8623: --- Assignee: Apache Spark (was: Sandy Ryza) > Hadoop RDDs fail to properly serialize configurat

[jira] [Updated] (SPARK-8623) Hadoop RDDs fail to properly serialize configuration

[ https://issues.apache.org/jira/browse/SPARK-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-8623: -- Summary: Hadoop RDDs fail to properly serialize configuration (was: Some queries in spark-sql lead to N

[jira] [Assigned] (SPARK-8623) Some queries in spark-sql lead to NullPointerException when using Yarn

[ https://issues.apache.org/jira/browse/SPARK-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned SPARK-8623: - Assignee: Sandy Ryza > Some queries in spark-sql lead to NullPointerException when using Yarn > -

[jira] [Updated] (SPARK-8623) Some queries in spark-sql lead to NullPointerException when using Yarn

[ https://issues.apache.org/jira/browse/SPARK-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-8623: -- Component/s: (was: SQL) Spark Core > Some queries in spark-sql lead to NullPointerE

[jira] [Updated] (SPARK-8672) throws NPE when running spark sql thrift server with session state authenticator

[ https://issues.apache.org/jira/browse/SPARK-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Min Zhou updated SPARK-8672: Description: Here is the configuration {noformat} hive.security.authorization.enabled false

[jira] [Created] (SPARK-8672) throws NPE when running spark sql thrift server with session state authenticator

Min Zhou created SPARK-8672: --- Summary: throws NPE when running spark sql thrift server with session state authenticator Key: SPARK-8672 URL: https://issues.apache.org/jira/browse/SPARK-8672 Project: Spark

[jira] [Commented] (SPARK-8623) Some queries in spark-sql lead to NullPointerException when using Yarn

[ https://issues.apache.org/jira/browse/SPARK-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603694#comment-14603694 ] Sandy Ryza commented on SPARK-8623: --- Figured out the issue - my patch omitted registerin

[jira] [Commented] (SPARK-2883) Spark Support for ORCFile format

[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603669#comment-14603669 ] Zhan Zhang commented on SPARK-2883: --- [~philclaridge] I try the spark-shell in local mod

[jira] [Commented] (SPARK-8670) Nested columns can't be referenced (but they can be selected)

[ https://issues.apache.org/jira/browse/SPARK-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603658#comment-14603658 ] Nicholas Chammas commented on SPARK-8670: - I thought, per the discussion on [SPARK

[jira] [Commented] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

[ https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603625#comment-14603625 ] Olivier Toupin commented on SPARK-6910: --- Anyone interested. I posted a workaround to

[jira] [Updated] (SPARK-8445) MLlib 1.5 Roadmap

[ https://issues.apache.org/jira/browse/SPARK-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8445: - Description: We expect to see many MLlib contributors for the 1.5 release. To scale out the devel

[jira] [Commented] (SPARK-6830) Memoize frequently queried vals in RDD, such as numPartitions, count etc.

[ https://issues.apache.org/jira/browse/SPARK-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603619#comment-14603619 ] Perinkulam I Ganesh commented on SPARK-6830: If we cache it locally within RDD

[jira] [Updated] (SPARK-8671) Add isotonic regression to the pipeline API

[ https://issues.apache.org/jira/browse/SPARK-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8671: - Remaining Estimate: 48h Original Estimate: 48h > Add isotonic regression to the pipeline API

[jira] [Created] (SPARK-8671) Add isotonic regression to the pipeline API

Xiangrui Meng created SPARK-8671: Summary: Add isotonic regression to the pipeline API Key: SPARK-8671 URL: https://issues.apache.org/jira/browse/SPARK-8671 Project: Spark Issue Type: New Fea

[jira] [Commented] (SPARK-8671) Add isotonic regression to the pipeline API

[ https://issues.apache.org/jira/browse/SPARK-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603613#comment-14603613 ] Xiangrui Meng commented on SPARK-8671: -- [~zapletal-martin] Are you interested in work

[jira] [Commented] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

[ https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603606#comment-14603606 ] Apache Spark commented on SPARK-6910: - User 'oliviertoupin' has created a pull request

[jira] [Commented] (SPARK-8670) Nested columns can't be referenced (but they can be selected)

[ https://issues.apache.org/jira/browse/SPARK-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603605#comment-14603605 ] Davies Liu commented on SPARK-8670: --- I think you should use `df.stats.age` or df.select

[jira] [Commented] (SPARK-8587) Return cost and cluster index KMeansModel.predict

[ https://issues.apache.org/jira/browse/SPARK-8587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603592#comment-14603592 ] Joseph K. Bradley commented on SPARK-8587: -- Based on feedback we've gotten about

[jira] [Commented] (SPARK-3528) Reading data from file:/// should be called NODE_LOCAL not PROCESS_LOCAL

[ https://issues.apache.org/jira/browse/SPARK-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603576#comment-14603576 ] Perinkulam I Ganesh commented on SPARK-3528: Have a question: If the driver i

[jira] [Updated] (SPARK-8670) Nested columns can't be referenced (but they can be selected)

[ https://issues.apache.org/jira/browse/SPARK-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-8670: Description: This is strange and looks like a regression from 1.3. {code} import json date

[jira] [Commented] (SPARK-8670) Nested columns can't be referenced (but they can be selected)

[ https://issues.apache.org/jira/browse/SPARK-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603572#comment-14603572 ] Nicholas Chammas commented on SPARK-8670: - cc [~rxin], [~davies] > Nested columns

[jira] [Created] (SPARK-8670) Nested columns can't be referenced (but they can be selected)

Nicholas Chammas created SPARK-8670: --- Summary: Nested columns can't be referenced (but they can be selected) Key: SPARK-8670 URL: https://issues.apache.org/jira/browse/SPARK-8670 Project: Spark

[jira] [Commented] (SPARK-2883) Spark Support for ORCFile format

[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603554#comment-14603554 ] Michael Armbrust commented on SPARK-2883: - Usage questions should probably go to t

[jira] [Commented] (SPARK-5997) Increase partition count without performing a shuffle

[ https://issues.apache.org/jira/browse/SPARK-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603543#comment-14603543 ] Perinkulam I Ganesh commented on SPARK-5997: Hi .. New to Spark .. maybe spe

[jira] [Commented] (SPARK-8646) PySpark does not run on YARN

[ https://issues.apache.org/jira/browse/SPARK-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603523#comment-14603523 ] Marcelo Vanzin commented on SPARK-8646: --- bq. Still a module missing error, this time

[jira] [Comment Edited] (SPARK-2883) Spark Support for ORCFile format

[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603507#comment-14603507 ] Phil Claridge edited comment on SPARK-2883 at 6/26/15 8:08 PM: -

[jira] [Commented] (SPARK-2883) Spark Support for ORCFile format

[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603507#comment-14603507 ] Phil Claridge commented on SPARK-2883: -- Took your data frame.write.format sample and

[jira] [Commented] (SPARK-2883) Spark Support for ORCFile format

[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603505#comment-14603505 ] Phil Claridge commented on SPARK-2883: -- Please can you provide link to text case? >

[jira] [Updated] (SPARK-8669) Parquet 1.7 files that store binary enums crash when inferring schema

[ https://issues.apache.org/jira/browse/SPARK-8669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8669: Shepherd: Cheng Lian > Parquet 1.7 files that store binary enums crash when inferring schema > -

[jira] [Commented] (SPARK-8669) Parquet 1.7 files that store binary enums crash when inferring schema

[ https://issues.apache.org/jira/browse/SPARK-8669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603470#comment-14603470 ] Steven She commented on SPARK-8669: --- https://github.com/apache/spark/pull/7048 > Parque

[jira] [Assigned] (SPARK-8669) Parquet 1.7 files that store binary enums crash when inferring schema

[ https://issues.apache.org/jira/browse/SPARK-8669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8669: --- Assignee: Apache Spark > Parquet 1.7 files that store binary enums crash when inferring schem

[jira] [Assigned] (SPARK-8669) Parquet 1.7 files that store binary enums crash when inferring schema

[ https://issues.apache.org/jira/browse/SPARK-8669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8669: --- Assignee: (was: Apache Spark) > Parquet 1.7 files that store binary enums crash when infe

[jira] [Commented] (SPARK-8669) Parquet 1.7 files that store binary enums crash when inferring schema

[ https://issues.apache.org/jira/browse/SPARK-8669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603471#comment-14603471 ] Apache Spark commented on SPARK-8669: - User 'stevencanopy' has created a pull request

[jira] [Created] (SPARK-8669) Parquet 1.7 files that store binary enums crash when inferring schema

Steven She created SPARK-8669: - Summary: Parquet 1.7 files that store binary enums crash when inferring schema Key: SPARK-8669 URL: https://issues.apache.org/jira/browse/SPARK-8669 Project: Spark

[jira] [Commented] (SPARK-8662) [SparkR] SparkSQL tests fail in R 3.2

[ https://issues.apache.org/jira/browse/SPARK-8662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603437#comment-14603437 ] Shivaram Venkataraman commented on SPARK-8662: -- Thanks [~srowen] ! I was able

[jira] [Updated] (SPARK-8662) [SparkR] SparkSQL tests fail in R 3.2

[ https://issues.apache.org/jira/browse/SPARK-8662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8662: - Assignee: Chris Freeman > [SparkR] SparkSQL tests fail in R 3.2 >

[jira] [Commented] (SPARK-8662) [SparkR] SparkSQL tests fail in R 3.2

[ https://issues.apache.org/jira/browse/SPARK-8662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603412#comment-14603412 ] Sean Owen commented on SPARK-8662: -- [~shivaram] you should be able to add to Contributors

[jira] [Created] (SPARK-8668) expr function to convert SQL expression into a Column

Reynold Xin created SPARK-8668: -- Summary: expr function to convert SQL expression into a Column Key: SPARK-8668 URL: https://issues.apache.org/jira/browse/SPARK-8668 Project: Spark Issue Type: S

[jira] [Commented] (SPARK-6196) Add MAPR 4.0.2 support to the build

[ https://issues.apache.org/jira/browse/SPARK-6196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603359#comment-14603359 ] Apache Spark commented on SPARK-6196: - User 'trystanleftwich' has created a pull reque

[jira] [Commented] (SPARK-8639) Instructions for executing jekyll in docs/README.md could be slightly more clear, typo in docs/api.md

[ https://issues.apache.org/jira/browse/SPARK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603336#comment-14603336 ] Apache Spark commented on SPARK-8639: - User 'Rosstin' has created a pull request for t

[jira] [Assigned] (SPARK-8639) Instructions for executing jekyll in docs/README.md could be slightly more clear, typo in docs/api.md

[ https://issues.apache.org/jira/browse/SPARK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8639: --- Assignee: (was: Apache Spark) > Instructions for executing jekyll in docs/README.md could

[jira] [Commented] (SPARK-8639) Instructions for executing jekyll in docs/README.md could be slightly more clear, typo in docs/api.md

[ https://issues.apache.org/jira/browse/SPARK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1460#comment-1460 ] Rosstin Murphy commented on SPARK-8639: --- Will fix these minor typos. > Instructions

[jira] [Assigned] (SPARK-8639) Instructions for executing jekyll in docs/README.md could be slightly more clear, typo in docs/api.md

[ https://issues.apache.org/jira/browse/SPARK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8639: --- Assignee: Apache Spark > Instructions for executing jekyll in docs/README.md could be slightl

[jira] [Updated] (SPARK-8484) Add TrainValidationSplit to ml.tuning

[ https://issues.apache.org/jira/browse/SPARK-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8484: - Shepherd: Ram Sriharsha (was: Xiangrui Meng) > Add TrainValidationSplit to ml.tuning > --

[jira] [Updated] (SPARK-5962) [MLLIB] Python support for Power Iteration Clustering

[ https://issues.apache.org/jira/browse/SPARK-5962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5962: - Shepherd: Xiangrui Meng > [MLLIB] Python support for Power Iteration Clustering >

[jira] [Updated] (SPARK-5962) [MLLIB] Python support for Power Iteration Clustering

[ https://issues.apache.org/jira/browse/SPARK-5962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5962: - Assignee: Yanbo Liang (was: Stephen Boesch) > [MLLIB] Python support for Power Iteration Clusteri

[jira] [Comment Edited] (SPARK-8647) Potential issues with the constant hashCode

[ https://issues.apache.org/jira/browse/SPARK-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603302#comment-14603302 ] Alok Singh edited comment on SPARK-8647 at 6/26/15 5:53 PM: Hi

  1   2   3   >