[jira] [Updated] (SPARK-5645) Track local bytes read for shuffles - update UI

[ https://issues.apache.org/jira/browse/SPARK-5645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-5645: -- Assignee: Kostas Sakellis > Track local bytes read for shuffles - update UI > --

[jira] [Updated] (SPARK-5646) Record output metrics for cache

[ https://issues.apache.org/jira/browse/SPARK-5646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-5646: -- Assignee: Kostas Sakellis > Record output metrics for cache > --- > >

[jira] [Resolved] (SPARK-4942) ML Transformers should allow output cols to be turned on,off

[ https://issues.apache.org/jira/browse/SPARK-4942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4942. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3637 [https://githu

[jira] [Resolved] (SPARK-5031) ml.LogisticRegression score column should be renamed probability

[ https://issues.apache.org/jira/browse/SPARK-5031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5031. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3637 [https://githu

[jira] [Resolved] (SPARK-4789) Standardize ML Prediction APIs

[ https://issues.apache.org/jira/browse/SPARK-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4789. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3637 [https://githu

[jira] [Created] (SPARK-5647) Output metrics do not show up for older hadoop versions (< 2.5)

Kostas Sakellis created SPARK-5647: -- Summary: Output metrics do not show up for older hadoop versions (< 2.5) Key: SPARK-5647 URL: https://issues.apache.org/jira/browse/SPARK-5647 Project: Spark

[jira] [Created] (SPARK-5646) Record output metrics for cache

Kostas Sakellis created SPARK-5646: -- Summary: Record output metrics for cache Key: SPARK-5646 URL: https://issues.apache.org/jira/browse/SPARK-5646 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-5645) Track local bytes read for shuffles - update UI

Kostas Sakellis created SPARK-5645: -- Summary: Track local bytes read for shuffles - update UI Key: SPARK-5645 URL: https://issues.apache.org/jira/browse/SPARK-5645 Project: Spark Issue Type:

[jira] [Commented] (SPARK-5635) Allow users to run .scala files directly from spark-submit

[ https://issues.apache.org/jira/browse/SPARK-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308776#comment-14308776 ] Sean Owen commented on SPARK-5635: -- spark-shell uses spark-submit, and spark-shell is the

[jira] [Resolved] (SPARK-926) spark_ec2 script when ssh/scp-ing should pipe UserknowHostFile to /dev/null

[ https://issues.apache.org/jira/browse/SPARK-926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-926. - Resolution: Duplicate Going to make this one the duplicate since SPARK-5403 has an active PR. > spark_ec2

[jira] [Commented] (SPARK-5566) Tokenizer for mllib package

[ https://issues.apache.org/jira/browse/SPARK-5566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308733#comment-14308733 ] yuhao yang commented on SPARK-5566: --- I mean only the underlying implementation. > Toke

[jira] [Resolved] (SPARK-5639) Support DataFrame.renameColumn

[ https://issues.apache.org/jira/browse/SPARK-5639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5639. Resolution: Fixed Fix Version/s: 1.3.0 > Support DataFrame.renameColumn > ---

[jira] [Commented] (SPARK-5644) Delete tmp dir when sc is stop

[ https://issues.apache.org/jira/browse/SPARK-5644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308719#comment-14308719 ] Apache Spark commented on SPARK-5644: - User 'Sephiroth-Lin' has created a pull request

[jira] [Created] (SPARK-5644) Delete tmp dir when sc is stop

Weizhong created SPARK-5644: --- Summary: Delete tmp dir when sc is stop Key: SPARK-5644 URL: https://issues.apache.org/jira/browse/SPARK-5644 Project: Spark Issue Type: Improvement Componen

[jira] [Commented] (SPARK-5598) Model import/export for ALS

[ https://issues.apache.org/jira/browse/SPARK-5598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308692#comment-14308692 ] Sean Owen commented on SPARK-5598: -- [~mengxr] No, no other tool could usefully read such

[jira] [Resolved] (SPARK-5625) Spark binaries do not incude Spark Core

[ https://issues.apache.org/jira/browse/SPARK-5625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5625. -- Resolution: Not a Problem All of these distributions include an assembly JAR with the entire Spark code

[jira] [Resolved] (SPARK-5531) Spark download .tgz file does not get unpacked

[ https://issues.apache.org/jira/browse/SPARK-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5531. -- Resolution: Not a Problem > Spark download .tgz file does not get unpacked > ---

[jira] [Resolved] (SPARK-5631) Server IPC version 7 cannot communicate with client version 4

[ https://issues.apache.org/jira/browse/SPARK-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5631. -- Resolution: Not a Problem The right place to ask questions and discuss this is the mailing list. This m

[jira] [Updated] (SPARK-5563) LDA with online variational inference

[ https://issues.apache.org/jira/browse/SPARK-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dai updated SPARK-5563: - Assignee: yuhao yang > LDA with online variational inference > - > >

[jira] [Commented] (SPARK-4808) Spark fails to spill with small number of large objects

[ https://issues.apache.org/jira/browse/SPARK-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308677#comment-14308677 ] Apache Spark commented on SPARK-4808: - User 'mingyukim' has created a pull request for

[jira] [Comment Edited] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308599#comment-14308599 ] Andrew Or edited comment on SPARK-5388 at 2/6/15 5:35 AM: -- By the

[jira] [Commented] (SPARK-4279) Implementing TinkerPop on top of GraphX

[ https://issues.apache.org/jira/browse/SPARK-4279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308651#comment-14308651 ] Sean Owen commented on SPARK-4279: -- This sounds like something that should live outside S

[jira] [Commented] (SPARK-3185) SPARK launch on Hadoop 2 in EC2 throws Tachyon exception when Formatting JOURNAL_FOLDER

[ https://issues.apache.org/jira/browse/SPARK-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308644#comment-14308644 ] Florian Verhein commented on SPARK-3185: [~dvohra] Sure, but the exception is thro

[jira] [Commented] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308635#comment-14308635 ] Patrick Wendell commented on SPARK-5388: I think it's reasonable to use DELETE per

[jira] [Commented] (SPARK-5391) SparkSQL fails to create tables with custom JSON SerDe

[ https://issues.apache.org/jira/browse/SPARK-5391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308627#comment-14308627 ] Muthupandi K commented on SPARK-5391: - Same error occoured when a table is created wit

[jira] [Comment Edited] (SPARK-5391) SparkSQL fails to create tables with custom JSON SerDe

[ https://issues.apache.org/jira/browse/SPARK-5391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308627#comment-14308627 ] Muthupandi K edited comment on SPARK-5391 at 2/6/15 5:13 AM: -

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308619#comment-14308619 ] Pedro Rodriguez commented on SPARK-5556: I will read that paper, seems interesting

[jira] [Commented] (SPARK-5081) Shuffle write increases

[ https://issues.apache.org/jira/browse/SPARK-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308620#comment-14308620 ] Kevin Jung commented on SPARK-5081: --- To test under the same condition, I set this to sna

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308615#comment-14308615 ] Guoqiang Li commented on SPARK-5556: LightLDA's computational complexity is O(1) The

[jira] [Commented] (SPARK-5081) Shuffle write increases

[ https://issues.apache.org/jira/browse/SPARK-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308608#comment-14308608 ] Kevin Jung commented on SPARK-5081: --- Sorry, I will make an effort to provide another cod

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308603#comment-14308603 ] Pedro Rodriguez commented on SPARK-5556: Posting here as a status update. I will b

[jira] [Commented] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308599#comment-14308599 ] Andrew Or commented on SPARK-5388: -- By the way for the more specific comments it would be

[jira] [Commented] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308598#comment-14308598 ] Andrew Or commented on SPARK-5388: -- [~tigerquoll] I still don't think we should use DELET

[jira] [Commented] (SPARK-5081) Shuffle write increases

[ https://issues.apache.org/jira/browse/SPARK-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308596#comment-14308596 ] Shekhar Bansal commented on SPARK-5081: --- I faced same problem, moving to lz4 compres

[jira] [Commented] (SPARK-4279) Implementing TinkerPop on top of GraphX

[ https://issues.apache.org/jira/browse/SPARK-4279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308595#comment-14308595 ] Jianshi Huang commented on SPARK-4279: -- Anyone is working on this? > Implementing Ti

[jira] [Commented] (SPARK-5563) LDA with online variational inference

[ https://issues.apache.org/jira/browse/SPARK-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308584#comment-14308584 ] Apache Spark commented on SPARK-5563: - User 'hhbyyh' has created a pull request for th

[jira] [Commented] (SPARK-5616) Add examples for PySpark API

[ https://issues.apache.org/jira/browse/SPARK-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308555#comment-14308555 ] Apache Spark commented on SPARK-5616: - User 'lazyman500' has created a pull request fo

[jira] [Commented] (SPARK-5643) Add a show method to print the content of a DataFrame in columnar format

[ https://issues.apache.org/jira/browse/SPARK-5643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308543#comment-14308543 ] Apache Spark commented on SPARK-5643: - User 'rxin' has created a pull request for this

[jira] [Created] (SPARK-5643) Add a show method to print the content of a DataFrame in columnar format

Reynold Xin created SPARK-5643: -- Summary: Add a show method to print the content of a DataFrame in columnar format Key: SPARK-5643 URL: https://issues.apache.org/jira/browse/SPARK-5643 Project: Spark

[jira] [Commented] (SPARK-5642) Apply column pruning on unused aggregation fields

[ https://issues.apache.org/jira/browse/SPARK-5642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308526#comment-14308526 ] Apache Spark commented on SPARK-5642: - User 'adrian-wang' has created a pull request f

[jira] [Created] (SPARK-5642) Apply column pruning on unused aggregation fields

Adrian Wang created SPARK-5642: -- Summary: Apply column pruning on unused aggregation fields Key: SPARK-5642 URL: https://issues.apache.org/jira/browse/SPARK-5642 Project: Spark Issue Type: Impro

[jira] [Commented] (SPARK-5628) Add option to return spark-ec2 version

[ https://issues.apache.org/jira/browse/SPARK-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308500#comment-14308500 ] Apache Spark commented on SPARK-5628: - User 'nchammas' has created a pull request for

[jira] [Commented] (SPARK-5607) NullPointerException in objenesis

[ https://issues.apache.org/jira/browse/SPARK-5607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308493#comment-14308493 ] Patrick Wendell commented on SPARK-5607: I've reverted my patch since it may have

[jira] [Reopened] (SPARK-5607) NullPointerException in objenesis

[ https://issues.apache.org/jira/browse/SPARK-5607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-5607: > NullPointerException in objenesis > - > > Key:

[jira] [Commented] (SPARK-5626) Spurious test failures due to NullPointerException in EasyMock test code

[ https://issues.apache.org/jira/browse/SPARK-5626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308482#comment-14308482 ] Patrick Wendell commented on SPARK-5626: [~joshrosen] I may have caused this by me

[jira] [Commented] (SPARK-5631) Server IPC version 7 cannot communicate with client version 4

[ https://issues.apache.org/jira/browse/SPARK-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308475#comment-14308475 ] DeepakVohra commented on SPARK-5631: The Spark is built with Hadoop 2.0 spark-assembly

[jira] [Commented] (SPARK-3185) SPARK launch on Hadoop 2 in EC2 throws Tachyon exception when Formatting JOURNAL_FOLDER

[ https://issues.apache.org/jira/browse/SPARK-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308471#comment-14308471 ] DeepakVohra commented on SPARK-3185: The Spark is built with Hadoop 2.0 spark-assembly

[jira] [Resolved] (SPARK-5557) Servlet API classes now missing after jetty shading

[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5557. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Patrick Wendell > Servlet A

[jira] [Resolved] (SPARK-5638) Add a config flag to disable eager analysis of DataFrames

[ https://issues.apache.org/jira/browse/SPARK-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5638. Resolution: Fixed Fix Version/s: 1.3.0 > Add a config flag to disable eager analysis of DataF

[jira] [Created] (SPARK-5641) Allow spark_ec2.py to copy arbitrary files to cluster via deploy.generic

Florian Verhein created SPARK-5641: -- Summary: Allow spark_ec2.py to copy arbitrary files to cluster via deploy.generic Key: SPARK-5641 URL: https://issues.apache.org/jira/browse/SPARK-5641 Project: S

[jira] [Commented] (SPARK-5598) Model import/export for ALS

[ https://issues.apache.org/jira/browse/SPARK-5598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308433#comment-14308433 ] Xiangrui Meng commented on SPARK-5598: -- [~srowen] Do you expect the produced PMML fil

[jira] [Created] (SPARK-5640) org.apache.spark.sql.catalyst.ScalaReflection is not thread safe

Tobias Schlatter created SPARK-5640: --- Summary: org.apache.spark.sql.catalyst.ScalaReflection is not thread safe Key: SPARK-5640 URL: https://issues.apache.org/jira/browse/SPARK-5640 Project: Spark

[jira] [Commented] (SPARK-5607) NullPointerException in objenesis

[ https://issues.apache.org/jira/browse/SPARK-5607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308423#comment-14308423 ] Patrick Wendell commented on SPARK-5607: This may have actually caused more of an

[jira] [Comment Edited] (SPARK-5637) Expose spark_ec2 as as StarCluster Plugin

[ https://issues.apache.org/jira/browse/SPARK-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308394#comment-14308394 ] Nicholas Chammas edited comment on SPARK-5637 at 2/6/15 1:19 AM: ---

[jira] [Comment Edited] (SPARK-5335) Destroying cluster in VPC with "--delete-groups" fails to remove security groups

[ https://issues.apache.org/jira/browse/SPARK-5335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308133#comment-14308133 ] Nicholas Chammas edited comment on SPARK-5335 at 2/6/15 1:15 AM: ---

[jira] [Commented] (SPARK-5637) Expose spark_ec2 as as StarCluster Plugin

[ https://issues.apache.org/jira/browse/SPARK-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308394#comment-14308394 ] Nicholas Chammas commented on SPARK-5637: - [~agrothberg] - Can you expand on how t

[jira] [Commented] (SPARK-5557) Servlet API classes now missing after jetty shading

[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308391#comment-14308391 ] Patrick Wendell commented on SPARK-5557: I'm sorry that this affected so many peop

[jira] [Comment Edited] (SPARK-5557) Servlet API classes now missing after jetty shading

[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308391#comment-14308391 ] Patrick Wendell edited comment on SPARK-5557 at 2/6/15 1:07 AM:

[jira] [Commented] (SPARK-5557) Servlet API classes now missing after jetty shading

[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308378#comment-14308378 ] Apache Spark commented on SPARK-5557: - User 'pwendell' has created a pull request for

[jira] [Updated] (SPARK-5637) Expose spark_ec2 as as StarCluster Plugin

[ https://issues.apache.org/jira/browse/SPARK-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5637: Component/s: EC2 > Expose spark_ec2 as as StarCluster Plugin > -

[jira] [Commented] (SPARK-5557) Servlet API classes now missing after jetty shading

[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308374#comment-14308374 ] Kostas Sakellis commented on SPARK-5557: [~pwendell] recommended this which did th

[jira] [Updated] (SPARK-5557) Servlet API classes now missing after jetty shading

[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5557: --- Summary: Servlet API classes now missing after jetty shading (was: spark-shell failed to star

[jira] [Commented] (SPARK-5557) spark-shell failed to start

[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308346#comment-14308346 ] Patrick Wendell commented on SPARK-5557: I can send a fix for this shortly. It als

[jira] [Resolved] (SPARK-5620) Group methods in generated unidoc

[ https://issues.apache.org/jira/browse/SPARK-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5620. Resolution: Fixed Fix Version/s: 1.3.0 > Group methods in generated unidoc >

[jira] [Commented] (SPARK-5639) Support DataFrame.renameColumn

[ https://issues.apache.org/jira/browse/SPARK-5639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308328#comment-14308328 ] Apache Spark commented on SPARK-5639: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-3454) Expose JSON representation of data shown in WebUI

[ https://issues.apache.org/jira/browse/SPARK-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308324#comment-14308324 ] Marcelo Vanzin commented on SPARK-3454: --- Hi [~imranr], There are two ways I can see

[jira] [Created] (SPARK-5639) Support DataFrame.renameColumn

Reynold Xin created SPARK-5639: -- Summary: Support DataFrame.renameColumn Key: SPARK-5639 URL: https://issues.apache.org/jira/browse/SPARK-5639 Project: Spark Issue Type: Sub-task Compo

[jira] [Commented] (SPARK-5636) Lower dynamic allocation add interval

[ https://issues.apache.org/jira/browse/SPARK-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308288#comment-14308288 ] Apache Spark commented on SPARK-5636: - User 'andrewor14' has created a pull request fo

[jira] [Commented] (SPARK-5638) Add a config flag to disable eager analysis of DataFrames

[ https://issues.apache.org/jira/browse/SPARK-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308286#comment-14308286 ] Apache Spark commented on SPARK-5638: - User 'rxin' has created a pull request for this

[jira] [Created] (SPARK-5637) Expose spark_ec2 as as StarCluster Plugin

Alex Rothberg created SPARK-5637: Summary: Expose spark_ec2 as as StarCluster Plugin Key: SPARK-5637 URL: https://issues.apache.org/jira/browse/SPARK-5637 Project: Spark Issue Type: Improveme

[jira] [Created] (SPARK-5638) Add a config flag to disable eager analysis of DataFrames

Reynold Xin created SPARK-5638: -- Summary: Add a config flag to disable eager analysis of DataFrames Key: SPARK-5638 URL: https://issues.apache.org/jira/browse/SPARK-5638 Project: Spark Issue Typ

[jira] [Created] (SPARK-5636) Lower dynamic allocation add interval

Andrew Or created SPARK-5636: Summary: Lower dynamic allocation add interval Key: SPARK-5636 URL: https://issues.apache.org/jira/browse/SPARK-5636 Project: Spark Issue Type: Bug Compone

[jira] [Commented] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308263#comment-14308263 ] Marcelo Vanzin commented on SPARK-5388: --- Also, a fun fact about the Jersey dependenc

[jira] [Commented] (SPARK-5624) Can't find new column

[ https://issues.apache.org/jira/browse/SPARK-5624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308261#comment-14308261 ] Alex Liu commented on SPARK-5624: - Test it on the latest master branch it doesn't have thi

[jira] [Commented] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308260#comment-14308260 ] Marcelo Vanzin commented on SPARK-5388: --- Hi [~andrewor14], Thanks for updating the

[jira] [Resolved] (SPARK-3575) Hive Schema is ignored when using convertMetastoreParquet

[ https://issues.apache.org/jira/browse/SPARK-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3575. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4308 [https:/

[jira] [Resolved] (SPARK-5182) Partitioning support for tables created by the data source API

[ https://issues.apache.org/jira/browse/SPARK-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5182. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4308 [https:/

[jira] [Created] (SPARK-5635) Allow users to run .scala files directly from spark-submit

Grant Henke created SPARK-5635: -- Summary: Allow users to run .scala files directly from spark-submit Key: SPARK-5635 URL: https://issues.apache.org/jira/browse/SPARK-5635 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-5509) EqualTo operator doesn't handle binary type properly

[ https://issues.apache.org/jira/browse/SPARK-5509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5509. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4308 [https:/

[jira] [Resolved] (SPARK-5528) Support schema merging while reading Parquet files

[ https://issues.apache.org/jira/browse/SPARK-5528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5528. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4308 [https:/

[jira] [Resolved] (SPARK-5604) Remove setCheckpointDir from LDA and tree Strategy

[ https://issues.apache.org/jira/browse/SPARK-5604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5604. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4390 [https://githu

[jira] [Updated] (SPARK-5460) RandomForest should catch exceptions when removing checkpoint files

[ https://issues.apache.org/jira/browse/SPARK-5460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5460: - Assignee: Yuri Saito > RandomForest should catch exceptions when removing checkpoint files > -

[jira] [Resolved] (SPARK-5460) RandomForest should catch exceptions when removing checkpoint files

[ https://issues.apache.org/jira/browse/SPARK-5460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5460. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4347 [https://githu

[jira] [Commented] (SPARK-3454) Expose JSON representation of data shown in WebUI

[ https://issues.apache.org/jira/browse/SPARK-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308184#comment-14308184 ] Imran Rashid commented on SPARK-3454: - I just realized one potential issue with the ro

[jira] [Commented] (SPARK-5604) Remove setCheckpointDir from LDA and tree Strategy

[ https://issues.apache.org/jira/browse/SPARK-5604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308166#comment-14308166 ] Apache Spark commented on SPARK-5604: - User 'mengxr' has created a pull request for th

[jira] [Commented] (SPARK-5622) Add connector/handler hive configuration settings to hive-thrift-server

[ https://issues.apache.org/jira/browse/SPARK-5622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308141#comment-14308141 ] Apache Spark commented on SPARK-5622: - User 'alexliu68' has created a pull request for

[jira] [Commented] (SPARK-5335) Destroying cluster in VPC with "--delete-groups" fails to remove security groups

[ https://issues.apache.org/jira/browse/SPARK-5335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308133#comment-14308133 ] Nicholas Chammas commented on SPARK-5335: - For the record: [AWS says|https://foru

[jira] [Commented] (SPARK-5493) Support proxy users under kerberos

[ https://issues.apache.org/jira/browse/SPARK-5493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308131#comment-14308131 ] Apache Spark commented on SPARK-5493: - User 'vanzin' has created a pull request for th

[jira] [Commented] (SPARK-5633) pyspark saveAsTextFile support for compression codec

[ https://issues.apache.org/jira/browse/SPARK-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308128#comment-14308128 ] Vladimir Vladimirov commented on SPARK-5633: Here is a workaround before propo

[jira] [Created] (SPARK-5634) History server shows misleading message when there are no incomplete apps

Marcelo Vanzin created SPARK-5634: - Summary: History server shows misleading message when there are no incomplete apps Key: SPARK-5634 URL: https://issues.apache.org/jira/browse/SPARK-5634 Project: Sp

[jira] [Updated] (SPARK-5632) not able to resolve dot('.') in field name

[ https://issues.apache.org/jira/browse/SPARK-5632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lishu Liu updated SPARK-5632: - Description: My cassandra table task_trace has a field sm.result which contains dot in the name. So SQL t

[jira] [Commented] (SPARK-5620) Group methods in generated unidoc

[ https://issues.apache.org/jira/browse/SPARK-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308084#comment-14308084 ] Apache Spark commented on SPARK-5620: - User 'mengxr' has created a pull request for th

[jira] [Commented] (SPARK-5633) pyspark saveAsTextFile support for compression codec

[ https://issues.apache.org/jira/browse/SPARK-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308078#comment-14308078 ] Apache Spark commented on SPARK-5633: - User 'smartkiwi' has created a pull request for

[jira] [Commented] (SPARK-5633) pyspark saveAsTextFile support for compression codec

[ https://issues.apache.org/jira/browse/SPARK-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308077#comment-14308077 ] Vladimir Vladimirov commented on SPARK-5633: Here is pull request that adds me

[jira] [Created] (SPARK-5633) pyspark saveAsTextFile support for compression codec

Vladimir Vladimirov created SPARK-5633: -- Summary: pyspark saveAsTextFile support for compression codec Key: SPARK-5633 URL: https://issues.apache.org/jira/browse/SPARK-5633 Project: Spark

[jira] [Created] (SPARK-5632) not able to resolve dot('.') in field name

Lishu Liu created SPARK-5632: Summary: not able to resolve dot('.') in field name Key: SPARK-5632 URL: https://issues.apache.org/jira/browse/SPARK-5632 Project: Spark Issue Type: Bug Co

[jira] [Commented] (SPARK-5631) Server IPC version 7 cannot communicate with client version 4

[ https://issues.apache.org/jira/browse/SPARK-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308011#comment-14308011 ] DeepakVohra commented on SPARK-5631: Which CDH4 version and MR version is used for spa

[jira] [Commented] (SPARK-5631) Server IPC version 7 cannot communicate with client version 4

[ https://issues.apache.org/jira/browse/SPARK-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308005#comment-14308005 ] DeepakVohra commented on SPARK-5631: The error is due to a different version of CDH4 a

[jira] [Resolved] (SPARK-5135) Add support for describe [extended] table to DDL in SQLContext

[ https://issues.apache.org/jira/browse/SPARK-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5135. Resolution: Fixed > Add support for describe [extended] table to DDL in SQLContext > ---

[jira] [Created] (SPARK-5631) Server IPC version 7 cannot communicate with client version 4

DeepakVohra created SPARK-5631: -- Summary: Server IPC version 7 cannot communicate with client version 4 Key: SPARK-5631 URL: https://issues.apache.org/jira/browse/SPARK-5631 Project: Spark

  1   2   >