[jira] [Created] (SPARK-13386) ConnectedComponents should support maxIteration option

2016-02-19 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-13386: Summary: ConnectedComponents should support maxIteration option Key: SPARK-13386 URL: https://issues.apache.org/jira/browse/SPARK-13386 Project: Spark Issue

[jira] [Created] (SPARK-13387) Add support for SPARK_DAEMON_JAVA_OPTS with MesosClusterDispatcher.

2016-02-19 Thread Timothy Chen (JIRA)
Timothy Chen created SPARK-13387: Summary: Add support for SPARK_DAEMON_JAVA_OPTS with MesosClusterDispatcher. Key: SPARK-13387 URL: https://issues.apache.org/jira/browse/SPARK-13387 Project: Spark

[jira] [Commented] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153903#comment-15153903 ] Apache Spark commented on SPARK-12363: -- User 'viirya' has created a pull request for

[jira] [Commented] (SPARK-12343) Remove YARN Client / ClientArguments

2016-02-19 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153910#comment-15153910 ] Saisai Shao commented on SPARK-12343: - Hi guys, Do we still want to support users w

[jira] [Commented] (SPARK-12449) Pushing down arbitrary logical plans to data sources

2016-02-19 Thread Stephan Kessler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153920#comment-15153920 ] Stephan Kessler commented on SPARK-12449: - In our github repo (https://github.com

[jira] [Commented] (SPARK-12449) Pushing down arbitrary logical plans to data sources

2016-02-19 Thread Stephan Kessler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153931#comment-15153931 ] Stephan Kessler commented on SPARK-12449: - To keep the interfaces stable, the pos

[jira] [Commented] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153933#comment-15153933 ] Apache Spark commented on SPARK-12363: -- User 'viirya' has created a pull request for

[jira] [Created] (SPARK-13388) PySpark Pipeline and PipelineModel should take advantages of its Scala companion

2016-02-19 Thread Xusen Yin (JIRA)
Xusen Yin created SPARK-13388: - Summary: PySpark Pipeline and PipelineModel should take advantages of its Scala companion Key: SPARK-13388 URL: https://issues.apache.org/jira/browse/SPARK-13388 Project: S

[jira] [Created] (SPARK-13389) SparkR support first/last with ignore NAs

2016-02-19 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13389: --- Summary: SparkR support first/last with ignore NAs Key: SPARK-13389 URL: https://issues.apache.org/jira/browse/SPARK-13389 Project: Spark Issue Type: Improveme

[jira] [Assigned] (SPARK-13388) PySpark Pipeline and PipelineModel should take advantages of its Scala companion

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13388: Assignee: (was: Apache Spark) > PySpark Pipeline and PipelineModel should take advanta

[jira] [Assigned] (SPARK-13038) PySpark ml.pipeline support export/import

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13038: Assignee: (was: Apache Spark) > PySpark ml.pipeline support export/import > --

[jira] [Assigned] (SPARK-13038) PySpark ml.pipeline support export/import

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13038: Assignee: Apache Spark > PySpark ml.pipeline support export/import > -

[jira] [Commented] (SPARK-13038) PySpark ml.pipeline support export/import

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153949#comment-15153949 ] Apache Spark commented on SPARK-13038: -- User 'yinxusen' has created a pull request f

[jira] [Assigned] (SPARK-13388) PySpark Pipeline and PipelineModel should take advantages of its Scala companion

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13388: Assignee: Apache Spark > PySpark Pipeline and PipelineModel should take advantages of its

[jira] [Commented] (SPARK-13388) PySpark Pipeline and PipelineModel should take advantages of its Scala companion

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153950#comment-15153950 ] Apache Spark commented on SPARK-13388: -- User 'yinxusen' has created a pull request f

[jira] [Assigned] (SPARK-13389) SparkR support first/last with ignore NAs

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13389: Assignee: Apache Spark > SparkR support first/last with ignore NAs > -

[jira] [Commented] (SPARK-13389) SparkR support first/last with ignore NAs

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153955#comment-15153955 ] Apache Spark commented on SPARK-13389: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-13389) SparkR support first/last with ignore NAs

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13389: Assignee: (was: Apache Spark) > SparkR support first/last with ignore NAs > --

[jira] [Assigned] (SPARK-13386) ConnectedComponents should support maxIteration option

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13386: Assignee: Apache Spark > ConnectedComponents should support maxIteration option >

[jira] [Commented] (SPARK-13386) ConnectedComponents should support maxIteration option

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153974#comment-15153974 ] Apache Spark commented on SPARK-13386: -- User 'zhengruifeng' has created a pull reque

[jira] [Assigned] (SPARK-13386) ConnectedComponents should support maxIteration option

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13386: Assignee: (was: Apache Spark) > ConnectedComponents should support maxIteration option

[jira] [Created] (SPARK-13390) Java Spark createDataFrame with List parameter bug

2016-02-19 Thread mike niemaz (JIRA)
mike niemaz created SPARK-13390: --- Summary: Java Spark createDataFrame with List parameter bug Key: SPARK-13390 URL: https://issues.apache.org/jira/browse/SPARK-13390 Project: Spark Issue Type:

[jira] [Commented] (SPARK-8480) Add setName for Dataframe

2016-02-19 Thread Emlyn Corrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153988#comment-15153988 ] Emlyn Corrin commented on SPARK-8480: - This would be really useful. We have a fairly l

[jira] [Updated] (SPARK-13386) ConnectedComponents should support maxIteration option

2016-02-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13386: -- Priority: Minor (was: Major) > ConnectedComponents should support maxIteration option > --

[jira] [Updated] (SPARK-13387) Add support for SPARK_DAEMON_JAVA_OPTS with MesosClusterDispatcher.

2016-02-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13387: -- Priority: Minor (was: Major) Component/s: Mesos [~tnachen] please set component/priority. > Ad

[jira] [Commented] (SPARK-13375) PySpark API Utils missing item: kFold

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154008#comment-15154008 ] Apache Spark commented on SPARK-13375: -- User 'davies' has created a pull request for

[jira] [Resolved] (SPARK-13378) Add tee method to RDD

2016-02-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13378. --- Resolution: Not A Problem No, we don't want to do this. You'd end up making hundreds of methods to "d

[jira] [Updated] (SPARK-13377) binaryFileRDD preferredLocations issue

2016-02-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13377: -- Priority: Minor (was: Blocker) Issue Type: Improvement (was: Bug) [~zhaozhang] never set blocke

[jira] [Commented] (SPARK-13363) Aggregator not working with DataFrame

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154034#comment-15154034 ] Apache Spark commented on SPARK-13363: -- User 'maropu' has created a pull request for

[jira] [Assigned] (SPARK-13363) Aggregator not working with DataFrame

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13363: Assignee: Apache Spark > Aggregator not working with DataFrame > -

[jira] [Assigned] (SPARK-13363) Aggregator not working with DataFrame

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13363: Assignee: (was: Apache Spark) > Aggregator not working with DataFrame > --

[jira] [Commented] (SPARK-8000) SQLContext.read.load() should be able to auto-detect input data

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154043#comment-15154043 ] Apache Spark commented on SPARK-8000: - User 'HyukjinKwon' has created a pull request f

[jira] [Assigned] (SPARK-8000) SQLContext.read.load() should be able to auto-detect input data

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8000: --- Assignee: (was: Apache Spark) > SQLContext.read.load() should be able to auto-detect inpu

[jira] [Assigned] (SPARK-8000) SQLContext.read.load() should be able to auto-detect input data

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8000: --- Assignee: Apache Spark > SQLContext.read.load() should be able to auto-detect input data > --

[jira] [Commented] (SPARK-8000) SQLContext.read.load() should be able to auto-detect input data

2016-02-19 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154044#comment-15154044 ] Takeshi Yamamuro commented on SPARK-8000: - Oh, it is a simple and good approach to

[jira] [Commented] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154047#comment-15154047 ] Sean Owen commented on SPARK-13379: --- (You can make these more descriptive -- it swaps L

[jira] [Commented] (SPARK-13241) add long--formatted timestamps to org.apache.spark.status.api.v1.ApplicationAttemptInfo

2016-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154052#comment-15154052 ] Steve Loughran commented on SPARK-13241: The REST API compatibility is described

[jira] [Resolved] (SPARK-13339) Clarify commutative / associative operator requirements for reduce, fold

2016-02-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13339. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 (was: 1.6.1, 2.0.0)

[jira] [Created] (SPARK-13391) Use Apache Arrow as In-memory columnar store implementation

2016-02-19 Thread JIRA
Maciej BryƄski created SPARK-13391: -- Summary: Use Apache Arrow as In-memory columnar store implementation Key: SPARK-13391 URL: https://issues.apache.org/jira/browse/SPARK-13391 Project: Spark

[jira] [Created] (SPARK-13392) KafkaSink for Metrics

2016-02-19 Thread UTKARSH BHATNAGAR (JIRA)
UTKARSH BHATNAGAR created SPARK-13392: - Summary: KafkaSink for Metrics Key: SPARK-13392 URL: https://issues.apache.org/jira/browse/SPARK-13392 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-13392) KafkaSink for Metrics

2016-02-19 Thread UTKARSH BHATNAGAR (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154085#comment-15154085 ] UTKARSH BHATNAGAR commented on SPARK-13392: --- Please assign me this issue. I hav

[jira] [Commented] (SPARK-13391) Use Apache Arrow as In-memory columnar store implementation

2016-02-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154145#comment-15154145 ] Sean Owen commented on SPARK-13391: --- Cc [~nongli] [~wesmckinn] yes I'm pretty sure othe

[jira] [Created] (SPARK-13393) Column mismatch issue in left_outer join using Spark DataFrame

2016-02-19 Thread Varadharajan (JIRA)
Varadharajan created SPARK-13393: Summary: Column mismatch issue in left_outer join using Spark DataFrame Key: SPARK-13393 URL: https://issues.apache.org/jira/browse/SPARK-13393 Project: Spark

[jira] [Created] (SPARK-13394) What is "java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.security.SimpleUserGroupsMapping not found"

2016-02-19 Thread Minwoo Kang (JIRA)
Minwoo Kang created SPARK-13394: --- Summary: What is "java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.security.SimpleUserGroupsMapping not found" Key: SPARK-13394 URL: https://is

[jira] [Resolved] (SPARK-13394) What is "java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.security.SimpleUserGroupsMapping not found"

2016-02-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13394. --- Resolution: Invalid Target Version/s: (was: 1.6.0) Read https://cwiki.apache.org/confluen

[jira] [Commented] (SPARK-13394) What is "java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.security.SimpleUserGroupsMapping not found"

2016-02-19 Thread Minwoo Kang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154251#comment-15154251 ] Minwoo Kang commented on SPARK-13394: - I am so sorry for doesn't read the url before

[jira] [Comment Edited] (SPARK-13394) What is "java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.security.SimpleUserGroupsMapping not found"

2016-02-19 Thread Minwoo Kang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154251#comment-15154251 ] Minwoo Kang edited comment on SPARK-13394 at 2/19/16 2:09 PM: -

[jira] [Commented] (SPARK-12583) spark shuffle fails with mesos after 2mins

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154262#comment-15154262 ] Apache Spark commented on SPARK-12583: -- User 'bbossy' has created a pull request for

[jira] [Commented] (SPARK-13382) Update PySpark testing notes

2016-02-19 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154375#comment-15154375 ] holdenk commented on SPARK-13382: - I'll make a PR for the in repo fix but I don't have wi

[jira] [Commented] (SPARK-13393) Column mismatch issue in left_outer join using Spark DataFrame

2016-02-19 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154393#comment-15154393 ] Herman van Hovell commented on SPARK-13393: --- I think you are encountering the f

[jira] [Updated] (SPARK-13395) Silence or skip unsafe deprecation warnings

2016-02-19 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-13395: Component/s: (was: Streaming) (was: Examples) > Silence or skip unsafe deprecation

[jira] [Created] (SPARK-13395) Silence or skip unsafe deprecation warnings

2016-02-19 Thread holdenk (JIRA)
holdenk created SPARK-13395: --- Summary: Silence or skip unsafe deprecation warnings Key: SPARK-13395 URL: https://issues.apache.org/jira/browse/SPARK-13395 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13396) Stop using our internal deprecated .metrics on ExceptionFailure instead use accumUpdates

2016-02-19 Thread holdenk (JIRA)
holdenk created SPARK-13396: --- Summary: Stop using our internal deprecated .metrics on ExceptionFailure instead use accumUpdates Key: SPARK-13396 URL: https://issues.apache.org/jira/browse/SPARK-13396 Projec

[jira] [Created] (SPARK-13397) Cleanup transient annotations which aren't being applied

2016-02-19 Thread holdenk (JIRA)
holdenk created SPARK-13397: --- Summary: Cleanup transient annotations which aren't being applied Key: SPARK-13397 URL: https://issues.apache.org/jira/browse/SPARK-13397 Project: Spark Issue Type: Su

[jira] [Created] (SPARK-13398) Move away from deprecated ThreadPoolTaskSupport

2016-02-19 Thread holdenk (JIRA)
holdenk created SPARK-13398: --- Summary: Move away from deprecated ThreadPoolTaskSupport Key: SPARK-13398 URL: https://issues.apache.org/jira/browse/SPARK-13398 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13399) Investigate type erasure warnings in CheckpointSuite

2016-02-19 Thread holdenk (JIRA)
holdenk created SPARK-13399: --- Summary: Investigate type erasure warnings in CheckpointSuite Key: SPARK-13399 URL: https://issues.apache.org/jira/browse/SPARK-13399 Project: Spark Issue Type: Improv

[jira] [Created] (SPARK-13400) Stop using deprecated Octal escape literals

2016-02-19 Thread holdenk (JIRA)
holdenk created SPARK-13400: --- Summary: Stop using deprecated Octal escape literals Key: SPARK-13400 URL: https://issues.apache.org/jira/browse/SPARK-13400 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13401) Fix SQL test warnings

2016-02-19 Thread holdenk (JIRA)
holdenk created SPARK-13401: --- Summary: Fix SQL test warnings Key: SPARK-13401 URL: https://issues.apache.org/jira/browse/SPARK-13401 Project: Spark Issue Type: Improvement Components: SQL

[jira] [Commented] (SPARK-13400) Stop using deprecated Octal escape literals

2016-02-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154479#comment-15154479 ] Sean Owen commented on SPARK-13400: --- Yeah all these are good. We need to zap virtually

[jira] [Commented] (SPARK-13400) Stop using deprecated Octal escape literals

2016-02-19 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154483#comment-15154483 ] holdenk commented on SPARK-13400: - oh yah for sure, I was going to try running some test

[jira] [Created] (SPARK-13402) List Spark R dependencies

2016-02-19 Thread holdenk (JIRA)
holdenk created SPARK-13402: --- Summary: List Spark R dependencies Key: SPARK-13402 URL: https://issues.apache.org/jira/browse/SPARK-13402 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-13402) List Spark R dependencies

2016-02-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154505#comment-15154505 ] Sean Owen commented on SPARK-13402: --- https://github.com/apache/spark/blob/master/docs/R

[jira] [Closed] (SPARK-13402) List Spark R dependencies

2016-02-19 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk closed SPARK-13402. --- Resolution: Not A Problem > List Spark R dependencies > - > > Key: SP

[jira] [Commented] (SPARK-13402) List Spark R dependencies

2016-02-19 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154507#comment-15154507 ] holdenk commented on SPARK-13402: - Oh let me close this, I was looking in the wrong place

[jira] [Created] (SPARK-13403) HiveConf used for SparkSQL is not based on the Hadoop configuration

2016-02-19 Thread Ryan Blue (JIRA)
Ryan Blue created SPARK-13403: - Summary: HiveConf used for SparkSQL is not based on the Hadoop configuration Key: SPARK-13403 URL: https://issues.apache.org/jira/browse/SPARK-13403 Project: Spark

[jira] [Commented] (SPARK-13403) HiveConf used for SparkSQL is not based on the Hadoop configuration

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154533#comment-15154533 ] Apache Spark commented on SPARK-13403: -- User 'rdblue' has created a pull request for

[jira] [Assigned] (SPARK-13403) HiveConf used for SparkSQL is not based on the Hadoop configuration

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13403: Assignee: Apache Spark > HiveConf used for SparkSQL is not based on the Hadoop configurati

[jira] [Assigned] (SPARK-13403) HiveConf used for SparkSQL is not based on the Hadoop configuration

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13403: Assignee: (was: Apache Spark) > HiveConf used for SparkSQL is not based on the Hadoop

[jira] [Assigned] (SPARK-13373) Generate code for sort merge join

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13373: Assignee: Davies Liu (was: Apache Spark) > Generate code for sort merge join > --

[jira] [Assigned] (SPARK-13373) Generate code for sort merge join

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13373: Assignee: Apache Spark (was: Davies Liu) > Generate code for sort merge join > --

[jira] [Commented] (SPARK-13373) Generate code for sort merge join

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154549#comment-15154549 ] Apache Spark commented on SPARK-13373: -- User 'davies' has created a pull request for

[jira] [Created] (SPARK-13404) Create the variables for input when it's used

2016-02-19 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13404: -- Summary: Create the variables for input when it's used Key: SPARK-13404 URL: https://issues.apache.org/jira/browse/SPARK-13404 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-13349) adding a split and union to a streaming application cause big performance hit

2016-02-19 Thread krishna ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154555#comment-15154555 ] krishna ramachandran commented on SPARK-13349: -- Hi Sean I posted to user@ 2

[jira] [Reopened] (SPARK-13349) adding a split and union to a streaming application cause big performance hit

2016-02-19 Thread krishna ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] krishna ramachandran reopened SPARK-13349: -- enabling "cache" for a DStream causes the app to run out of memory > adding a spl

[jira] [Assigned] (SPARK-13404) Create the variables for input when it's used

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13404: Assignee: Davies Liu (was: Apache Spark) > Create the variables for input when it's used

[jira] [Comment Edited] (SPARK-13349) adding a split and union to a streaming application cause big performance hit

2016-02-19 Thread krishna ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154558#comment-15154558 ] krishna ramachandran edited comment on SPARK-13349 at 2/19/16 6:01 PM:

[jira] [Commented] (SPARK-13404) Create the variables for input when it's used

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154559#comment-15154559 ] Apache Spark commented on SPARK-13404: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-13404) Create the variables for input when it's used

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13404: Assignee: Apache Spark (was: Davies Liu) > Create the variables for input when it's used

[jira] [Assigned] (SPARK-13304) Broadcast join with two ints could be very slow

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13304: Assignee: (was: Apache Spark) > Broadcast join with two ints could be very slow >

[jira] [Commented] (SPARK-13304) Broadcast join with two ints could be very slow

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154570#comment-15154570 ] Apache Spark commented on SPARK-13304: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-13304) Broadcast join with two ints could be very slow

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13304: Assignee: Apache Spark > Broadcast join with two ints could be very slow > ---

[jira] [Created] (SPARK-13405) Flaky test: o.a.s.sql.util.ContinuousQueryListenerSuite.event ordering

2016-02-19 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-13405: Summary: Flaky test: o.a.s.sql.util.ContinuousQueryListenerSuite.event ordering Key: SPARK-13405 URL: https://issues.apache.org/jira/browse/SPARK-13405 Project: Spark

[jira] [Updated] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2016-02-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-1405: - Description: Latent Dirichlet Allocation (a.k.a. LDA) is a topic model which extracts topics from

[jira] [Commented] (SPARK-13405) Flaky test: o.a.s.sql.util.ContinuousQueryListenerSuite.event ordering

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154580#comment-15154580 ] Apache Spark commented on SPARK-13405: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-13405) Flaky test: o.a.s.sql.util.ContinuousQueryListenerSuite.event ordering

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13405: Assignee: Shixiong Zhu (was: Apache Spark) > Flaky test: o.a.s.sql.util.ContinuousQueryLi

[jira] [Assigned] (SPARK-13405) Flaky test: o.a.s.sql.util.ContinuousQueryListenerSuite.event ordering

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13405: Assignee: Apache Spark (was: Shixiong Zhu) > Flaky test: o.a.s.sql.util.ContinuousQueryLi

[jira] [Updated] (SPARK-13405) Flaky test: o.a.s.sql.util.ContinuousQueryListenerSuite.event ordering

2016-02-19 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-13405: - Labels: flaky-test (was: ) > Flaky test: o.a.s.sql.util.ContinuousQueryListenerSuite.event order

[jira] [Updated] (SPARK-13375) PySpark API Utils missing item: kFold

2016-02-19 Thread Bruno Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Wu updated SPARK-13375: - Affects Version/s: (was: 1.6.0) 1.5.0 > PySpark API Utils missing item: kFold

[jira] [Commented] (SPARK-13341) Casting Unix timestamp to SQL timestamp fails

2016-02-19 Thread Srinivasa Reddy Vundela (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154694#comment-15154694 ] Srinivasa Reddy Vundela commented on SPARK-13341: - I guess the following

[jira] [Comment Edited] (SPARK-13046) Partitioning looks broken in 1.6

2016-02-19 Thread Julien Baley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152718#comment-15152718 ] Julien Baley edited comment on SPARK-13046 at 2/19/16 7:56 PM:

[jira] [Resolved] (SPARK-13384) Keep attribute qualifiers after dedup in Analyzer

2016-02-19 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13384. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11261 [htt

[jira] [Updated] (SPARK-13384) Keep attribute qualifiers after dedup in Analyzer

2016-02-19 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13384: - Assignee: Liang-Chi Hsieh > Keep attribute qualifiers after dedup in Analyzer > -

[jira] [Created] (SPARK-13406) NPE in LazilyGeneratedOrdering

2016-02-19 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13406: -- Summary: NPE in LazilyGeneratedOrdering Key: SPARK-13406 URL: https://issues.apache.org/jira/browse/SPARK-13406 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-13407) TaskMetrics.fromAccumulatorUpdates can crash when trying to access garbage-collected accumulators

2016-02-19 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-13407: -- Summary: TaskMetrics.fromAccumulatorUpdates can crash when trying to access garbage-collected accumulators Key: SPARK-13407 URL: https://issues.apache.org/jira/browse/SPARK-13407

[jira] [Commented] (SPARK-13407) TaskMetrics.fromAccumulatorUpdates can crash when trying to access garbage-collected accumulators

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154826#comment-15154826 ] Apache Spark commented on SPARK-13407: -- User 'JoshRosen' has created a pull request

[jira] [Commented] (SPARK-13387) Add support for SPARK_DAEMON_JAVA_OPTS with MesosClusterDispatcher.

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15154842#comment-15154842 ] Apache Spark commented on SPARK-13387: -- User 'tnachen' has created a pull request fo

[jira] [Assigned] (SPARK-13387) Add support for SPARK_DAEMON_JAVA_OPTS with MesosClusterDispatcher.

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13387: Assignee: Apache Spark > Add support for SPARK_DAEMON_JAVA_OPTS with MesosClusterDispatche

[jira] [Assigned] (SPARK-13387) Add support for SPARK_DAEMON_JAVA_OPTS with MesosClusterDispatcher.

2016-02-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13387: Assignee: (was: Apache Spark) > Add support for SPARK_DAEMON_JAVA_OPTS with MesosClust

[jira] [Created] (SPARK-13408) Exception in resultHandler will shutdown SparkContext

2016-02-19 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13408: -- Summary: Exception in resultHandler will shutdown SparkContext Key: SPARK-13408 URL: https://issues.apache.org/jira/browse/SPARK-13408 Project: Spark Issue Type:

[jira] [Created] (SPARK-13409) Remember the stacktrace when stop a SparkContext

2016-02-19 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13409: -- Summary: Remember the stacktrace when stop a SparkContext Key: SPARK-13409 URL: https://issues.apache.org/jira/browse/SPARK-13409 Project: Spark Issue Type: Bug

  1   2   >