[jira] [Commented] (SPARK-12895) Implement TaskMetrics using accumulators

2016-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107358#comment-15107358 ] Apache Spark commented on SPARK-12895: -- User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-12895) Implement TaskMetrics using accumulators

2016-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12895: Assignee: Andrew Or (was: Apache Spark) > Implement TaskMetrics using accumulators >

[jira] [Created] (SPARK-12909) Spark on Mesos accessing Secured HDFS w/Kerberos

2016-01-19 Thread Greg Senia (JIRA)
Greg Senia created SPARK-12909: -- Summary: Spark on Mesos accessing Secured HDFS w/Kerberos Key: SPARK-12909 URL: https://issues.apache.org/jira/browse/SPARK-12909 Project: Spark Issue Type: New

[jira] [Closed] (SPARK-12485) Rename "dynamic allocation" to "elastic scaling"

2016-01-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-12485. --- Resolution: Won't Fix I talked to Andrew more offline. Looks like this name isn't so bad that we have

[jira] [Updated] (SPARK-12908) Add tests to make sure that ml.classification.LogisticRegression returns meaningful result when labels are the same without intercept

2016-01-19 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-12908: Description: This will be only adding new tests as followup PR to https://github.com/apache/spark/pull/1074

[jira] [Created] (SPARK-12908) Add tests to make sure that ml.classification.LogisticRegression returns meaningful result when labels are the same without intercept

2016-01-19 Thread DB Tsai (JIRA)
DB Tsai created SPARK-12908: --- Summary: Add tests to make sure that ml.classification.LogisticRegression returns meaningful result when labels are the same without intercept Key: SPARK-12908 URL: https://issues.apache.o

[jira] [Resolved] (SPARK-12867) Nullability of Intersect can be stricter

2016-01-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-12867. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10812 [https://github.

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2016-01-19 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107267#comment-15107267 ] Mark Grover commented on SPARK-12177: - Thanks Mario! bq. We should also have a pytho

[jira] [Commented] (SPARK-12546) Writing to partitioned parquet table can fail with OOM

2016-01-19 Thread Nong Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107258#comment-15107258 ] Nong Li commented on SPARK-12546: - A better workaround might be to figure the max number

[jira] [Resolved] (SPARK-12804) ml.classification.LogisticRegression fails when FitIntercept with same-label dataset

2016-01-19 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-12804. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10743 [https://github.com/ap

[jira] [Commented] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

2016-01-19 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107203#comment-15107203 ] Josh Rosen commented on SPARK-12906: Ping [~zsxwing], since I know you've looked into

[jira] [Commented] (SPARK-12907) Use BitSet to represent null fields in ColumnVector

2016-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107200#comment-15107200 ] Apache Spark commented on SPARK-12907: -- User 'kiszk' has created a pull request for

[jira] [Assigned] (SPARK-12907) Use BitSet to represent null fields in ColumnVector

2016-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12907: Assignee: (was: Apache Spark) > Use BitSet to represent null fields in ColumnVector >

[jira] [Assigned] (SPARK-12907) Use BitSet to represent null fields in ColumnVector

2016-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12907: Assignee: Apache Spark > Use BitSet to represent null fields in ColumnVector > ---

[jira] [Resolved] (SPARK-12887) Do not expose var's in TaskMetrics

2016-01-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12887. --- Resolution: Fixed Fix Version/s: 2.0.0 > Do not expose var's in TaskMetrics >

[jira] [Commented] (SPARK-12783) Dataset map serialization error

2016-01-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107178#comment-15107178 ] Wenchen Fan commented on SPARK-12783: - hi [~babloo80], can you move `MyMap` and `Test

[jira] [Commented] (SPARK-12790) Remove HistoryServer old multiple files format

2016-01-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107169#comment-15107169 ] Andrew Or commented on SPARK-12790: --- I've assigned this to you. > Remove HistoryServer

[jira] [Updated] (SPARK-12790) Remove HistoryServer old multiple files format

2016-01-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12790: -- Assignee: Felix Cheung > Remove HistoryServer old multiple files format > -

[jira] [Commented] (SPARK-12790) Remove HistoryServer old multiple files format

2016-01-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107167#comment-15107167 ] Andrew Or commented on SPARK-12790: --- also updating all the tests that rely on the old f

[jira] [Updated] (SPARK-12870) better format bucket id in file name

2016-01-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12870: - Assignee: Wenchen Fan > better format bucket id in file name > > >

[jira] [Resolved] (SPARK-12870) better format bucket id in file name

2016-01-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12870. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10799 [https://github.com/

[jira] [Created] (SPARK-12907) Use BitSet to represent null fields in ColumnVector

2016-01-19 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-12907: Summary: Use BitSet to represent null fields in ColumnVector Key: SPARK-12907 URL: https://issues.apache.org/jira/browse/SPARK-12907 Project: Spark I

[jira] [Updated] (SPARK-12826) Spark Workers do not attempt reconnect or exit on connection failure.

2016-01-19 Thread Alan Braithwaite (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite updated SPARK-12826: - Priority: Critical (was: Major) > Spark Workers do not attempt reconnect or exit on conn

[jira] [Commented] (SPARK-12485) Rename "dynamic allocation" to "elastic scaling"

2016-01-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107151#comment-15107151 ] Andrew Or commented on SPARK-12485: --- [~srowen] to answer your question no I don't feel

[jira] [Resolved] (SPARK-11944) Python API for mllib.clustering.BisectingKMeans

2016-01-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-11944. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10150 [h

[jira] [Commented] (SPARK-12883) 1.6 Dynamic allocation document for removing executors with cached data differs in different sections

2016-01-19 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107085#comment-15107085 ] Saisai Shao commented on SPARK-12883: - I get your point now. But I think these two de

[jira] [Commented] (SPARK-12650) No means to specify Xmx settings for SparkSubmit in yarn-cluster mode

2016-01-19 Thread John Vines (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107061#comment-15107061 ] John Vines commented on SPARK-12650: SPARK_SUBMIT_OPTS seems to work. -Xmx256m change

[jira] [Commented] (SPARK-12883) 1.6 Dynamic allocation document for removing executors with cached data differs in different sections

2016-01-19 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107057#comment-15107057 ] Manoj Samel commented on SPARK-12883: - Updated Jira subject for more accurate reflect

[jira] [Updated] (SPARK-12883) 1.6 Dynamic allocation document for removing executors with cached data differs in different sections

2016-01-19 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SPARK-12883: Summary: 1.6 Dynamic allocation document for removing executors with cached data differs in differe

[jira] [Commented] (SPARK-12883) 1.6 Dynamic allocation doc still refers to 1.2

2016-01-19 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107042#comment-15107042 ] Manoj Samel commented on SPARK-12883: - Information about removing executors with cach

[jira] [Commented] (SPARK-12485) Rename "dynamic allocation" to "elastic scaling"

2016-01-19 Thread Mark Hamstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106966#comment-15106966 ] Mark Hamstra commented on SPARK-12485: -- Right, I am saying that "dynamic allocation"

[jira] [Commented] (SPARK-12485) Rename "dynamic allocation" to "elastic scaling"

2016-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106920#comment-15106920 ] Sean Owen commented on SPARK-12485: --- So you're suggesting "dynamic allocation" is a bet

[jira] [Commented] (SPARK-12485) Rename "dynamic allocation" to "elastic scaling"

2016-01-19 Thread Mark Hamstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106820#comment-15106820 ] Mark Hamstra commented on SPARK-12485: -- Actually, Sean, I'd argue that they are not

[jira] [Commented] (SPARK-12650) No means to specify Xmx settings for SparkSubmit in yarn-cluster mode

2016-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106786#comment-15106786 ] Sean Owen commented on SPARK-12650: --- [~jvi...@gmail.com] are you able to follow up on t

[jira] [Commented] (SPARK-1747) check for Spark on Yarn ApplicationMaster split brain

2016-01-19 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106784#comment-15106784 ] Thomas Graves commented on SPARK-1747: -- This should stay open. > check for Spark on

[jira] [Commented] (SPARK-3374) Spark on Yarn config cleanup

2016-01-19 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106766#comment-15106766 ] Thomas Graves commented on SPARK-3374: -- I think with 2.0 we should actually just remo

[jira] [Resolved] (SPARK-5238) Improve the robustness of Spark Streaming WAL mechanism

2016-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5238. -- Resolution: Done I detached the remaining issue and the rest is done > Improve the robustness of Spark

[jira] [Updated] (SPARK-5142) Possibly data may be ruined in Spark Streaming's WAL mechanism.

2016-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5142: - Issue Type: Bug (was: Sub-task) Parent: (was: SPARK-5238) > Possibly data may be ruined in Sp

[jira] [Resolved] (SPARK-6005) Flaky test: o.a.s.streaming.kafka.DirectKafkaStreamSuite.offset recovery

2016-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6005. -- Resolution: Not A Problem Given lack of updates, and that I can't recall seeing this fail in recent mem

[jira] [Resolved] (SPARK-6170) Add support for skew join

2016-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6170. -- Resolution: Won't Fix Given there's no activity and the proposer isn't going to implement, I think this

[jira] [Resolved] (SPARK-6140) Retain longForm call site information even when shortForm is overridden.

2016-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6140. -- Resolution: Not A Problem Maybe this was changed since, but it looks like the methods to set call site d

[jira] [Commented] (SPARK-4563) Allow spark driver to bind to different ip then advertise ip

2016-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106749#comment-15106749 ] Sean Owen commented on SPARK-4563: -- I don't think this will be implemented, but if you ca

[jira] [Resolved] (SPARK-3917) Compress data before network transfer

2016-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3917. -- Resolution: Won't Fix The narrow issue here is probably WontFix, as the issue is more about treatment o

[jira] [Commented] (SPARK-3374) Spark on Yarn config cleanup

2016-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106741#comment-15106741 ] Sean Owen commented on SPARK-3374: -- Is this moving forward -- what specifically needs to

[jira] [Commented] (SPARK-12485) Rename "dynamic allocation" to "elastic scaling"

2016-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106710#comment-15106710 ] Sean Owen commented on SPARK-12485: --- I think these are all arguably about the same, and

[jira] [Assigned] (SPARK-12485) Rename "dynamic allocation" to "elastic scaling"

2016-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12485: Assignee: Andrew Or (was: Apache Spark) > Rename "dynamic allocation" to "elastic scaling

[jira] [Commented] (SPARK-12485) Rename "dynamic allocation" to "elastic scaling"

2016-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106693#comment-15106693 ] Apache Spark commented on SPARK-12485: -- User 'somideshmukh' has created a pull reque

[jira] [Assigned] (SPARK-12485) Rename "dynamic allocation" to "elastic scaling"

2016-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12485: Assignee: Apache Spark (was: Andrew Or) > Rename "dynamic allocation" to "elastic scaling

[jira] [Comment Edited] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

2016-01-19 Thread Sasi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106599#comment-15106599 ] Sasi edited comment on SPARK-12906 at 1/19/16 11:14 AM: added dum

[jira] [Comment Edited] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

2016-01-19 Thread Sasi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106599#comment-15106599 ] Sasi edited comment on SPARK-12906 at 1/19/16 11:12 AM: added dum

[jira] [Issue Comment Deleted] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

2016-01-19 Thread Sasi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sasi updated SPARK-12906: - Comment: was deleted (was: added dumps ) > LongSQLMetricValue cause memory leak on Spark 1.5.1 > --

[jira] [Updated] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

2016-01-19 Thread Sasi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sasi updated SPARK-12906: - Attachment: dump1.PNG After GC. > LongSQLMetricValue cause memory leak on Spark 1.5.1 >

[jira] [Commented] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

2016-01-19 Thread Sasi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106596#comment-15106596 ] Sasi commented on SPARK-12906: -- added dumps > LongSQLMetricValue cause memory leak on Spa

[jira] [Commented] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

2016-01-19 Thread Sasi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106548#comment-15106548 ] Sasi commented on SPARK-12906: -- Hi, I'm running endless script that does query on my table u

[jira] [Commented] (SPARK-9976) create function do not work

2016-01-19 Thread ocean (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106517#comment-15106517 ] ocean commented on SPARK-9976: -- the second problem I just found that only function can not de

[jira] [Commented] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

2016-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106498#comment-15106498 ] Sean Owen commented on SPARK-12906: --- Please provide more detail. What leads you to thin

[jira] [Updated] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

2016-01-19 Thread Sasi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sasi updated SPARK-12906: - Attachment: screenshot-1.png > LongSQLMetricValue cause memory leak on Spark 1.5.1 >

[jira] [Created] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

2016-01-19 Thread Sasi (JIRA)
Sasi created SPARK-12906: Summary: LongSQLMetricValue cause memory leak on Spark 1.5.1 Key: SPARK-12906 URL: https://issues.apache.org/jira/browse/SPARK-12906 Project: Spark Issue Type: Bug Affec

[jira] [Commented] (SPARK-12904) Strength reduction for integer/decimal comparisons

2016-01-19 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106491#comment-15106491 ] Liang-Chi Hsieh commented on SPARK-12904: - Yeah. I would like to do. Thanks! > S

[jira] [Resolved] (SPARK-7683) Confusing behavior of fold function of RDD in pyspark

2016-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7683. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10771 [https://github.com/a

[jira] [Assigned] (SPARK-7683) Confusing behavior of fold function of RDD in pyspark

2016-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-7683: Assignee: Sean Owen > Confusing behavior of fold function of RDD in pyspark > -

[jira] [Commented] (SPARK-12892) Support plugging in Spark scheduler

2016-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106471#comment-15106471 ] Sean Owen commented on SPARK-12892: --- Do you intend some of the same stuff described in

[jira] [Resolved] (SPARK-12876) Race condition when driver rapidly shutdown after started.

2016-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12876. --- Resolution: Duplicate > Race condition when driver rapidly shutdown after started. >

[jira] [Commented] (SPARK-12897) spark ui with tachyon show all Stream Blocks

2016-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106458#comment-15106458 ] Sean Owen commented on SPARK-12897: --- It's not clear what you're describing. Can you say

[jira] [Assigned] (SPARK-12905) PCAModel return eigenvalues for PySpark

2016-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12905: Assignee: (was: Apache Spark) > PCAModel return eigenvalues for PySpark >

[jira] [Commented] (SPARK-12905) PCAModel return eigenvalues for PySpark

2016-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106444#comment-15106444 ] Apache Spark commented on SPARK-12905: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-12905) PCAModel return eigenvalues for PySpark

2016-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12905: Assignee: Apache Spark > PCAModel return eigenvalues for PySpark > ---

[jira] [Updated] (SPARK-12905) PCAModel return eigenvalues for PySpark

2016-01-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12905: Priority: Minor (was: Trivial) > PCAModel return eigenvalues for PySpark > ---

[jira] [Created] (SPARK-12905) PCAModel return eigenvalues for PySpark

2016-01-19 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12905: --- Summary: PCAModel return eigenvalues for PySpark Key: SPARK-12905 URL: https://issues.apache.org/jira/browse/SPARK-12905 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-12905) PCAModel return eigenvalues for PySpark

2016-01-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12905: Priority: Trivial (was: Minor) > PCAModel return eigenvalues for PySpark > ---

[jira] [Commented] (SPARK-12904) Strength reduction for integer/decimal comparisons

2016-01-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106436#comment-15106436 ] Reynold Xin commented on SPARK-12904: - [~viirya] maybe you can add this when you have

[jira] [Updated] (SPARK-12904) Strength reduction for integer/decimal comparisons

2016-01-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12904: Description: We can do the following strength reduction for comparisons between an integral column

[jira] [Created] (SPARK-12904) Strength reduction for integer/decimal comparisons

2016-01-19 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12904: --- Summary: Strength reduction for integer/decimal comparisons Key: SPARK-12904 URL: https://issues.apache.org/jira/browse/SPARK-12904 Project: Spark Issue Type:

[jira] [Updated] (SPARK-12848) Parse number as decimal rather than doubles

2016-01-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12848: Summary: Parse number as decimal rather than doubles (was: Parse number as decimal) > Parse numbe

[jira] [Updated] (SPARK-12848) Parse numbers as decimals rather than doubles

2016-01-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12848: Summary: Parse numbers as decimals rather than doubles (was: Parse number as decimal rather than d

[jira] [Assigned] (SPARK-12903) Add covar_samp and covar_pop for SparkR

2016-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12903: Assignee: (was: Apache Spark) > Add covar_samp and covar_pop for SparkR >

[jira] [Commented] (SPARK-12903) Add covar_samp and covar_pop for SparkR

2016-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106422#comment-15106422 ] Apache Spark commented on SPARK-12903: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-12903) Add covar_samp and covar_pop for SparkR

2016-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12903: Assignee: Apache Spark > Add covar_samp and covar_pop for SparkR > ---

[jira] [Created] (SPARK-12903) Add covar_samp and covar_pop for SparkR

2016-01-19 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12903: --- Summary: Add covar_samp and covar_pop for SparkR Key: SPARK-12903 URL: https://issues.apache.org/jira/browse/SPARK-12903 Project: Spark Issue Type: Improvement

<    1   2