[jira] [Resolved] (SPARK-13466) Don't introduce redundant project with colum pruning rule

2016-03-03 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13466. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11341 [https://github.

[jira] [Updated] (SPARK-13466) Don't introduce redundant project with colum pruning rule

2016-03-03 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13466: --- Assignee: Liang-Chi Hsieh > Don't introduce redundant project with colum pruning rule > -

[jira] [Updated] (SPARK-13466) Remove redundant project in colum pruning rule

2016-03-03 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13466: --- Issue Type: Improvement (was: Bug) Summary: Remove redundant project in colum pruning rule (w

[jira] [Created] (SPARK-13644) [SQL] add the source file name and line into Logger when an exception occurs in the generated code

2016-03-03 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-13644: Summary: [SQL] add the source file name and line into Logger when an exception occurs in the generated code Key: SPARK-13644 URL: https://issues.apache.org/jira/browse/SPA

[jira] [Resolved] (SPARK-13311) prettyString of IN is not good

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13311. --- Resolution: Duplicate > prettyString of IN is not good > -- > >

[jira] [Commented] (SPARK-13631) getPreferredLocations race condition in spark 1.6.0?

2016-03-03 Thread Andy Sloane (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177502#comment-15177502 ] Andy Sloane commented on SPARK-13631: - Further bisecting with the reduceLocality flag

[jira] [Updated] (SPARK-13311) prettyString of IN is not good

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13311: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > prettyString of IN is not goo

[jira] [Comment Edited] (SPARK-13631) getPreferredLocations race condition in spark 1.6.0?

2016-03-03 Thread Andy Sloane (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177502#comment-15177502 ] Andy Sloane edited comment on SPARK-13631 at 3/3/16 8:55 AM: -

[jira] [Commented] (SPARK-13631) getPreferredLocations race condition in spark 1.6.0?

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177508#comment-15177508 ] Sean Owen commented on SPARK-13631: --- (Propose it as a pull request) > getPreferredLoca

[jira] [Commented] (SPARK-13639) Statistics.colStats(rdd).mean and variance should handle NaN in the input vectors

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177510#comment-15177510 ] Sean Owen commented on SPARK-13639: --- I don't see a reason to silently ignore it, myself

[jira] [Commented] (SPARK-13628) Temporary intermediate output file should be renamed before copying to destination filesystem

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177512#comment-15177512 ] Sean Owen commented on SPARK-13628: --- I don't think that's a good idea in general, becau

[jira] [Resolved] (SPARK-13624) Documentation: "Spark 1.6.0 uses Scala 2.10", but in IntelliJ module names are "spark-xxx-2.11"

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13624. --- Resolution: Not A Problem > Documentation: "Spark 1.6.0 uses Scala 2.10", but in IntelliJ module name

[jira] [Reopened] (SPARK-13624) Documentation: "Spark 1.6.0 uses Scala 2.10", but in IntelliJ module names are "spark-xxx-2.11"

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-13624: --- > Documentation: "Spark 1.6.0 uses Scala 2.10", but in IntelliJ module names > are "spark-xxx-2.11" > --

[jira] [Updated] (SPARK-13618) Make Streaming web UI display rate-limit lines in the statistics graph

2016-03-03 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated SPARK-13618: -- Description: This JIRA propose to make Streaming web UI display rate-limit lines in the statistics gra

[jira] [Created] (SPARK-13645) DAG Diagram not shown properly in Chrome

2016-03-03 Thread Todd Leo (JIRA)
Todd Leo created SPARK-13645: Summary: DAG Diagram not shown properly in Chrome Key: SPARK-13645 URL: https://issues.apache.org/jira/browse/SPARK-13645 Project: Spark Issue Type: Bug Co

[jira] [Updated] (SPARK-13642) Inconsistent finishing state between driver and AM

2016-03-03 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-13642: Description: Currently when running Spark on Yarn with yarn cluster mode, the default application

[jira] [Updated] (SPARK-13642) Inconsistent finishing state between driver and AM

2016-03-03 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-13642: Description: Currently when running Spark on Yarn with yarn cluster mode, the default application

[jira] [Updated] (SPARK-13645) DAG Diagram not shown properly in Chrome

2016-03-03 Thread Todd Leo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Leo updated SPARK-13645: - Description: In my Chrome 49, the execution DAG diagram can't be shown properly. Only a few grey dots la

[jira] [Updated] (SPARK-13645) DAG Diagram not shown properly in Chrome

2016-03-03 Thread Todd Leo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Leo updated SPARK-13645: - Attachment: Slack for iOS Upload.jpg > DAG Diagram not shown properly in Chrome > ---

[jira] [Updated] (SPARK-13645) DAG Diagram not shown properly in Chrome

2016-03-03 Thread Todd Leo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Leo updated SPARK-13645: - Description: In my Chrome 49, the execution DAG diagram can't be shown properly. Only a few grey dots la

[jira] [Created] (SPARK-13646) QuantileDiscretizer counts dataset twice in getSampledInput

2016-03-03 Thread Abou Haydar Elias (JIRA)
Abou Haydar Elias created SPARK-13646: - Summary: QuantileDiscretizer counts dataset twice in getSampledInput Key: SPARK-13646 URL: https://issues.apache.org/jira/browse/SPARK-13646 Project: Spark

[jira] [Commented] (SPARK-13646) QuantileDiscretizer counts dataset twice in getSampledInput

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177561#comment-15177561 ] Sean Owen commented on SPARK-13646: --- Yeah you can open a PR to improve that. > Quantil

[jira] [Commented] (SPARK-13117) WebUI should use the local ip not 0.0.0.0

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177571#comment-15177571 ] Apache Spark commented on SPARK-13117: -- User 'devaraj-kavali' has created a pull req

[jira] [Commented] (SPARK-13646) QuantileDiscretizer counts dataset twice in getSampledInput

2016-03-03 Thread Abou Haydar Elias (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177573#comment-15177573 ] Abou Haydar Elias commented on SPARK-13646: --- I'm trying to run the ./dev/run-te

[jira] [Updated] (SPARK-13646) QuantileDiscretizer counts dataset twice in getSampledInput

2016-03-03 Thread Abou Haydar Elias (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abou Haydar Elias updated SPARK-13646: -- Description: getSampledInput counts the dataset twice as you see here : [https://githu

[jira] [Resolved] (SPARK-13423) Static analysis fixes for 2.x

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13423. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11292 [https://github.co

[jira] [Created] (SPARK-13647) also check if numeric value is within allowed range in _verify_type

2016-03-03 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-13647: --- Summary: also check if numeric value is within allowed range in _verify_type Key: SPARK-13647 URL: https://issues.apache.org/jira/browse/SPARK-13647 Project: Spark

[jira] [Commented] (SPARK-13646) QuantileDiscretizer counts dataset twice in getSampledInput

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177594#comment-15177594 ] Apache Spark commented on SPARK-13646: -- User 'eliasah' has created a pull request fo

[jira] [Assigned] (SPARK-13646) QuantileDiscretizer counts dataset twice in getSampledInput

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13646: Assignee: (was: Apache Spark) > QuantileDiscretizer counts dataset twice in getSampled

[jira] [Assigned] (SPARK-13646) QuantileDiscretizer counts dataset twice in getSampledInput

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13646: Assignee: Apache Spark > QuantileDiscretizer counts dataset twice in getSampledInput > ---

[jira] [Assigned] (SPARK-13647) also check if numeric value is within allowed range in _verify_type

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13647: Assignee: Apache Spark > also check if numeric value is within allowed range in _verify_ty

[jira] [Assigned] (SPARK-13647) also check if numeric value is within allowed range in _verify_type

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13647: Assignee: (was: Apache Spark) > also check if numeric value is within allowed range in

[jira] [Commented] (SPARK-13647) also check if numeric value is within allowed range in _verify_type

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177604#comment-15177604 ] Apache Spark commented on SPARK-13647: -- User 'cloud-fan' has created a pull request

[jira] [Resolved] (SPARK-13583) Remove unused imports and add checkstyle rule

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13583. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11438 [https://github.co

[jira] [Updated] (SPARK-13583) Remove unused imports and add checkstyle rule

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13583: -- Assignee: Dongjoon Hyun > Remove unused imports and add checkstyle rule > -

[jira] [Commented] (SPARK-7481) Add Hadoop 2.6+ profile to pull in object store FS accessors

2016-03-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177623#comment-15177623 ] Steve Loughran commented on SPARK-7481: --- Hadoop 2.6 added S3a, which we put into a n

[jira] [Commented] (SPARK-13423) Static analysis fixes for 2.x

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177628#comment-15177628 ] Apache Spark commented on SPARK-13423: -- User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-10719) SQLImplicits.rddToDataFrameHolder is not thread safe when using Scala 2.10

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177631#comment-15177631 ] Sean Owen commented on SPARK-10719: --- [~sarutak] suggests this might be solved by SPARK-

[jira] [Created] (SPARK-13648) org.apache.spark.sql.hive.client.VersionsSuite fails NoClassDefFoundError

2016-03-03 Thread Tim Preece (JIRA)
Tim Preece created SPARK-13648: -- Summary: org.apache.spark.sql.hive.client.VersionsSuite fails NoClassDefFoundError Key: SPARK-13648 URL: https://issues.apache.org/jira/browse/SPARK-13648 Project: Spark

[jira] [Updated] (SPARK-13648) org.apache.spark.sql.hive.client.VersionsSuite fails NoClassDefFoundError

2016-03-03 Thread Tim Preece (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Preece updated SPARK-13648: --- Description: When running the standard Spark unit tests on the IBM Java SDK the hive VersionsSuite f

[jira] [Commented] (SPARK-13648) org.apache.spark.sql.hive.client.VersionsSuite fails NoClassDefFoundError

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177654#comment-15177654 ] Sean Owen commented on SPARK-13648: --- I don't see why it would have to do with the JDK.

[jira] [Commented] (SPARK-13620) Avoid reverse DNS lookup for 0.0.0.0 on startup

2016-03-03 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177655#comment-15177655 ] Daniel Darabos commented on SPARK-13620: For the record I figured out a workaroun

[jira] [Commented] (SPARK-13620) Avoid reverse DNS lookup for 0.0.0.0 on startup

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177659#comment-15177659 ] Sean Owen commented on SPARK-13620: --- If it's just an optimization, and doesn't affect 2

[jira] [Updated] (SPARK-13644) add the source file name and line into Logger when an exception occurs in the generated code

2016-03-03 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-13644: - Issue Type: Improvement (was: Bug) Summary: add the source file name and line into

[jira] [Updated] (SPARK-13644) Add the source file name and line into Logger when an exception occurs in the generated code

2016-03-03 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-13644: - Summary: Add the source file name and line into Logger when an exception occurs in the ge

[jira] [Assigned] (SPARK-10399) Off Heap Memory Access for non-JVM libraries (C++)

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10399: Assignee: Apache Spark > Off Heap Memory Access for non-JVM libraries (C++) >

[jira] [Assigned] (SPARK-10399) Off Heap Memory Access for non-JVM libraries (C++)

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10399: Assignee: (was: Apache Spark) > Off Heap Memory Access for non-JVM libraries (C++) > -

[jira] [Commented] (SPARK-10399) Off Heap Memory Access for non-JVM libraries (C++)

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177763#comment-15177763 ] Apache Spark commented on SPARK-10399: -- User 'yzotov' has created a pull request for

[jira] [Assigned] (SPARK-13648) org.apache.spark.sql.hive.client.VersionsSuite fails NoClassDefFoundError

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13648: Assignee: Apache Spark > org.apache.spark.sql.hive.client.VersionsSuite fails NoClassDefFo

[jira] [Assigned] (SPARK-13648) org.apache.spark.sql.hive.client.VersionsSuite fails NoClassDefFoundError

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13648: Assignee: (was: Apache Spark) > org.apache.spark.sql.hive.client.VersionsSuite fails N

[jira] [Commented] (SPARK-13648) org.apache.spark.sql.hive.client.VersionsSuite fails NoClassDefFoundError

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177767#comment-15177767 ] Apache Spark commented on SPARK-13648: -- User 'preecet' has created a pull request fo

[jira] [Issue Comment Deleted] (SPARK-13648) org.apache.spark.sql.hive.client.VersionsSuite fails NoClassDefFoundError

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13648: -- Comment: was deleted (was: I don't see why it would have to do with the JDK. You're missing Hive class

[jira] [Created] (SPARK-13649) Move CalendarInterval out of unsafe package

2016-03-03 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13649: -- Summary: Move CalendarInterval out of unsafe package Key: SPARK-13649 URL: https://issues.apache.org/jira/browse/SPARK-13649 Project: Spark Issue Type: Improveme

[jira] [Commented] (SPARK-13649) Move CalendarInterval out of unsafe package

2016-03-03 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1510#comment-1510 ] Cheng Lian commented on SPARK-13649: cc [~cloud_fan] > Move CalendarInterval out of

[jira] [Commented] (SPARK-13649) Move CalendarInterval out of unsafe package

2016-03-03 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1513#comment-1513 ] Wenchen Fan commented on SPARK-13649: - We should either move it to a proper package o

[jira] [Commented] (SPARK-13620) Avoid reverse DNS lookup for 0.0.0.0 on startup

2016-03-03 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177784#comment-15177784 ] Daniel Darabos commented on SPARK-13620: I just tested with the latest 2.0 nightl

[jira] [Resolved] (SPARK-13620) Avoid reverse DNS lookup for 0.0.0.0 on startup

2016-03-03 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Darabos resolved SPARK-13620. Resolution: Fixed > Avoid reverse DNS lookup for 0.0.0.0 on startup > -

[jira] [Updated] (SPARK-13620) Avoid reverse DNS lookup for 0.0.0.0 on startup

2016-03-03 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Darabos updated SPARK-13620: --- Fix Version/s: 2.0.0 > Avoid reverse DNS lookup for 0.0.0.0 on startup >

[jira] [Created] (SPARK-13650) Usage of the window() function on DStream

2016-03-03 Thread Mario Briggs (JIRA)
Mario Briggs created SPARK-13650: Summary: Usage of the window() function on DStream Key: SPARK-13650 URL: https://issues.apache.org/jira/browse/SPARK-13650 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-13650) Usage of the window() function on DStream

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177857#comment-15177857 ] Sean Owen commented on SPARK-13650: --- What do you mean by hangs? > Usage of the window(

[jira] [Commented] (SPARK-13631) getPreferredLocations race condition in spark 1.6.0?

2016-03-03 Thread Andy Sloane (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177893#comment-15177893 ] Andy Sloane commented on SPARK-13631: - I will.. It was late and I was brain-dumping..

[jira] [Commented] (SPARK-13642) Inconsistent finishing state between driver and AM

2016-03-03 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177905#comment-15177905 ] Thomas Graves commented on SPARK-13642: --- The problem is that you really don't want

[jira] [Commented] (SPARK-7481) Add Hadoop 2.6+ profile to pull in object store FS accessors

2016-03-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177918#comment-15177918 ] Steve Loughran commented on SPARK-7481: --- Longer term, having spark_home /lib/*.jar i

[jira] [Commented] (SPARK-7481) Add Hadoop 2.6+ profile to pull in object store FS accessors

2016-03-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177922#comment-15177922 ] Steve Loughran commented on SPARK-7481: --- For comparison, the full AWS SDK is 13MB; t

[jira] [Commented] (SPARK-13423) Static analysis fixes for 2.x

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178007#comment-15178007 ] Apache Spark commented on SPARK-13423: -- User 'srowen' has created a pull request for

[jira] [Created] (SPARK-13651) Generator outputs are not resolved correctly resulting in runtime error

2016-03-03 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-13651: Summary: Generator outputs are not resolved correctly resulting in runtime error Key: SPARK-13651 URL: https://issues.apache.org/jira/browse/SPARK-13651 Project: Spar

[jira] [Updated] (SPARK-13652) spark netty network issu

2016-03-03 Thread huangyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huangyu updated SPARK-13652: Description: TransportClient is not thread safe and if it is called from multiple threads, the messages ca

[jira] [Updated] (SPARK-13652) spark netty network issu

2016-03-03 Thread huangyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huangyu updated SPARK-13652: Description: TransportClient is not thread safe and if it is called from multiple threads, the messages ca

[jira] [Updated] (SPARK-13652) spark netty network issu

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13652: -- Description: TransportClient is not thread safe and if it is called from multiple threads, the message

[jira] [Created] (SPARK-13652) spark netty network issu

2016-03-03 Thread huangyu (JIRA)
huangyu created SPARK-13652: --- Summary: spark netty network issu Key: SPARK-13652 URL: https://issues.apache.org/jira/browse/SPARK-13652 Project: Spark Issue Type: Bug Affects Versions: 1.6.0, 1

[jira] [Updated] (SPARK-13652) spark netty network issu

2016-03-03 Thread huangyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huangyu updated SPARK-13652: Attachment: Test.java RankHandler.java > spark netty network issu > ---

[jira] [Updated] (SPARK-13652) spark netty network issue

2016-03-03 Thread huangyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huangyu updated SPARK-13652: Summary: spark netty network issue (was: spark netty network issu) > spark netty network issue > -

[jira] [Assigned] (SPARK-13651) Generator outputs are not resolved correctly resulting in runtime error

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13651: Assignee: (was: Apache Spark) > Generator outputs are not resolved correctly resulting

[jira] [Assigned] (SPARK-13651) Generator outputs are not resolved correctly resulting in runtime error

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13651: Assignee: Apache Spark > Generator outputs are not resolved correctly resulting in runtime

[jira] [Commented] (SPARK-13651) Generator outputs are not resolved correctly resulting in runtime error

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178057#comment-15178057 ] Apache Spark commented on SPARK-13651: -- User 'dilipbiswal' has created a pull reques

[jira] [Commented] (SPARK-13652) spark netty network issue

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178061#comment-15178061 ] Sean Owen commented on SPARK-13652: --- I don't think it's supposed to work this way: {co

[jira] [Commented] (SPARK-13652) spark netty network issue

2016-03-03 Thread huangyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178100#comment-15178100 ] huangyu commented on SPARK-13652: - Does it mean that for a TransportClient, i can't send

[jira] [Comment Edited] (SPARK-13652) spark netty network issue

2016-03-03 Thread huangyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178100#comment-15178100 ] huangyu edited comment on SPARK-13652 at 3/3/16 4:55 PM: - Does it

[jira] [Commented] (SPARK-13161) Extend MLlib LDA to include options for Author Topic Modeling

2016-03-03 Thread John Hogue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178124#comment-15178124 ] John Hogue commented on SPARK-13161: Author-Topic model is ideal for working with ext

[jira] [Commented] (SPARK-13652) spark netty network issue

2016-03-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178121#comment-15178121 ] Sean Owen commented on SPARK-13652: --- I think you can send from multiple threads to mult

[jira] [Resolved] (SPARK-13013) Replace example code in mllib-clustering.md using include_example

2016-03-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-13013. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 6 [https://g

[jira] [Resolved] (SPARK-12877) TrainValidationSplit is missing in pyspark.ml.tuning

2016-03-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-12877. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11335 [https://g

[jira] [Commented] (SPARK-10610) Using AppName instead of AppId in the name of all metrics

2016-03-03 Thread karan kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178228#comment-15178228 ] karan kumar commented on SPARK-10610: - Rather than using appName, I think it may be b

[jira] [Updated] (SPARK-12877) TrainValidationSplit is missing in pyspark.ml.tuning

2016-03-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12877: -- Issue Type: New Feature (was: Bug) > TrainValidationSplit is missing in pyspark.ml.tuning > --

[jira] [Commented] (SPARK-11157) Allow Spark to be built without assemblies

2016-03-03 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178267#comment-15178267 ] Marcelo Vanzin commented on SPARK-11157: For the record: there's a potential issu

[jira] [Resolved] (SPARK-13543) Support for specifying compression codec for Parquet/ORC via option()

2016-03-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13543. - Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.0.0 > Support for speci

[jira] [Commented] (SPARK-3789) [GRAPHX] Python bindings for GraphX

2016-03-03 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178340#comment-15178340 ] Maciej BryƄski commented on SPARK-3789: --- [~mengxr] Is there any ideas to replace gra

[jira] [Commented] (SPARK-11157) Allow Spark to be built without assemblies

2016-03-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178347#comment-15178347 ] Steve Loughran commented on SPARK-11157: FWIW Hadoop lets you swap out 11.x and g

[jira] [Commented] (SPARK-11157) Allow Spark to be built without assemblies

2016-03-03 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178350#comment-15178350 ] Marcelo Vanzin commented on SPARK-11157: Ah, yes. And also, the multiple jars app

[jira] [Created] (SPARK-13653) Split DiskBlockObjectWriter to separate object- and byte-based write interfaces

2016-03-03 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-13653: -- Summary: Split DiskBlockObjectWriter to separate object- and byte-based write interfaces Key: SPARK-13653 URL: https://issues.apache.org/jira/browse/SPARK-13653 Project:

[jira] [Assigned] (SPARK-13653) Split DiskBlockObjectWriter to separate object- and byte-based write interfaces

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13653: Assignee: Josh Rosen (was: Apache Spark) > Split DiskBlockObjectWriter to separate object

[jira] [Commented] (SPARK-13653) Split DiskBlockObjectWriter to separate object- and byte-based write interfaces

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178431#comment-15178431 ] Apache Spark commented on SPARK-13653: -- User 'JoshRosen' has created a pull request

[jira] [Created] (SPARK-13654) get_json_object fails with java.io.CharConversionException

2016-03-03 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-13654: Summary: get_json_object fails with java.io.CharConversionException Key: SPARK-13654 URL: https://issues.apache.org/jira/browse/SPARK-13654 Project: Spark Is

[jira] [Assigned] (SPARK-13653) Split DiskBlockObjectWriter to separate object- and byte-based write interfaces

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13653: Assignee: Apache Spark (was: Josh Rosen) > Split DiskBlockObjectWriter to separate object

[jira] [Commented] (SPARK-13641) getModelFeatures of ml.api.r.SparkRWrapper cannot (always) reveal the original column names

2016-03-03 Thread Gayathri Murali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178517#comment-15178517 ] Gayathri Murali commented on SPARK-13641: - I can work on this. Can you please ass

[jira] [Commented] (SPARK-13587) Support virtualenv in PySpark

2016-03-03 Thread Juliet Hougland (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178536#comment-15178536 ] Juliet Hougland commented on SPARK-13587: - If pyspark allows users to create virt

[jira] [Commented] (SPARK-11888) Model export/import for spark.ml: DecisionTreeClassifier,Regressor

2016-03-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178590#comment-15178590 ] Joseph K. Bradley commented on SPARK-11888: --- We shouldn't add new features for

[jira] [Updated] (SPARK-11888) Model export/import for spark.ml: DecisionTreeClassifier,Regressor

2016-03-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11888: -- Target Version/s: 2.0.0 (was: ) > Model export/import for spark.ml: DecisionTreeClassi

[jira] [Closed] (SPARK-13291) Numerical models should preserve label attributes

2016-03-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-13291. - Resolution: Duplicate > Numerical models should preserve label attributes > -

[jira] [Issue Comment Deleted] (SPARK-13375) PySpark API Utils missing item: kFold

2016-03-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-13375: -- Comment: was deleted (was: User 'davies' has created a pull request for this issue: htt

  1   2   3   >