[jira] [Created] (SPARK-8021) DataFrameReader/Writer in Python does not match Scala

2015-06-01 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-8021: --- Summary: DataFrameReader/Writer in Python does not match Scala Key: SPARK-8021 URL: https://issues.apache.org/jira/browse/SPARK-8021 Project: Spark

[jira] [Updated] (SPARK-8021) DataFrameReader/Writer in Python does not match Scala

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8021: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-6116 DataFrameReader/Writer in Python does

[jira] [Commented] (SPARK-7851) SparkSQL cli built against Hive 0.13 throws exception when using with Hive 0.12 HCat

2015-06-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568211#comment-14568211 ] Yin Huai commented on SPARK-7851: - Oh, right. It will not work. I am pretty close to have

[jira] [Created] (SPARK-8022) df.select(df.columnName) no longer works

2015-06-01 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-8022: --- Summary: df.select(df.columnName) no longer works Key: SPARK-8022 URL: https://issues.apache.org/jira/browse/SPARK-8022 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-8022) df.select(df.columnName) no longer works

2015-06-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8022: Description: This seems to be a pretty serious regression: {code} df =

[jira] [Updated] (SPARK-8022) df.select(df.columnName) no longer works

2015-06-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8022: Description: This seems to be a pretty serious regression: {code} df =

[jira] [Resolved] (SPARK-8022) df.select(df.columnName) no longer works

2015-06-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8022. - Resolution: Not A Problem Seems to be environment specific. df.select(df.columnName) no

[jira] [Assigned] (SPARK-8020) Spark SQL in spark-defaults.conf make metadataHive get constructed too early

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8020: --- Assignee: Apache Spark (was: Yin Huai) Spark SQL in spark-defaults.conf make metadataHive

[jira] [Assigned] (SPARK-8020) Spark SQL in spark-defaults.conf make metadataHive get constructed too early

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8020: --- Assignee: Yin Huai (was: Apache Spark) Spark SQL in spark-defaults.conf make metadataHive

[jira] [Commented] (SPARK-8023) Random Number Generation inconsistent in projections in DataFrame

2015-06-01 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568265#comment-14568265 ] Burak Yavuz commented on SPARK-8023: cc [~yhuai] Random Number Generation

[jira] [Created] (SPARK-8023) Random Number Generation inconsistent in projections in DataFrame

2015-06-01 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-8023: -- Summary: Random Number Generation inconsistent in projections in DataFrame Key: SPARK-8023 URL: https://issues.apache.org/jira/browse/SPARK-8023 Project: Spark

[jira] [Assigned] (SPARK-8023) Random Number Generation inconsistent in projections in DataFrame

2015-06-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-8023: --- Assignee: Yin Huai Random Number Generation inconsistent in projections in DataFrame

[jira] [Commented] (SPARK-4258) NPE with new Parquet Filters

2015-06-01 Thread Olivier Toupin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568287#comment-14568287 ] Olivier Toupin commented on SPARK-4258: --- 1.6.0 seems to be released =

[jira] [Commented] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

2015-06-01 Thread Mark Smiley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568317#comment-14568317 ] Mark Smiley commented on SPARK-5389: Sean, can you share your JAVA_HOME and the

[jira] [Updated] (SPARK-8014) DataFrame.write.mode(error).save(...) should not scan the output folder

2015-06-01 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8014: -- Target Version/s: 1.4.1, 1.5.0 DataFrame.write.mode(error).save(...) should not scan the output folder

[jira] [Resolved] (SPARK-8024) Luigi triggering resolved Blockmanager bug

2015-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8024. -- Resolution: Duplicate Target Version/s: (was: 1.3.1) Please review

[jira] [Commented] (SPARK-8004) Spark does not enclose column names when fetchting from jdbc sources

2015-06-01 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568357#comment-14568357 ] Liang-Chi Hsieh commented on SPARK-8004: Yes. I will submit a patch later. Spark

[jira] [Commented] (SPARK-7960) Serialization problem when multiple receivers are specified in a loop

2015-06-01 Thread Nishkam Ravi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568373#comment-14568373 ] Nishkam Ravi commented on SPARK-7960: - Yep, the problem persists. Serialization

[jira] [Assigned] (SPARK-8028) SparkR does not work with `--jars` and `--packages`

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8028: --- Assignee: Apache Spark (was: Shivaram Venkataraman) SparkR does not work with `--jars` and

[jira] [Commented] (SPARK-8028) SparkR does not work with `--jars` and `--packages`

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568406#comment-14568406 ] Apache Spark commented on SPARK-8028: - User 'shivaram' has created a pull request for

[jira] [Assigned] (SPARK-8028) SparkR does not work with `--jars` and `--packages`

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8028: --- Assignee: Shivaram Venkataraman (was: Apache Spark) SparkR does not work with `--jars` and

[jira] [Commented] (SPARK-7953) Spark should cleanup output dir if job fails

2015-06-01 Thread Mohit Sabharwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568491#comment-14568491 ] Mohit Sabharwal commented on SPARK-7953: Thanks, [~joshrosen], don't have cycles

[jira] [Updated] (SPARK-8023) Random Number Generation inconsistent in projections in DataFrame

2015-06-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8023: Affects Version/s: 1.4.0 Random Number Generation inconsistent in projections in DataFrame

[jira] [Updated] (SPARK-8020) Spark SQL in spark-defaults.conf make metadataHive get constructed too early

2015-06-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8020: Priority: Blocker (was: Critical) Spark SQL in spark-defaults.conf make metadataHive get constructed too

[jira] [Updated] (SPARK-8020) Spark SQL in spark-defaults.conf make metadataHive get constructed too early

2015-06-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8020: Target Version/s: 1.4.0 Spark SQL in spark-defaults.conf make metadataHive get constructed too early

[jira] [Created] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

2015-06-01 Thread Imran Rashid (JIRA)
Imran Rashid created SPARK-8029: --- Summary: ShuffleMapTasks must be robust to concurrent attempts on the same executor Key: SPARK-8029 URL: https://issues.apache.org/jira/browse/SPARK-8029 Project:

[jira] [Commented] (SPARK-8024) Luigi triggering resolved Blockmanager bug

2015-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568309#comment-14568309 ] Sean Owen commented on SPARK-8024: -- OK, but what is this about that is different? You

[jira] [Assigned] (SPARK-8026) Add Column.alias to Scala/Java API

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8026: --- Assignee: Apache Spark (was: Reynold Xin) Add Column.alias to Scala/Java API

[jira] [Commented] (SPARK-8026) Add Column.alias to Scala/Java API

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568338#comment-14568338 ] Apache Spark commented on SPARK-8026: - User 'rxin' has created a pull request for this

[jira] [Deleted] (SPARK-7914) Unusual behavior detected.

2015-06-01 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen deleted SPARK-7914: -- Unusual behavior detected. Key: SPARK-7914

[jira] [Commented] (SPARK-7949) update document with some missing save/load

2015-06-01 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568339#comment-14568339 ] yuhao yang commented on SPARK-7949: --- Oh thanks, I thought we should close jira when the

[jira] [Assigned] (SPARK-8026) Add Column.alias to Scala/Java API

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8026: --- Assignee: Reynold Xin (was: Apache Spark) Add Column.alias to Scala/Java API

[jira] [Assigned] (SPARK-8027) SparkR docs should be included in the distribution

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8027: --- Assignee: Shivaram Venkataraman (was: Apache Spark) SparkR docs should be included in the

[jira] [Assigned] (SPARK-8027) SparkR docs should be included in the distribution

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8027: --- Assignee: Apache Spark (was: Shivaram Venkataraman) SparkR docs should be included in the

[jira] [Commented] (SPARK-8027) SparkR docs should be included in the distribution

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568407#comment-14568407 ] Apache Spark commented on SPARK-8027: - User 'shivaram' has created a pull request for

[jira] [Commented] (SPARK-8020) Spark SQL in spark-defaults.conf make metadataHive get constructed too early

2015-06-01 Thread jeanlyn (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568427#comment-14568427 ] jeanlyn commented on SPARK-8020: [~yhuai],I set *spark.sql.hive.metastore.jars* in

[jira] [Resolved] (SPARK-7958) Failed StreamingContext.start() can leak active actors

2015-06-01 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7958. -- Resolution: Fixed Fix Version/s: 1.4.1 Failed StreamingContext.start() can leak active

[jira] [Commented] (SPARK-8020) Spark SQL in spark-defaults.conf make metadataHive get constructed too early

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568533#comment-14568533 ] Apache Spark commented on SPARK-8020: - User 'yhuai' has created a pull request for

[jira] [Updated] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

2015-06-01 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-8029: Attachment: AlternativesforMakingShuffleMapTasksRobusttoMultipleAttempts.pdf [~joshrosen] and I

[jira] [Commented] (SPARK-7952) equality check between boolean type and numeric type is broken.

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568560#comment-14568560 ] Apache Spark commented on SPARK-7952: - User 'cloud-fan' has created a pull request for

[jira] [Updated] (SPARK-7979) Enforce structural type checker

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7979: --- Fix Version/s: (was: 1.4.1) 1.4.0 Enforce structural type checker

[jira] [Updated] (SPARK-7957) Preserve partitioning in randomSplit in RDD.scala

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7957: --- Fix Version/s: (was: 1.4.1) (was: 1.5.0) 1.4.0

[jira] [Updated] (SPARK-7954) Implicitly create SparkContext in sparkRSQL.init

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7954: --- Fix Version/s: (was: 1.4.1) (was: 1.5.0) 1.4.0

[jira] [Updated] (SPARK-7227) Support fillna / dropna in R DataFrame

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7227: --- Fix Version/s: (was: 1.4.1) (was: 1.5.0) 1.4.0 Support

[jira] [Updated] (SPARK-7975) CovariantEqualsChecker

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7975: --- Fix Version/s: (was: 1.4.1) 1.4.0 CovariantEqualsChecker

[jira] [Commented] (SPARK-8025) Add JavaDoc style deprecation for deprecated Streaming methods

2015-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568331#comment-14568331 ] Sean Owen commented on SPARK-8025: -- Is this a different issue then? applying to what?

[jira] [Closed] (SPARK-7949) update document with some missing save/load

2015-06-01 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang closed SPARK-7949. - update document with some missing save/load ---

[jira] [Assigned] (SPARK-7982) crosstab should use 0 instead of null for pairs that don't appear

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7982: --- Assignee: Apache Spark crosstab should use 0 instead of null for pairs that don't appear

[jira] [Assigned] (SPARK-7982) crosstab should use 0 instead of null for pairs that don't appear

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7982: --- Assignee: (was: Apache Spark) crosstab should use 0 instead of null for pairs that

[jira] [Comment Edited] (SPARK-8020) Spark SQL in spark-defaults.conf make metadataHive get constructed too early

2015-06-01 Thread jeanlyn (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568427#comment-14568427 ] jeanlyn edited comment on SPARK-8020 at 6/2/15 3:16 AM: [~yhuai],I

[jira] [Comment Edited] (SPARK-8020) Spark SQL in spark-defaults.conf make metadataHive get constructed too early

2015-06-01 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568444#comment-14568444 ] Cheolsoo Park edited comment on SPARK-8020 at 6/2/15 3:17 AM: --

[jira] [Commented] (SPARK-5841) Memory leak in DiskBlockManager

2015-06-01 Thread Cory Nguyen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568312#comment-14568312 ] Cory Nguyen commented on SPARK-5841: We are using Luigi with Spark to manage our jobs

[jira] [Created] (SPARK-8026) Add Column.alias to Scala/Java API

2015-06-01 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8026: -- Summary: Add Column.alias to Scala/Java API Key: SPARK-8026 URL: https://issues.apache.org/jira/browse/SPARK-8026 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-8030) Spelling Mistake: 'fetchHcfsFile' should be 'fetchHdfsFile'

2015-06-01 Thread Liangliang Gu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568578#comment-14568578 ] Liangliang Gu commented on SPARK-8030: -- https://github.com/apache/spark/pull/6575

[jira] [Updated] (SPARK-7976) Add style checker to disallow overriding finalize

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7976: --- Fix Version/s: (was: 1.4.1) (was: 1.5.0) 1.4.0 Add

[jira] [Commented] (SPARK-8024) Luigi triggering resolved Blockmanager bug

2015-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568302#comment-14568302 ] Sean Owen commented on SPARK-8024: -- I don't think there's info about a Spark problem

[jira] [Commented] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

2015-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568322#comment-14568322 ] Sean Owen commented on SPARK-5389: -- Have a look at Yana's comment? I don't use Windows,

[jira] [Comment Edited] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

2015-06-01 Thread Mark Smiley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568317#comment-14568317 ] Mark Smiley edited comment on SPARK-5389 at 6/2/15 12:52 AM: -

[jira] [Comment Edited] (SPARK-8020) Spark SQL in spark-defaults.conf make metadataHive get constructed too early

2015-06-01 Thread jeanlyn (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568427#comment-14568427 ] jeanlyn edited comment on SPARK-8020 at 6/2/15 2:48 AM: [~yhuai],I

[jira] [Commented] (SPARK-7547) Example code for ElasticNet

2015-06-01 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568498#comment-14568498 ] DB Tsai commented on SPARK-7547: Pong! Sorry for the delay. Was a busy weekend. Will send

[jira] [Commented] (SPARK-8024) Luigi triggering resolved Blockmanager bug

2015-06-01 Thread Cory Nguyen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568306#comment-14568306 ] Cory Nguyen commented on SPARK-8024: oops! forgot to include the bug it's related to:

[jira] [Commented] (SPARK-7949) update document with some missing save/load

2015-06-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568354#comment-14568354 ] Joseph K. Bradley commented on SPARK-7949: -- No, it's fine. The

[jira] [Commented] (SPARK-7541) Check model save/load for MLlib 1.4

2015-06-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568355#comment-14568355 ] Joseph K. Bradley commented on SPARK-7541: -- I trust your initial check, and I

[jira] [Resolved] (SPARK-7965) Wrong answers for queries with multiple window specs in the same expression

2015-06-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7965. - Resolution: Fixed Fix Version/s: 1.4.0 It has been resolved by

[jira] [Resolved] (SPARK-7972) When parse window spec frame, we need to do case insensitive matches.

2015-06-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7972. - Resolution: Fixed Fix Version/s: 1.4.0 It has been resolved by

[jira] [Resolved] (SPARK-7582) User guide update for StringIndexer

2015-06-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7582. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6561

[jira] [Commented] (SPARK-7432) Flaky test in PySpark CrossValidator doc test

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568535#comment-14568535 ] Apache Spark commented on SPARK-7432: - User 'mengxr' has created a pull request for

[jira] [Commented] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

2015-06-01 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568552#comment-14568552 ] Imran Rashid commented on SPARK-8029: - This is a subset of the issues originally

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

2015-06-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568580#comment-14568580 ] Sandy Ryza commented on SPARK-4352: --- [~jerryshao] I think you're right that in the case

[jira] [Updated] (SPARK-7978) DecimalType should not be singleton

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7978: --- Fix Version/s: (was: 1.4.1) 1.4.0 DecimalType should not be singleton

[jira] [Commented] (SPARK-8020) Spark SQL in spark-defaults.conf make metadataHive get constructed too early

2015-06-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568313#comment-14568313 ] Yin Huai commented on SPARK-8020: - [~cheolsoo] Can you try

[jira] [Commented] (SPARK-8024) Luigi triggering resolved Blockmanager bug

2015-06-01 Thread Cory Nguyen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568315#comment-14568315 ] Cory Nguyen commented on SPARK-8024: ok, I moved the description to the other jira

[jira] [Commented] (SPARK-5784) Add StatsDSink to MetricsSystem

2015-06-01 Thread Vidhya Arvind (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568382#comment-14568382 ] Vidhya Arvind commented on SPARK-5784: -- Hi - checking to see if there are plans to

[jira] [Commented] (SPARK-8020) Spark SQL in spark-defaults.conf make metadataHive get constructed too early

2015-06-01 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568444#comment-14568444 ] Cheolsoo Park commented on SPARK-8020: -- [~yhuai], the patch seems to fix the original

[jira] [Resolved] (SPARK-7982) crosstab should use 0 instead of null for pairs that don't appear

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7982. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Reynold Xin crosstab should use 0

[jira] [Updated] (SPARK-8023) Random Number Generation inconsistent in projections in DataFrame

2015-06-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8023: --- Target Version/s: 1.4.0 Random Number Generation inconsistent in projections in DataFrame

[jira] [Commented] (SPARK-8023) Random Number Generation inconsistent in projections in DataFrame

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568554#comment-14568554 ] Apache Spark commented on SPARK-8023: - User 'rxin' has created a pull request for this

[jira] [Comment Edited] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

2015-06-01 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568552#comment-14568552 ] Imran Rashid edited comment on SPARK-8029 at 6/2/15 5:27 AM: -

[jira] [Comment Edited] (SPARK-5841) Memory leak in DiskBlockManager

2015-06-01 Thread Cory Nguyen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568312#comment-14568312 ] Cory Nguyen edited comment on SPARK-5841 at 6/2/15 12:58 AM: -

[jira] [Assigned] (SPARK-8025) Add JavaDoc style deprecation for deprecated Streaming methods

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8025: --- Assignee: Apache Spark Add JavaDoc style deprecation for deprecated Streaming methods

[jira] [Commented] (SPARK-7949) update document with some missing save/load

2015-06-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568334#comment-14568334 ] Joseph K. Bradley commented on SPARK-7949: -- [~yuhaoyan] I think of Resolved as

[jira] [Commented] (SPARK-8025) Add JavaDoc style deprecation for deprecated Streaming methods

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568335#comment-14568335 ] Apache Spark commented on SPARK-8025: - User 'zsxwing' has created a pull request for

[jira] [Assigned] (SPARK-8025) Add JavaDoc style deprecation for deprecated Streaming methods

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8025: --- Assignee: (was: Apache Spark) Add JavaDoc style deprecation for deprecated Streaming

[jira] [Created] (SPARK-8027) SparkR docs should be included in the distribution

2015-06-01 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-8027: Summary: SparkR docs should be included in the distribution Key: SPARK-8027 URL: https://issues.apache.org/jira/browse/SPARK-8027 Project: Spark

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

2015-06-01 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568410#comment-14568410 ] Saisai Shao commented on SPARK-4352: Hi [~sandyr], I start to know your algorithm,

[jira] [Commented] (SPARK-8020) Spark SQL in spark-defaults.conf make metadataHive get constructed too early

2015-06-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568482#comment-14568482 ] Yin Huai commented on SPARK-8020: - Is guava causing the problem? Spark SQL in

[jira] [Issue Comment Deleted] (SPARK-8020) Spark SQL in spark-defaults.conf make metadataHive get constructed too early

2015-06-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8020: Comment: was deleted (was: Is guava causing the problem?) Spark SQL in spark-defaults.conf make

[jira] [Resolved] (SPARK-8028) SparkR does not work with `--jars` and `--packages`

2015-06-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8028. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request

[jira] [Issue Comment Deleted] (SPARK-8020) Spark SQL in spark-defaults.conf make metadataHive get constructed too early

2015-06-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8020: Comment: was deleted (was: Is guava causing the problem?) Spark SQL in spark-defaults.conf make

[jira] [Commented] (SPARK-8020) Spark SQL in spark-defaults.conf make metadataHive get constructed too early

2015-06-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568480#comment-14568480 ] Yin Huai commented on SPARK-8020: - Is guava causing the problem? Spark SQL in

[jira] [Resolved] (SPARK-8027) SparkR docs should be included in the distribution

2015-06-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8027. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-8025) Add JavaDoc style deprecation for deprecated Streaming methods

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8025. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Shixiong Zhu Add JavaDoc style

[jira] [Commented] (SPARK-8025) Add JavaDoc style deprecation for deprecated Streaming methods

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568507#comment-14568507 ] Reynold Xin commented on SPARK-8025: [~srowen] I guess this was the streaming one?

[jira] [Created] (SPARK-8024) Luigi triggering resolved Blockmanager bug

2015-06-01 Thread Cory Nguyen (JIRA)
Cory Nguyen created SPARK-8024: -- Summary: Luigi triggering resolved Blockmanager bug Key: SPARK-8024 URL: https://issues.apache.org/jira/browse/SPARK-8024 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-8012) ArrayIndexOutOfBoundsException in SerializationDebugger

2015-06-01 Thread Jianshi Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568350#comment-14568350 ] Jianshi Huang commented on SPARK-8012: -- Yeah, it's from pretty big code base. I'm

[jira] [Commented] (SPARK-8023) Random Number Generation inconsistent in projections in DataFrame

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568471#comment-14568471 ] Apache Spark commented on SPARK-8023: - User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-8023) Random Number Generation inconsistent in projections in DataFrame

2015-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8023: --- Assignee: Apache Spark (was: Yin Huai) Random Number Generation inconsistent in

[jira] [Commented] (SPARK-6164) CrossValidatorModel should keep stats from fitting

2015-06-01 Thread Justin Yip (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568562#comment-14568562 ] Justin Yip commented on SPARK-6164: --- Hello, May I know the progress of this issue? It

[jira] [Created] (SPARK-8030) Spelling Mistake: 'fetchHcfsFile' should be 'fetchHdfsFile'

2015-06-01 Thread Liangliang Gu (JIRA)
Liangliang Gu created SPARK-8030: Summary: Spelling Mistake: 'fetchHcfsFile' should be 'fetchHdfsFile' Key: SPARK-8030 URL: https://issues.apache.org/jira/browse/SPARK-8030 Project: Spark

<    1   2   3