[jira] [Updated] (SPARK-5697) Allow Spark driver to wait longer before giving up connecting to the master

2015-02-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5697: --- Fix Version/s: (was: 1.4.0) > Allow Spark driver to wait longer before giving up connectin

[jira] [Updated] (SPARK-5697) Allow Spark driver to wait longer before giving up connecting to the master

2015-02-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5697: --- Target Version/s: 1.4.0 > Allow Spark driver to wait longer before giving up connecting to the

[jira] [Issue Comment Deleted] (SPARK-5671) Bump jets3t version from 0.9.0 to 0.9.2 in hadoop-2.3 and hadoop-2.4 profiles

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5671: -- Comment: was deleted (was: Thanks, Josh. PR submitted.) > Bump jets3t version from 0.9.0 to 0.9.2 in ha

[jira] [Commented] (SPARK-5671) Bump jets3t version from 0.9.0 to 0.9.2 in hadoop-2.3 and hadoop-2.4 profiles

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313788#comment-14313788 ] Cheng Lian commented on SPARK-5671: --- Thanks, Josh. PR submitted. > Bump jets3t version

[jira] [Commented] (SPARK-5700) Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles

2015-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313789#comment-14313789 ] Apache Spark commented on SPARK-5700: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-5700) Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313793#comment-14313793 ] Cheng Lian commented on SPARK-5700: --- Thanks, Josh. PR submitted. > Bump jets3t version

[jira] [Issue Comment Deleted] (SPARK-5700) Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5700: -- Comment: was deleted (was: Thanks, Josh. PR submitted.) > Bump jets3t version from 0.9.2 to 0.9.3 in ha

[jira] [Commented] (SPARK-5671) Bump jets3t version from 0.9.0 to 0.9.2 in hadoop-2.3 and hadoop-2.4 profiles

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313790#comment-14313790 ] Cheng Lian commented on SPARK-5671: --- Thanks, Josh. PR submitted. > Bump jets3t version

[jira] [Commented] (SPARK-5700) Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313794#comment-14313794 ] Cheng Lian commented on SPARK-5700: --- Thanks, Josh. PR submitted. > Bump jets3t version

[jira] [Created] (SPARK-5712) Semicolon at end of a comment line

2015-02-10 Thread Adrian Wang (JIRA)
Adrian Wang created SPARK-5712: -- Summary: Semicolon at end of a comment line Key: SPARK-5712 URL: https://issues.apache.org/jira/browse/SPARK-5712 Project: Spark Issue Type: Bug Compon

[jira] [Commented] (SPARK-5712) Semicolon at end of a comment line

2015-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313807#comment-14313807 ] Apache Spark commented on SPARK-5712: - User 'adrian-wang' has created a pull request f

[jira] [Updated] (SPARK-5712) Semicolon at end of a comment line

2015-02-10 Thread Adrian Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Wang updated SPARK-5712: --- Description: HIVE-3348 > Semicolon at end of a comment line > -- > >

[jira] [Commented] (SPARK-4900) MLlib SingularValueDecomposition ARPACK IllegalStateException

2015-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313863#comment-14313863 ] Sean Owen commented on SPARK-4900: -- Yeah, that fixes the error at least. I imagine the re

[jira] [Resolved] (SPARK-5558) pySpark zip function unexpected errors

2015-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5558. -- Resolution: Fixed Fix Version/s: 1.3.0 Could be related to how https://issues.apache.org/jira/bro

[jira] [Commented] (SPARK-4208) stack over flow error while using sqlContext.sql

2015-02-10 Thread seekerak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313871#comment-14313871 ] seekerak commented on SPARK-4208: - me too my env: ===

[jira] [Resolved] (SPARK-5239) JdbcRDD throws "java.lang.AbstractMethodError: oracle.jdbc.driver.xxxxxx.isClosed()Z"

2015-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5239. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4470 [https://github.com/ap

[jira] [Updated] (SPARK-5239) JdbcRDD throws "java.lang.AbstractMethodError: oracle.jdbc.driver.xxxxxx.isClosed()Z"

2015-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5239: - Assignee: Gankun Luo > JdbcRDD throws "java.lang.AbstractMethodError: > oracle.jdbc.driver.xx.isClose

[jira] [Resolved] (SPARK-5705) Explore GPU-accelerated Linear Algebra Libraries

2015-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5705. -- Resolution: Duplicate This already had a discussion going; let's merge the two. > Explore GPU-accelerat

[jira] [Commented] (SPARK-4360) task only execute on one node when spark on yarn

2015-02-10 Thread seekerak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313898#comment-14313898 ] seekerak commented on SPARK-4360: - i have resolved this issue by configure yarn scheduler

[jira] [Comment Edited] (SPARK-4360) task only execute on one node when spark on yarn

2015-02-10 Thread seekerak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313898#comment-14313898 ] seekerak edited comment on SPARK-4360 at 2/10/15 9:37 AM: -- i have

[jira] [Created] (SPARK-5713) Support python serialization for RandomForest

2015-02-10 Thread Guillaume Charhon (JIRA)
Guillaume Charhon created SPARK-5713: Summary: Support python serialization for RandomForest Key: SPARK-5713 URL: https://issues.apache.org/jira/browse/SPARK-5713 Project: Spark Issue Typ

[jira] [Created] (SPARK-5714) Refactor initial step of LDA to remove redundant operations

2015-02-10 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-5714: -- Summary: Refactor initial step of LDA to remove redundant operations Key: SPARK-5714 URL: https://issues.apache.org/jira/browse/SPARK-5714 Project: Spark

[jira] [Commented] (SPARK-5714) Refactor initial step of LDA to remove redundant operations

2015-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313917#comment-14313917 ] Apache Spark commented on SPARK-5714: - User 'viirya' has created a pull request for th

[jira] [Commented] (SPARK-2653) Heap size should be the sum of driver.memory and executor.memory in local mode

2015-02-10 Thread liu chang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313940#comment-14313940 ] liu chang commented on SPARK-2653: -- I would like to fix it. I will patch a PR soon. > He

[jira] [Closed] (SPARK-5667) Remove version from spark-ec2 example.

2015-02-10 Thread Miguel Peralvo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miguel Peralvo closed SPARK-5667. - > Remove version from spark-ec2 example. > -- > >

[jira] [Created] (SPARK-5715) Shuffle size increase, performance loss from Spark 1.1.0 to Spark 1.2.0 (and 1.2.1)

2015-02-10 Thread Dr. Christian Betz (JIRA)
Dr. Christian Betz created SPARK-5715: - Summary: Shuffle size increase, performance loss from Spark 1.1.0 to Spark 1.2.0 (and 1.2.1) Key: SPARK-5715 URL: https://issues.apache.org/jira/browse/SPARK-5715

[jira] [Commented] (SPARK-4906) Spark master OOMs with exception stack trace stored in JobProgressListener

2015-02-10 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313947#comment-14313947 ] Matt Cheah commented on SPARK-4906: --- Spark has logic for failing a stage if there are to

[jira] [Created] (SPARK-5716) Support TOK_CHARSETLITERAL in HiveQl

2015-02-10 Thread Adrian Wang (JIRA)
Adrian Wang created SPARK-5716: -- Summary: Support TOK_CHARSETLITERAL in HiveQl Key: SPARK-5716 URL: https://issues.apache.org/jira/browse/SPARK-5716 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-5716) Support TOK_CHARSETLITERAL in HiveQl

2015-02-10 Thread Adrian Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Wang updated SPARK-5716: --- Description: where value = _UTF8 0x12345678 Environment: (was: _UTF8 0x12345678) > Support TOK

[jira] [Comment Edited] (SPARK-4906) Spark master OOMs with exception stack trace stored in JobProgressListener

2015-02-10 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313947#comment-14313947 ] Matt Cheah edited comment on SPARK-4906 at 2/10/15 10:15 AM: -

[jira] [Resolved] (SPARK-5715) Shuffle size increase, performance loss from Spark 1.1.0 to Spark 1.2.0 (and 1.2.1)

2015-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5715. -- Resolution: Duplicate Can you move your comment to the existing JIRA, SPARK-5081? > Shuffle size increa

[jira] [Commented] (SPARK-5716) Support TOK_CHARSETLITERAL in HiveQl

2015-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313955#comment-14313955 ] Apache Spark commented on SPARK-5716: - User 'adrian-wang' has created a pull request f

[jira] [Resolved] (SPARK-5700) Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-5700. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4499 [https://github.com/

[jira] [Created] (SPARK-5717) add sc.stop to LDA examples

2015-02-10 Thread yuhao yang (JIRA)
yuhao yang created SPARK-5717: - Summary: add sc.stop to LDA examples Key: SPARK-5717 URL: https://issues.apache.org/jira/browse/SPARK-5717 Project: Spark Issue Type: Improvement Compone

[jira] [Commented] (SPARK-5717) add sc.stop to LDA examples

2015-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313968#comment-14313968 ] Apache Spark commented on SPARK-5717: - User 'hhbyyh' has created a pull request for th

[jira] [Commented] (SPARK-5676) License missing from spark-ec2 repo

2015-02-10 Thread Adam B (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313995#comment-14313995 ] Adam B commented on SPARK-5676: --- I agree that spark-ec2 has less to do with Mesos than even

[jira] [Commented] (SPARK-5566) Tokenizer for mllib package

2015-02-10 Thread Augustin Borsu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313996#comment-14313996 ] Augustin Borsu commented on SPARK-5566: --- We could use a tokenizer like this, but we

[jira] [Updated] (SPARK-4705) Driver retries in yarn-cluster mode always fail if event logging is enabled

2015-02-10 Thread Twinkle Sachdeva (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Twinkle Sachdeva updated SPARK-4705: Attachment: Screen Shot 2015-02-10 at 6.27.49 pm.png UI - 2 > Driver retries in yarn-cluste

[jira] [Commented] (SPARK-4705) Driver retries in yarn-cluster mode always fail if event logging is enabled

2015-02-10 Thread Twinkle Sachdeva (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314140#comment-14314140 ] Twinkle Sachdeva commented on SPARK-4705: - Hi, So here is the final approach I ha

[jira] [Updated] (SPARK-4705) Driver retries in yarn-cluster mode always fail if event logging is enabled

2015-02-10 Thread Twinkle Sachdeva (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Twinkle Sachdeva updated SPARK-4705: Attachment: (was: Screen Shot 2015-02-10 at 6.27.49 pm.png) > Driver retries in yarn-clu

[jira] [Updated] (SPARK-4705) Driver retries in yarn-cluster mode always fail if event logging is enabled

2015-02-10 Thread Twinkle Sachdeva (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Twinkle Sachdeva updated SPARK-4705: Attachment: (was: multi-attempts with no attempt based UI.png) > Driver retries in yarn-

[jira] [Updated] (SPARK-4705) Driver retries in yarn-cluster mode always fail if event logging is enabled

2015-02-10 Thread Twinkle Sachdeva (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Twinkle Sachdeva updated SPARK-4705: Attachment: Screen Shot 2015-02-10 at 6.27.49 pm.png UI-2 > Driver retries in yarn-cluster

[jira] [Created] (SPARK-5718) Change to native offset management for ReliableKafkaReceiver

2015-02-10 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-5718: -- Summary: Change to native offset management for ReliableKafkaReceiver Key: SPARK-5718 URL: https://issues.apache.org/jira/browse/SPARK-5718 Project: Spark Issue

[jira] [Created] (SPARK-5719) allow UIs to bind to specified host

2015-02-10 Thread Tao Wang (JIRA)
Tao Wang created SPARK-5719: --- Summary: allow UIs to bind to specified host Key: SPARK-5719 URL: https://issues.apache.org/jira/browse/SPARK-5719 Project: Spark Issue Type: Improvement Com

[jira] [Updated] (SPARK-5719) allow daemons to bind to specified host

2015-02-10 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-5719: Summary: allow daemons to bind to specified host (was: allow UIs to bind to specified host) > allow daemon

[jira] [Updated] (SPARK-5719) allow daemons to bind to specified host

2015-02-10 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-5719: Description: Now web ui binds to "0.0.0.0". When multiple network plane is enabled, we may try to bind ui

[jira] [Commented] (SPARK-5719) allow daemons to bind to specified host

2015-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314192#comment-14314192 ] Apache Spark commented on SPARK-5719: - User 'WangTaoTheTonic' has created a pull reque

[jira] [Updated] (SPARK-5718) Add native offset management for ReliableKafkaReceiver

2015-02-10 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-5718: --- Summary: Add native offset management for ReliableKafkaReceiver (was: Change to native offset managem

[jira] [Updated] (SPARK-5719) allow daemons to bind to specified host

2015-02-10 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-5719: Description: Now web ui binds to "0.0.0.0". When multiple network plane is enabled, we may try to bind ui

[jira] [Commented] (SPARK-2653) Heap size should be the sum of driver.memory and executor.memory in local mode

2015-02-10 Thread liu chang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314330#comment-14314330 ] liu chang commented on SPARK-2653: -- hi, Davies Liu I have review the spark core codes, f

[jira] [Updated] (SPARK-1805) Error launching cluster when master and slave machines are of different virtualization types

2015-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1805: - Target Version/s: (was: 1.3.0) Assignee: Nicholas Chammas > Error launching cluster when mas

[jira] [Resolved] (SPARK-1805) Error launching cluster when master and slave machines are of different virtualization types

2015-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1805. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4455 [https://github.com/ap

[jira] [Updated] (SPARK-4261) make right version info for beeline

2015-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4261: - Priority: Trivial (was: Major) > make right version info for beeline > --

[jira] [Resolved] (SPARK-4261) make right version info for beeline

2015-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4261. -- Resolution: Won't Fix Per PR discussion, this is a cosmetic issue, and can't really be resolved in the

[jira] [Resolved] (SPARK-4237) Generate right Manifest File for maven building

2015-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4237. -- Resolution: Won't Fix Per PR discussion, it sounds like the action here if anything is to omit most or

[jira] [Created] (SPARK-5720) Support `Create Table xx Like xx` in HiveContext

2015-02-10 Thread Li Sheng (JIRA)
Li Sheng created SPARK-5720: --- Summary: Support `Create Table xx Like xx` in HiveContext Key: SPARK-5720 URL: https://issues.apache.org/jira/browse/SPARK-5720 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-5720) Support `Create Table Like` in HiveContext

2015-02-10 Thread Li Sheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Sheng updated SPARK-5720: Summary: Support `Create Table Like` in HiveContext (was: Support `Create Table xx Like xx` in HiveContext)

[jira] [Commented] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

2015-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314424#comment-14314424 ] Apache Spark commented on SPARK-5655: - User 'growse' has created a pull request for th

[jira] [Commented] (SPARK-2653) Heap size should be the sum of driver.memory and executor.memory in local mode

2015-02-10 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314441#comment-14314441 ] Davies Liu commented on SPARK-2653: --- [~andrewor14] Could you help to answer the question

[jira] [Updated] (SPARK-5720) `Create Table Like` in HiveContext need support `like registered temporary table`

2015-02-10 Thread Li Sheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Sheng updated SPARK-5720: Issue Type: Improvement (was: New Feature) > `Create Table Like` in HiveContext need support `like register

[jira] [Updated] (SPARK-5720) `Create Table Like` in HiveContext need support `like registered temporary table`

2015-02-10 Thread Li Sheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Sheng updated SPARK-5720: Summary: `Create Table Like` in HiveContext need support `like registered temporary table` (was: Support `C

[jira] [Commented] (SPARK-5720) `Create Table Like` in HiveContext need support `like registered temporary table`

2015-02-10 Thread Li Sheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314446#comment-14314446 ] Li Sheng commented on SPARK-5720: - We need support user registered temp table as source ta

[jira] [Commented] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

2015-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314451#comment-14314451 ] Apache Spark commented on SPARK-5655: - User 'growse' has created a pull request for th

[jira] [Resolved] (SPARK-5717) add sc.stop to LDA examples

2015-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5717. -- Resolution: Fixed Assignee: yuhao yang Target Version/s: 1.3.0 Resolved by https:

[jira] [Updated] (SPARK-5717) add sc.stop to LDA examples

2015-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5717: - Fix Version/s: 1.3.0 > add sc.stop to LDA examples > --- > > Key:

[jira] [Updated] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

2015-02-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5655: - Priority: Critical (was: Blocker) > YARN Auxiliary Shuffle service can't access shuffle files on Hadoop c

[jira] [Updated] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

2015-02-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5655: - Priority: Blocker (was: Major) > YARN Auxiliary Shuffle service can't access shuffle files on Hadoop clus

[jira] [Updated] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

2015-02-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5655: - Target Version/s: 1.3.0, 1.2.2 Affects Version/s: (was: 1.2.0) 1.2.1 > YAR

[jira] [Commented] (SPARK-3889) JVM dies with SIGBUS, resulting in ConnectionManager failed ACK

2015-02-10 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314651#comment-14314651 ] Aaron Davidson commented on SPARK-3889: --- The only place we memory map in 1.1 is this

[jira] [Commented] (SPARK-3889) JVM dies with SIGBUS, resulting in ConnectionManager failed ACK

2015-02-10 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314650#comment-14314650 ] Aaron Davidson commented on SPARK-3889: --- The only place we memory map in 1.1 is this

[jira] [Updated] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-02-10 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4105: -- Affects Version/s: 1.2.1 1.3.0 > FAILED_TO_UNCOMPRESS(5) errors when fetching shu

[jira] [Resolved] (SPARK-5716) Support TOK_CHARSETLITERAL in HiveQl

2015-02-10 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5716. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4502 [https:/

[jira] [Created] (SPARK-5721) Propagate missing external shuffle service errors to client

2015-02-10 Thread Kostas Sakellis (JIRA)
Kostas Sakellis created SPARK-5721: -- Summary: Propagate missing external shuffle service errors to client Key: SPARK-5721 URL: https://issues.apache.org/jira/browse/SPARK-5721 Project: Spark

[jira] [Resolved] (SPARK-5668) spark_ec2.py region parameter could be either mandatory or its value displayed

2015-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5668. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4457 [https://github.com/ap

[jira] [Updated] (SPARK-5592) java.net.URISyntaxException when insert data to a partitioned table

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5592: -- Assignee: wangfei > java.net.URISyntaxException when insert data to a partitioned table >

[jira] [Resolved] (SPARK-5592) java.net.URISyntaxException when insert data to a partitioned table

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-5592. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4368 [https://github.com/

[jira] [Updated] (SPARK-5592) java.net.URISyntaxException when insert data to a partitioned table

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5592: -- Description: {code} create table sc as select * from (select '2011-01-11', '2011-01-11+14:18:26' from s

[jira] [Closed] (SPARK-5668) spark_ec2.py region parameter could be either mandatory or its value displayed

2015-02-10 Thread Miguel Peralvo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miguel Peralvo closed SPARK-5668. - > spark_ec2.py region parameter could be either mandatory or its value displayed > ---

[jira] [Commented] (SPARK-5645) Track local bytes read for shuffles - update UI

2015-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314811#comment-14314811 ] Apache Spark commented on SPARK-5645: - User 'kayousterhout' has created a pull request

[jira] [Commented] (SPARK-5613) YarnClientSchedulerBackend fails to get application report when yarn restarts

2015-02-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314821#comment-14314821 ] Patrick Wendell commented on SPARK-5613: I have cherry picked it into the 1.3 bran

[jira] [Created] (SPARK-5722) Infer_schma_type incorrect for Integers in pyspark

2015-02-10 Thread Don Drake (JIRA)
Don Drake created SPARK-5722: Summary: Infer_schma_type incorrect for Integers in pyspark Key: SPARK-5722 URL: https://issues.apache.org/jira/browse/SPARK-5722 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3754) Spark Streaming fileSystem API is not callable from Java

2015-02-10 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314899#comment-14314899 ] Tathagata Das commented on SPARK-3754: -- Yes, it is. This has already been fixed. >

[jira] [Closed] (SPARK-3754) Spark Streaming fileSystem API is not callable from Java

2015-02-10 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-3754. Resolution: Duplicate > Spark Streaming fileSystem API is not callable from Java > -

[jira] [Commented] (SPARK-4964) Exactly-once + WAL-free Kafka Support in Spark Streaming

2015-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314903#comment-14314903 ] Apache Spark commented on SPARK-4964: - User 'koeninger' has created a pull request for

[jira] [Created] (SPARK-5723) Change the default file format to Parquet for CTAS statements.

2015-02-10 Thread Yin Huai (JIRA)
Yin Huai created SPARK-5723: --- Summary: Change the default file format to Parquet for CTAS statements. Key: SPARK-5723 URL: https://issues.apache.org/jira/browse/SPARK-5723 Project: Spark Issue Typ

[jira] [Closed] (SPARK-5613) YarnClientSchedulerBackend fails to get application report when yarn restarts

2015-02-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5613. Resolution: Fixed > YarnClientSchedulerBackend fails to get application report when yarn restarts >

[jira] [Commented] (SPARK-5613) YarnClientSchedulerBackend fails to get application report when yarn restarts

2015-02-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314922#comment-14314922 ] Andrew Or commented on SPARK-5613: -- Thanks Patrick. I just verified that it was merged in

[jira] [Updated] (SPARK-5722) Infer_schema_type incorrect for Integers in pyspark

2015-02-10 Thread Don Drake (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Don Drake updated SPARK-5722: - Summary: Infer_schema_type incorrect for Integers in pyspark (was: Infer_schma_type incorrect for Integer

[jira] [Updated] (SPARK-5722) Infer_schema_type incorrect for Integers in pyspark

2015-02-10 Thread Don Drake (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Don Drake updated SPARK-5722: - Description: The Integers datatype in Python does not match what a Scala/Java integer is defined as. Th

[jira] [Resolved] (SPARK-5686) Support `show current roles`

2015-02-10 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5686. - Resolution: Fixed Issue resolved by pull request 4471 [https://github.com/apache/spark/pul

[jira] [Closed] (SPARK-4136) Under dynamic allocation, cancel outstanding executor requests when no longer needed

2015-02-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4136. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Sandy Ryza > Under dynamic allocation, canc

[jira] [Updated] (SPARK-4879) Missing output partitions after job completes with speculative execution

2015-02-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4879: - Target Version/s: 1.0.3, 1.3.0, 1.1.2, 1.2.2 (was: 1.0.3, 1.3.0, 1.1.2, 1.2.1) > Missing output partitio

[jira] [Commented] (SPARK-4705) Driver retries in yarn-cluster mode always fail if event logging is enabled

2015-02-10 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14315024#comment-14315024 ] Marcelo Vanzin commented on SPARK-4705: --- Hi [~twinkle], I think the UI on the lates

[jira] [Resolved] (SPARK-5021) GaussianMixtureEM should be faster for SparseVector input

2015-02-10 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5021. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4459 [https://githu

[jira] [Commented] (SPARK-4879) Missing output partitions after job completes with speculative execution

2015-02-10 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14315077#comment-14315077 ] Josh Rosen commented on SPARK-4879: --- This issue is _really_ hard to reproduce, but I man

[jira] [Commented] (SPARK-4879) Missing output partitions after job completes with speculative execution

2015-02-10 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14315087#comment-14315087 ] Andrew Ash commented on SPARK-4879: --- This is really great work [~joshrosen]! I really a

[jira] [Created] (SPARK-5724) misconfiguration in Akka system

2015-02-10 Thread Nan Zhu (JIRA)
Nan Zhu created SPARK-5724: -- Summary: misconfiguration in Akka system Key: SPARK-5724 URL: https://issues.apache.org/jira/browse/SPARK-5724 Project: Spark Issue Type: Bug Components: Spark

[jira] [Commented] (SPARK-5724) misconfiguration in Akka system

2015-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14315135#comment-14315135 ] Apache Spark commented on SPARK-5724: - User 'CodingCat' has created a pull request for

[jira] [Resolved] (SPARK-5343) ShortestPaths traverses backwards

2015-02-10 Thread Ankur Dave (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-5343. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4478 https://github.com/a

[jira] [Created] (SPARK-5725) ParquetRelation2.equals throws when compared with non-Parquet relations

2015-02-10 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5725: - Summary: ParquetRelation2.equals throws when compared with non-Parquet relations Key: SPARK-5725 URL: https://issues.apache.org/jira/browse/SPARK-5725 Project: Spark

  1   2   >