[jira] [Comment Edited] (SPARK-5792) hive udfs like get_json_object and json_tuple doesnot work in spark 1.2.0

[ https://issues.apache.org/jira/browse/SPARK-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319645#comment-14319645 ] pengxu edited comment on SPARK-5792 at 2/14/15 9:38 AM: I've

[jira] [Comment Edited] (SPARK-5792) hive udfs like get_json_object and json_tuple doesnot work in spark 1.2.0

[ https://issues.apache.org/jira/browse/SPARK-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319645#comment-14319645 ] pengxu edited comment on SPARK-5792 at 2/14/15 9:39 AM: I've

[jira] [Updated] (SPARK-5166) Stabilize Spark SQL APIs

[ https://issues.apache.org/jira/browse/SPARK-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5166: --- Component/s: (was: DataFrame) SQL Stabilize Spark SQL APIs

[jira] [Commented] (SPARK-5770) Use addJar() to upload a new jar file to executor, it can't be added to classloader

[ https://issues.apache.org/jira/browse/SPARK-5770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321269#comment-14321269 ] Patrick Wendell commented on SPARK-5770: If the request is to support hot

[jira] [Updated] (SPARK-5166) Stabilize Spark SQL APIs

[ https://issues.apache.org/jira/browse/SPARK-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5166: --- Component/s: (was: SQL) DataFrame Stabilize Spark SQL APIs

[jira] [Updated] (SPARK-5809) OutOfMemoryError in logDebug in RandomForest.scala

[ https://issues.apache.org/jira/browse/SPARK-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5809: - Priority: Minor (was: Major) Assignee: Joseph K. Bradley Labels: easyfix (was: easyfix newbie)

[jira] [Assigned] (SPARK-5810) Maven Coordinate Inclusion failing in pySpark

[ https://issues.apache.org/jira/browse/SPARK-5810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-5810: - Assignee: Josh Rosen Maven Coordinate Inclusion failing in pySpark

[jira] [Resolved] (SPARK-5752) Don't implicitly convert RDDs directly to DataFrames

[ https://issues.apache.org/jira/browse/SPARK-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5752. Resolution: Fixed Fix Version/s: 1.3.0 Don't implicitly convert RDDs directly to DataFrames

[jira] [Updated] (SPARK-3290) No unpersist callls in SVDPlusPlus

[ https://issues.apache.org/jira/browse/SPARK-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3290: -- Assignee: Sean Owen No unpersist callls in SVDPlusPlus --

[jira] [Commented] (SPARK-2313) PySpark should accept port via a command line argument rather than STDIN

[ https://issues.apache.org/jira/browse/SPARK-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321236#comment-14321236 ] Apache Spark commented on SPARK-2313: - User 'JoshRosen' has created a pull request for

[jira] [Created] (SPARK-5818) unable to use add jar in hql

pengxu created SPARK-5818: - Summary: unable to use add jar in hql Key: SPARK-5818 URL: https://issues.apache.org/jira/browse/SPARK-5818 Project: Spark Issue Type: Bug Components: SQL

[jira] [Updated] (SPARK-5792) hive udfs like get_json_object and json_tuple doesnot work in spark 1.2.0

[ https://issues.apache.org/jira/browse/SPARK-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pengxu updated SPARK-5792: -- Description: I'm using spark 1.2.1 now. After several testing, I found that the hive udfs like get_json_object

[jira] [Commented] (SPARK-5819) Backport of SPARK-5805 to branch-1.2

[ https://issues.apache.org/jira/browse/SPARK-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321421#comment-14321421 ] Apache Spark commented on SPARK-5819: - User 'emres' has created a pull request for

[jira] [Commented] (SPARK-5805) Fix the type error in the final example given in MLlib - Clustering documentation

[ https://issues.apache.org/jira/browse/SPARK-5805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321422#comment-14321422 ] Apache Spark commented on SPARK-5805: - User 'emres' has created a pull request for

[jira] [Commented] (SPARK-5016) GaussianMixtureEM should distribute matrix inverse for large numFeatures, k

[ https://issues.apache.org/jira/browse/SPARK-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321466#comment-14321466 ] Manoj Kumar commented on SPARK-5016: [~tgaloppo] If I understand, [~mengxr] 's

[jira] [Updated] (SPARK-5820) Example does not work when using SOCKS proxy

[ https://issues.apache.org/jira/browse/SPARK-5820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric O. LEBIGOT (EOL) updated SPARK-5820: - Description: When using a SOCKS proxy (on OS X 10.10.2), running even the basic

[jira] [Created] (SPARK-5820) Example does not work when using SOCKS proxy

Eric O. LEBIGOT (EOL) created SPARK-5820: Summary: Example does not work when using SOCKS proxy Key: SPARK-5820 URL: https://issues.apache.org/jira/browse/SPARK-5820 Project: Spark

[jira] [Commented] (SPARK-5016) GaussianMixtureEM should distribute matrix inverse for large numFeatures, k

[ https://issues.apache.org/jira/browse/SPARK-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321538#comment-14321538 ] Travis Galoppo commented on SPARK-5016: --- @mechcoder I may well be missing something

[jira] [Commented] (SPARK-5820) Example does not work when using SOCKS proxy

[ https://issues.apache.org/jira/browse/SPARK-5820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321524#comment-14321524 ] Sean Owen commented on SPARK-5820: -- SOCKS proxy where? I don't know that Spark works when

[jira] [Commented] (SPARK-5821) [SQL] CTAS command failure when your don't have write permission of the parent directory

[ https://issues.apache.org/jira/browse/SPARK-5821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321578#comment-14321578 ] Yanbo Liang commented on SPARK-5821: The following is one kind of exception log:

[jira] [Commented] (SPARK-5821) [SQL] CTAS command failure when your don't have write permission of the parent directory

[ https://issues.apache.org/jira/browse/SPARK-5821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321584#comment-14321584 ] Yanbo Liang commented on SPARK-5821: This is because that INSERT OVERWRITE in external

[jira] [Created] (SPARK-5821) [SQL] CTAS command failure when your don't have write permission of the parent directory

Yanbo Liang created SPARK-5821: -- Summary: [SQL] CTAS command failure when your don't have write permission of the parent directory Key: SPARK-5821 URL: https://issues.apache.org/jira/browse/SPARK-5821

[jira] [Commented] (SPARK-5746) INSERT OVERWRITE throws FileNotFoundException when the source and destination point to the same table.

[ https://issues.apache.org/jira/browse/SPARK-5746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321604#comment-14321604 ] Apache Spark commented on SPARK-5746: - User 'yanbohappy' has created a pull request

[jira] [Commented] (SPARK-5016) GaussianMixtureEM should distribute matrix inverse for large numFeatures, k

[ https://issues.apache.org/jira/browse/SPARK-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321554#comment-14321554 ] Travis Galoppo commented on SPARK-5016: --- Right, unless each reducer is computing the

[jira] [Commented] (SPARK-5821) [SQL] CTAS command failure when your don't have write permission of the parent directory

[ https://issues.apache.org/jira/browse/SPARK-5821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321603#comment-14321603 ] Apache Spark commented on SPARK-5821: - User 'yanbohappy' has created a pull request

[jira] [Commented] (SPARK-5016) GaussianMixtureEM should distribute matrix inverse for large numFeatures, k

[ https://issues.apache.org/jira/browse/SPARK-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321611#comment-14321611 ] Manoj Kumar commented on SPARK-5016: Is there a possibility that memory is shared

[jira] [Issue Comment Deleted] (SPARK-5016) GaussianMixtureEM should distribute matrix inverse for large numFeatures, k

[ https://issues.apache.org/jira/browse/SPARK-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar updated SPARK-5016: --- Comment: was deleted (was: Is there a possibility that memory is shared between all k reducers (I

[jira] [Closed] (SPARK-5774) Support save RDD append to file

[ https://issues.apache.org/jira/browse/SPARK-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang closed SPARK-5774. -- Support save RDD append to file --- Key: SPARK-5774

[jira] [Commented] (SPARK-5774) Support save RDD append to file

[ https://issues.apache.org/jira/browse/SPARK-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321570#comment-14321570 ] Yanbo Liang commented on SPARK-5774: [~srowen] Thank you for your replay. Your opinion

[jira] [Resolved] (SPARK-5819) Backport of SPARK-5805 to branch-1.2

[ https://issues.apache.org/jira/browse/SPARK-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emre Sevinç resolved SPARK-5819. Resolution: Fixed Target Version/s: 1.2.1, 1.2.0 (was: 1.2.0, 1.2.1) Backport of

[jira] [Resolved] (SPARK-5822) Add add-source goal in Scala plugin for Eclipse

[ https://issues.apache.org/jira/browse/SPARK-5822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5822. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4531

[jira] [Updated] (SPARK-5822) Add add-source goal in Scala plugin for Eclipse

[ https://issues.apache.org/jira/browse/SPARK-5822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5822: - Assignee: Gang Li Add add-source goal in Scala plugin for Eclipse

[jira] [Resolved] (SPARK-5800) Streaming. Change linked files according the selected language

[ https://issues.apache.org/jira/browse/SPARK-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gaspar Muñoz resolved SPARK-5800. -- Resolution: Fixed Streaming. Change linked files according the selected language

[jira] [Closed] (SPARK-5819) Backport of SPARK-5805 to branch-1.2

[ https://issues.apache.org/jira/browse/SPARK-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emre Sevinç closed SPARK-5819. -- Backport of SPARK-5805 to branch-1.2 Key:

[jira] [Resolved] (SPARK-5819) Backport of SPARK-5805 to branch-1.2

[ https://issues.apache.org/jira/browse/SPARK-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5819. -- Resolution: Duplicate Fix Version/s: (was: 1.2.1) (was:

[jira] [Commented] (SPARK-5819) Backport of SPARK-5805 to branch-1.2

[ https://issues.apache.org/jira/browse/SPARK-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321679#comment-14321679 ] Sean Owen commented on SPARK-5819: -- (That's fine, you didn't need another JIRA here

[jira] [Reopened] (SPARK-5819) Backport of SPARK-5805 to branch-1.2

[ https://issues.apache.org/jira/browse/SPARK-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-5819: -- Backport of SPARK-5805 to branch-1.2 Key:

[jira] [Updated] (SPARK-5800) Streaming. Change linked files according the selected language

[ https://issues.apache.org/jira/browse/SPARK-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5800: - Assignee: Gaspar Muñoz Streaming. Change linked files according the selected language

[jira] [Closed] (SPARK-5805) Fix the type error in the final example given in MLlib - Clustering documentation

[ https://issues.apache.org/jira/browse/SPARK-5805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emre Sevinç closed SPARK-5805. -- Fix the type error in the final example given in MLlib - Clustering documentation

[jira] [Created] (SPARK-5822) Add add-source goal in Scala plugin for Eclipse

Sean Owen created SPARK-5822: Summary: Add add-source goal in Scala plugin for Eclipse Key: SPARK-5822 URL: https://issues.apache.org/jira/browse/SPARK-5822 Project: Spark Issue Type: Bug

[jira] [Reopened] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-1867: -- I'm reopening this per Phillippe's comment. We have a customer who can also reliably reproduce this, and

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321747#comment-14321747 ] Philippe Girolami commented on SPARK-1867: -- I tried this afternoon again using

[jira] [Commented] (SPARK-5813) Spark-ec2: Switch to OracleJDK

[ https://issues.apache.org/jira/browse/SPARK-5813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321748#comment-14321748 ] Florian Verhein commented on SPARK-5813: No specific technical reason esp WRT

[jira] [Updated] (SPARK-5134) Bump default Hadoop version to 2+

[ https://issues.apache.org/jira/browse/SPARK-5134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5134: - Target Version/s: 2+ For the moment this seems like a WontFix-until-2.x, although I'd be pleased to see

[jira] [Commented] (SPARK-5813) Spark-ec2: Switch to OracleJDK

[ https://issues.apache.org/jira/browse/SPARK-5813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321749#comment-14321749 ] Sean Owen commented on SPARK-5813: -- I could be wrong about this, but I thought one of the

[jira] [Updated] (SPARK-5801) Shuffle creates too many nested directories

[ https://issues.apache.org/jira/browse/SPARK-5801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5801: --- Priority: Critical (was: Major) Shuffle creates too many nested directories

[jira] [Commented] (SPARK-5813) Spark-ec2: Switch to OracleJDK

[ https://issues.apache.org/jira/browse/SPARK-5813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321267#comment-14321267 ] Patrick Wendell commented on SPARK-5813: Hey [~florianverhein]. Just wondering,

[jira] [Updated] (SPARK-5801) Shuffle creates too many nested directories

[ https://issues.apache.org/jira/browse/SPARK-5801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5801: --- Component/s: Spark Core Shuffle creates too many nested directories