[jira] [Assigned] (SPARK-6673) spark-shell.cmd can't start even when spark was built in Windows

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6673: --- Assignee: Apache Spark > spark-shell.cmd can't start even when spark was built in Windows > -

[jira] [Commented] (SPARK-6673) spark-shell.cmd can't start even when spark was built in Windows

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392246#comment-14392246 ] Apache Spark commented on SPARK-6673: - User 'tsudukim' has created a pull request for

[jira] [Assigned] (SPARK-6673) spark-shell.cmd can't start even when spark was built in Windows

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6673: --- Assignee: (was: Apache Spark) > spark-shell.cmd can't start even when spark was built in

[jira] [Commented] (SPARK-6671) Add status command for spark daemons

2015-04-01 Thread PRADEEP CHANUMOLU (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392236#comment-14392236 ] PRADEEP CHANUMOLU commented on SPARK-6671: -- created a pull request for the fix.

[jira] [Resolved] (SPARK-6627) Clean up of shuffle code and interfaces

2015-04-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6627. Resolution: Fixed Fix Version/s: 1.4.0 > Clean up of shuffle code and interfaces > --

[jira] [Commented] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

2015-04-01 Thread Marius Soutier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392234#comment-14392234 ] Marius Soutier commented on SPARK-6613: --- It's combination of actorStreams and Stream

[jira] [Created] (SPARK-6673) spark-shell.cmd can't start even when spark was built in Windows

2015-04-01 Thread Masayoshi TSUZUKI (JIRA)
Masayoshi TSUZUKI created SPARK-6673: Summary: spark-shell.cmd can't start even when spark was built in Windows Key: SPARK-6673 URL: https://issues.apache.org/jira/browse/SPARK-6673 Project: Spark

[jira] [Created] (SPARK-6672) createDataFrame from RDD[Row] with UDTs cannot be saved

2015-04-01 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-6672: Summary: createDataFrame from RDD[Row] with UDTs cannot be saved Key: SPARK-6672 URL: https://issues.apache.org/jira/browse/SPARK-6672 Project: Spark Issue T

[jira] [Assigned] (SPARK-3862) MultiWayBroadcastInnerHashJoin

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3862: --- Assignee: (was: Apache Spark) > MultiWayBroadcastInnerHashJoin >

[jira] [Commented] (SPARK-3862) MultiWayBroadcastInnerHashJoin

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392214#comment-14392214 ] Apache Spark commented on SPARK-3862: - User 'chenghao-intel' has created a pull reques

[jira] [Assigned] (SPARK-3862) MultiWayBroadcastInnerHashJoin

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3862: --- Assignee: Apache Spark > MultiWayBroadcastInnerHashJoin > -- > >

[jira] [Commented] (SPARK-6671) Add status command for spark daemons

2015-04-01 Thread PRADEEP CHANUMOLU (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392207#comment-14392207 ] PRADEEP CHANUMOLU commented on SPARK-6671: -- Its fairly simple fix and I can provi

[jira] [Created] (SPARK-6671) Add status command for spark daemons

2015-04-01 Thread PRADEEP CHANUMOLU (JIRA)
PRADEEP CHANUMOLU created SPARK-6671: Summary: Add status command for spark daemons Key: SPARK-6671 URL: https://issues.apache.org/jira/browse/SPARK-6671 Project: Spark Issue Type: Improv

[jira] [Updated] (SPARK-6106) Support user group mapping and groups in view, modify and admin acls

2015-04-01 Thread Colin Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Ma updated SPARK-6106: Attachment: (was: SPARK-6106.001.patch) > Support user group mapping and groups in view, modify and admi

[jira] [Assigned] (SPARK-6106) Support user group mapping and groups in view, modify and admin acls

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6106: --- Assignee: Apache Spark > Support user group mapping and groups in view, modify and admin acls

[jira] [Assigned] (SPARK-6106) Support user group mapping and groups in view, modify and admin acls

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6106: --- Assignee: (was: Apache Spark) > Support user group mapping and groups in view, modify and

[jira] [Commented] (SPARK-6106) Support user group mapping and groups in view, modify and admin acls

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392188#comment-14392188 ] Apache Spark commented on SPARK-6106: - User 'colinmjj' has created a pull request for

[jira] [Closed] (SPARK-6659) Spark SQL 1.3 cannot read json file that only with a record.

2015-04-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell closed SPARK-6659. -- Resolution: Invalid Per the comment, I think the issue is the JSON is not correctly formatted.

[jira] [Updated] (SPARK-6659) Spark SQL 1.3 cannot read json file that only with a record.

2015-04-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6659: --- Component/s: SQL > Spark SQL 1.3 cannot read json file that only with a record. >

[jira] [Created] (SPARK-6670) HiveContext.analyze should throw UnsupportedOperationException instead of NotImplementedError

2015-04-01 Thread Yin Huai (JIRA)
Yin Huai created SPARK-6670: --- Summary: HiveContext.analyze should throw UnsupportedOperationException instead of NotImplementedError Key: SPARK-6670 URL: https://issues.apache.org/jira/browse/SPARK-6670 Pro

[jira] [Assigned] (SPARK-6667) hang while collect in PySpark

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6667: --- Assignee: Apache Spark (was: Davies Liu) > hang while collect in PySpark > -

[jira] [Commented] (SPARK-6667) hang while collect in PySpark

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392170#comment-14392170 ] Apache Spark commented on SPARK-6667: - User 'davies' has created a pull request for th

[jira] [Assigned] (SPARK-6667) hang while collect in PySpark

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6667: --- Assignee: Davies Liu (was: Apache Spark) > hang while collect in PySpark > -

[jira] [Created] (SPARK-6669) Lock metastore client in analyzeTable

2015-04-01 Thread Yin Huai (JIRA)
Yin Huai created SPARK-6669: --- Summary: Lock metastore client in analyzeTable Key: SPARK-6669 URL: https://issues.apache.org/jira/browse/SPARK-6669 Project: Spark Issue Type: Bug Component

[jira] [Commented] (SPARK-6667) hang while collect in PySpark

2015-04-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392161#comment-14392161 ] Davies Liu commented on SPARK-6667: --- The server side had timed out: {code} 15/04/01 22:0

[jira] [Commented] (SPARK-6618) HiveMetastoreCatalog.lookupRelation should use fine-grained lock

2015-04-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392148#comment-14392148 ] Yin Huai commented on SPARK-6618: - Seems the metastore client is not protected in some cas

[jira] [Reopened] (SPARK-6618) HiveMetastoreCatalog.lookupRelation should use fine-grained lock

2015-04-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reopened SPARK-6618: - > HiveMetastoreCatalog.lookupRelation should use fine-grained lock > -

[jira] [Updated] (SPARK-6667) hang while collect in PySpark

2015-04-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-6667: -- Affects Version/s: 1.4.0 1.3.1 > hang while collect in PySpark >

[jira] [Closed] (SPARK-6658) Incorrect DataFrame Documentation Type References

2015-04-01 Thread Chet Mancini (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chet Mancini closed SPARK-6658. --- > Incorrect DataFrame Documentation Type References > - >

[jira] [Updated] (SPARK-6668) repeated asking to remove non-existent executor

2015-04-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-6668: -- Affects Version/s: 1.4.0 > repeated asking to remove non-existent executor > ---

[jira] [Created] (SPARK-6668) repeated asking to remove non-existent executor

2015-04-01 Thread Davies Liu (JIRA)
Davies Liu created SPARK-6668: - Summary: repeated asking to remove non-existent executor Key: SPARK-6668 URL: https://issues.apache.org/jira/browse/SPARK-6668 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-6667) hang while collect in PySpark

2015-04-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-6667: -- Priority: Critical (was: Major) > hang while collect in PySpark > - > >

[jira] [Created] (SPARK-6667) hang while collect in PySpark

2015-04-01 Thread Davies Liu (JIRA)
Davies Liu created SPARK-6667: - Summary: hang while collect in PySpark Key: SPARK-6667 URL: https://issues.apache.org/jira/browse/SPARK-6667 Project: Spark Issue Type: Bug Components: P

[jira] [Reopened] (SPARK-6575) Add configuration to disable schema merging while converting metastore Parquet tables

2015-04-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reopened SPARK-6575: - > Add configuration to disable schema merging while converting metastore > Parquet tables > -

[jira] [Commented] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

2015-04-01 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392102#comment-14392102 ] zhichao-li commented on SPARK-6613: --- Just trying to understand the issue but it cann't b

[jira] [Created] (SPARK-6666) org.apache.spark.sql.jdbc.JDBCRDD does not escape/quote column names

2015-04-01 Thread John Ferguson (JIRA)
John Ferguson created SPARK-: Summary: org.apache.spark.sql.jdbc.JDBCRDD does not escape/quote column names Key: SPARK- URL: https://issues.apache.org/jira/browse/SPARK- Project: Spark

[jira] [Commented] (SPARK-4081) Categorical feature indexing

2015-04-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392055#comment-14392055 ] Joseph K. Bradley commented on SPARK-4081: -- Note: I am adding this to the spark.m

[jira] [Commented] (SPARK-6113) Stabilize DecisionTree and ensembles APIs

2015-04-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392054#comment-14392054 ] Joseph K. Bradley commented on SPARK-6113: -- I just noted that this is blocked by

[jira] [Commented] (SPARK-5989) Model import/export for LDAModel

2015-04-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392047#comment-14392047 ] Joseph K. Bradley commented on SPARK-5989: -- If there are other tasks on your plat

[jira] [Commented] (SPARK-5989) Model import/export for LDAModel

2015-04-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392046#comment-14392046 ] Joseph K. Bradley commented on SPARK-5989: -- Yes, but this may be affected by this

[jira] [Updated] (SPARK-5989) Model import/export for LDAModel

2015-04-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5989: - Assignee: Manoj Kumar > Model import/export for LDAModel > ---

[jira] [Assigned] (SPARK-6639) Create a new script to start multiple masters

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6639: --- Assignee: (was: Apache Spark) > Create a new script to start multiple masters > -

[jira] [Assigned] (SPARK-6639) Create a new script to start multiple masters

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6639: --- Assignee: Apache Spark > Create a new script to start multiple masters >

[jira] [Commented] (SPARK-6639) Create a new script to start multiple masters

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392037#comment-14392037 ] Apache Spark commented on SPARK-6639: - User 'wangzhonnew' has created a pull request f

[jira] [Created] (SPARK-6665) Randomly Shuffle an RDD

2015-04-01 Thread Florian Verhein (JIRA)
Florian Verhein created SPARK-6665: -- Summary: Randomly Shuffle an RDD Key: SPARK-6665 URL: https://issues.apache.org/jira/browse/SPARK-6665 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-6653) New configuration property to specify port for sparkYarnAM actor system

2015-04-01 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391993#comment-14391993 ] Shixiong Zhu commented on SPARK-6653: - Could you send a pull request to https://github

[jira] [Updated] (SPARK-3468) WebUI Timeline-View feature

2015-04-01 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-3468: -- Affects Version/s: 1.4.0 > WebUI Timeline-View feature > --- > >

[jira] [Updated] (SPARK-3468) WebUI Timeline-View feature

2015-04-01 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-3468: -- Target Version/s: 1.4.0 > WebUI Timeline-View feature > --- > >

[jira] [Commented] (SPARK-6664) Split Ordered RDD into multiple RDDs by keys (boundaries or intervals)

2015-04-01 Thread Florian Verhein (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391950#comment-14391950 ] Florian Verhein commented on SPARK-6664: The closest approach I've found that shou

[jira] [Updated] (SPARK-6664) Split Ordered RDD into multiple RDDs by keys (boundaries or intervals)

2015-04-01 Thread Florian Verhein (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Florian Verhein updated SPARK-6664: --- Description: I can't find this functionality (if I missed something, apologies!), but it woul

[jira] [Comment Edited] (SPARK-5682) Add encrypted shuffle in spark

2015-04-01 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390235#comment-14390235 ] liyunzhang_intel edited comment on SPARK-5682 at 4/2/15 1:34 AM: ---

[jira] [Created] (SPARK-6664) Split Ordered RDD into multiple RDDs by keys (boundaries or intervals)

2015-04-01 Thread Florian Verhein (JIRA)
Florian Verhein created SPARK-6664: -- Summary: Split Ordered RDD into multiple RDDs by keys (boundaries or intervals) Key: SPARK-6664 URL: https://issues.apache.org/jira/browse/SPARK-6664 Project: Spa

[jira] [Updated] (SPARK-5682) Add encrypted shuffle in spark

2015-04-01 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated SPARK-5682: Attachment: Design Document of Encrypted Spark Shuffle_20150402.docx > Add encrypted shuffle

[jira] [Updated] (SPARK-5682) Add encrypted shuffle in spark

2015-04-01 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated SPARK-5682: Attachment: (was: Design Document of Encrypted Spark Shuffle_20150401.docx) > Add encry

[jira] [Resolved] (SPARK-6660) MLLibPythonAPI.pythonToJava doesn't recognize object arrays

2015-04-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6660. -- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull re

[jira] [Commented] (SPARK-6659) Spark SQL 1.3 cannot read json file that only with a record.

2015-04-01 Thread Adnan Khan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391898#comment-14391898 ] Adnan Khan commented on SPARK-6659: --- {quote} Spark SQL 1.3 cannot read json file that on

[jira] [Assigned] (SPARK-6663) Use Literal.create instead of constructor

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6663: --- Assignee: Apache Spark (was: Davies Liu) > Use Literal.create instead of constructor > -

[jira] [Assigned] (SPARK-6663) Use Literal.create instead of constructor

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6663: --- Assignee: Davies Liu (was: Apache Spark) > Use Literal.create instead of constructor > -

[jira] [Commented] (SPARK-6663) Use Literal.create instead of constructor

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391861#comment-14391861 ] Apache Spark commented on SPARK-6663: - User 'davies' has created a pull request for th

[jira] [Created] (SPARK-6663) Use Literal.create instead of constructor

2015-04-01 Thread Davies Liu (JIRA)
Davies Liu created SPARK-6663: - Summary: Use Literal.create instead of constructor Key: SPARK-6663 URL: https://issues.apache.org/jira/browse/SPARK-6663 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-6553) Support for functools.partial as UserDefinedFunction

2015-04-01 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-6553. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 > Support for functools.partial

[jira] [Commented] (SPARK-6553) Support for functools.partial as UserDefinedFunction

2015-04-01 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391851#comment-14391851 ] Josh Rosen commented on SPARK-6553: --- This was fixed by https://github.com/apache/spark/p

[jira] [Updated] (SPARK-6553) Support for functools.partial as UserDefinedFunction

2015-04-01 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-6553: -- Assignee: Kalle Jepsen > Support for functools.partial as UserDefinedFunction >

[jira] [Resolved] (SPARK-6580) Optimize LogisticRegressionModel.predictPoint

2015-04-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6580. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5249 [https://githu

[jira] [Updated] (SPARK-6580) Optimize LogisticRegressionModel.predictPoint

2015-04-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6580: - Assignee: Yanbo Liang > Optimize LogisticRegressionModel.predictPoint > --

[jira] [Commented] (SPARK-6662) Allow variable substitution in spark.yarn.historyServer.address

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391825#comment-14391825 ] Apache Spark commented on SPARK-6662: - User 'piaozhexiu' has created a pull request fo

[jira] [Assigned] (SPARK-6662) Allow variable substitution in spark.yarn.historyServer.address

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6662: --- Assignee: Apache Spark > Allow variable substitution in spark.yarn.historyServer.address > --

[jira] [Assigned] (SPARK-6662) Allow variable substitution in spark.yarn.historyServer.address

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6662: --- Assignee: (was: Apache Spark) > Allow variable substitution in spark.yarn.historyServer.a

[jira] [Updated] (SPARK-6576) DenseMatrix in PySpark should support indexing

2015-04-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6576: - Assignee: Manoj Kumar > DenseMatrix in PySpark should support indexing > -

[jira] [Resolved] (SPARK-6576) DenseMatrix in PySpark should support indexing

2015-04-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6576. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5232 [https://githu

[jira] [Created] (SPARK-6662) Allow variable substitution in spark.yarn.historyServer.address

2015-04-01 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created SPARK-6662: Summary: Allow variable substitution in spark.yarn.historyServer.address Key: SPARK-6662 URL: https://issues.apache.org/jira/browse/SPARK-6662 Project: Spark

[jira] [Resolved] (SPARK-6642) Change the lambda weight to number of explicit ratings in implicit ALS

2015-04-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6642. -- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull re

[jira] [Comment Edited] (SPARK-2243) Support multiple SparkContexts in the same JVM

2015-04-01 Thread Jason Hubbard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391770#comment-14391770 ] Jason Hubbard edited comment on SPARK-2243 at 4/1/15 11:41 PM: -

[jira] [Comment Edited] (SPARK-2243) Support multiple SparkContexts in the same JVM

2015-04-01 Thread Jason Hubbard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391770#comment-14391770 ] Jason Hubbard edited comment on SPARK-2243 at 4/1/15 11:40 PM: -

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2015-04-01 Thread Jason Hubbard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391770#comment-14391770 ] Jason Hubbard commented on SPARK-2243: -- Apologizing for being flippant is a bit of an

[jira] [Commented] (SPARK-6578) Outbound channel in network library is not thread-safe, can lead to fetch failures

2015-04-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391737#comment-14391737 ] Reynold Xin commented on SPARK-6578: We should patch 1.2.x too. [~vanzin] mind submitt

[jira] [Created] (SPARK-6661) Python type errors should print type, not object

2015-04-01 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-6661: Summary: Python type errors should print type, not object Key: SPARK-6661 URL: https://issues.apache.org/jira/browse/SPARK-6661 Project: Spark Issue

[jira] [Commented] (SPARK-6578) Outbound channel in network library is not thread-safe, can lead to fetch failures

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391731#comment-14391731 ] Apache Spark commented on SPARK-6578: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-6660) MLLibPythonAPI.pythonToJava doesn't recognize object arrays

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6660: --- Assignee: Xiangrui Meng (was: Apache Spark) > MLLibPythonAPI.pythonToJava doesn't recognize

[jira] [Assigned] (SPARK-6660) MLLibPythonAPI.pythonToJava doesn't recognize object arrays

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6660: --- Assignee: Apache Spark (was: Xiangrui Meng) > MLLibPythonAPI.pythonToJava doesn't recognize

[jira] [Commented] (SPARK-6660) MLLibPythonAPI.pythonToJava doesn't recognize object arrays

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391720#comment-14391720 ] Apache Spark commented on SPARK-6660: - User 'mengxr' has created a pull request for th

[jira] [Resolved] (SPARK-6578) Outbound channel in network library is not thread-safe, can lead to fetch failures

2015-04-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-6578. Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 > Outbound channel in network

[jira] [Created] (SPARK-6660) MLLibPythonAPI.pythonToJava doesn't recognize object arrays

2015-04-01 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-6660: Summary: MLLibPythonAPI.pythonToJava doesn't recognize object arrays Key: SPARK-6660 URL: https://issues.apache.org/jira/browse/SPARK-6660 Project: Spark Is

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

2015-04-01 Thread Venkat Krishnamurthy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391683#comment-14391683 ] Venkat Krishnamurthy commented on SPARK-6646: - I'm looking forward to the rele

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

2015-04-01 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391636#comment-14391636 ] Tathagata Das commented on SPARK-6646: -- I vehemently disagree. I dont think we should

[jira] [Assigned] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5556: --- Assignee: Pedro Rodriguez (was: Apache Spark) > Latent Dirichlet Allocation (LDA) using Gibb

[jira] [Assigned] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5556: --- Assignee: Apache Spark (was: Pedro Rodriguez) > Latent Dirichlet Allocation (LDA) using Gibb

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2015-04-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391629#comment-14391629 ] Sean Owen commented on SPARK-2243: -- Sorry to be flippant but really the answer is to not

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2015-04-01 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391623#comment-14391623 ] Neelesh Srinivas Salian commented on SPARK-2243: I hit this error. Simply

[jira] [Resolved] (SPARK-6658) Incorrect DataFrame Documentation Type References

2015-04-01 Thread Chet Mancini (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chet Mancini resolved SPARK-6658. - Resolution: Implemented > Incorrect DataFrame Documentation Type References >

[jira] [Commented] (SPARK-6657) Fix Python doc build warnings

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391593#comment-14391593 ] Apache Spark commented on SPARK-6657: - User 'jkbradley' has created a pull request for

[jira] [Assigned] (SPARK-6657) Fix Python doc build warnings

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6657: --- Assignee: Joseph K. Bradley (was: Apache Spark) > Fix Python doc build warnings > --

[jira] [Assigned] (SPARK-6657) Fix Python doc build warnings

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6657: --- Assignee: Apache Spark (was: Joseph K. Bradley) > Fix Python doc build warnings > --

[jira] [Comment Edited] (SPARK-5989) Model import/export for LDAModel

2015-04-01 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390209#comment-14390209 ] Manoj Kumar edited comment on SPARK-5989 at 4/1/15 10:04 PM: -

[jira] [Assigned] (SPARK-6658) Incorrect DataFrame Documentation Type References

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6658: --- Assignee: (was: Apache Spark) > Incorrect DataFrame Documentation Type References > -

[jira] [Commented] (SPARK-6658) Incorrect DataFrame Documentation Type References

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391563#comment-14391563 ] Apache Spark commented on SPARK-6658: - User 'chetmancini' has created a pull request f

[jira] [Assigned] (SPARK-6658) Incorrect DataFrame Documentation Type References

2015-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6658: --- Assignee: Apache Spark > Incorrect DataFrame Documentation Type References >

[jira] [Created] (SPARK-6659) Spark SQL 1.3 cannot read json file that only with a record.

2015-04-01 Thread luochenghui (JIRA)
luochenghui created SPARK-6659: -- Summary: Spark SQL 1.3 cannot read json file that only with a record. Key: SPARK-6659 URL: https://issues.apache.org/jira/browse/SPARK-6659 Project: Spark Issue

[jira] [Updated] (SPARK-6658) Incorrect DataFrame Documentation Type References

2015-04-01 Thread Chet Mancini (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chet Mancini updated SPARK-6658: Labels: documentation (was: docuentation) > Incorrect DataFrame Documentation Type References > ---

[jira] [Updated] (SPARK-6658) Incorrect DataFrame Documentation Type References

2015-04-01 Thread Chet Mancini (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chet Mancini updated SPARK-6658: Priority: Trivial (was: Major) > Incorrect DataFrame Documentation Type References > --

  1   2   >