[jira] [Updated] (SPARK-5297) File Streams do not work with custom key/values

[ https://issues.apache.org/jira/browse/SPARK-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5297: --- Assignee: Saisai Shao > File Streams do not work with custom key/values >

[jira] [Updated] (SPARK-5297) File Streams do not work with custom key/values

[ https://issues.apache.org/jira/browse/SPARK-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5297: --- Fix Version/s: 1.3.0 > File Streams do not work with custom key/values > -

[jira] [Updated] (SPARK-5297) File Streams do not work with custom key/values

[ https://issues.apache.org/jira/browse/SPARK-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5297: --- Labels: backport-needed (was: ) > File Streams do not work with custom key/values > -

[jira] [Updated] (SPARK-5297) File Streams do not work with custom key/values

[ https://issues.apache.org/jira/browse/SPARK-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5297: --- Target Version/s: 1.3.0, 1.2.1 > File Streams do not work with custom key/values > ---

[jira] [Commented] (SPARK-5345) Fix unstable test case in FsHistoryProviderSuite

[ https://issues.apache.org/jira/browse/SPARK-5345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285298#comment-14285298 ] Apache Spark commented on SPARK-5345: - User 'sarutak' has created a pull request for t

[jira] [Updated] (SPARK-5196) Add comment field in Create Table Field DDL

[ https://issues.apache.org/jira/browse/SPARK-5196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shengli updated SPARK-5196: --- Description: Support `comment` in Create Table Field DDL (was: StructField should contains name, type, nullab

[jira] [Updated] (SPARK-5196) Add comment field in Create Table Field DDL

[ https://issues.apache.org/jira/browse/SPARK-5196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shengli updated SPARK-5196: --- Summary: Add comment field in Create Table Field DDL (was: Add comment field in StructField) > Add comment f

[jira] [Closed] (SPARK-5263) `create table` DDL need to check if table exists first

[ https://issues.apache.org/jira/browse/SPARK-5263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shengli closed SPARK-5263. -- Resolution: Not a Problem > `create table` DDL need to check if table exists first > --

[jira] [Reopened] (SPARK-5263) `create table` DDL need to check if table exists first

[ https://issues.apache.org/jira/browse/SPARK-5263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shengli reopened SPARK-5263: change status > `create table` DDL need to check if table exists first > -

[jira] [Closed] (SPARK-5263) `create table` DDL need to check if table exists first

[ https://issues.apache.org/jira/browse/SPARK-5263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shengli closed SPARK-5263. -- Resolution: Fixed > `create table` DDL need to check if table exists first > --

[jira] [Created] (SPARK-5345) Fix unstable test case in FsHistoryProviderSuite

Kousuke Saruta created SPARK-5345: - Summary: Fix unstable test case in FsHistoryProviderSuite Key: SPARK-5345 URL: https://issues.apache.org/jira/browse/SPARK-5345 Project: Spark Issue Type:

[jira] [Closed] (SPARK-5022) Change VectorUDT to object

[ https://issues.apache.org/jira/browse/SPARK-5022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-5022. -- Resolution: Won't Fix We can't figure out how to pass the class to annotation. > Change VectorUDT to ob

[jira] [Commented] (SPARK-2926) Add MR-style (merge-sort) SortShuffleReader for sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285272#comment-14285272 ] Saisai Shao commented on SPARK-2926: Hi [~manojsamel], we're still waiting for any mai

[jira] [Issue Comment Deleted] (SPARK-1262) Numerical drift in computation of matrix inverse leads to invalid results in ALS

[ https://issues.apache.org/jira/browse/SPARK-1262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1262: - Comment: was deleted (was: That makes sense. There may still be an interesting point here. What would be

[jira] [Updated] (SPARK-5342) Allow long running Spark apps to run on secure YARN/HDFS

[ https://issues.apache.org/jira/browse/SPARK-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated SPARK-5342: Attachment: (was: SparkYARN.pdf) > Allow long running Spark apps to run on secure YARN/H

[jira] [Commented] (SPARK-5342) Allow long running Spark apps to run on secure YARN/HDFS

[ https://issues.apache.org/jira/browse/SPARK-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285266#comment-14285266 ] Hari Shreedharan commented on SPARK-5342: - Looks like we cannot write to the cache

[jira] [Updated] (SPARK-5342) Allow long running Spark apps to run on secure YARN/HDFS

[ https://issues.apache.org/jira/browse/SPARK-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated SPARK-5342: Attachment: SparkYARN.pdf > Allow long running Spark apps to run on secure YARN/HDFS > -

[jira] [Updated] (SPARK-4296) Throw "Expression not in GROUP BY" when using same expression in group by clause and select clause

[ https://issues.apache.org/jira/browse/SPARK-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4296: --- Fix Version/s: 1.2.1 1.3.0 > Throw "Expression not in GROUP BY" when using

[jira] [Commented] (SPARK-4296) Throw "Expression not in GROUP BY" when using same expression in group by clause and select clause

[ https://issues.apache.org/jira/browse/SPARK-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285263#comment-14285263 ] Patrick Wendell commented on SPARK-4296: Note this was fixed in https://github.com

[jira] [Issue Comment Deleted] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4959: --- Comment: was deleted (was: Note that in the 1.2 branch this was fixed by https://github.com/a

[jira] [Commented] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285262#comment-14285262 ] Patrick Wendell commented on SPARK-4959: Excuse my last comment, it was on the wro

[jira] [Commented] (SPARK-5344) HistoryServer cannot recognize that inprogress file was renamed to completed file

[ https://issues.apache.org/jira/browse/SPARK-5344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285261#comment-14285261 ] Apache Spark commented on SPARK-5344: - User 'sarutak' has created a pull request for t

[jira] [Updated] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4959: --- Fix Version/s: (was: 1.2.1) > Attributes are case sensitive when using a select query from

[jira] [Updated] (SPARK-5021) GaussianMixtureEM should be faster for SparseVector input

[ https://issues.apache.org/jira/browse/SPARK-5021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5021: - Assignee: Manoj Kumar > GaussianMixtureEM should be faster for SparseVector input > --

[jira] [Comment Edited] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285258#comment-14285258 ] Patrick Wendell edited comment on SPARK-4959 at 1/21/15 6:47 AM: ---

[jira] [Updated] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4959: --- Fix Version/s: 1.2.1 > Attributes are case sensitive when using a select query from a projecti

[jira] [Updated] (SPARK-5344) HistoryServer cannot recognize that inprogress file was renamed to completed file

[ https://issues.apache.org/jira/browse/SPARK-5344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-5344: -- Description: FsHistoryProvider tries to updates application status but if checkForLogs is called

[jira] [Updated] (SPARK-5344) HistoryServer cannot recognize that inprogress file was renamed to completed file

[ https://issues.apache.org/jira/browse/SPARK-5344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-5344: -- Description: FsHistoryProvider tries to update application status but if checkForLogs is called

[jira] [Commented] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285258#comment-14285258 ] Patrick Wendell commented on SPARK-4959: Note that in the 1.2 branch this was fixe

[jira] [Created] (SPARK-5344) HistoryServer cannot recognize that inprogress file was renamed to completed file

Kousuke Saruta created SPARK-5344: - Summary: HistoryServer cannot recognize that inprogress file was renamed to completed file Key: SPARK-5344 URL: https://issues.apache.org/jira/browse/SPARK-5344 Pro

[jira] [Resolved] (SPARK-5275) pyspark.streaming is not included in assembly jar

[ https://issues.apache.org/jira/browse/SPARK-5275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5275. Resolution: Fixed Assignee: Davies Liu > pyspark.streaming is not included in assembly

[jira] [Updated] (SPARK-4996) Memory leak?

[ https://issues.apache.org/jira/browse/SPARK-4996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4996: --- Priority: Major (was: Blocker) > Memory leak? > > > Key: SPARK-4

[jira] [Commented] (SPARK-4996) Memory leak?

[ https://issues.apache.org/jira/browse/SPARK-4996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285255#comment-14285255 ] Patrick Wendell commented on SPARK-4996: I'm de-escalating this right now because

[jira] [Updated] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4959: --- Target Version/s: 1.3.0, 1.2.1 (was: 1.3.0) > Attributes are case sensitive when using a sele

[jira] [Updated] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4959: --- Assignee: Cheng Hao > Attributes are case sensitive when using a select query from a projectio

[jira] [Updated] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4959: --- Fix Version/s: 1.3.0 > Attributes are case sensitive when using a select query from a projecti

[jira] [Updated] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4959: --- Priority: Blocker (was: Critical) > Attributes are case sensitive when using a select query f

[jira] [Resolved] (SPARK-5257) SparseVector indices must be non-negative

[ https://issues.apache.org/jira/browse/SPARK-5257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5257. -- Resolution: Won't Fix [~MechCoder] I will resolve as WontFix. With ~1100 open JIRAs unfortunately I don

[jira] [Updated] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-4959: Labels: backport-needed (was: ) > Attributes are case sensitive when using a select query from a projection

[jira] [Commented] (SPARK-5262) coalesce should allow NullType and 1 another type in parameters

[ https://issues.apache.org/jira/browse/SPARK-5262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285220#comment-14285220 ] Yin Huai commented on SPARK-5262: - I am not sure they are actually focusing on different t

[jira] [Commented] (SPARK-5262) coalesce should allow NullType and 1 another type in parameters

[ https://issues.apache.org/jira/browse/SPARK-5262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285192#comment-14285192 ] Adrian Wang commented on SPARK-5262: Yeah, so I think we'd better merge this first and

[jira] [Commented] (SPARK-5262) coalesce should allow NullType and 1 another type in parameters

[ https://issues.apache.org/jira/browse/SPARK-5262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285187#comment-14285187 ] Yin Huai commented on SPARK-5262: - OK i see. In HiveContext, we are still using Hive's UDF

[jira] [Commented] (SPARK-5262) coalesce should allow NullType and 1 another type in parameters

[ https://issues.apache.org/jira/browse/SPARK-5262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285179#comment-14285179 ] Adrian Wang commented on SPARK-5262: Currently if you try coalesce in hivecontext, it

[jira] [Commented] (SPARK-5262) coalesce should allow NullType and 1 another type in parameters

[ https://issues.apache.org/jira/browse/SPARK-5262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285176#comment-14285176 ] Yin Huai commented on SPARK-5262: - [~adrian-wang] I tried Coalesce(null, 1, null) in HiveC

[jira] [Created] (SPARK-5343) ShortestPaths traverses backwards

Michael Malak created SPARK-5343: Summary: ShortestPaths traverses backwards Key: SPARK-5343 URL: https://issues.apache.org/jira/browse/SPARK-5343 Project: Spark Issue Type: Bug Com

[jira] [Commented] (SPARK-5257) SparseVector indices must be non-negative

[ https://issues.apache.org/jira/browse/SPARK-5257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285139#comment-14285139 ] Manoj Kumar commented on SPARK-5257: [~mengxr] Can you please mark this as resolved. I

[jira] [Commented] (SPARK-2620) case class cannot be used as key for reduce

[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285074#comment-14285074 ] Tobias Schlatter commented on SPARK-2620: - [SI-1698|https://issues.scala-lang.org/

[jira] [Commented] (SPARK-5331) Spark workers can't find tachyon master as spark-ec2 doesn't set spark.tachyonStore.url

[ https://issues.apache.org/jira/browse/SPARK-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285072#comment-14285072 ] Florian Verhein commented on SPARK-5331: The problem was actually that the spark-e

[jira] [Updated] (SPARK-5331) Spark workers can't find tachyon master as spark-ec2 doesn't set spark.tachyonStore.url

[ https://issues.apache.org/jira/browse/SPARK-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Florian Verhein updated SPARK-5331: --- Component/s: EC2 Description: ps -ef | grep Tachyon shows Tachyon running on the master (

[jira] [Commented] (SPARK-2620) case class cannot be used as key for reduce

[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285058#comment-14285058 ] Derrick Burns commented on SPARK-2620: -- Thanks for the info! It would seem to me th

[jira] [Updated] (SPARK-5342) Allow long running Spark apps to run on secure YARN/HDFS

[ https://issues.apache.org/jira/browse/SPARK-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated SPARK-5342: Attachment: (was: SparkYARN.pdf) > Allow long running Spark apps to run on secure YARN/H

[jira] [Updated] (SPARK-5342) Allow long running Spark apps to run on secure YARN/HDFS

[ https://issues.apache.org/jira/browse/SPARK-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated SPARK-5342: Attachment: SparkYARN.pdf Minor updates. > Allow long running Spark apps to run on secure Y

[jira] [Commented] (SPARK-5337) respect spark.task.cpus when launch executors

[ https://issues.apache.org/jira/browse/SPARK-5337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284986#comment-14284986 ] Apache Spark commented on SPARK-5337: - User 'CodingCat' has created a pull request for

[jira] [Commented] (SPARK-2620) case class cannot be used as key for reduce

[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284969#comment-14284969 ] Tobias Schlatter commented on SPARK-2620: - I am currently looking into the various

[jira] [Comment Edited] (SPARK-5342) Allow long running Spark apps to run on secure YARN/HDFS

[ https://issues.apache.org/jira/browse/SPARK-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284908#comment-14284908 ] Hari Shreedharan edited comment on SPARK-5342 at 1/21/15 12:46 AM: -

[jira] [Commented] (SPARK-5275) pyspark.streaming is not included in assembly jar

[ https://issues.apache.org/jira/browse/SPARK-5275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284924#comment-14284924 ] Apache Spark commented on SPARK-5275: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-5342) Allow long running Spark apps to run on secure YARN/HDFS

[ https://issues.apache.org/jira/browse/SPARK-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284914#comment-14284914 ] Hari Shreedharan commented on SPARK-5342: - Thanks [~adhoot] for helping with inves

[jira] [Commented] (SPARK-5135) Add support for describe [extended] table to DDL in SQLContext

[ https://issues.apache.org/jira/browse/SPARK-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284915#comment-14284915 ] Apache Spark commented on SPARK-5135: - User 'rxin' has created a pull request for this

[jira] [Resolved] (SPARK-5294) Hide tables in AllStagePages for "Active Stages, Completed Stages and Failed Stages" when they are empty

[ https://issues.apache.org/jira/browse/SPARK-5294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5294. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4083 [https://github.com/

[jira] [Updated] (SPARK-5294) Hide tables in AllStagePages for "Active Stages, Completed Stages and Failed Stages" when they are empty

[ https://issues.apache.org/jira/browse/SPARK-5294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5294: -- Assignee: Kousuke Saruta > Hide tables in AllStagePages for "Active Stages, Completed Stages and Failed

[jira] [Commented] (SPARK-5342) Allow long running Spark apps to run on secure YARN/HDFS

[ https://issues.apache.org/jira/browse/SPARK-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284908#comment-14284908 ] Hari Shreedharan commented on SPARK-5342: - [~pwendell], [~tgraves], [~vanzin], [~a

[jira] [Updated] (SPARK-5342) Allow long running Spark apps to run on secure YARN/HDFS

[ https://issues.apache.org/jira/browse/SPARK-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated SPARK-5342: Attachment: SparkYARN.pdf Design doc with proposed design. Original design doc with comments

[jira] [Commented] (SPARK-3789) Python bindings for GraphX

[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284903#comment-14284903 ] Ameet Talwalkar commented on SPARK-3789: Great. I hope this can make it into 1.3.

[jira] [Created] (SPARK-5342) Allow long running Spark apps to run on secure YARN/HDFS

Hari Shreedharan created SPARK-5342: --- Summary: Allow long running Spark apps to run on secure YARN/HDFS Key: SPARK-5342 URL: https://issues.apache.org/jira/browse/SPARK-5342 Project: Spark

[jira] [Commented] (SPARK-5012) Python API for Gaussian Mixture Model

[ https://issues.apache.org/jira/browse/SPARK-5012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284704#comment-14284704 ] Travis Galoppo commented on SPARK-5012: --- [~MeethuMathew] SPARK-5019 has been complet

[jira] [Commented] (SPARK-5144) spark-yarn module should be published

[ https://issues.apache.org/jira/browse/SPARK-5144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284662#comment-14284662 ] David McWhorter commented on SPARK-5144: Similar problem here, building an uber-ja

[jira] [Commented] (SPARK-3452) Maven build should skip publishing artifacts people shouldn't depend on

[ https://issues.apache.org/jira/browse/SPARK-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284659#comment-14284659 ] David McWhorter commented on SPARK-3452: Same problem here -- if spark-yarn is not

[jira] [Created] (SPARK-5341) Support maven coordinates in spark-shell and spark-submit

Burak Yavuz created SPARK-5341: -- Summary: Support maven coordinates in spark-shell and spark-submit Key: SPARK-5341 URL: https://issues.apache.org/jira/browse/SPARK-5341 Project: Spark Issue Typ

[jira] [Updated] (SPARK-5186) Vector.equals and Vector.hashCode are very inefficient and fail on SparseVectors with large size

[ https://issues.apache.org/jira/browse/SPARK-5186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5186: - Assignee: yuhao yang > Vector.equals and Vector.hashCode are very inefficient and fail on > Spar

[jira] [Resolved] (SPARK-5186) Vector.equals and Vector.hashCode are very inefficient and fail on SparseVectors with large size

[ https://issues.apache.org/jira/browse/SPARK-5186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5186. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3997 [https://githu

[jira] [Resolved] (SPARK-5323) Row shouldn't extend Seq

[ https://issues.apache.org/jira/browse/SPARK-5323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5323. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4115 [https:/

[jira] [Updated] (SPARK-3439) Add Canopy Clustering Algorithm

[ https://issues.apache.org/jira/browse/SPARK-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3439: - Assignee: Muhammad-Ali A'rabi > Add Canopy Clustering Algorithm > ---

[jira] [Commented] (SPARK-3439) Add Canopy Clustering Algorithm

[ https://issues.apache.org/jira/browse/SPARK-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284584#comment-14284584 ] Xiangrui Meng commented on SPARK-3439: -- [~angellandros] Are you interested in contrib

[jira] [Commented] (SPARK-4259) Add Spectral Clustering Algorithm with Gaussian Similarity Function

[ https://issues.apache.org/jira/browse/SPARK-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284561#comment-14284561 ] Xiangrui Meng commented on SPARK-4259: -- Note: [~javadba]'s update is from an offline

[jira] [Closed] (SPARK-4296) Throw "Expression not in GROUP BY" when using same expression in group by clause and select clause

[ https://issues.apache.org/jira/browse/SPARK-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust closed SPARK-4296. --- Resolution: Fixed > Throw "Expression not in GROUP BY" when using same expression in group by

[jira] [Commented] (SPARK-4259) Add Spectral Clustering Algorithm with Gaussian Similarity Function

[ https://issues.apache.org/jira/browse/SPARK-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284470#comment-14284470 ] Stephen Boesch commented on SPARK-4259: --- Xiangrui has provided valuable feedback. Hi

[jira] [Resolved] (SPARK-4923) Add Developer API to REPL to allow re-publishing the REPL jar

[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4923. Resolution: Fixed Target Version/s: 1.3.0 (was: 1.3.0, 1.2.1) I updated the title

[jira] [Updated] (SPARK-4923) Add Developer API to REPL to allow re-publishing the REPL jar

[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4923: --- Assignee: Chip Senkbeil > Add Developer API to REPL to allow re-publishing the REPL jar >

[jira] [Updated] (SPARK-4923) Add Developer API to REPL to allow re-publishing the REPL jar

[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4923: --- Summary: Add Developer API to REPL to allow re-publishing the REPL jar (was: Maven build shou

[jira] [Updated] (SPARK-5289) Backport publishing of repl, yarn into branch-1.2

[ https://issues.apache.org/jira/browse/SPARK-5289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5289: --- Fix Version/s: 1.2.1 > Backport publishing of repl, yarn into branch-1.2 > ---

[jira] [Resolved] (SPARK-5276) pyspark.streaming is not included in assembly jar

[ https://issues.apache.org/jira/browse/SPARK-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5276. Resolution: Duplicate > pyspark.streaming is not included in assembly jar >

[jira] [Resolved] (SPARK-5287) Add defaultSizeOf to every data type

[ https://issues.apache.org/jira/browse/SPARK-5287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5287. Resolution: Fixed Fix Version/s: 1.3.0 > Add defaultSizeOf to every data type > -

[jira] [Updated] (SPARK-5287) Add defaultSizeOf to every data type

[ https://issues.apache.org/jira/browse/SPARK-5287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5287: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-5166 > Add defaultSizeOf to every data type > -

[jira] [Updated] (SPARK-5287) Add defaultSizeOf to every data type

[ https://issues.apache.org/jira/browse/SPARK-5287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5287: --- Assignee: Yin Huai > Add defaultSizeOf to every data type > > >

[jira] [Resolved] (SPARK-5019) Update GMM API to use MultivariateGaussian

[ https://issues.apache.org/jira/browse/SPARK-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5019. -- Resolution: Fixed Fixed by https://github.com/apache/spark/pull/4088 > Update GMM API to use Mu

[jira] [Updated] (SPARK-5019) Update GMM API to use MultivariateGaussian

[ https://issues.apache.org/jira/browse/SPARK-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5019: - Assignee: Travis Galoppo > Update GMM API to use MultivariateGaussian > --

[jira] [Updated] (SPARK-5019) Update GMM API to use MultivariateGaussian

[ https://issues.apache.org/jira/browse/SPARK-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5019: - Fix Version/s: 1.3.0 > Update GMM API to use MultivariateGaussian > --

[jira] [Updated] (SPARK-5019) Update GMM API to use MultivariateGaussian

[ https://issues.apache.org/jira/browse/SPARK-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5019: - Priority: Minor (was: Blocker) > Update GMM API to use MultivariateGaussian > ---

[jira] [Commented] (SPARK-5226) Add DBSCAN Clustering Algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-5226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284391#comment-14284391 ] Xiangrui Meng commented on SPARK-5226: -- The preprocessing step is parallel but very e

[jira] [Commented] (SPARK-3789) Python bindings for GraphX

[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284381#comment-14284381 ] Kushal Datta commented on SPARK-3789: - Hi Ameet, Going well. I'm planning to issue th

[jira] [Updated] (SPARK-5340) Spark startup in local mode should not always create HTTP file server

[ https://issues.apache.org/jira/browse/SPARK-5340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul R. Brown updated SPARK-5340: - Summary: Spark startup in local mode should not always create HTTP file server (was: Spark startu

[jira] [Created] (SPARK-5340) Spark startup in local mode shoudl not alway create HTTP file server

Paul R. Brown created SPARK-5340: Summary: Spark startup in local mode shoudl not alway create HTTP file server Key: SPARK-5340 URL: https://issues.apache.org/jira/browse/SPARK-5340 Project: Spark

[jira] [Commented] (SPARK-3789) Python bindings for GraphX

[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284375#comment-14284375 ] Ameet Talwalkar commented on SPARK-3789: Hi Kushal, Just curious to know how thin

[jira] [Resolved] (SPARK-5329) UIWorkloadGenerator should stop SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-5329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5329. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Kousuke Saruta > UIWorkload

[jira] [Updated] (SPARK-4660) JavaSerializer uses wrong classloader

[ https://issues.apache.org/jira/browse/SPARK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4660: --- Assignee: Piotr Kołaczkowski > JavaSerializer uses wrong classloader > ---

[jira] [Resolved] (SPARK-4660) JavaSerializer uses wrong classloader

[ https://issues.apache.org/jira/browse/SPARK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4660. Resolution: Fixed Fix Version/s: 1.2.1 1.1.2 1.3

[jira] [Commented] (SPARK-4630) Dynamically determine optimal number of partitions

[ https://issues.apache.org/jira/browse/SPARK-4630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284341#comment-14284341 ] Kostas Sakellis commented on SPARK-4630: I agree that this should be build not ass

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284335#comment-14284335 ] Manoj Samel commented on SPARK-2243: Is there a target release for this ? > Support m

[jira] [Commented] (SPARK-5339) build/mvn doesn't work because of invalid URL for maven's tgz.

[ https://issues.apache.org/jira/browse/SPARK-5339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284317#comment-14284317 ] Sean Owen commented on SPARK-5339: -- To clarify, there are two issues: the current downloa

[jira] [Commented] (SPARK-5339) build/mvn doesn't work because of invalid URL for maven's tgz.

[ https://issues.apache.org/jira/browse/SPARK-5339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284308#comment-14284308 ] Apache Spark commented on SPARK-5339: - User 'sarutak' has created a pull request for t

  1   2   >