[jira] [Updated] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-10-05 Thread Pallavi Priyadarshini (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pallavi Priyadarshini updated SPARK-10946: -- Summary: JDBC - Use Statement.executeUpdate instead of PreparedStatement.execut

[jira] [Created] (SPARK-10946) JDBC - Use Statement.execute instead of PreparedStatement.execute for DDLs

2015-10-05 Thread Pallavi Priyadarshini (JIRA)
Pallavi Priyadarshini created SPARK-10946: - Summary: JDBC - Use Statement.execute instead of PreparedStatement.execute for DDLs Key: SPARK-10946 URL: https://issues.apache.org/jira/browse/SPARK-10946

[jira] [Commented] (SPARK-10942) Not all cached RDDs are unpersisted

2015-10-05 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944569#comment-14944569 ] Rekha Joshi commented on SPARK-10942: - great, thanks [~pnpritchard].In anycase will k

[jira] [Created] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-05 Thread Khaled Ammar (JIRA)
Khaled Ammar created SPARK-10945: Summary: GraphX computes Pagerank with NaN (with some datasets) Key: SPARK-10945 URL: https://issues.apache.org/jira/browse/SPARK-10945 Project: Spark Issue

[jira] [Comment Edited] (SPARK-10944) org/slf4j/Logger is not provided in spark-1.5.1-bin-without-hadoop/lib/spark-assembly-1.5.1-hadoop2.2.0.jar

2015-10-05 Thread Pranas Baliuka (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944539#comment-14944539 ] Pranas Baliuka edited comment on SPARK-10944 at 10/6/15 5:42 AM: --

[jira] [Comment Edited] (SPARK-10944) org/slf4j/Logger is not provided in spark-1.5.1-bin-without-hadoop/lib/spark-assembly-1.5.1-hadoop2.2.0.jar

2015-10-05 Thread Pranas Baliuka (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944539#comment-14944539 ] Pranas Baliuka edited comment on SPARK-10944 at 10/6/15 5:42 AM: --

[jira] [Commented] (SPARK-10944) org/slf4j/Logger is not provided in spark-1.5.1-bin-without-hadoop/lib/spark-assembly-1.5.1-hadoop2.2.0.jar

2015-10-05 Thread Pranas Baliuka (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944539#comment-14944539 ] Pranas Baliuka commented on SPARK-10944: If one wants to deploy Spark without Had

[jira] [Created] (SPARK-10944) org/slf4j/Logger is not provided in spark-1.5.1-bin-without-hadoop/lib/spark-assembly-1.5.1-hadoop2.2.0.jar

2015-10-05 Thread Pranas Baliuka (JIRA)
Pranas Baliuka created SPARK-10944: -- Summary: org/slf4j/Logger is not provided in spark-1.5.1-bin-without-hadoop/lib/spark-assembly-1.5.1-hadoop2.2.0.jar Key: SPARK-10944 URL: https://issues.apache.org/jira/brows

[jira] [Created] (SPARK-10943) NullType Column cannot be written to Parquet

2015-10-05 Thread Jason Pohl (JIRA)
Jason Pohl created SPARK-10943: -- Summary: NullType Column cannot be written to Parquet Key: SPARK-10943 URL: https://issues.apache.org/jira/browse/SPARK-10943 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-10942) Not all cached RDDs are unpersisted

2015-10-05 Thread Nick Pritchard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pritchard updated SPARK-10942: --- Priority: Minor (was: Major) > Not all cached RDDs are unpersisted > ---

[jira] [Commented] (SPARK-10942) Not all cached RDDs are unpersisted

2015-10-05 Thread Nick Pritchard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944508#comment-14944508 ] Nick Pritchard commented on SPARK-10942: [~rekhajoshm] Thanks for trying to repro

[jira] [Updated] (SPARK-10942) Not all cached RDDs are unpersisted

2015-10-05 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated SPARK-10942: Attachment: SPARK-10942_3.png SPARK-10942_2.png SPARK-10942_1.png S

[jira] [Comment Edited] (SPARK-10942) Not all cached RDDs are unpersisted

2015-10-05 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944500#comment-14944500 ] Rekha Joshi edited comment on SPARK-10942 at 10/6/15 4:50 AM: -

[jira] [Commented] (SPARK-10942) Not all cached RDDs are unpersisted

2015-10-05 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944497#comment-14944497 ] Rekha Joshi commented on SPARK-10942: - Thanks [~pnpritchard] I tried to replicate the

[jira] [Comment Edited] (SPARK-10942) Not all cached RDDs are unpersisted

2015-10-05 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944497#comment-14944497 ] Rekha Joshi edited comment on SPARK-10942 at 10/6/15 4:48 AM: -

[jira] [Commented] (SPARK-10641) skewness and kurtosis support

2015-10-05 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944485#comment-14944485 ] Seth Hendrickson commented on SPARK-10641: -- My apologies, I haven't been able to

[jira] [Commented] (SPARK-10382) Make example code in user guide testable

2015-10-05 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944480#comment-14944480 ] Xusen Yin commented on SPARK-10382: --- [~mengxr] I'd love to work on this if no one else

[jira] [Commented] (SPARK-10942) Not all cached RDDs are unpersisted

2015-10-05 Thread Nick Pritchard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944478#comment-14944478 ] Nick Pritchard commented on SPARK-10942: Regardless, the documentation for {{spar

[jira] [Commented] (SPARK-10942) Not all cached RDDs are unpersisted

2015-10-05 Thread Nick Pritchard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944477#comment-14944477 ] Nick Pritchard commented on SPARK-10942: [~rekhajoshm] Yes, but calling {{rdd2.un

[jira] [Comment Edited] (SPARK-10942) Not all cached RDDs are unpersisted

2015-10-05 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944465#comment-14944465 ] Rekha Joshi edited comment on SPARK-10942 at 10/6/15 4:04 AM: -

[jira] [Commented] (SPARK-10942) Not all cached RDDs are unpersisted

2015-10-05 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944465#comment-14944465 ] Rekha Joshi commented on SPARK-10942: - [~pnpritchard] hi.did you try rdd.unpersist()?

[jira] [Commented] (SPARK-10534) ORDER BY clause allows only columns that are present in SELECT statement

2015-10-05 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944462#comment-14944462 ] Dilip Biswal commented on SPARK-10534: -- I would like to work on this. > ORDER BY cl

[jira] [Created] (SPARK-10942) Not all cached RDDs are unpersisted

2015-10-05 Thread Nick Pritchard (JIRA)
Nick Pritchard created SPARK-10942: -- Summary: Not all cached RDDs are unpersisted Key: SPARK-10942 URL: https://issues.apache.org/jira/browse/SPARK-10942 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6723) Model import/export for ChiSqSelector

2015-10-05 Thread Jayant Shekhar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944415#comment-14944415 ] Jayant Shekhar commented on SPARK-6723: --- [~fliang] Hey Feyman, I made changes to the

[jira] [Comment Edited] (SPARK-6723) Model import/export for ChiSqSelector

2015-10-05 Thread Jayant Shekhar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944415#comment-14944415 ] Jayant Shekhar edited comment on SPARK-6723 at 10/6/15 2:25 AM:

[jira] [Resolved] (SPARK-10900) Add output operation events to StreamingListener

2015-10-05 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-10900. --- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.6.0 > Add output op

[jira] [Commented] (SPARK-10941) .Refactor AggregateFunction2 and AlgebraicAggregate interfaces to improve code clarity

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944411#comment-14944411 ] Apache Spark commented on SPARK-10941: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-10941) .Refactor AggregateFunction2 and AlgebraicAggregate interfaces to improve code clarity

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10941: Assignee: Apache Spark (was: Josh Rosen) > .Refactor AggregateFunction2 and AlgebraicAggr

[jira] [Assigned] (SPARK-10941) .Refactor AggregateFunction2 and AlgebraicAggregate interfaces to improve code clarity

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10941: Assignee: Josh Rosen (was: Apache Spark) > .Refactor AggregateFunction2 and AlgebraicAggr

[jira] [Created] (SPARK-10941) .Refactor AggregateFunction2 and AlgebraicAggregate interfaces to improve code clarity

2015-10-05 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-10941: -- Summary: .Refactor AggregateFunction2 and AlgebraicAggregate interfaces to improve code clarity Key: SPARK-10941 URL: https://issues.apache.org/jira/browse/SPARK-10941 Pr

[jira] [Commented] (SPARK-9239) HiveUDAF support for AggregateFunction2

2015-10-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944405#comment-14944405 ] Josh Rosen commented on SPARK-9239: --- Is this duplicated by SPARK-10765? > HiveUDAF supp

[jira] [Comment Edited] (SPARK-10560) Make StreamingLogisticRegressionWithSGD Python API equals with Scala one

2015-10-05 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944305#comment-14944305 ] Bryan Cutler edited comment on SPARK-10560 at 10/6/15 1:17 AM:

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

2015-10-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944340#comment-14944340 ] Michael Armbrust commented on SPARK-9776: - You should not create a HiveContext in

[jira] [Commented] (SPARK-10585) only copy data once when generate unsafe projection

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944337#comment-14944337 ] Apache Spark commented on SPARK-10585: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

2015-10-05 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944335#comment-14944335 ] Alexander Pivovarov commented on SPARK-9776: To reproduce the issue 1. start

[jira] [Updated] (SPARK-10934) hashCode of unsafe array may crush

2015-10-05 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-10934: --- Assignee: Wenchen Fan > hashCode of unsafe array may crush > -- > >

[jira] [Updated] (SPARK-10934) hashCode of unsafe array may crush

2015-10-05 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-10934: --- Fix Version/s: 1.5.2 > hashCode of unsafe array may crush > -- > >

[jira] [Resolved] (SPARK-10934) hashCode of unsafe array may crush

2015-10-05 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10934. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8987 [https://github.c

[jira] [Commented] (SPARK-10940) Too many open files Spark Shuffle

2015-10-05 Thread Sandeep Pal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944307#comment-14944307 ] Sandeep Pal commented on SPARK-10940: - I have already read similar issue as below but

[jira] [Commented] (SPARK-10560) Make StreamingLogisticRegressionWithSGD Python API equals with Scala one

2015-10-05 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944305#comment-14944305 ] Bryan Cutler commented on SPARK-10560: -- Hi [~yanboliang]], I just want to make sure

[jira] [Issue Comment Deleted] (SPARK-10925) Exception when joining DataFrames

2015-10-05 Thread Jason C Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason C Lee updated SPARK-10925: Comment: was deleted (was: I removed your 2nd step "apply an UDF on column "name"" and was able to

[jira] [Commented] (SPARK-10925) Exception when joining DataFrames

2015-10-05 Thread Jason C Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944303#comment-14944303 ] Jason C Lee commented on SPARK-10925: - I removed your 2nd step "apply an UDF on colum

[jira] [Updated] (SPARK-10940) Too many open files Spark Shuffle

2015-10-05 Thread Sandeep Pal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Pal updated SPARK-10940: Description: Executing terasort by Spark-SQL on the data generated by teragen in hadoop. Data size

[jira] [Created] (SPARK-10940) Too many open files Spark Shuffle

2015-10-05 Thread Sandeep Pal (JIRA)
Sandeep Pal created SPARK-10940: --- Summary: Too many open files Spark Shuffle Key: SPARK-10940 URL: https://issues.apache.org/jira/browse/SPARK-10940 Project: Spark Issue Type: Bug Com

[jira] [Commented] (SPARK-10685) Misaligned data with RDD.zip and DataFrame.withColumn after repartition

2015-10-05 Thread Dan Brown (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944282#comment-14944282 ] Dan Brown commented on SPARK-10685: --- [~davies] [~joshrosen] Ok, I've split out the zip-

[jira] [Created] (SPARK-10939) Misaligned data with RDD.zip after repartition

2015-10-05 Thread Dan Brown (JIRA)
Dan Brown created SPARK-10939: - Summary: Misaligned data with RDD.zip after repartition Key: SPARK-10939 URL: https://issues.apache.org/jira/browse/SPARK-10939 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

2015-10-05 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944271#comment-14944271 ] Marcelo Vanzin commented on SPARK-10937: And I assume that you checked the classp

[jira] [Issue Comment Deleted] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

2015-10-05 Thread Curtis Wilde (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Curtis Wilde updated SPARK-10937: - Comment: was deleted (was: In spark-defaults.conf I've added: spark.sql.hive.metastore.version

[jira] [Reopened] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

2015-10-05 Thread Curtis Wilde (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Curtis Wilde reopened SPARK-10937: -- In spark-defaults.conf I've added: spark.sql.hive.metastore.version 0.12.0 spark.sql.hive.metastore

[jira] [Assigned] (SPARK-10337) Views are broken

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10337: Assignee: Apache Spark (was: Wenchen Fan) > Views are broken > > >

[jira] [Commented] (SPARK-10337) Views are broken

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944259#comment-14944259 ] Apache Spark commented on SPARK-10337: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-10337) Views are broken

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10337: Assignee: Wenchen Fan (was: Apache Spark) > Views are broken > > >

[jira] [Commented] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

2015-10-05 Thread Curtis Wilde (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944258#comment-14944258 ] Curtis Wilde commented on SPARK-10937: -- In spark-defaults.conf I've added: spark.sq

[jira] [Assigned] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-: --- Assignee: Michael Armbrust > RDD-like API on top of Catalyst/DataFrame >

[jira] [Updated] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-: Description: The RDD API is very flexible, and as a result harder to optimize its execution

[jira] [Commented] (SPARK-10938) Remove typeId in columnar cache

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944238#comment-14944238 ] Apache Spark commented on SPARK-10938: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-10938) Remove typeId in columnar cache

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10938: Assignee: Davies Liu (was: Apache Spark) > Remove typeId in columnar cache >

[jira] [Assigned] (SPARK-10938) Remove typeId in columnar cache

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10938: Assignee: Apache Spark (was: Davies Liu) > Remove typeId in columnar cache >

[jira] [Created] (SPARK-10938) Remove typeId in columnar cache

2015-10-05 Thread Davies Liu (JIRA)
Davies Liu created SPARK-10938: -- Summary: Remove typeId in columnar cache Key: SPARK-10938 URL: https://issues.apache.org/jira/browse/SPARK-10938 Project: Spark Issue Type: Task Repo

[jira] [Comment Edited] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

2015-10-05 Thread Curtis Wilde (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944218#comment-14944218 ] Curtis Wilde edited comment on SPARK-10937 at 10/5/15 11:13 PM: ---

[jira] [Resolved] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

2015-10-05 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-10937. Resolution: Invalid Then that's your problem. You're causing the error by overriding the Hi

[jira] [Commented] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

2015-10-05 Thread Curtis Wilde (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944218#comment-14944218 ] Curtis Wilde commented on SPARK-10937: -- Yes, I added the following jars to the class

[jira] [Commented] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

2015-10-05 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944215#comment-14944215 ] Marcelo Vanzin commented on SPARK-10937: Nevermind. The exception is coming from

[jira] [Comment Edited] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

2015-10-05 Thread Curtis Wilde (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944213#comment-14944213 ] Curtis Wilde edited comment on SPARK-10937 at 10/5/15 11:06 PM: ---

[jira] [Created] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

2015-10-05 Thread Curtis Wilde (JIRA)
Curtis Wilde created SPARK-10937: Summary: java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x Key: SPARK-10937 URL: https://issues.apache.org/jira/browse/SPARK-10937

[jira] [Commented] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

2015-10-05 Thread Curtis Wilde (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944213#comment-14944213 ] Curtis Wilde commented on SPARK-10937: -- Yes > java.lang.NoSuchMethodError when inst

[jira] [Commented] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

2015-10-05 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944211#comment-14944211 ] Marcelo Vanzin commented on SPARK-10937: Did you set {{spark.sql.hive.metastore.v

[jira] [Updated] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

2015-10-05 Thread Curtis Wilde (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Curtis Wilde updated SPARK-10937: - Description: Running spark-shell with Hive 0.12.0 (HDP 2.0) causes an exception and sqlContext i

[jira] [Commented] (SPARK-8848) Write Parquet LISTs and MAPs conforming to Parquet format spec

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944197#comment-14944197 ] Apache Spark commented on SPARK-8848: - User 'liancheng' has created a pull request for

[jira] [Comment Edited] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-10-05 Thread Hans van den Bogert (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944166#comment-14944166 ] Hans van den Bogert edited comment on SPARK-10474 at 10/5/15 10:39 PM:

[jira] [Commented] (SPARK-5575) Artificial neural networks for MLlib deep learning

2015-10-05 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944173#comment-14944173 ] Alexander Ulanov commented on SPARK-5575: - Weide, These are major features and so

[jira] [Comment Edited] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-10-05 Thread Hans van den Bogert (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944166#comment-14944166 ] Hans van den Bogert edited comment on SPARK-10474 at 10/5/15 10:36 PM:

[jira] [Commented] (SPARK-10384) Univariate statistics as UDAFs

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944168#comment-14944168 ] Xiangrui Meng commented on SPARK-10384: --- I marked small umbrella JIRAs duplicated i

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-10-05 Thread Hans van den Bogert (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944166#comment-14944166 ] Hans van den Bogert commented on SPARK-10474: - Had this patch against tag 1.5

[jira] [Updated] (SPARK-10912) Improve Spark metrics executor.filesystem

2015-10-05 Thread Yongjia Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjia Wang updated SPARK-10912: - Attachment: s3a_metrics.patch Adding s3a is fairly straightforward. I guess the reason it's not i

[jira] [Comment Edited] (SPARK-10641) skewness and kurtosis support

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944155#comment-14944155 ] Xiangrui Meng edited comment on SPARK-10641 at 10/5/15 10:34 PM: --

[jira] [Closed] (SPARK-10602) Univariate statistics as UDAFs: single-pass continuous stats

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-10602. - Resolution: Duplicate Marking this as duplicated in favor of concrete JIRAs. Please continue the

[jira] [Commented] (SPARK-10641) skewness and kurtosis support

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944155#comment-14944155 ] Xiangrui Meng commented on SPARK-10641: --- Any updates? > skewness and kurtosis supp

[jira] [Comment Edited] (SPARK-10603) Univariate statistics as UDAFs: multi-pass continuous stats

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944153#comment-14944153 ] Xiangrui Meng edited comment on SPARK-10603 at 10/5/15 10:32 PM: --

[jira] [Closed] (SPARK-10603) Univariate statistics as UDAFs: multi-pass continuous stats

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-10603. - Resolution: Duplicate Marking this as duplicated in favor of concrete JIRAs. > Univariate statis

[jira] [Resolved] (SPARK-10604) Univariate statistics as UDAFs: categorical stats

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10604. --- Resolution: Duplicate Marking this as duplicated in favor of concrete JIRAs. > Univariate st

[jira] [Commented] (SPARK-10877) Assertions fail straightforward DataFrame job due to word alignment

2015-10-05 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944150#comment-14944150 ] Matt Cheah commented on SPARK-10877: Does spark-submit enable assertions? I'm not sur

[jira] [Updated] (SPARK-10384) Univariate statistics as UDAFs

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10384: -- Description: It would be nice to define univariate statistics as UDAFs. This JIRA discusses ge

[jira] [Created] (SPARK-10936) UDAF "mode" for categorical variables

2015-10-05 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-10936: - Summary: UDAF "mode" for categorical variables Key: SPARK-10936 URL: https://issues.apache.org/jira/browse/SPARK-10936 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-10384) Univariate statistics as UDAFs

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10384: -- Description: It would be nice to define univariate statistics as UDAFs. This JIRA discusses ge

[jira] [Assigned] (SPARK-10384) Univariate statistics as UDAFs

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-10384: - Assignee: Xiangrui Meng (was: Burak Yavuz) > Univariate statistics as UDAFs > -

[jira] [Resolved] (SPARK-10862) Univariate Statistics: Adding median & quantile support as UDAF

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10862. --- Resolution: Duplicate > Univariate Statistics: Adding median & quantile support as UDAF > ---

[jira] [Updated] (SPARK-10384) Univariate statistics as UDAFs

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10384: -- Description: It would be nice to define univariate statistics as UDAFs. This JIRA discusses ge

[jira] [Updated] (SPARK-10384) Univariate statistics as UDAFs

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10384: -- Description: It would be nice to define univariate statistics as UDAFs. This JIRA discusses ge

[jira] [Commented] (SPARK-10877) Assertions fail straightforward DataFrame job due to word alignment

2015-10-05 Thread Jason C Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944141#comment-14944141 ] Jason C Lee commented on SPARK-10877: - I enabled assertions by specifying either the

[jira] [Updated] (SPARK-10384) Univariate statistics as UDAFs

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10384: -- Description: It would be nice to define univariate statistics as UDAFs. This JIRA discusses ge

[jira] [Updated] (SPARK-10384) Univariate statistics as UDAFs

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10384: -- Description: It would be nice to define univariate statistics as UDAFs. This JIRA discusses ge

[jira] [Updated] (SPARK-10384) Univariate statistics as UDAFs

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10384: -- Description: It would be nice to define univariate statistics as UDAFs. This JIRA discusses ge

[jira] [Updated] (SPARK-10384) Univariate statistics as UDAFs

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10384: -- Description: It would be nice to define univariate statistics as UDAFs. This JIRA discusses ge

[jira] [Updated] (SPARK-10384) Univariate statistics as UDAFs

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10384: -- Description: It would be nice to define univariate statistics as UDAFs. This JIRA discusses ge

[jira] [Updated] (SPARK-10384) Univariate statistics as UDAFs

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10384: -- Description: It would be nice to define univariate statistics as UDAFs. This JIRA discusses ge

[jira] [Updated] (SPARK-10384) Univariate statistics as UDAFs

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10384: -- Description: It would be nice to define univariate statistics as UDAFs. This JIRA discusses ge

[jira] [Commented] (SPARK-10868) monotonicallyIncreasingId() supports offset for indexing

2015-10-05 Thread Martin Senne (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944137#comment-14944137 ] Martin Senne commented on SPARK-10868: -- I will do (and give my best!) Thx for offeri

[jira] [Updated] (SPARK-10384) Univariate statistics as UDAFs

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10384: -- Description: It would be nice to define univariate statistics as UDAFs. This JIRA discusses ge

[jira] [Commented] (SPARK-9941) Try ML pipeline API on Kaggle competitions

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944128#comment-14944128 ] Xiangrui Meng commented on SPARK-9941: -- Created https://issues.apache.org/jira/browse

  1   2   3   >