[jira] [Commented] (SPARK-16938) Cannot resolve column name after a join

[ https://issues.apache.org/jira/browse/SPARK-16938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15492643#comment-15492643 ] Dongjoon Hyun commented on SPARK-16938: --- Hi, [~cloud_fan]. Could you review the PR?

[jira] [Resolved] (SPARK-17537) Improve performance for reading parquet schema

[ https://issues.apache.org/jira/browse/SPARK-17537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17537. --- Resolution: Duplicate > Improve performance for reading parquet schema >

[jira] [Created] (SPARK-17552) Doubt about the double Synchronized in Object SparkSession.getOrCreate()

Jianfei Wang created SPARK-17552: Summary: Doubt about the double Synchronized in Object SparkSession.getOrCreate() Key: SPARK-17552 URL: https://issues.apache.org/jira/browse/SPARK-17552 Project: Spa

[jira] [Resolved] (SPARK-17552) Doubt about the double Synchronized in Object SparkSession.getOrCreate()

[ https://issues.apache.org/jira/browse/SPARK-17552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17552. --- Resolution: Invalid Questions should go to user@. The two locks here are not the same one. > Doubt a

[jira] [Resolved] (SPARK-17535) Performance Improvement of Signleton pattern in SparkContext

[ https://issues.apache.org/jira/browse/SPARK-17535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17535. --- Resolution: Won't Fix I don't think volatile matters here. It's not the point I was making actually;

[jira] [Commented] (SPARK-17552) Doubt about the double Synchronized in Object SparkSession.getOrCreate()

[ https://issues.apache.org/jira/browse/SPARK-17552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15492684#comment-15492684 ] Jianfei Wang commented on SPARK-17552: -- of course not the same one ,but only one thr

[jira] [Commented] (SPARK-17546) start-* scripts should use hostname --fqdn

[ https://issues.apache.org/jira/browse/SPARK-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15492685#comment-15492685 ] Sean Owen commented on SPARK-17546: --- {{hostname --fqdn}} doesn't work on OS X, so may b

[jira] [Commented] (SPARK-17552) Doubt about the double Synchronized in Object SparkSession.getOrCreate()

[ https://issues.apache.org/jira/browse/SPARK-17552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15492689#comment-15492689 ] Sean Owen commented on SPARK-17552: --- The comments explain why one lock is used over the

[jira] [Updated] (SPARK-17507) check weight vector size in ANN

[ https://issues.apache.org/jira/browse/SPARK-17507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17507: -- Assignee: Weichen Xu Priority: Trivial (was: Major) > check weight vector size in ANN > --

[jira] [Resolved] (SPARK-17507) check weight vector size in ANN

[ https://issues.apache.org/jira/browse/SPARK-17507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17507. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15060 [https://github.co

[jira] [Resolved] (SPARK-17524) RowBasedKeyValueBatchSuite always uses 64 mb page size

[ https://issues.apache.org/jira/browse/SPARK-17524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17524. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15079 [https://github.co

[jira] [Updated] (SPARK-17524) RowBasedKeyValueBatchSuite always uses 64 mb page size

[ https://issues.apache.org/jira/browse/SPARK-17524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17524: -- Assignee: Adam Roberts Priority: Trivial (was: Minor) > RowBasedKeyValueBatchSuite always uses 64

[jira] [Resolved] (SPARK-17521) Error when I use sparkContext.makeRDD(Seq())

[ https://issues.apache.org/jira/browse/SPARK-17521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17521. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull request

[jira] [Updated] (SPARK-17521) Error when I use sparkContext.makeRDD(Seq())

[ https://issues.apache.org/jira/browse/SPARK-17521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17521: -- Assignee: Jianfei Wang > Error when I use sparkContext.makeRDD(Seq()) > ---

[jira] [Resolved] (SPARK-17406) Event Timeline will be very slow when there are too many executor events

[ https://issues.apache.org/jira/browse/SPARK-17406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17406. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14969 [https://github.co

[jira] [Updated] (SPARK-17536) Minor performance improvement to JDBC batch inserts

[ https://issues.apache.org/jira/browse/SPARK-17536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17536: -- Assignee: John Muller > Minor performance improvement to JDBC batch inserts > -

[jira] [Updated] (SPARK-17406) Event Timeline will be very slow when there are too many executor events

[ https://issues.apache.org/jira/browse/SPARK-17406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17406: -- Assignee: cen yuhai > Event Timeline will be very slow when there are too many executor events > --

[jira] [Resolved] (SPARK-17536) Minor performance improvement to JDBC batch inserts

[ https://issues.apache.org/jira/browse/SPARK-17536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17536. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15098 [https://github.co

[jira] [Updated] (SPARK-17534) Increase timeouts for DirectKafkaStreamSuite tests

[ https://issues.apache.org/jira/browse/SPARK-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17534: -- Priority: Trivial (was: Minor) > Increase timeouts for DirectKafkaStreamSuite tests >

[jira] [Updated] (SPARK-17534) Increase timeouts for DirectKafkaStreamSuite tests

[ https://issues.apache.org/jira/browse/SPARK-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17534: -- Assignee: Adam Roberts > Increase timeouts for DirectKafkaStreamSuite tests > -

[jira] [Created] (SPARK-17553) On Master Change the running Apps goes to wait state even though resource are available

vimal dinakaran created SPARK-17553: --- Summary: On Master Change the running Apps goes to wait state even though resource are available Key: SPARK-17553 URL: https://issues.apache.org/jira/browse/SPARK-17553

[jira] [Updated] (SPARK-17538) sqlContext.registerDataFrameAsTable is not working sometimes in pyspark 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-17538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-17538: -- Labels: pyspark (was: ) > sqlContext.registerDataFrameAsTable

[jira] [Resolved] (SPARK-17505) Add setBins for BinaryClassificationMetrics in mlllb/evaluation

[ https://issues.apache.org/jira/browse/SPARK-17505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17505. --- Resolution: Won't Fix > Add setBins for BinaryClassificationMetrics in mlllb/evaluation > ---

[jira] [Created] (SPARK-17554) spark.executor.memory option not working

Sankar Mittapally created SPARK-17554: - Summary: spark.executor.memory option not working Key: SPARK-17554 URL: https://issues.apache.org/jira/browse/SPARK-17554 Project: Spark Issue Type

[jira] [Resolved] (SPARK-17554) spark.executor.memory option not working

[ https://issues.apache.org/jira/browse/SPARK-17554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17554. --- Resolution: Invalid Questions should go to user@. Without seeing how you're running the job or what

[jira] [Updated] (SPARK-17538) sqlContext.registerDataFrameAsTable is not working sometimes in pyspark 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-17538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17538: -- Shepherd: (was: Matei Zaharia) Flags: (was: Important) Affects Version/

[jira] [Updated] (SPARK-17501) Re-register BlockManager again and again

[ https://issues.apache.org/jira/browse/SPARK-17501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-17501: -- Priority: Minor (was: Major) > Re-register BlockManager again and again >

[jira] [Updated] (SPARK-17523) Cannot get Spark build info from spark-core package which built in Windows

[ https://issues.apache.org/jira/browse/SPARK-17523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17523: -- Fix Version/s: (was: 2.0.1) Component/s: (was: Spark Core) > Cannot get Spark build info

[jira] [Comment Edited] (SPARK-17501) Re-register BlockManager again and again

[ https://issues.apache.org/jira/browse/SPARK-17501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15484185#comment-15484185 ] cen yuhai edited comment on SPARK-17501 at 9/15/16 9:19 AM: I

[jira] [Updated] (SPARK-17281) Add treeAggregateDepth parameter for AFTSurvivalRegression

[ https://issues.apache.org/jira/browse/SPARK-17281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17281: -- Priority: Minor (was: Major) What's the use case, just consistency? why not on more jobs than just the

[jira] [Commented] (SPARK-17501) Re-register BlockManager again and again

[ https://issues.apache.org/jira/browse/SPARK-17501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15492860#comment-15492860 ] Apache Spark commented on SPARK-17501: -- User 'cenyuhai' has created a pull request f

[jira] [Assigned] (SPARK-17501) Re-register BlockManager again and again

[ https://issues.apache.org/jira/browse/SPARK-17501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17501: Assignee: Apache Spark > Re-register BlockManager again and again > --

[jira] [Assigned] (SPARK-17501) Re-register BlockManager again and again

[ https://issues.apache.org/jira/browse/SPARK-17501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17501: Assignee: (was: Apache Spark) > Re-register BlockManager again and again > ---

[jira] [Commented] (SPARK-17406) Event Timeline will be very slow when there are too many executor events

[ https://issues.apache.org/jira/browse/SPARK-17406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15492919#comment-15492919 ] Apache Spark commented on SPARK-17406: -- User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-17281) Add treeAggregateDepth parameter for AFTSurvivalRegression

[ https://issues.apache.org/jira/browse/SPARK-17281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15492931#comment-15492931 ] Weichen Xu commented on SPARK-17281: because currently, the AFTSuvivalRegression use

[jira] [Commented] (SPARK-17538) sqlContext.registerDataFrameAsTable is not working sometimes in pyspark 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-17538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15492937#comment-15492937 ] Srinivas Rishindra Pothireddi commented on SPARK-17538: --- Hi [~srowe

[jira] [Commented] (SPARK-16297) Mapping Boolean and string to BIT and NVARCHAR(MAX) for SQL Server jdbc dialect

[ https://issues.apache.org/jira/browse/SPARK-16297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15492994#comment-15492994 ] Oussama Mekni commented on SPARK-16297: --- some updates about ? > Mapping Boolean an

[jira] [Updated] (SPARK-17538) sqlContext.registerDataFrameAsTable is not working sometimes in pyspark 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-17538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-17538: -- Description: I have a production job in spark 1.6.2 that regist

[jira] [Commented] (SPARK-17538) sqlContext.registerDataFrameAsTable is not working sometimes in pyspark 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-17538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15493075#comment-15493075 ] Srinivas Rishindra Pothireddi commented on SPARK-17538: --- Hi [~srowe

[jira] [Commented] (SPARK-15917) Define the number of executors in standalone mode with an easy-to-use property

[ https://issues.apache.org/jira/browse/SPARK-15917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15493395#comment-15493395 ] Jonathan Taws commented on SPARK-15917: --- Hi Andrew, Your 2 suggestions make a lot

[jira] [Commented] (SPARK-15917) Define the number of executors in standalone mode with an easy-to-use property

[ https://issues.apache.org/jira/browse/SPARK-15917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15493399#comment-15493399 ] Jonathan Taws commented on SPARK-15917: --- I didn't create a specific pull request fo

[jira] [Commented] (SPARK-17544) Timeout waiting for connection from pool, DataFrame Reader's not closing S3 connections?

[ https://issues.apache.org/jira/browse/SPARK-17544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15493555#comment-15493555 ] Brady Auen commented on SPARK-17544: That looks like my issue too, thanks Josh! > T

[jira] [Created] (SPARK-17555) ExternalShuffleBlockResolver fails randomly with External Shuffle Service and Dynamic Resource Allocation on Mesos running under Marathon

Brad Willard created SPARK-17555: Summary: ExternalShuffleBlockResolver fails randomly with External Shuffle Service and Dynamic Resource Allocation on Mesos running under Marathon Key: SPARK-17555 URL: https://i

[jira] [Updated] (SPARK-17544) Timeout waiting for connection from pool, DataFrame Reader's not closing S3 connections?

[ https://issues.apache.org/jira/browse/SPARK-17544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17544: -- Description: I have an application that loops through a text file to find files in S3 a

[jira] [Comment Edited] (SPARK-15917) Define the number of executors in standalone mode with an easy-to-use property

[ https://issues.apache.org/jira/browse/SPARK-15917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15493395#comment-15493395 ] Jonathan Taws edited comment on SPARK-15917 at 9/15/16 4:05 PM: ---

[jira] [Assigned] (SPARK-17458) Alias specified for aggregates in a pivot are not honored

[ https://issues.apache.org/jira/browse/SPARK-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17458: Assignee: Apache Spark > Alias specified for aggregates in a pivot are not honored > -

[jira] [Assigned] (SPARK-17458) Alias specified for aggregates in a pivot are not honored

[ https://issues.apache.org/jira/browse/SPARK-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17458: Assignee: (was: Apache Spark) > Alias specified for aggregates in a pivot are not hono

[jira] [Commented] (SPARK-17458) Alias specified for aggregates in a pivot are not honored

[ https://issues.apache.org/jira/browse/SPARK-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15493777#comment-15493777 ] Apache Spark commented on SPARK-17458: -- User 'aray' has created a pull request for t

[jira] [Assigned] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17549: Assignee: Apache Spark > InMemoryRelation doesn't scale to large tables >

[jira] [Assigned] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17549: Assignee: (was: Apache Spark) > InMemoryRelation doesn't scale to large tables > -

[jira] [Commented] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15493929#comment-15493929 ] Apache Spark commented on SPARK-17549: -- User 'vanzin' has created a pull request for

[jira] [Commented] (SPARK-16407) Allow users to supply custom StreamSinkProviders

[ https://issues.apache.org/jira/browse/SPARK-16407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15493936#comment-15493936 ] holdenk commented on SPARK-16407: - I think its important to keep in mind that these APIs

[jira] [Resolved] (SPARK-17451) CoarseGrainedExecutorBackend should inform driver before self-kill

[ https://issues.apache.org/jira/browse/SPARK-17451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-17451. -- Resolution: Fixed Assignee: Tejas Patil Fix Version/s: 2.1.0 > CoarseGrainedExe

[jira] [Resolved] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-17379. -- Resolution: Fixed Fix Version/s: 2.1.0 > Upgrade netty-all to 4.0.41.Final (4.1.5-Final

[jira] [Resolved] (SPARK-17547) Temporary shuffle data files may be leaked following exception in write

[ https://issues.apache.org/jira/browse/SPARK-17547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17547. Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 1.6.3 Iss

[jira] [Resolved] (SPARK-17114) Adding a 'GROUP BY 1' where first column is literal results in wrong answer

[ https://issues.apache.org/jira/browse/SPARK-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17114. --- Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.1.0

[jira] [Resolved] (SPARK-17429) spark sql length(1) return error

[ https://issues.apache.org/jira/browse/SPARK-17429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17429. --- Resolution: Fixed Assignee: cen yuhai Fix Version/s: 2.1.0 > spark sq

[jira] [Updated] (SPARK-17483) Minor refactoring and cleanup in BlockManager block status reporting and block removal

[ https://issues.apache.org/jira/browse/SPARK-17483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17483: --- Fix Version/s: 2.0.1 > Minor refactoring and cleanup in BlockManager block status reporting and > bl

[jira] [Resolved] (SPARK-17484) Race condition when cancelling a job during a cache write can lead to block fetch failures

[ https://issues.apache.org/jira/browse/SPARK-17484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17484. Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull reque

[jira] [Resolved] (SPARK-17364) Can not query hive table starting with number

[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17364. --- Resolution: Fixed Assignee: Sean Zhong Fix Version/s: 2.1.0

[jira] [Created] (SPARK-17556) Executor side broadcast for broadcast joins

Reynold Xin created SPARK-17556: --- Summary: Executor side broadcast for broadcast joins Key: SPARK-17556 URL: https://issues.apache.org/jira/browse/SPARK-17556 Project: Spark Issue Type: New Fea

[jira] [Created] (SPARK-17557) SQL query on parquet table java.lang.UnsupportedOperationException: org.apache.parquet.column.values.dictionary.PlainValuesDictionary

Egor Pahomov created SPARK-17557: Summary: SQL query on parquet table java.lang.UnsupportedOperationException: org.apache.parquet.column.values.dictionary.PlainValuesDictionary Key: SPARK-17557 URL: https://issue

[jira] [Resolved] (SPARK-17458) Alias specified for aggregates in a pivot are not honored

[ https://issues.apache.org/jira/browse/SPARK-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17458. --- Resolution: Fixed Fix Version/s: 2.1.0 I cannot find the JIRA username of the

[jira] [Commented] (SPARK-17458) Alias specified for aggregates in a pivot are not honored

[ https://issues.apache.org/jira/browse/SPARK-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15494361#comment-15494361 ] Andrew Ray commented on SPARK-17458: It's a1ray > Alias specified for aggregates in

[jira] [Updated] (SPARK-17458) Alias specified for aggregates in a pivot are not honored

[ https://issues.apache.org/jira/browse/SPARK-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17458: -- Assignee: Herman van Hovell > Alias specified for aggregates in a pivot are not honored

[jira] [Comment Edited] (SPARK-17458) Alias specified for aggregates in a pivot are not honored

[ https://issues.apache.org/jira/browse/SPARK-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15494361#comment-15494361 ] Andrew Ray edited comment on SPARK-17458 at 9/15/16 8:09 PM: -

[jira] [Commented] (SPARK-17508) Setting weightCol to None in ML library causes an error

[ https://issues.apache.org/jira/browse/SPARK-17508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15494418#comment-15494418 ] Apache Spark commented on SPARK-17508: -- User 'BryanCutler' has created a pull reques

[jira] [Assigned] (SPARK-17508) Setting weightCol to None in ML library causes an error

[ https://issues.apache.org/jira/browse/SPARK-17508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17508: Assignee: (was: Apache Spark) > Setting weightCol to None in ML library causes an erro

[jira] [Assigned] (SPARK-17508) Setting weightCol to None in ML library causes an error

[ https://issues.apache.org/jira/browse/SPARK-17508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17508: Assignee: Apache Spark > Setting weightCol to None in ML library causes an error > ---

[jira] [Comment Edited] (SPARK-16407) Allow users to supply custom StreamSinkProviders

[ https://issues.apache.org/jira/browse/SPARK-16407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15494475#comment-15494475 ] Michael Armbrust edited comment on SPARK-16407 at 9/15/16 8:42 PM:

[jira] [Commented] (SPARK-16407) Allow users to supply custom StreamSinkProviders

[ https://issues.apache.org/jira/browse/SPARK-16407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15494475#comment-15494475 ] Michael Armbrust commented on SPARK-16407: -- Sure, but the bar for compatibility

[jira] [Resolved] (SPARK-17544) Timeout waiting for connection from pool, DataFrame Reader's not closing S3 connections?

[ https://issues.apache.org/jira/browse/SPARK-17544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17544. Resolution: Invalid This is caused by a bug in the third-party {{spark-avro}} data source. I'm goi

[jira] [Commented] (SPARK-16264) Allow the user to use operators on the received DataFrame

[ https://issues.apache.org/jira/browse/SPARK-16264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15494587#comment-15494587 ] Jakob Odersky commented on SPARK-16264: --- I just came across this issue through a co

[jira] [Issue Comment Deleted] (SPARK-17458) Alias specified for aggregates in a pivot are not honored

[ https://issues.apache.org/jira/browse/SPARK-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ray updated SPARK-17458: --- Comment: was deleted (was: [~hvanhovell] It's a1ray) > Alias specified for aggregates in a pivot are

[jira] [Commented] (SPARK-17458) Alias specified for aggregates in a pivot are not honored

[ https://issues.apache.org/jira/browse/SPARK-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15494591#comment-15494591 ] Andrew Ray commented on SPARK-17458: [~hvanhovell]: My JIRA username is a1ray. > Ali

[jira] [Commented] (SPARK-17473) jdbc docker tests are failing with java.lang.AbstractMethodError:

[ https://issues.apache.org/jira/browse/SPARK-17473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15494597#comment-15494597 ] Apache Spark commented on SPARK-17473: -- User 'sureshthalamati' has created a pull re

[jira] [Assigned] (SPARK-17473) jdbc docker tests are failing with java.lang.AbstractMethodError:

[ https://issues.apache.org/jira/browse/SPARK-17473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17473: Assignee: Apache Spark > jdbc docker tests are failing with java.lang.AbstractMethodError:

[jira] [Assigned] (SPARK-17473) jdbc docker tests are failing with java.lang.AbstractMethodError:

[ https://issues.apache.org/jira/browse/SPARK-17473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17473: Assignee: (was: Apache Spark) > jdbc docker tests are failing with java.lang.AbstractM

[jira] [Updated] (SPARK-17458) Alias specified for aggregates in a pivot are not honored

[ https://issues.apache.org/jira/browse/SPARK-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17458: -- Assignee: (was: Herman van Hovell) > Alias specified for aggregates in a pivot are

[jira] [Updated] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Beyer updated SPARK-17545: - Summary: Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset (was: Spark SQL

[jira] [Commented] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15494666#comment-15494666 ] Nathan Beyer commented on SPARK-17545: -- As a workaround, the following format can be

[jira] [Commented] (SPARK-17477) SparkSQL cannot handle schema evolution from Int -> Long when parquet files have Int as its type while hive metastore has Long as its type

[ https://issues.apache.org/jira/browse/SPARK-17477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15494681#comment-15494681 ] Gang Wu commented on SPARK-17477: - Just confirmed that this also doesn't work with vector

[jira] [Commented] (SPARK-17544) Timeout waiting for connection from pool, DataFrame Reader's not closing S3 connections?

[ https://issues.apache.org/jira/browse/SPARK-17544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15494715#comment-15494715 ] Josh Rosen commented on SPARK-17544: 3.0.1 release fixing this should be available no

[jira] [Commented] (SPARK-16407) Allow users to supply custom StreamSinkProviders

[ https://issues.apache.org/jira/browse/SPARK-16407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15494795#comment-15494795 ] Frederick Reiss commented on SPARK-16407: - With respect, I'm not seeing a whole l

[jira] [Commented] (SPARK-16534) Kafka 0.10 Python support

[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15494955#comment-15494955 ] Reynold Xin commented on SPARK-16534: - [~maver1ck] thanks for the comment. That's a g

[jira] [Updated] (SPARK-15689) Data source API v2

[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15689: Target Version/s: 2.2.0 (was: 2.1.0) > Data source API v2 > -- > >

[jira] [Commented] (SPARK-16407) Allow users to supply custom StreamSinkProviders

[ https://issues.apache.org/jira/browse/SPARK-16407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15495006#comment-15495006 ] Reynold Xin commented on SPARK-16407: - The source/sink interface currently depends on

[jira] [Updated] (SPARK-10815) API design: data sources and sinks

[ https://issues.apache.org/jira/browse/SPARK-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10815: Description: The existing (in 2.0) source/sink interface for structured streaming depends on RDDs.

[jira] [Commented] (SPARK-10816) API design: window and session specification

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15495011#comment-15495011 ] Reynold Xin commented on SPARK-10816: - I guess window specification was done, but ses

[jira] [Updated] (SPARK-10815) API design: data sources and sinks

[ https://issues.apache.org/jira/browse/SPARK-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10815: Description: The existing source/sink interface for structured streaming depends on RDDs. This dep

[jira] [Commented] (SPARK-15472) Add support for writing in `csv`, `json`, `text` formats in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-15472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15495015#comment-15495015 ] Reynold Xin commented on SPARK-15472: - This is done in 2.0, isn't it? cc [~zsxwing]

[jira] [Commented] (SPARK-10816) API design: window and session specification

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15495032#comment-15495032 ] Tathagata Das commented on SPARK-10816: --- Yeah, its yet to be designed. > API desig

[jira] [Created] (SPARK-17558) Bump Hadoop 2.7 version from 2.7.2 to 2.7.3

Reynold Xin created SPARK-17558: --- Summary: Bump Hadoop 2.7 version from 2.7.2 to 2.7.3 Key: SPARK-17558 URL: https://issues.apache.org/jira/browse/SPARK-17558 Project: Spark Issue Type: New Fea

[jira] [Assigned] (SPARK-17558) Bump Hadoop 2.7 version from 2.7.2 to 2.7.3

[ https://issues.apache.org/jira/browse/SPARK-17558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17558: Assignee: Reynold Xin (was: Apache Spark) > Bump Hadoop 2.7 version from 2.7.2 to 2.7.3 >

[jira] [Assigned] (SPARK-17558) Bump Hadoop 2.7 version from 2.7.2 to 2.7.3

[ https://issues.apache.org/jira/browse/SPARK-17558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17558: Assignee: Apache Spark (was: Reynold Xin) > Bump Hadoop 2.7 version from 2.7.2 to 2.7.3 >

[jira] [Commented] (SPARK-17558) Bump Hadoop 2.7 version from 2.7.2 to 2.7.3

[ https://issues.apache.org/jira/browse/SPARK-17558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15495125#comment-15495125 ] Apache Spark commented on SPARK-17558: -- User 'rxin' has created a pull request for t

[jira] [Commented] (SPARK-5484) Pregel should checkpoint periodically to avoid StackOverflowError

[ https://issues.apache.org/jira/browse/SPARK-5484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15495131#comment-15495131 ] ding commented on SPARK-5484: - I will work on the issue if nobody took it. > Pregel should ch

[jira] [Commented] (SPARK-17522) [MESOS] More even distribution of executors on Mesos cluster

[ https://issues.apache.org/jira/browse/SPARK-17522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15495243#comment-15495243 ] Saisai Shao commented on SPARK-17522: - [~sunrui] I think the performance is depended

[jira] [Comment Edited] (SPARK-17522) [MESOS] More even distribution of executors on Mesos cluster

[ https://issues.apache.org/jira/browse/SPARK-17522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15495243#comment-15495243 ] Saisai Shao edited comment on SPARK-17522 at 9/16/16 3:19 AM: -

[jira] [Created] (SPARK-17559) PeriodicGraphCheckpointer didnot persist edges as expected in some cases

ding created SPARK-17559: Summary: PeriodicGraphCheckpointer didnot persist edges as expected in some cases Key: SPARK-17559 URL: https://issues.apache.org/jira/browse/SPARK-17559 Project: Spark Iss

  1   2   >