[jira] [Commented] (SPARK-14409) Investigate adding a RankingEvaluator to ML

[ https://issues.apache.org/jira/browse/SPARK-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898855#comment-15898855 ] Nick Pentreath commented on SPARK-14409: [~josephkb] the proposed input schema above encompasses

[jira] [Assigned] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18549: Assignee: Apache Spark > Failed to Uncache a View that References a Dropped Table. >

[jira] [Assigned] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18549: Assignee: (was: Apache Spark) > Failed to Uncache a View that References a Dropped

[jira] [Commented] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898834#comment-15898834 ] Apache Spark commented on SPARK-18549: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18549: Assignee: (was: Apache Spark) > Failed to Uncache a View that References a Dropped

[jira] [Assigned] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18549: Assignee: Apache Spark > Failed to Uncache a View that References a Dropped Table. >

[jira] [Assigned] (SPARK-19832) DynamicPartitionWriteTask should escape the partition name

[ https://issues.apache.org/jira/browse/SPARK-19832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-19832: --- Assignee: Song Jun > DynamicPartitionWriteTask should escape the partition name >

[jira] [Resolved] (SPARK-19832) DynamicPartitionWriteTask should escape the partition name

[ https://issues.apache.org/jira/browse/SPARK-19832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19832. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17173

[jira] [Commented] (SPARK-19847) port hive read to FileFormat API

[ https://issues.apache.org/jira/browse/SPARK-19847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898824#comment-15898824 ] Apache Spark commented on SPARK-19847: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19847) port hive read to FileFormat API

[ https://issues.apache.org/jira/browse/SPARK-19847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19847: Assignee: Apache Spark (was: Wenchen Fan) > port hive read to FileFormat API >

[jira] [Commented] (SPARK-14409) Investigate adding a RankingEvaluator to ML

[ https://issues.apache.org/jira/browse/SPARK-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898823#comment-15898823 ] Joseph K. Bradley commented on SPARK-14409: --- Thanks [~nick.pentre...@gmail.com]! I like this

[jira] [Assigned] (SPARK-19847) port hive read to FileFormat API

[ https://issues.apache.org/jira/browse/SPARK-19847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19847: Assignee: Wenchen Fan (was: Apache Spark) > port hive read to FileFormat API >

[jira] [Created] (SPARK-19847) port hive read to FileFormat API

Wenchen Fan created SPARK-19847: --- Summary: port hive read to FileFormat API Key: SPARK-19847 URL: https://issues.apache.org/jira/browse/SPARK-19847 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-19818) rbind should check for name consistency of input data frames

[ https://issues.apache.org/jira/browse/SPARK-19818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19818. -- Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.2.0

[jira] [Updated] (SPARK-19818) rbind should check for name consistency of input data frames

[ https://issues.apache.org/jira/browse/SPARK-19818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19818: - Labels: releasenotes (was: ) > rbind should check for name consistency of input data frames >

[jira] [Updated] (SPARK-19818) rbind should check for name consistency of input data frames

[ https://issues.apache.org/jira/browse/SPARK-19818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19818: - Summary: rbind should check for name consistency of input data frames (was: SparkR union should

[jira] [Assigned] (SPARK-19350) Cardinality estimation of Limit and Sample

[ https://issues.apache.org/jira/browse/SPARK-19350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-19350: --- Assignee: Zhenhua Wang > Cardinality estimation of Limit and Sample >

[jira] [Resolved] (SPARK-19350) Cardinality estimation of Limit and Sample

[ https://issues.apache.org/jira/browse/SPARK-19350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-19350. - Resolution: Fixed Fix Version/s: 2.2.0 > Cardinality estimation of Limit and Sample >

[jira] [Assigned] (SPARK-19846) Add a flag to disable constraint propagation

[ https://issues.apache.org/jira/browse/SPARK-19846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19846: Assignee: (was: Apache Spark) > Add a flag to disable constraint propagation >

[jira] [Assigned] (SPARK-19846) Add a flag to disable constraint propagation

[ https://issues.apache.org/jira/browse/SPARK-19846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19846: Assignee: Apache Spark > Add a flag to disable constraint propagation >

[jira] [Commented] (SPARK-19846) Add a flag to disable constraint propagation

[ https://issues.apache.org/jira/browse/SPARK-19846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898774#comment-15898774 ] Apache Spark commented on SPARK-19846: -- User 'viirya' has created a pull request for this issue:

[jira] [Created] (SPARK-19846) Add a flag to disable constraint propagation

Liang-Chi Hsieh created SPARK-19846: --- Summary: Add a flag to disable constraint propagation Key: SPARK-19846 URL: https://issues.apache.org/jira/browse/SPARK-19846 Project: Spark Issue

[jira] [Commented] (SPARK-19602) Unable to query using the fully qualified column name of the form ( ..)

[ https://issues.apache.org/jira/browse/SPARK-19602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898741#comment-15898741 ] Apache Spark commented on SPARK-19602: -- User 'skambha' has created a pull request for this issue:

[jira] [Updated] (SPARK-19831) Sending the heartbeat master from worker maybe blocked by other rpc messages

[ https://issues.apache.org/jira/browse/SPARK-19831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hustfxj updated SPARK-19831: Description: Cleaning the application may cost much time at worker, then it will block that the worker

[jira] [Updated] (SPARK-19831) Sending the heartbeat master from worker maybe blocked by other rpc messages

[ https://issues.apache.org/jira/browse/SPARK-19831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hustfxj updated SPARK-19831: Description: Cleaning the application may cost much time at worker, then it will block that the worker

[jira] [Updated] (SPARK-19831) Sending the heartbeat master from worker maybe blocked by other rpc messages

[ https://issues.apache.org/jira/browse/SPARK-19831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hustfxj updated SPARK-19831: Description: Cleaning the application may cost much time at worker, then it will block that the worker

[jira] [Updated] (SPARK-19831) Sending the heartbeat master from worker maybe blocked by other rpc messages

[ https://issues.apache.org/jira/browse/SPARK-19831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hustfxj updated SPARK-19831: Description: Cleaning the application may cost much time at worker, then it will block that the worker

[jira] [Comment Edited] (SPARK-19831) Sending the heartbeat master from worker maybe blocked by other rpc messages

[ https://issues.apache.org/jira/browse/SPARK-19831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898704#comment-15898704 ] hustfxj edited comment on SPARK-19831 at 3/7/17 4:15 AM: - [~zsxwing]. I only find

[jira] [Commented] (SPARK-19829) The log about driver should support rolling like executor

[ https://issues.apache.org/jira/browse/SPARK-19829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898713#comment-15898713 ] hustfxj commented on SPARK-19829: - [~sowen] Yes, this is handled by systems like YARN. But my spark

[jira] [Commented] (SPARK-19831) Sending the heartbeat master from worker maybe blocked by other rpc messages

[ https://issues.apache.org/jira/browse/SPARK-19831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898704#comment-15898704 ] hustfxj commented on SPARK-19831: - [~zsxwing]. I only find the code which handles *ApplicationFinished*

[jira] [Assigned] (SPARK-19843) UTF8String => (int / long) conversion expensive for invalid inputs

[ https://issues.apache.org/jira/browse/SPARK-19843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19843: Assignee: Apache Spark > UTF8String => (int / long) conversion expensive for invalid

[jira] [Commented] (SPARK-19843) UTF8String => (int / long) conversion expensive for invalid inputs

[ https://issues.apache.org/jira/browse/SPARK-19843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898632#comment-15898632 ] Apache Spark commented on SPARK-19843: -- User 'tejasapatil' has created a pull request for this

[jira] [Assigned] (SPARK-19843) UTF8String => (int / long) conversion expensive for invalid inputs

[ https://issues.apache.org/jira/browse/SPARK-19843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19843: Assignee: (was: Apache Spark) > UTF8String => (int / long) conversion expensive for

[jira] [Updated] (SPARK-18085) Better History Server scalability for many / large applications

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DjvuLee updated SPARK-18085: Yes, you're right. I just want to impact as few as possible. > Better History Server scalability for many

[jira] [Comment Edited] (SPARK-19845) failed to uncache datasource table after the table location altered

[ https://issues.apache.org/jira/browse/SPARK-19845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898626#comment-15898626 ] Song Jun edited comment on SPARK-19845 at 3/7/17 2:33 AM: -- yes, this jira is

[jira] [Commented] (SPARK-19845) failed to uncache datasource table after the table location altered

[ https://issues.apache.org/jira/browse/SPARK-19845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898626#comment-15898626 ] Song Jun commented on SPARK-19845: -- yes, this jira is doing this

[jira] [Commented] (SPARK-19845) failed to uncache datasource table after the table location altered

[ https://issues.apache.org/jira/browse/SPARK-19845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898591#comment-15898591 ] Wenchen Fan commented on SPARK-19845: - In this case, I think we have to uncache the table when alter

[jira] [Created] (SPARK-19845) failed to uncache datasource table after the table location altered

Song Jun created SPARK-19845: Summary: failed to uncache datasource table after the table location altered Key: SPARK-19845 URL: https://issues.apache.org/jira/browse/SPARK-19845 Project: Spark

[jira] [Updated] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark

[ https://issues.apache.org/jira/browse/SPARK-19842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ioana Delaney updated SPARK-19842: -- Description: *Informational Referential Integrity Constraints Support in Spark* This work

[jira] [Updated] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark

[ https://issues.apache.org/jira/browse/SPARK-19842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ioana Delaney updated SPARK-19842: -- Description: *Informational Referential Integrity Constraints Support in Spark* This work

[jira] [Created] (SPARK-19844) UDF in when control function is executed before the when clause is evaluated.

Franklyn Dsouza created SPARK-19844: --- Summary: UDF in when control function is executed before the when clause is evaluated. Key: SPARK-19844 URL: https://issues.apache.org/jira/browse/SPARK-19844

[jira] [Resolved] (SPARK-19719) Structured Streaming write to Kafka

[ https://issues.apache.org/jira/browse/SPARK-19719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-19719. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17043

[jira] [Created] (SPARK-19843) UTF8String => (int / long) conversion expensive for invalid inputs

Tejas Patil created SPARK-19843: --- Summary: UTF8String => (int / long) conversion expensive for invalid inputs Key: SPARK-19843 URL: https://issues.apache.org/jira/browse/SPARK-19843 Project: Spark

[jira] [Updated] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark

[ https://issues.apache.org/jira/browse/SPARK-19842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ioana Delaney updated SPARK-19842: -- Target Version/s: (was: 2.2.0) > Informational Referential Integrity Constraints Support in

[jira] [Updated] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark

[ https://issues.apache.org/jira/browse/SPARK-19842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ioana Delaney updated SPARK-19842: -- Attachment: InformationalRIConstraints.doc > Informational Referential Integrity Constraints

[jira] [Created] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark

Ioana Delaney created SPARK-19842: - Summary: Informational Referential Integrity Constraints Support in Spark Key: SPARK-19842 URL: https://issues.apache.org/jira/browse/SPARK-19842 Project: Spark

[jira] [Assigned] (SPARK-19841) StreamingDeduplicateExec.watermarkPredicate should filter rows based on keys

[ https://issues.apache.org/jira/browse/SPARK-19841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19841: Assignee: Shixiong Zhu (was: Apache Spark) > StreamingDeduplicateExec.watermarkPredicate

[jira] [Assigned] (SPARK-19841) StreamingDeduplicateExec.watermarkPredicate should filter rows based on keys

[ https://issues.apache.org/jira/browse/SPARK-19841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19841: Assignee: Apache Spark (was: Shixiong Zhu) > StreamingDeduplicateExec.watermarkPredicate

[jira] [Commented] (SPARK-19841) StreamingDeduplicateExec.watermarkPredicate should filter rows based on keys

[ https://issues.apache.org/jira/browse/SPARK-19841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898446#comment-15898446 ] Apache Spark commented on SPARK-19841: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Created] (SPARK-19841) StreamingDeduplicateExec.watermarkPredicate should filter rows based on keys

Shixiong Zhu created SPARK-19841: Summary: StreamingDeduplicateExec.watermarkPredicate should filter rows based on keys Key: SPARK-19841 URL: https://issues.apache.org/jira/browse/SPARK-19841

[jira] [Commented] (SPARK-19840) Disallow creating permanent functions with invalid class names

[ https://issues.apache.org/jira/browse/SPARK-19840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898402#comment-15898402 ] Apache Spark commented on SPARK-19840: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-19840) Disallow creating permanent functions with invalid class names

[ https://issues.apache.org/jira/browse/SPARK-19840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19840: Assignee: (was: Apache Spark) > Disallow creating permanent functions with invalid

[jira] [Assigned] (SPARK-19840) Disallow creating permanent functions with invalid class names

[ https://issues.apache.org/jira/browse/SPARK-19840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19840: Assignee: Apache Spark > Disallow creating permanent functions with invalid class names >

[jira] [Created] (SPARK-19840) Disallow creating permanent functions with invalid class names

Dongjoon Hyun created SPARK-19840: - Summary: Disallow creating permanent functions with invalid class names Key: SPARK-19840 URL: https://issues.apache.org/jira/browse/SPARK-19840 Project: Spark

[jira] [Comment Edited] (SPARK-15522) DataFrame Column Names That are Numbers aren't referenced correctly in SQL

[ https://issues.apache.org/jira/browse/SPARK-15522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897638#comment-15897638 ] Hyukjin Kwon edited comment on SPARK-15522 at 3/6/17 11:26 PM: --- We can use

[jira] [Commented] (SPARK-14423) Handle jar conflict issue when uploading to distributed cache

[ https://issues.apache.org/jira/browse/SPARK-14423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898256#comment-15898256 ] Junping Du commented on SPARK-14423: Thanks [~jerryshao] for reporting this issue. I think YARN

[jira] [Commented] (SPARK-19767) API Doc pages for Streaming with Kafka 0.10 not current

[ https://issues.apache.org/jira/browse/SPARK-19767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898159#comment-15898159 ] Sean Owen commented on SPARK-19767: --- Hm, have you installed all the ruby-based dependencies? I don't

[jira] [Assigned] (SPARK-19709) CSV datasource fails to read empty file

[ https://issues.apache.org/jira/browse/SPARK-19709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-19709: --- Assignee: Wojciech Szymanski > CSV datasource fails to read empty file >

[jira] [Resolved] (SPARK-19709) CSV datasource fails to read empty file

[ https://issues.apache.org/jira/browse/SPARK-19709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19709. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17068

[jira] [Commented] (SPARK-19094) Plumb through logging/error messages from the JVM to Jupyter PySpark

[ https://issues.apache.org/jira/browse/SPARK-19094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898114#comment-15898114 ] Kyle Kelley commented on SPARK-19094: - Super interested in this, as it's been confusing for our

[jira] [Updated] (SPARK-16845) org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificOrdering" grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-16845: Fix Version/s: 2.0.3 1.6.4 >

[jira] [Assigned] (SPARK-19824) Standalone master JSON not showing cores for running applications

[ https://issues.apache.org/jira/browse/SPARK-19824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19824: Assignee: Apache Spark > Standalone master JSON not showing cores for running

[jira] [Commented] (SPARK-19824) Standalone master JSON not showing cores for running applications

[ https://issues.apache.org/jira/browse/SPARK-19824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898111#comment-15898111 ] Apache Spark commented on SPARK-19824: -- User 'yongtang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19824) Standalone master JSON not showing cores for running applications

[ https://issues.apache.org/jira/browse/SPARK-19824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19824: Assignee: (was: Apache Spark) > Standalone master JSON not showing cores for running

[jira] [Resolved] (SPARK-19382) Test sparse vectors in LinearSVCSuite

[ https://issues.apache.org/jira/browse/SPARK-19382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-19382. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16784

[jira] [Assigned] (SPARK-19382) Test sparse vectors in LinearSVCSuite

[ https://issues.apache.org/jira/browse/SPARK-19382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-19382: - Assignee: Miao Wang > Test sparse vectors in LinearSVCSuite >

[jira] [Commented] (SPARK-18832) Spark SQL: Thriftserver unable to run a registered Hive UDTF

[ https://issues.apache.org/jira/browse/SPARK-18832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898052#comment-15898052 ] Dongjoon Hyun commented on SPARK-18832: --- Could you check the permission of the following? Is it

[jira] [Assigned] (SPARK-19211) Explicitly prevent Insert into View or Create View As Insert

[ https://issues.apache.org/jira/browse/SPARK-19211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-19211: --- Assignee: Jiang Xingbo > Explicitly prevent Insert into View or Create View As Insert >

[jira] [Resolved] (SPARK-19211) Explicitly prevent Insert into View or Create View As Insert

[ https://issues.apache.org/jira/browse/SPARK-19211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-19211. - Resolution: Fixed Fix Version/s: 2.2.0 > Explicitly prevent Insert into View or Create View As

[jira] [Commented] (SPARK-17495) Hive hash implementation

[ https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898005#comment-15898005 ] Reynold Xin commented on SPARK-17495: - We should probably create subtickets next time for this ...

[jira] [Commented] (SPARK-19790) OutputCommitCoordinator should not allow another task to commit after an ExecutorFailure

[ https://issues.apache.org/jira/browse/SPARK-19790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898003#comment-15898003 ] Steve Loughran commented on SPARK-19790: Thinking some more & looking at code snippets #

[jira] [Commented] (SPARK-19796) taskScheduler fails serializing long statements received by thrift server

[ https://issues.apache.org/jira/browse/SPARK-19796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897997#comment-15897997 ] Imran Rashid commented on SPARK-19796: -- I'm opposed to (b) as well. It feels wrong to only do a

[jira] [Commented] (SPARK-19839) Fix memory leak in BytesToBytesMap

[ https://issues.apache.org/jira/browse/SPARK-19839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897975#comment-15897975 ] Zhan Zhang commented on SPARK-19839: When BytesToBytesMap spills, its longArray should be released.

[jira] [Commented] (SPARK-19839) Fix memory leak in BytesToBytesMap

[ https://issues.apache.org/jira/browse/SPARK-19839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897970#comment-15897970 ] Apache Spark commented on SPARK-19839: -- User 'zhzhan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19839) Fix memory leak in BytesToBytesMap

[ https://issues.apache.org/jira/browse/SPARK-19839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19839: Assignee: Apache Spark > Fix memory leak in BytesToBytesMap >

[jira] [Assigned] (SPARK-19839) Fix memory leak in BytesToBytesMap

[ https://issues.apache.org/jira/browse/SPARK-19839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19839: Assignee: (was: Apache Spark) > Fix memory leak in BytesToBytesMap >

[jira] [Assigned] (SPARK-19796) taskScheduler fails serializing long statements received by thrift server

[ https://issues.apache.org/jira/browse/SPARK-19796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-19796: Assignee: Imran Rashid > taskScheduler fails serializing long statements received by

[jira] [Commented] (SPARK-19837) Fetch failure throws a SparkException in SparkHiveWriter

[ https://issues.apache.org/jira/browse/SPARK-19837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897961#comment-15897961 ] Sital Kedia commented on SPARK-19837: - `SparkHiveDynamicPartitionWriterContainer` has been refactored

[jira] [Closed] (SPARK-19837) Fetch failure throws a SparkException in SparkHiveWriter

[ https://issues.apache.org/jira/browse/SPARK-19837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sital Kedia closed SPARK-19837. --- Resolution: Fixed > Fetch failure throws a SparkException in SparkHiveWriter >

[jira] [Commented] (SPARK-19767) API Doc pages for Streaming with Kafka 0.10 not current

[ https://issues.apache.org/jira/browse/SPARK-19767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897965#comment-15897965 ] Nick Afshartous commented on SPARK-19767: - I believe all the dependencies are installed and got

[jira] [Resolved] (SPARK-19796) taskScheduler fails serializing long statements received by thrift server

[ https://issues.apache.org/jira/browse/SPARK-19796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-19796. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17140

[jira] [Created] (SPARK-19839) Fix memory leak in BytesToBytesMap

Zhan Zhang created SPARK-19839: -- Summary: Fix memory leak in BytesToBytesMap Key: SPARK-19839 URL: https://issues.apache.org/jira/browse/SPARK-19839 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-17495) Hive hash implementation

[ https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17495: Assignee: Apache Spark (was: Tejas Patil) > Hive hash implementation >

[jira] [Assigned] (SPARK-17495) Hive hash implementation

[ https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17495: Assignee: Tejas Patil (was: Apache Spark) > Hive hash implementation >

[jira] [Reopened] (SPARK-17495) Hive hash implementation

[ https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil reopened SPARK-17495: - Re-opening. This is not done yet as there are time related datatypes that need to be handled and

[jira] [Commented] (SPARK-19067) mapGroupsWithState - arbitrary stateful operations with Structured Streaming (similar to DStream.mapWithState)

[ https://issues.apache.org/jira/browse/SPARK-19067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897868#comment-15897868 ] Amit Sela commented on SPARK-19067: --- Sweet! I will make time tomorrow to go over the PR thoroughly

[jira] [Commented] (SPARK-19790) OutputCommitCoordinator should not allow another task to commit after an ExecutorFailure

[ https://issues.apache.org/jira/browse/SPARK-19790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897863#comment-15897863 ] Steve Loughran commented on SPARK-19790: The only time a task output committer should be making

[jira] [Commented] (SPARK-19067) mapGroupsWithState - arbitrary stateful operations with Structured Streaming (similar to DStream.mapWithState)

[ https://issues.apache.org/jira/browse/SPARK-19067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897859#comment-15897859 ] Apache Spark commented on SPARK-19067: -- User 'tdas' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-18832) Spark SQL: Thriftserver unable to run a registered Hive UDTF

[ https://issues.apache.org/jira/browse/SPARK-18832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897799#comment-15897799 ] Dongjoon Hyun edited comment on SPARK-18832 at 3/6/17 7:11 PM: --- Hi,

[jira] [Commented] (SPARK-18568) vertex attributes in the edge triplet not getting updated in super steps for Pregel API

[ https://issues.apache.org/jira/browse/SPARK-18568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897852#comment-15897852 ] Laurent Philippart commented on SPARK-18568: Does it also occur when the vertex attribute or

[jira] [Commented] (SPARK-19067) mapGroupsWithState - arbitrary stateful operations with Structured Streaming (similar to DStream.mapWithState)

[ https://issues.apache.org/jira/browse/SPARK-19067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897851#comment-15897851 ] Tathagata Das commented on SPARK-19067: --- Yes, they will be resettable. Just see the timeout subtask

[jira] [Created] (SPARK-19838) Adding Processing Time based timeout

Tathagata Das created SPARK-19838: - Summary: Adding Processing Time based timeout Key: SPARK-19838 URL: https://issues.apache.org/jira/browse/SPARK-19838 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-18832) Spark SQL: Thriftserver unable to run a registered Hive UDTF

[ https://issues.apache.org/jira/browse/SPARK-18832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897841#comment-15897841 ] Dongjoon Hyun commented on SPARK-18832: --- Could you upload your `jar` file? It could be a problem of

[jira] [Comment Edited] (SPARK-18832) Spark SQL: Thriftserver unable to run a registered Hive UDTF

[ https://issues.apache.org/jira/browse/SPARK-18832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897799#comment-15897799 ] Dongjoon Hyun edited comment on SPARK-18832 at 3/6/17 6:55 PM: --- Hi,

[jira] [Comment Edited] (SPARK-18832) Spark SQL: Thriftserver unable to run a registered Hive UDTF

[ https://issues.apache.org/jira/browse/SPARK-18832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897799#comment-15897799 ] Dongjoon Hyun edited comment on SPARK-18832 at 3/6/17 6:53 PM: --- Hi,

[jira] [Comment Edited] (SPARK-18832) Spark SQL: Thriftserver unable to run a registered Hive UDTF

[ https://issues.apache.org/jira/browse/SPARK-18832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897799#comment-15897799 ] Dongjoon Hyun edited comment on SPARK-18832 at 3/6/17 6:46 PM: --- Hi,

[jira] [Assigned] (SPARK-19257) The type of CatalogStorageFormat.locationUri should be java.net.URI instead of String

[ https://issues.apache.org/jira/browse/SPARK-19257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-19257: --- Assignee: Song Jun > The type of CatalogStorageFormat.locationUri should be java.net.URI

[jira] [Resolved] (SPARK-19257) The type of CatalogStorageFormat.locationUri should be java.net.URI instead of String

[ https://issues.apache.org/jira/browse/SPARK-19257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19257. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17149

[jira] [Resolved] (SPARK-19304) Kinesis checkpoint recovery is 10x slow

[ https://issues.apache.org/jira/browse/SPARK-19304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-19304. - Resolution: Fixed Fix Version/s: 2.2.0 Target Version/s: 2.2.0 Resolved by:

[jira] [Assigned] (SPARK-19304) Kinesis checkpoint recovery is 10x slow

[ https://issues.apache.org/jira/browse/SPARK-19304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reassigned SPARK-19304: --- Assignee: Gaurav Shah > Kinesis checkpoint recovery is 10x slow >

  1   2   >