[jira] [Resolved] (SPARK-22002) Read JDBC table use custom schema support specify partial fields

[ https://issues.apache.org/jira/browse/SPARK-22002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22002. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 2.3.0 > Read JDBC table use custom

[jira] [Commented] (SPARK-21994) Spark 2.2 can not read Parquet table created by itself

[ https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167407#comment-16167407 ] Jurgis Pods commented on SPARK-21994: - Thank you for testing. Which version of Hive a

[jira] [Created] (SPARK-22020) Support session local timezone

Navya Krishnappa created SPARK-22020: Summary: Support session local timezone Key: SPARK-22020 URL: https://issues.apache.org/jira/browse/SPARK-22020 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-21902) BlockManager.doPut will hide actually exception when exception thrown in finally block

[ https://issues.apache.org/jira/browse/SPARK-21902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-21902: Priority: Trivial (was: Major) > BlockManager.doPut will hide actually exception when exception th

[jira] [Updated] (SPARK-21902) BlockManager.doPut will hide actually exception when exception thrown in finally block

[ https://issues.apache.org/jira/browse/SPARK-21902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-21902: Issue Type: Improvement (was: Wish) > BlockManager.doPut will hide actually exception when excepti

[jira] [Assigned] (SPARK-21902) BlockManager.doPut will hide actually exception when exception thrown in finally block

[ https://issues.apache.org/jira/browse/SPARK-21902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-21902: --- Assignee: zhoukang > BlockManager.doPut will hide actually exception when exception thrown i

[jira] [Resolved] (SPARK-21902) BlockManager.doPut will hide actually exception when exception thrown in finally block

[ https://issues.apache.org/jira/browse/SPARK-21902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-21902. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19171 [https://githu

[jira] [Commented] (SPARK-20921) While reading from oracle database, it converts to wrong type.

[ https://issues.apache.org/jira/browse/SPARK-20921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167373#comment-16167373 ] Yuming Wang commented on SPARK-20921: - Fixed by https://github.com/apache/spark/pull/

[jira] [Resolved] (SPARK-22018) Catalyst Optimizer does not preserve top-level metadata while collapsing projects

[ https://issues.apache.org/jira/browse/SPARK-22018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-22018. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 19240 [https://g

[jira] [Created] (SPARK-22019) JavaBean int type property

taiho choi created SPARK-22019: -- Summary: JavaBean int type property Key: SPARK-22019 URL: https://issues.apache.org/jira/browse/SPARK-22019 Project: Spark Issue Type: Bug Components:

[jira] [Comment Edited] (SPARK-21994) Spark 2.2 can not read Parquet table created by itself

[ https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167280#comment-16167280 ] Jia-Xuan Liu edited comment on SPARK-21994 at 9/15/17 3:40 AM:

[jira] [Commented] (SPARK-21994) Spark 2.2 can not read Parquet table created by itself

[ https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167280#comment-16167280 ] Jia-Xuan Liu commented on SPARK-21994: -- I also can't reproduce this in Spark 2.2 rel

[jira] [Comment Edited] (SPARK-21994) Spark 2.2 can not read Parquet table created by itself

[ https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167276#comment-16167276 ] Xiayun Sun edited comment on SPARK-21994 at 9/15/17 3:31 AM: -

[jira] [Comment Edited] (SPARK-21994) Spark 2.2 can not read Parquet table created by itself

[ https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167276#comment-16167276 ] Xiayun Sun edited comment on SPARK-21994 at 9/15/17 3:30 AM: -

[jira] [Comment Edited] (SPARK-21994) Spark 2.2 can not read Parquet table created by itself

[ https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167276#comment-16167276 ] Xiayun Sun edited comment on SPARK-21994 at 9/15/17 3:29 AM: -

[jira] [Commented] (SPARK-21994) Spark 2.2 can not read Parquet table created by itself

[ https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167276#comment-16167276 ] Xiayun Sun commented on SPARK-21994: I'm unable to reproduce this for latest master b

[jira] [Commented] (SPARK-19459) ORC tables cannot be read when they contain char/varchar columns

[ https://issues.apache.org/jira/browse/SPARK-19459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167258#comment-16167258 ] Apache Spark commented on SPARK-19459: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Commented] (SPARK-14387) Enable Hive-1.x ORC compatibility with spark.sql.hive.convertMetastoreOrc

[ https://issues.apache.org/jira/browse/SPARK-14387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167257#comment-16167257 ] Apache Spark commented on SPARK-14387: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Commented] (SPARK-22000) org.codehaus.commons.compiler.CompileException: toString method is not declared

[ https://issues.apache.org/jira/browse/SPARK-22000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167248#comment-16167248 ] taiho choi commented on SPARK-22000: @members, my code generates this error message b

[jira] [Updated] (SPARK-21997) Spark shows different results on char/varchar columns on Parquet

[ https://issues.apache.org/jira/browse/SPARK-21997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21997: -- Description: SPARK-19459 resolves CHAR/VARCHAR issues in general, but Spark shows different re

[jira] [Assigned] (SPARK-22018) Catalyst Optimizer does not preserve top-level metadata while collapsing projects

[ https://issues.apache.org/jira/browse/SPARK-22018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22018: Assignee: Apache Spark (was: Tathagata Das) > Catalyst Optimizer does not preserve top-le

[jira] [Assigned] (SPARK-22018) Catalyst Optimizer does not preserve top-level metadata while collapsing projects

[ https://issues.apache.org/jira/browse/SPARK-22018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22018: Assignee: Tathagata Das (was: Apache Spark) > Catalyst Optimizer does not preserve top-le

[jira] [Commented] (SPARK-22018) Catalyst Optimizer does not preserve top-level metadata while collapsing projects

[ https://issues.apache.org/jira/browse/SPARK-22018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167166#comment-16167166 ] Apache Spark commented on SPARK-22018: -- User 'tdas' has created a pull request for t

[jira] [Created] (SPARK-22018) Catalyst Optimizer does not preserve top-level metadata while collapsing projects

Tathagata Das created SPARK-22018: - Summary: Catalyst Optimizer does not preserve top-level metadata while collapsing projects Key: SPARK-22018 URL: https://issues.apache.org/jira/browse/SPARK-22018 P

[jira] [Commented] (SPARK-21523) Fix bug of strong wolfe linesearch `init` parameter lose effectiveness

[ https://issues.apache.org/jira/browse/SPARK-21523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167033#comment-16167033 ] Ihor Bobak commented on SPARK-21523: For us it is also critical issue: we faced with

[jira] [Commented] (SPARK-22017) watermark evaluation with multi-input stream operators is unspecified

[ https://issues.apache.org/jira/browse/SPARK-22017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167020#comment-16167020 ] Apache Spark commented on SPARK-22017: -- User 'joseph-torres' has created a pull requ

[jira] [Assigned] (SPARK-22017) watermark evaluation with multi-input stream operators is unspecified

[ https://issues.apache.org/jira/browse/SPARK-22017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22017: Assignee: (was: Apache Spark) > watermark evaluation with multi-input stream operators

[jira] [Assigned] (SPARK-22017) watermark evaluation with multi-input stream operators is unspecified

[ https://issues.apache.org/jira/browse/SPARK-22017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22017: Assignee: Apache Spark > watermark evaluation with multi-input stream operators is unspeci

[jira] [Created] (SPARK-22017) watermark evaluation with multi-input stream operators is unspecified

Jose Torres created SPARK-22017: --- Summary: watermark evaluation with multi-input stream operators is unspecified Key: SPARK-22017 URL: https://issues.apache.org/jira/browse/SPARK-22017 Project: Spark

[jira] [Assigned] (SPARK-22016) Add HiveDialect for JDBC connection to Hive

[ https://issues.apache.org/jira/browse/SPARK-22016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22016: Assignee: Apache Spark > Add HiveDialect for JDBC connection to Hive > ---

[jira] [Commented] (SPARK-22016) Add HiveDialect for JDBC connection to Hive

[ https://issues.apache.org/jira/browse/SPARK-22016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166988#comment-16166988 ] Apache Spark commented on SPARK-22016: -- User 'danielfx90' has created a pull request

[jira] [Assigned] (SPARK-22016) Add HiveDialect for JDBC connection to Hive

[ https://issues.apache.org/jira/browse/SPARK-22016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22016: Assignee: (was: Apache Spark) > Add HiveDialect for JDBC connection to Hive >

[jira] [Created] (SPARK-22016) Add HiveDialect for JDBC connection to Hive

Daniel Fernandez created SPARK-22016: Summary: Add HiveDialect for JDBC connection to Hive Key: SPARK-22016 URL: https://issues.apache.org/jira/browse/SPARK-22016 Project: Spark Issue Typ

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166945#comment-16166945 ] Michael N commented on SPARK-21999: --- Some related questions that would provide insights

[jira] [Resolved] (SPARK-21988) Add default stats to StreamingExecutionRelation

[ https://issues.apache.org/jira/browse/SPARK-21988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-21988. -- Resolution: Fixed Assignee: Jose Torres Fix Version/s: 2.3.0 > Add default stat

[jira] [Assigned] (SPARK-21987) Spark 2.3 cannot read 2.2 event logs

[ https://issues.apache.org/jira/browse/SPARK-21987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21987: Assignee: (was: Apache Spark) > Spark 2.3 cannot read 2.2 event logs > ---

[jira] [Commented] (SPARK-21987) Spark 2.3 cannot read 2.2 event logs

[ https://issues.apache.org/jira/browse/SPARK-21987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166637#comment-16166637 ] Apache Spark commented on SPARK-21987: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-21987) Spark 2.3 cannot read 2.2 event logs

[ https://issues.apache.org/jira/browse/SPARK-21987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21987: Assignee: Apache Spark > Spark 2.3 cannot read 2.2 event logs > --

[jira] [Assigned] (SPARK-22015) Remove usage of non-used private field isAuthenticated from org.apache.spark.network.sasl.SaslRpcHandler.java

[ https://issues.apache.org/jira/browse/SPARK-22015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22015: Assignee: Apache Spark > Remove usage of non-used private field isAuthenticated from > or

[jira] [Commented] (SPARK-22015) Remove usage of non-used private field isAuthenticated from org.apache.spark.network.sasl.SaslRpcHandler.java

[ https://issues.apache.org/jira/browse/SPARK-22015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166561#comment-16166561 ] Apache Spark commented on SPARK-22015: -- User 'nikhilbhide' has created a pull reques

[jira] [Assigned] (SPARK-22015) Remove usage of non-used private field isAuthenticated from org.apache.spark.network.sasl.SaslRpcHandler.java

[ https://issues.apache.org/jira/browse/SPARK-22015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22015: Assignee: (was: Apache Spark) > Remove usage of non-used private field isAuthenticated

[jira] [Created] (SPARK-22015) Remove usage of non-used private field isAuthenticated from org.apache.spark.network.sasl.SaslRpcHandler.java

Nikhil Bhide created SPARK-22015: Summary: Remove usage of non-used private field isAuthenticated from org.apache.spark.network.sasl.SaslRpcHandler.java Key: SPARK-22015 URL: https://issues.apache.org/jira/browse/

[jira] [Updated] (SPARK-21997) Spark shows different results on char/varchar columns on Parquet

[ https://issues.apache.org/jira/browse/SPARK-21997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21997: -- Description: SPARK-19459 resolves CHAR/VARCHAR issues in general, but Spark shows different re

[jira] [Updated] (SPARK-21997) Spark shows different results on char/varchar columns on Parquet

[ https://issues.apache.org/jira/browse/SPARK-21997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21997: -- Summary: Spark shows different results on char/varchar columns on Parquet (was: Spark shows di

[jira] [Updated] (SPARK-21997) Spark shows different results on Hive char/varchar columns on Parquet

[ https://issues.apache.org/jira/browse/SPARK-21997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21997: -- Description: SPARK-19459 resolves CHAR/VARCHAR issues in general, but Spark shows different re

[jira] [Commented] (SPARK-21997) Spark shows different results on Hive char/varchar columns on Parquet

[ https://issues.apache.org/jira/browse/SPARK-21997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166539#comment-16166539 ] Apache Spark commented on SPARK-21997: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-21997) Spark shows different results on Hive char/varchar columns on Parquet

[ https://issues.apache.org/jira/browse/SPARK-21997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21997: Assignee: (was: Apache Spark) > Spark shows different results on Hive char/varchar col

[jira] [Assigned] (SPARK-21997) Spark shows different results on Hive char/varchar columns on Parquet

[ https://issues.apache.org/jira/browse/SPARK-21997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21997: Assignee: Apache Spark > Spark shows different results on Hive char/varchar columns on Par

[jira] [Updated] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-22010: --- Description: To convert timestamp type to python we are using {code}datetime.datetime.fromti

[jira] [Updated] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-22010: --- Priority: Minor (was: Major) > Slow fromInternal conversion for TimestampType >

[jira] [Updated] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-22010: --- Issue Type: Improvement (was: Bug) > Slow fromInternal conversion for TimestampType > --

[jira] [Updated] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-22010: --- Description: To convert timestamp type to python we are using {code}datetime.datetime.fromti

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166516#comment-16166516 ] Michael N commented on SPARK-21999: --- My app was not asynchronously modifying an object

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166493#comment-16166493 ] Sean Owen commented on SPARK-21999: --- I'm suggesting it could happen if your app was asy

[jira] [Commented] (SPARK-21858) Make Spark grouping_id() compatible with Hive grouping__id

[ https://issues.apache.org/jira/browse/SPARK-21858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166467#comment-16166467 ] Dongjoon Hyun commented on SPARK-21858: --- Thank you for conclusion, [~cloud_fan]! >

[jira] [Updated] (SPARK-22014) Sample windows in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-22014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22014: -- Target Version/s: (was: 2.2.0) > Sample windows in Spark SQL > --- > >

[jira] [Resolved] (SPARK-22011) model <- spark.logit(training, Survived ~ ., regParam = 0.5) shwoing error

[ https://issues.apache.org/jira/browse/SPARK-22011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22011. --- Resolution: Not A Problem The error pretty much says it all -- set SPARK_HOME. See the SparkR docs.

[jira] [Assigned] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22010: Assignee: (was: Apache Spark) > Slow fromInternal conversion for TimestampType > -

[jira] [Assigned] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22010: Assignee: Apache Spark > Slow fromInternal conversion for TimestampType >

[jira] [Commented] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166430#comment-16166430 ] Apache Spark commented on SPARK-22010: -- User 'maver1ck' has created a pull request f

[jira] [Updated] (SPARK-22014) Sample windows in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-22014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simon Schiff updated SPARK-22014: - Description: Hello, I am using spark to process measurement data. It is possible to create sample

[jira] [Updated] (SPARK-22014) Sample windows in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-22014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simon Schiff updated SPARK-22014: - Description: Hello, I am using spark to process measurement data. It is possible to create sample

[jira] [Updated] (SPARK-22014) Sample windows in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-22014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simon Schiff updated SPARK-22014: - Issue Type: Wish (was: Improvement) > Sample windows in Spark SQL > ---

[jira] [Updated] (SPARK-22011) model <- spark.logit(training, Survived ~ ., regParam = 0.5) shwoing error

[ https://issues.apache.org/jira/browse/SPARK-22011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22011: - Fix Version/s: (was: 0.8.2) > model <- spark.logit(training, Survived ~ ., regParam = 0.5) sh

[jira] [Updated] (SPARK-22011) model <- spark.logit(training, Survived ~ ., regParam = 0.5) shwoing error

[ https://issues.apache.org/jira/browse/SPARK-22011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22011: - Target Version/s: (was: 2.2.0) > model <- spark.logit(training, Survived ~ ., regParam = 0.5) s

[jira] [Created] (SPARK-22014) Sample windows in Spark SQL

Simon Schiff created SPARK-22014: Summary: Sample windows in Spark SQL Key: SPARK-22014 URL: https://issues.apache.org/jira/browse/SPARK-22014 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166316#comment-16166316 ] Michael N commented on SPARK-21999: --- Sean, this issue occurred on the master as well.

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Description: Hi, I am using Spark Streaming v2.1.0 with Kafka 0.8. I am getting ConcurrentModificati

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Summary: ConcurrentModificationException - Spark Streaming (was: ConcurrentModificationException - Mas

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Master

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Summary: ConcurrentModificationException - Master (was: ConcurrentModificationException - Error sendi

[jira] [Commented] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166206#comment-16166206 ] Maciej Bryński commented on SPARK-22010: I'll open PR. > Slow fromInternal conve

[jira] [Created] (SPARK-22013) Allow to read the results of a streaming query as non-streaming datasource

Ivan Sharamet created SPARK-22013: - Summary: Allow to read the results of a streaming query as non-streaming datasource Key: SPARK-22013 URL: https://issues.apache.org/jira/browse/SPARK-22013 Project:

[jira] [Resolved] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-21922. - Resolution: Fixed Assignee: zhoukang Target Version/s: 2.3.0 > When executo

[jira] [Updated] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-21922: Fix Version/s: 2.3.0 > When executor failed and task metrics have not send to driver,the status wil

[jira] [Updated] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-21922: Target Version/s: (was: 2.3.0) > When executor failed and task metrics have not send to driver,th

[jira] [Commented] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166187#comment-16166187 ] Hyukjin Kwon commented on SPARK-22010: -- I'd also put some details in the PR descript

[jira] [Commented] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166181#comment-16166181 ] Hyukjin Kwon commented on SPARK-22010: -- Sounds good. Would you like to go ahead and

[jira] [Comment Edited] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166136#comment-16166136 ] Maciej Bryński edited comment on SPARK-22010 at 9/14/17 12:06 PM: -

[jira] [Comment Edited] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166136#comment-16166136 ] Maciej Bryński edited comment on SPARK-22010 at 9/14/17 12:05 PM: -

[jira] [Comment Edited] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166136#comment-16166136 ] Maciej Bryński edited comment on SPARK-22010 at 9/14/17 12:05 PM: -

[jira] [Updated] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-22010: --- Attachment: profile_fact_dok.png > Slow fromInternal conversion for TimestampType > -

[jira] [Commented] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166136#comment-16166136 ] Maciej Bryński commented on SPARK-22010: The reason of this Jira is this profilin

[jira] [Commented] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166134#comment-16166134 ] Maciej Bryński commented on SPARK-22010: Proposition Create constant {code} utc =

[jira] [Closed] (SPARK-22012) CLONE - Spark Streaming, Kafka receiver, "Failed to get records for ... after polling for 512"

[ https://issues.apache.org/jira/browse/SPARK-22012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-22012. - > CLONE - Spark Streaming, Kafka receiver, "Failed to get records for ... after > polling for 512" > ---

[jira] [Resolved] (SPARK-22012) CLONE - Spark Streaming, Kafka receiver, "Failed to get records for ... after polling for 512"

[ https://issues.apache.org/jira/browse/SPARK-22012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22012. --- Resolution: Invalid > CLONE - Spark Streaming, Kafka receiver, "Failed to get records for ... after

[jira] [Updated] (SPARK-22012) CLONE - Spark Streaming, Kafka receiver, "Failed to get records for ... after polling for 512"

[ https://issues.apache.org/jira/browse/SPARK-22012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karan Singh updated SPARK-22012: Environment: Apache Spark 2.1.0.2.6.0.3-8, Kafka 0.10 for Java 8 (was: Apache Spark 2.0.0, Kafka 0

[jira] [Commented] (SPARK-12216) Spark failed to delete temp directory

[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166117#comment-16166117 ] Michel Lemay commented on SPARK-12216: -- In my case, what prevent the temp folder to

[jira] [Updated] (SPARK-22012) CLONE - Spark Streaming, Kafka receiver, "Failed to get records for ... after polling for 512"

[ https://issues.apache.org/jira/browse/SPARK-22012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karan Singh updated SPARK-22012: Description: My Spark Streaming duration is 5 seconds (5000) and kafka is all at its default prope

[jira] [Updated] (SPARK-22012) CLONE - Spark Streaming, Kafka receiver, "Failed to get records for ... after polling for 512"

[ https://issues.apache.org/jira/browse/SPARK-22012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karan Singh updated SPARK-22012: Priority: Blocker (was: Major) > CLONE - Spark Streaming, Kafka receiver, "Failed to get records f

[jira] [Created] (SPARK-22012) CLONE - Spark Streaming, Kafka receiver, "Failed to get records for ... after polling for 512"

Karan Singh created SPARK-22012: --- Summary: CLONE - Spark Streaming, Kafka receiver, "Failed to get records for ... after polling for 512" Key: SPARK-22012 URL: https://issues.apache.org/jira/browse/SPARK-22012

[jira] [Commented] (SPARK-19275) Spark Streaming, Kafka receiver, "Failed to get records for ... after polling for 512"

[ https://issues.apache.org/jira/browse/SPARK-19275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166112#comment-16166112 ] Karan Singh commented on SPARK-19275: - Hi Team , My Spark Streaming duration is 5 se

[jira] [Created] (SPARK-22011) model <- spark.logit(training, Survived ~ ., regParam = 0.5) shwoing error

Atul Khairnar created SPARK-22011: - Summary: model <- spark.logit(training, Survived ~ ., regParam = 0.5) shwoing error Key: SPARK-22011 URL: https://issues.apache.org/jira/browse/SPARK-22011 Project:

[jira] [Assigned] (SPARK-22008) Spark Streaming Dynamic Allocation auto fix maxNumExecutors

[ https://issues.apache.org/jira/browse/SPARK-22008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22008: Assignee: Apache Spark > Spark Streaming Dynamic Allocation auto fix maxNumExecutors > ---

[jira] [Commented] (SPARK-22008) Spark Streaming Dynamic Allocation auto fix maxNumExecutors

[ https://issues.apache.org/jira/browse/SPARK-22008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166106#comment-16166106 ] Apache Spark commented on SPARK-22008: -- User 'mayuehappy' has created a pull request

[jira] [Assigned] (SPARK-22008) Spark Streaming Dynamic Allocation auto fix maxNumExecutors

[ https://issues.apache.org/jira/browse/SPARK-22008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22008: Assignee: (was: Apache Spark) > Spark Streaming Dynamic Allocation auto fix maxNumExec

[jira] [Commented] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166097#comment-16166097 ] Hyukjin Kwon commented on SPARK-22010: -- I don't think this is worth fixing for now.

[jira] [Resolved] (SPARK-22006) date/datetime comparisons should avoid casting

[ https://issues.apache.org/jira/browse/SPARK-22006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22006. -- Resolution: Invalid Please see https://github.com/apache/spark/blob/183d4cb71fbcbf484fc85d8621

[jira] [Updated] (SPARK-22008) Spark Streaming Dynamic Allocation auto fix maxNumExecutors

[ https://issues.apache.org/jira/browse/SPARK-22008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated SPARK-22008: --- Description: In SparkStreaming DRA .The metric we use to add or remove executor is the ratio of batch proces

[jira] [Commented] (SPARK-21935) Pyspark UDF causing ExecutorLostFailure

[ https://issues.apache.org/jira/browse/SPARK-21935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166086#comment-16166086 ] Nikolaos Tsipas commented on SPARK-21935: - Thanks for the response [~srowen]! The

[jira] [Commented] (SPARK-21935) Pyspark UDF causing ExecutorLostFailure

[ https://issues.apache.org/jira/browse/SPARK-21935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166069#comment-16166069 ] Sean Owen commented on SPARK-21935: --- The error is just running out of memory. Generally

  1   2   >