[jira] [Resolved] (SPARK-22018) Catalyst Optimizer does not preserve top-level metadata while collapsing projects

[ https://issues.apache.org/jira/browse/SPARK-22018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-22018. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 19240

[jira] [Created] (SPARK-22019) JavaBean int type property

taiho choi created SPARK-22019: -- Summary: JavaBean int type property Key: SPARK-22019 URL: https://issues.apache.org/jira/browse/SPARK-22019 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-21994) Spark 2.2 can not read Parquet table created by itself

[ https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167280#comment-16167280 ] Jia-Xuan Liu edited comment on SPARK-21994 at 9/15/17 3:40 AM: --- I also

[jira] [Commented] (SPARK-21994) Spark 2.2 can not read Parquet table created by itself

[ https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167280#comment-16167280 ] Jia-Xuan Liu commented on SPARK-21994: -- I also can't reproduce this in Spark 2.2 release.

[jira] [Comment Edited] (SPARK-21994) Spark 2.2 can not read Parquet table created by itself

[ https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167276#comment-16167276 ] Xiayun Sun edited comment on SPARK-21994 at 9/15/17 3:31 AM: - Looks like it's

[jira] [Comment Edited] (SPARK-21994) Spark 2.2 can not read Parquet table created by itself

[ https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167276#comment-16167276 ] Xiayun Sun edited comment on SPARK-21994 at 9/15/17 3:30 AM: - I'm unable to

[jira] [Comment Edited] (SPARK-21994) Spark 2.2 can not read Parquet table created by itself

[ https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167276#comment-16167276 ] Xiayun Sun edited comment on SPARK-21994 at 9/15/17 3:29 AM: - I'm unable to

[jira] [Commented] (SPARK-21994) Spark 2.2 can not read Parquet table created by itself

[ https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167276#comment-16167276 ] Xiayun Sun commented on SPARK-21994: I'm unable to reproduce this for latest master build (commit

[jira] [Commented] (SPARK-19459) ORC tables cannot be read when they contain char/varchar columns

[ https://issues.apache.org/jira/browse/SPARK-19459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167258#comment-16167258 ] Apache Spark commented on SPARK-19459: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-14387) Enable Hive-1.x ORC compatibility with spark.sql.hive.convertMetastoreOrc

[ https://issues.apache.org/jira/browse/SPARK-14387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167257#comment-16167257 ] Apache Spark commented on SPARK-14387: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-22000) org.codehaus.commons.compiler.CompileException: toString method is not declared

[ https://issues.apache.org/jira/browse/SPARK-22000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167248#comment-16167248 ] taiho choi commented on SPARK-22000: @members, my code generates this error message but i cannot make

[jira] [Updated] (SPARK-21997) Spark shows different results on char/varchar columns on Parquet

[ https://issues.apache.org/jira/browse/SPARK-21997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21997: -- Description: SPARK-19459 resolves CHAR/VARCHAR issues in general, but Spark shows different

[jira] [Assigned] (SPARK-22018) Catalyst Optimizer does not preserve top-level metadata while collapsing projects

[ https://issues.apache.org/jira/browse/SPARK-22018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22018: Assignee: Apache Spark (was: Tathagata Das) > Catalyst Optimizer does not preserve

[jira] [Assigned] (SPARK-22018) Catalyst Optimizer does not preserve top-level metadata while collapsing projects

[ https://issues.apache.org/jira/browse/SPARK-22018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22018: Assignee: Tathagata Das (was: Apache Spark) > Catalyst Optimizer does not preserve

[jira] [Commented] (SPARK-22018) Catalyst Optimizer does not preserve top-level metadata while collapsing projects

[ https://issues.apache.org/jira/browse/SPARK-22018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167166#comment-16167166 ] Apache Spark commented on SPARK-22018: -- User 'tdas' has created a pull request for this issue:

[jira] [Created] (SPARK-22018) Catalyst Optimizer does not preserve top-level metadata while collapsing projects

Tathagata Das created SPARK-22018: - Summary: Catalyst Optimizer does not preserve top-level metadata while collapsing projects Key: SPARK-22018 URL: https://issues.apache.org/jira/browse/SPARK-22018

[jira] [Commented] (SPARK-21523) Fix bug of strong wolfe linesearch `init` parameter lose effectiveness

[ https://issues.apache.org/jira/browse/SPARK-21523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167033#comment-16167033 ] Ihor Bobak commented on SPARK-21523: For us it is also critical issue: we faced with the same

[jira] [Commented] (SPARK-22017) watermark evaluation with multi-input stream operators is unspecified

[ https://issues.apache.org/jira/browse/SPARK-22017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167020#comment-16167020 ] Apache Spark commented on SPARK-22017: -- User 'joseph-torres' has created a pull request for this

[jira] [Assigned] (SPARK-22017) watermark evaluation with multi-input stream operators is unspecified

[ https://issues.apache.org/jira/browse/SPARK-22017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22017: Assignee: (was: Apache Spark) > watermark evaluation with multi-input stream

[jira] [Assigned] (SPARK-22017) watermark evaluation with multi-input stream operators is unspecified

[ https://issues.apache.org/jira/browse/SPARK-22017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22017: Assignee: Apache Spark > watermark evaluation with multi-input stream operators is

[jira] [Created] (SPARK-22017) watermark evaluation with multi-input stream operators is unspecified

Jose Torres created SPARK-22017: --- Summary: watermark evaluation with multi-input stream operators is unspecified Key: SPARK-22017 URL: https://issues.apache.org/jira/browse/SPARK-22017 Project: Spark

[jira] [Assigned] (SPARK-22016) Add HiveDialect for JDBC connection to Hive

[ https://issues.apache.org/jira/browse/SPARK-22016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22016: Assignee: Apache Spark > Add HiveDialect for JDBC connection to Hive >

[jira] [Commented] (SPARK-22016) Add HiveDialect for JDBC connection to Hive

[ https://issues.apache.org/jira/browse/SPARK-22016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166988#comment-16166988 ] Apache Spark commented on SPARK-22016: -- User 'danielfx90' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22016) Add HiveDialect for JDBC connection to Hive

[ https://issues.apache.org/jira/browse/SPARK-22016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22016: Assignee: (was: Apache Spark) > Add HiveDialect for JDBC connection to Hive >

[jira] [Created] (SPARK-22016) Add HiveDialect for JDBC connection to Hive

Daniel Fernandez created SPARK-22016: Summary: Add HiveDialect for JDBC connection to Hive Key: SPARK-22016 URL: https://issues.apache.org/jira/browse/SPARK-22016 Project: Spark Issue

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166945#comment-16166945 ] Michael N commented on SPARK-21999: --- Some related questions that would provide insights into this issue

[jira] [Resolved] (SPARK-21988) Add default stats to StreamingExecutionRelation

[ https://issues.apache.org/jira/browse/SPARK-21988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-21988. -- Resolution: Fixed Assignee: Jose Torres Fix Version/s: 2.3.0 > Add default

[jira] [Assigned] (SPARK-21987) Spark 2.3 cannot read 2.2 event logs

[ https://issues.apache.org/jira/browse/SPARK-21987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21987: Assignee: (was: Apache Spark) > Spark 2.3 cannot read 2.2 event logs >

[jira] [Commented] (SPARK-21987) Spark 2.3 cannot read 2.2 event logs

[ https://issues.apache.org/jira/browse/SPARK-21987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166637#comment-16166637 ] Apache Spark commented on SPARK-21987: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21987) Spark 2.3 cannot read 2.2 event logs

[ https://issues.apache.org/jira/browse/SPARK-21987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21987: Assignee: Apache Spark > Spark 2.3 cannot read 2.2 event logs >

[jira] [Assigned] (SPARK-22015) Remove usage of non-used private field isAuthenticated from org.apache.spark.network.sasl.SaslRpcHandler.java

[ https://issues.apache.org/jira/browse/SPARK-22015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22015: Assignee: Apache Spark > Remove usage of non-used private field isAuthenticated from >

[jira] [Commented] (SPARK-22015) Remove usage of non-used private field isAuthenticated from org.apache.spark.network.sasl.SaslRpcHandler.java

[ https://issues.apache.org/jira/browse/SPARK-22015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166561#comment-16166561 ] Apache Spark commented on SPARK-22015: -- User 'nikhilbhide' has created a pull request for this

[jira] [Assigned] (SPARK-22015) Remove usage of non-used private field isAuthenticated from org.apache.spark.network.sasl.SaslRpcHandler.java

[ https://issues.apache.org/jira/browse/SPARK-22015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22015: Assignee: (was: Apache Spark) > Remove usage of non-used private field

[jira] [Created] (SPARK-22015) Remove usage of non-used private field isAuthenticated from org.apache.spark.network.sasl.SaslRpcHandler.java

Nikhil Bhide created SPARK-22015: Summary: Remove usage of non-used private field isAuthenticated from org.apache.spark.network.sasl.SaslRpcHandler.java Key: SPARK-22015 URL:

[jira] [Updated] (SPARK-21997) Spark shows different results on char/varchar columns on Parquet

[ https://issues.apache.org/jira/browse/SPARK-21997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21997: -- Description: SPARK-19459 resolves CHAR/VARCHAR issues in general, but Spark shows different

[jira] [Updated] (SPARK-21997) Spark shows different results on char/varchar columns on Parquet

[ https://issues.apache.org/jira/browse/SPARK-21997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21997: -- Summary: Spark shows different results on char/varchar columns on Parquet (was: Spark shows

[jira] [Updated] (SPARK-21997) Spark shows different results on Hive char/varchar columns on Parquet

[ https://issues.apache.org/jira/browse/SPARK-21997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21997: -- Description: SPARK-19459 resolves CHAR/VARCHAR issues in general, but Spark shows different

[jira] [Commented] (SPARK-21997) Spark shows different results on Hive char/varchar columns on Parquet

[ https://issues.apache.org/jira/browse/SPARK-21997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166539#comment-16166539 ] Apache Spark commented on SPARK-21997: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-21997) Spark shows different results on Hive char/varchar columns on Parquet

[ https://issues.apache.org/jira/browse/SPARK-21997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21997: Assignee: (was: Apache Spark) > Spark shows different results on Hive char/varchar

[jira] [Assigned] (SPARK-21997) Spark shows different results on Hive char/varchar columns on Parquet

[ https://issues.apache.org/jira/browse/SPARK-21997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21997: Assignee: Apache Spark > Spark shows different results on Hive char/varchar columns on

[jira] [Updated] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-22010: --- Description: To convert timestamp type to python we are using

[jira] [Updated] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-22010: --- Priority: Minor (was: Major) > Slow fromInternal conversion for TimestampType >

[jira] [Updated] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-22010: --- Issue Type: Improvement (was: Bug) > Slow fromInternal conversion for TimestampType >

[jira] [Updated] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-22010: --- Description: To convert timestamp type to python we are using

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166516#comment-16166516 ] Michael N commented on SPARK-21999: --- My app was not asynchronously modifying an object that your

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166493#comment-16166493 ] Sean Owen commented on SPARK-21999: --- I'm suggesting it could happen if your app was asynchronously

[jira] [Commented] (SPARK-21858) Make Spark grouping_id() compatible with Hive grouping__id

[ https://issues.apache.org/jira/browse/SPARK-21858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166467#comment-16166467 ] Dongjoon Hyun commented on SPARK-21858: --- Thank you for conclusion, [~cloud_fan]! > Make Spark

[jira] [Updated] (SPARK-22014) Sample windows in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-22014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22014: -- Target Version/s: (was: 2.2.0) > Sample windows in Spark SQL > --- > >

[jira] [Resolved] (SPARK-22011) model <- spark.logit(training, Survived ~ ., regParam = 0.5) shwoing error

[ https://issues.apache.org/jira/browse/SPARK-22011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22011. --- Resolution: Not A Problem The error pretty much says it all -- set SPARK_HOME. See the SparkR docs.

[jira] [Assigned] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22010: Assignee: (was: Apache Spark) > Slow fromInternal conversion for TimestampType >

[jira] [Assigned] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22010: Assignee: Apache Spark > Slow fromInternal conversion for TimestampType >

[jira] [Commented] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166430#comment-16166430 ] Apache Spark commented on SPARK-22010: -- User 'maver1ck' has created a pull request for this issue:

[jira] [Updated] (SPARK-22014) Sample windows in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-22014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simon Schiff updated SPARK-22014: - Description: Hello, I am using spark to process measurement data. It is possible to create

[jira] [Updated] (SPARK-22014) Sample windows in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-22014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simon Schiff updated SPARK-22014: - Description: Hello, I am using spark to process measurement data. It is possible to create

[jira] [Updated] (SPARK-22014) Sample windows in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-22014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simon Schiff updated SPARK-22014: - Issue Type: Wish (was: Improvement) > Sample windows in Spark SQL > ---

[jira] [Updated] (SPARK-22011) model <- spark.logit(training, Survived ~ ., regParam = 0.5) shwoing error

[ https://issues.apache.org/jira/browse/SPARK-22011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22011: - Fix Version/s: (was: 0.8.2) > model <- spark.logit(training, Survived ~ ., regParam = 0.5)

[jira] [Updated] (SPARK-22011) model <- spark.logit(training, Survived ~ ., regParam = 0.5) shwoing error

[ https://issues.apache.org/jira/browse/SPARK-22011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22011: - Target Version/s: (was: 2.2.0) > model <- spark.logit(training, Survived ~ ., regParam = 0.5)

[jira] [Created] (SPARK-22014) Sample windows in Spark SQL

Simon Schiff created SPARK-22014: Summary: Sample windows in Spark SQL Key: SPARK-22014 URL: https://issues.apache.org/jira/browse/SPARK-22014 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166316#comment-16166316 ] Michael N commented on SPARK-21999: --- Sean, this issue occurred on the master as well.I updated the

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Description: Hi, I am using Spark Streaming v2.1.0 with Kafka 0.8. I am getting

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Summary: ConcurrentModificationException - Spark Streaming (was: ConcurrentModificationException -

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Master

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Summary: ConcurrentModificationException - Master (was: ConcurrentModificationException - Error

[jira] [Commented] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166206#comment-16166206 ] Maciej Bryński commented on SPARK-22010: I'll open PR. > Slow fromInternal conversion for

[jira] [Resolved] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-21922. - Resolution: Fixed Assignee: zhoukang Target Version/s: 2.3.0 > When

[jira] [Updated] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-21922: Fix Version/s: 2.3.0 > When executor failed and task metrics have not send to driver,the status

[jira] [Updated] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-21922: Target Version/s: (was: 2.3.0) > When executor failed and task metrics have not send to

[jira] [Commented] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166187#comment-16166187 ] Hyukjin Kwon commented on SPARK-22010: -- I'd also put some details in the PR description, for

[jira] [Commented] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166181#comment-16166181 ] Hyukjin Kwon commented on SPARK-22010: -- Sounds good. Would you like to go ahead and open a PR with

[jira] [Comment Edited] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166136#comment-16166136 ] Maciej Bryński edited comment on SPARK-22010 at 9/14/17 12:05 PM: -- The

[jira] [Commented] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166134#comment-16166134 ] Maciej Bryński commented on SPARK-22010: Proposition Create constant {code} utc =

[jira] [Closed] (SPARK-22012) CLONE - Spark Streaming, Kafka receiver, "Failed to get records for ... after polling for 512"

[ https://issues.apache.org/jira/browse/SPARK-22012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-22012. - > CLONE - Spark Streaming, Kafka receiver, "Failed to get records for ... after > polling for 512" >

[jira] [Resolved] (SPARK-22012) CLONE - Spark Streaming, Kafka receiver, "Failed to get records for ... after polling for 512"

[ https://issues.apache.org/jira/browse/SPARK-22012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22012. --- Resolution: Invalid > CLONE - Spark Streaming, Kafka receiver, "Failed to get records for ... after

[jira] [Updated] (SPARK-22012) CLONE - Spark Streaming, Kafka receiver, "Failed to get records for ... after polling for 512"

[ https://issues.apache.org/jira/browse/SPARK-22012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karan Singh updated SPARK-22012: Environment: Apache Spark 2.1.0.2.6.0.3-8, Kafka 0.10 for Java 8 (was: Apache Spark 2.0.0, Kafka

[jira] [Commented] (SPARK-12216) Spark failed to delete temp directory

[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166117#comment-16166117 ] Michel Lemay commented on SPARK-12216: -- In my case, what prevent the temp folder to be deleted is a

[jira] [Updated] (SPARK-22012) CLONE - Spark Streaming, Kafka receiver, "Failed to get records for ... after polling for 512"

[ https://issues.apache.org/jira/browse/SPARK-22012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karan Singh updated SPARK-22012: Description: My Spark Streaming duration is 5 seconds (5000) and kafka is all at its default

[jira] [Updated] (SPARK-22012) CLONE - Spark Streaming, Kafka receiver, "Failed to get records for ... after polling for 512"

[ https://issues.apache.org/jira/browse/SPARK-22012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karan Singh updated SPARK-22012: Priority: Blocker (was: Major) > CLONE - Spark Streaming, Kafka receiver, "Failed to get records

[jira] [Created] (SPARK-22012) CLONE - Spark Streaming, Kafka receiver, "Failed to get records for ... after polling for 512"

Karan Singh created SPARK-22012: --- Summary: CLONE - Spark Streaming, Kafka receiver, "Failed to get records for ... after polling for 512" Key: SPARK-22012 URL: https://issues.apache.org/jira/browse/SPARK-22012

[jira] [Commented] (SPARK-19275) Spark Streaming, Kafka receiver, "Failed to get records for ... after polling for 512"

[ https://issues.apache.org/jira/browse/SPARK-19275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166112#comment-16166112 ] Karan Singh commented on SPARK-19275: - Hi Team , My Spark Streaming duration is 5 seconds (5000) and

[jira] [Created] (SPARK-22011) model <- spark.logit(training, Survived ~ ., regParam = 0.5) shwoing error

Atul Khairnar created SPARK-22011: - Summary: model <- spark.logit(training, Survived ~ ., regParam = 0.5) shwoing error Key: SPARK-22011 URL: https://issues.apache.org/jira/browse/SPARK-22011

[jira] [Assigned] (SPARK-22008) Spark Streaming Dynamic Allocation auto fix maxNumExecutors

[ https://issues.apache.org/jira/browse/SPARK-22008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22008: Assignee: Apache Spark > Spark Streaming Dynamic Allocation auto fix maxNumExecutors >

[jira] [Commented] (SPARK-22008) Spark Streaming Dynamic Allocation auto fix maxNumExecutors

[ https://issues.apache.org/jira/browse/SPARK-22008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166106#comment-16166106 ] Apache Spark commented on SPARK-22008: -- User 'mayuehappy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22008) Spark Streaming Dynamic Allocation auto fix maxNumExecutors

[ https://issues.apache.org/jira/browse/SPARK-22008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22008: Assignee: (was: Apache Spark) > Spark Streaming Dynamic Allocation auto fix

[jira] [Commented] (SPARK-22010) Slow fromInternal conversion for TimestampType

[ https://issues.apache.org/jira/browse/SPARK-22010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166097#comment-16166097 ] Hyukjin Kwon commented on SPARK-22010: -- I don't think this is worth fixing for now. The improvement

[jira] [Resolved] (SPARK-22006) date/datetime comparisons should avoid casting

[ https://issues.apache.org/jira/browse/SPARK-22006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22006. -- Resolution: Invalid Please see

[jira] [Updated] (SPARK-22008) Spark Streaming Dynamic Allocation auto fix maxNumExecutors

[ https://issues.apache.org/jira/browse/SPARK-22008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated SPARK-22008: --- Description: In SparkStreaming DRA .The metric we use to add or remove executor is the ratio of batch

[jira] [Commented] (SPARK-21935) Pyspark UDF causing ExecutorLostFailure

[ https://issues.apache.org/jira/browse/SPARK-21935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166086#comment-16166086 ] Nikolaos Tsipas commented on SPARK-21935: - Thanks for the response [~srowen]! The problem only

[jira] [Commented] (SPARK-21935) Pyspark UDF causing ExecutorLostFailure

[ https://issues.apache.org/jira/browse/SPARK-21935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166069#comment-16166069 ] Sean Owen commented on SPARK-21935: --- The error is just running out of memory. Generally it is not true

[jira] [Commented] (SPARK-21935) Pyspark UDF causing ExecutorLostFailure

[ https://issues.apache.org/jira/browse/SPARK-21935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166063#comment-16166063 ] Alistair Wooldrige commented on SPARK-21935: I get this a lot, and see it *only* when

[jira] [Created] (SPARK-22010) Slow fromInternal conversion for TimestampType

Maciej Bryński created SPARK-22010: -- Summary: Slow fromInternal conversion for TimestampType Key: SPARK-22010 URL: https://issues.apache.org/jira/browse/SPARK-22010 Project: Spark Issue

[jira] [Updated] (SPARK-22009) Using treeAggregate improve some algs

[ https://issues.apache.org/jira/browse/SPARK-22009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-22009: - Description: I test on a dataset of about 13M instances, and found that using `treeAggregate`

[jira] [Assigned] (SPARK-22009) Using treeAggregate improve some algs

[ https://issues.apache.org/jira/browse/SPARK-22009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22009: Assignee: Apache Spark > Using treeAggregate improve some algs >

[jira] [Commented] (SPARK-22009) Using treeAggregate improve some algs

[ https://issues.apache.org/jira/browse/SPARK-22009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166003#comment-16166003 ] Apache Spark commented on SPARK-22009: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-22009) Using treeAggregate improve some algs

[ https://issues.apache.org/jira/browse/SPARK-22009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22009: Assignee: (was: Apache Spark) > Using treeAggregate improve some algs >

[jira] [Created] (SPARK-22009) Using treeAggregate improve some algs

zhengruifeng created SPARK-22009: Summary: Using treeAggregate improve some algs Key: SPARK-22009 URL: https://issues.apache.org/jira/browse/SPARK-22009 Project: Spark Issue Type:

[jira] [Created] (SPARK-22008) Spark Streaming Dynamic Allocation auto fix maxNumExecutors

Yue Ma created SPARK-22008: -- Summary: Spark Streaming Dynamic Allocation auto fix maxNumExecutors Key: SPARK-22008 URL: https://issues.apache.org/jira/browse/SPARK-22008 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-22007) spark-submit on yarn or local , got different result

[ https://issues.apache.org/jira/browse/SPARK-22007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xinzhang resolved SPARK-22007. -- Resolution: Won't Fix > spark-submit on yarn or local , got different result >

[jira] [Commented] (SPARK-22007) spark-submit on yarn or local , got different result

[ https://issues.apache.org/jira/browse/SPARK-22007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165972#comment-16165972 ] xinzhang commented on SPARK-22007: -- ye .i figure it out. add this with instance sparkSession

[jira] [Commented] (SPARK-21418) NoSuchElementException: None.get in DataSourceScanExec with sun.io.serialization.extendedDebugInfo=true

[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165946#comment-16165946 ] Daniel Darabos commented on SPARK-21418: Sean's fix should cover you no matter what triggers the

[jira] [Updated] (SPARK-22007) spark-submit on yarn or local , got different result

[ https://issues.apache.org/jira/browse/SPARK-22007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xinzhang updated SPARK-22007: - Description: submit the py script on local. /opt/spark/spark-bin/bin/spark-submit --master local cluster

[jira] [Created] (SPARK-22007) spark-submit on yarn or local , got different result

xinzhang created SPARK-22007: Summary: spark-submit on yarn or local , got different result Key: SPARK-22007 URL: https://issues.apache.org/jira/browse/SPARK-22007 Project: Spark Issue Type: Bug

  1   2   >