[jira] [Commented] (SPARK-19293) Spark 2.1.x unstable with spark.speculation=true

[ https://issues.apache.org/jira/browse/SPARK-19293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057091#comment-16057091 ] Damian Momot commented on SPARK-19293: -- Yep, Some tasks are marked as "killed" but

[jira] [Commented] (SPARK-21159) Cluster mode, driver throws connection refused exception submitted by SparkLauncher

[ https://issues.apache.org/jira/browse/SPARK-21159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057117#comment-16057117 ] niefei commented on SPARK-21159: thank you for your reply. it should use launcher's IP ad

[jira] [Commented] (SPARK-19293) Spark 2.1.x unstable with spark.speculation=true

[ https://issues.apache.org/jira/browse/SPARK-19293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057127#comment-16057127 ] coneyliu commented on SPARK-19293: -- Have you tried the latest code? The exceptions you g

[jira] [Comment Edited] (SPARK-19293) Spark 2.1.x unstable with spark.speculation=true

[ https://issues.apache.org/jira/browse/SPARK-19293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057127#comment-16057127 ] coneyliu edited comment on SPARK-19293 at 6/21/17 8:01 AM: --- Hav

[jira] [Commented] (SPARK-19293) Spark 2.1.x unstable with spark.speculation=true

[ https://issues.apache.org/jira/browse/SPARK-19293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057157#comment-16057157 ] Damian Momot commented on SPARK-19293: -- I'll try to build from 2.2 branch and test t

[jira] [Commented] (SPARK-21144) Unexpected results when the data schema and partition schema have the duplicate columns

[ https://issues.apache.org/jira/browse/SPARK-21144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057312#comment-16057312 ] Apache Spark commented on SPARK-21144: -- User 'maropu' has created a pull request for

[jira] [Updated] (SPARK-20466) HadoopRDD#addLocalConfiguration throws NPE

[ https://issues.apache.org/jira/browse/SPARK-20466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20466: -- Priority: Minor (was: Major) Hm, I think the question is how the JobConf is ever null here. I think ad

[jira] [Created] (SPARK-21160) Filtering rows with "not equal" operator yields unexpected result with null rows

Edoardo Vivo created SPARK-21160: Summary: Filtering rows with "not equal" operator yields unexpected result with null rows Key: SPARK-21160 URL: https://issues.apache.org/jira/browse/SPARK-21160 Proj

[jira] [Commented] (SPARK-18484) case class datasets - ability to specify decimal precision and scale

[ https://issues.apache.org/jira/browse/SPARK-18484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057410#comment-16057410 ] Arkadiusz Bicz commented on SPARK-18484: Usage of DecimalType should be avoided w

[jira] [Created] (SPARK-21161) SparkContext stopped when execute a query on Solr

Jian Wu created SPARK-21161: --- Summary: SparkContext stopped when execute a query on Solr Key: SPARK-21161 URL: https://issues.apache.org/jira/browse/SPARK-21161 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-21137) Spark cannot read many small files (wholeTextFiles)

[ https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057510#comment-16057510 ] Mikael Valot commented on SPARK-21137: -- this is a very common issue, I do not unders

[jira] [Assigned] (SPARK-21161) SparkContext stopped when execute a query on Solr

[ https://issues.apache.org/jira/browse/SPARK-21161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21161: Assignee: Apache Spark > SparkContext stopped when execute a query on Solr > -

[jira] [Commented] (SPARK-21161) SparkContext stopped when execute a query on Solr

[ https://issues.apache.org/jira/browse/SPARK-21161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057530#comment-16057530 ] Apache Spark commented on SPARK-21161: -- User 'janplus' has created a pull request fo

[jira] [Assigned] (SPARK-21161) SparkContext stopped when execute a query on Solr

[ https://issues.apache.org/jira/browse/SPARK-21161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21161: Assignee: (was: Apache Spark) > SparkContext stopped when execute a query on Solr > --

[jira] [Commented] (SPARK-21093) Multiple gapply execution occasionally failed in SparkR

[ https://issues.apache.org/jira/browse/SPARK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057550#comment-16057550 ] Nick Pentreath commented on SPARK-21093: Just adding the info from test failure r

[jira] [Resolved] (SPARK-20640) Make rpc timeout and retry for shuffle registration configurable

[ https://issues.apache.org/jira/browse/SPARK-20640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20640. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18092 [https://githu

[jira] [Assigned] (SPARK-20640) Make rpc timeout and retry for shuffle registration configurable

[ https://issues.apache.org/jira/browse/SPARK-20640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20640: --- Assignee: Li Yichao > Make rpc timeout and retry for shuffle registration configurable > ---

[jira] [Commented] (SPARK-21161) SparkContext stopped when execute a query on Solr

[ https://issues.apache.org/jira/browse/SPARK-21161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057564#comment-16057564 ] Sean Owen commented on SPARK-21161: --- Yes, that's not a valid host/port. No, you can't j

[jira] [Commented] (SPARK-21137) Spark cannot read many small files (wholeTextFiles)

[ https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057565#comment-16057565 ] Sean Owen commented on SPARK-21137: --- [~leakimav] -- there still isn't detail here about

[jira] [Commented] (SPARK-21160) Filtering rows with "not equal" operator yields unexpected result with null rows

[ https://issues.apache.org/jira/browse/SPARK-21160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057587#comment-16057587 ] Takeshi Yamamuro commented on SPARK-21160: -- This is an expected behaviour. Proba

[jira] [Commented] (SPARK-21137) Spark cannot read many small files (wholeTextFiles)

[ https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057592#comment-16057592 ] sam commented on SPARK-21137: - [~srowen] I thought I already made a point about that? Please

[jira] [Commented] (SPARK-21160) Filtering rows with "not equal" operator yields unexpected result with null rows

[ https://issues.apache.org/jira/browse/SPARK-21160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057601#comment-16057601 ] Takeshi Yamamuro commented on SPARK-21160: -- BTW, anybody knows why `a` is nullab

[jira] [Commented] (SPARK-21137) Spark cannot read many small files (wholeTextFiles)

[ https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057605#comment-16057605 ] Sean Owen commented on SPARK-21137: --- (This is not a common use case) What change are y

[jira] [Commented] (SPARK-21160) Filtering rows with "not equal" operator yields unexpected result with null rows

[ https://issues.apache.org/jira/browse/SPARK-21160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057614#comment-16057614 ] Edoardo Vivo commented on SPARK-21160: -- Sorry for the stupid question, but may I ask

[jira] [Resolved] (SPARK-21082) Consider Executor's memory usage when scheduling task

[ https://issues.apache.org/jira/browse/SPARK-21082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21082. --- Resolution: Won't Fix > Consider Executor's memory usage when scheduling task >

[jira] [Commented] (SPARK-21160) Filtering rows with "not equal" operator yields unexpected result with null rows

[ https://issues.apache.org/jira/browse/SPARK-21160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057629#comment-16057629 ] Takeshi Yamamuro commented on SPARK-21160: -- you better google it though, this is

[jira] [Created] (SPARK-21162) Cannot count rows in an empty Hive table stored as parquet when spark.sql.parquet.cacheMetadata is set to false

Tom Ogle created SPARK-21162: Summary: Cannot count rows in an empty Hive table stored as parquet when spark.sql.parquet.cacheMetadata is set to false Key: SPARK-21162 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057657#comment-16057657 ] Apache Spark commented on SPARK-18016: -- User 'bdrillard' has created a pull request

[jira] [Commented] (SPARK-21160) Filtering rows with "not equal" operator yields unexpected result with null rows

[ https://issues.apache.org/jira/browse/SPARK-21160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057722#comment-16057722 ] Edoardo Vivo commented on SPARK-21160: -- Thank you for your answer. I noticed the sam

[jira] [Created] (SPARK-21163) DataFrame.toPandas should respect the data type

Wenchen Fan created SPARK-21163: --- Summary: DataFrame.toPandas should respect the data type Key: SPARK-21163 URL: https://issues.apache.org/jira/browse/SPARK-21163 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-21163) DataFrame.toPandas should respect the data type

[ https://issues.apache.org/jira/browse/SPARK-21163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21163: Assignee: Apache Spark (was: Wenchen Fan) > DataFrame.toPandas should respect the data ty

[jira] [Assigned] (SPARK-21163) DataFrame.toPandas should respect the data type

[ https://issues.apache.org/jira/browse/SPARK-21163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21163: Assignee: Wenchen Fan (was: Apache Spark) > DataFrame.toPandas should respect the data ty

[jira] [Commented] (SPARK-21163) DataFrame.toPandas should respect the data type

[ https://issues.apache.org/jira/browse/SPARK-21163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057729#comment-16057729 ] Apache Spark commented on SPARK-21163: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-21161) SparkContext stopped when execute a query on Solr

[ https://issues.apache.org/jira/browse/SPARK-21161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057753#comment-16057753 ] Jian Wu commented on SPARK-21161: - I'll fix this bug in the `spark-solr` project. Thx for

[jira] [Commented] (SPARK-21159) Cluster mode, driver throws connection refused exception submitted by SparkLauncher

[ https://issues.apache.org/jira/browse/SPARK-21159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057767#comment-16057767 ] Marcelo Vanzin commented on SPARK-21159: No, that should not be it. That's not ho

[jira] [Commented] (SPARK-10878) Race condition when resolving Maven coordinates via Ivy

[ https://issues.apache.org/jira/browse/SPARK-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057797#comment-16057797 ] Todd Morrison commented on SPARK-10878: --- Any chance we can move the priority of thi

[jira] [Resolved] (SPARK-17851) Make sure all test sqls in catalyst pass checkAnalysis

[ https://issues.apache.org/jira/browse/SPARK-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-17851. - Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.3.0 > Make sure all test sqls i

[jira] [Commented] (SPARK-21161) SparkContext stopped when execute a query on Solr

[ https://issues.apache.org/jira/browse/SPARK-21161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057855#comment-16057855 ] Jian Wu commented on SPARK-21161: - For others who come up with the same issue, please che

[jira] [Resolved] (SPARK-20917) SparkR supports string encoding consistent with R

[ https://issues.apache.org/jira/browse/SPARK-20917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20917. -- Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.3.0 Target

[jira] [Created] (SPARK-21164) Remove isTableSample from Sample

Xiao Li created SPARK-21164: --- Summary: Remove isTableSample from Sample Key: SPARK-21164 URL: https://issues.apache.org/jira/browse/SPARK-21164 Project: Spark Issue Type: Improvement Comp

[jira] [Updated] (SPARK-21147) the schema of socket/rate source can not be set.

[ https://issues.apache.org/jira/browse/SPARK-21147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-21147: - Summary: the schema of socket/rate source can not be set. (was: the schema of socket source can

[jira] [Resolved] (SPARK-21147) the schema of socket/rate source can not be set.

[ https://issues.apache.org/jira/browse/SPARK-21147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-21147. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.3.0 > the schema of s

[jira] [Assigned] (SPARK-21125) PySpark context missing function to set Job Description.

[ https://issues.apache.org/jira/browse/SPARK-21125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-21125: - Assignee: Shane Jarvie > PySpark context missing function to set Job Description. >

[jira] [Resolved] (SPARK-21125) PySpark context missing function to set Job Description.

[ https://issues.apache.org/jira/browse/SPARK-21125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-21125. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18332 [https://g

[jira] [Updated] (SPARK-21147) the schema of socket/rate source can not be set.

[ https://issues.apache.org/jira/browse/SPARK-21147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-21147: - Affects Version/s: 2.2.0 > the schema of socket/rate source can not be set. > ---

[jira] [Commented] (SPARK-21164) Remove isTableSample from Sample

[ https://issues.apache.org/jira/browse/SPARK-21164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057923#comment-16057923 ] Apache Spark commented on SPARK-21164: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-21164) Remove isTableSample from Sample

[ https://issues.apache.org/jira/browse/SPARK-21164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21164: Assignee: Xiao Li (was: Apache Spark) > Remove isTableSample from Sample > --

[jira] [Assigned] (SPARK-21164) Remove isTableSample from Sample

[ https://issues.apache.org/jira/browse/SPARK-21164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21164: Assignee: Apache Spark (was: Xiao Li) > Remove isTableSample from Sample > --

[jira] [Created] (SPARK-21165) Fail to write into partitioned hive table due to attribute reference not working with cast on partition column

Imran Rashid created SPARK-21165: Summary: Fail to write into partitioned hive table due to attribute reference not working with cast on partition column Key: SPARK-21165 URL: https://issues.apache.org/jira/browse

[jira] [Updated] (SPARK-21165) Fail to write into partitioned hive table due to attribute reference not working with cast on partition column

[ https://issues.apache.org/jira/browse/SPARK-21165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-21165: - Description: A simple "insert into ... select" involving partitioned hive tables fails. Here's

[jira] [Assigned] (SPARK-16019) Eliminate unexpected delay during spark on yarn job launch

[ https://issues.apache.org/jira/browse/SPARK-16019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16019: Assignee: Apache Spark > Eliminate unexpected delay during spark on yarn job launch >

[jira] [Assigned] (SPARK-16019) Eliminate unexpected delay during spark on yarn job launch

[ https://issues.apache.org/jira/browse/SPARK-16019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16019: Assignee: (was: Apache Spark) > Eliminate unexpected delay during spark on yarn job la

[jira] [Commented] (SPARK-16019) Eliminate unexpected delay during spark on yarn job launch

[ https://issues.apache.org/jira/browse/SPARK-16019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058116#comment-16058116 ] Apache Spark commented on SPARK-16019: -- User 'vanzin' has created a pull request for

[jira] [Updated] (SPARK-20114) spark.ml parity for sequential pattern mining - PrefixSpan

[ https://issues.apache.org/jira/browse/SPARK-20114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20114: -- Issue Type: Sub-task (was: New Feature) Parent: SPARK-14501 > spark.ml parity

[jira] [Created] (SPARK-21166) Automated ML persistence

Joseph K. Bradley created SPARK-21166: - Summary: Automated ML persistence Key: SPARK-21166 URL: https://issues.apache.org/jira/browse/SPARK-21166 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-20830) PySpark wrappers for explode_outer and posexplode_outer

[ https://issues.apache.org/jira/browse/SPARK-20830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-20830: - Assignee: Maciej Szymkiewicz > PySpark wrappers for explode_outer and posexplode_outer >

[jira] [Resolved] (SPARK-20830) PySpark wrappers for explode_outer and posexplode_outer

[ https://issues.apache.org/jira/browse/SPARK-20830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-20830. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18049 [https://g

[jira] [Commented] (SPARK-21165) Fail to write into partitioned hive table due to attribute reference not working with cast on partition column

[ https://issues.apache.org/jira/browse/SPARK-21165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058440#comment-16058440 ] Xiao Li commented on SPARK-21165: - Unable to reproduce it in the current master branch. W

[jira] [Created] (SPARK-21167) Path is not decoded correctly when reading output of FileSink

Shixiong Zhu created SPARK-21167: Summary: Path is not decoded correctly when reading output of FileSink Key: SPARK-21167 URL: https://issues.apache.org/jira/browse/SPARK-21167 Project: Spark

[jira] [Assigned] (SPARK-21167) Path is not decoded correctly when reading output of FileSink

[ https://issues.apache.org/jira/browse/SPARK-21167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21167: Assignee: Shixiong Zhu (was: Apache Spark) > Path is not decoded correctly when reading o

[jira] [Assigned] (SPARK-21167) Path is not decoded correctly when reading output of FileSink

[ https://issues.apache.org/jira/browse/SPARK-21167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21167: Assignee: Apache Spark (was: Shixiong Zhu) > Path is not decoded correctly when reading o

[jira] [Commented] (SPARK-21167) Path is not decoded correctly when reading output of FileSink

[ https://issues.apache.org/jira/browse/SPARK-21167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058486#comment-16058486 ] Apache Spark commented on SPARK-21167: -- User 'zsxwing' has created a pull request fo

[jira] [Commented] (SPARK-21165) Fail to write into partitioned hive table due to attribute reference not working with cast on partition column

[ https://issues.apache.org/jira/browse/SPARK-21165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058490#comment-16058490 ] Xiao Li commented on SPARK-21165: - 2.2 branch failed with the same error. > Fail to writ

[jira] [Resolved] (SPARK-21160) Filtering rows with "not equal" operator yields unexpected result with null rows

[ https://issues.apache.org/jira/browse/SPARK-21160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21160. -- Resolution: Not A Bug There is null-safe equality comparison ``` scala> Seq(Some(1), Some(2),

[jira] [Comment Edited] (SPARK-21160) Filtering rows with "not equal" operator yields unexpected result with null rows

[ https://issues.apache.org/jira/browse/SPARK-21160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058537#comment-16058537 ] Hyukjin Kwon edited comment on SPARK-21160 at 6/22/17 12:40 AM: ---

[jira] [Comment Edited] (SPARK-21160) Filtering rows with "not equal" operator yields unexpected result with null rows

[ https://issues.apache.org/jira/browse/SPARK-21160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058537#comment-16058537 ] Hyukjin Kwon edited comment on SPARK-21160 at 6/22/17 12:40 AM: ---

[jira] [Commented] (SPARK-21158) SparkSQL function SparkSession.Catalog.ListTables() does not handle spark setting for case-sensitivity

[ https://issues.apache.org/jira/browse/SPARK-21158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058577#comment-16058577 ] Kathryn McClintic commented on SPARK-21158: --- I'm fine with that from my perspec

[jira] [Commented] (SPARK-19341) Bucketing support for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-19341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058590#comment-16058590 ] Fei Shao commented on SPARK-19341: -- @gagan taneia Would you like add more info about th

[jira] [Commented] (SPARK-21149) Add job description API for R

[ https://issues.apache.org/jira/browse/SPARK-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058599#comment-16058599 ] Apache Spark commented on SPARK-21149: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-21149) Add job description API for R

[ https://issues.apache.org/jira/browse/SPARK-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21149: Assignee: Apache Spark > Add job description API for R > - > >

[jira] [Assigned] (SPARK-21149) Add job description API for R

[ https://issues.apache.org/jira/browse/SPARK-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21149: Assignee: (was: Apache Spark) > Add job description API for R > --

[jira] [Issue Comment Deleted] (SPARK-21155) Add (? running tasks) into Spark UI progress

[ https://issues.apache.org/jira/browse/SPARK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Vandenberg updated SPARK-21155: Comment: was deleted (was: Before ) > Add (? running tasks) into Spark UI progress > -

[jira] [Commented] (SPARK-20338) Spaces in spark.eventLog.dir are not correctly handled

[ https://issues.apache.org/jira/browse/SPARK-20338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058666#comment-16058666 ] Apache Spark commented on SPARK-20338: -- User 'zuotingbing' has created a pull reques

[jira] [Created] (SPARK-21168) KafkaRDD should always set kafka clientId.

Xingxing Di created SPARK-21168: --- Summary: KafkaRDD should always set kafka clientId. Key: SPARK-21168 URL: https://issues.apache.org/jira/browse/SPARK-21168 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-21168) KafkaRDD should always set kafka clientId.

[ https://issues.apache.org/jira/browse/SPARK-21168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingxing Di updated SPARK-21168: External issue URL: https://github.com/apache/spark/pull/18383 > KafkaRDD should always set kafka c

[jira] [Commented] (SPARK-21167) Path is not decoded correctly when reading output of FileSink

[ https://issues.apache.org/jira/browse/SPARK-21167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058678#comment-16058678 ] Apache Spark commented on SPARK-21167: -- User 'dijingran' has created a pull request

[jira] [Resolved] (SPARK-20906) Constrained Logistic Regression for SparkR

[ https://issues.apache.org/jira/browse/SPARK-20906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20906. -- Resolution: Fixed Assignee: Miao Wang Fix Version/s: 2.3.0 Target V

[jira] [Updated] (SPARK-21168) KafkaRDD should always set kafka clientId.

[ https://issues.apache.org/jira/browse/SPARK-21168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingxing Di updated SPARK-21168: External issue URL: (was: https://github.com/apache/spark/pull/18383) > KafkaRDD should always se

[jira] [Assigned] (SPARK-21165) Fail to write into partitioned hive table due to attribute reference not working with cast on partition column

[ https://issues.apache.org/jira/browse/SPARK-21165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-21165: --- Assignee: Xiao Li > Fail to write into partitioned hive table due to attribute reference not > work

[jira] [Created] (SPARK-21169) Spark HA: Jobs state is in WAITING status after reconnecting to standby master

Srinivasarao Daruna created SPARK-21169: --- Summary: Spark HA: Jobs state is in WAITING status after reconnecting to standby master Key: SPARK-21169 URL: https://issues.apache.org/jira/browse/SPARK-21169

[jira] [Commented] (SPARK-19141) VectorAssembler metadata causing memory issues

[ https://issues.apache.org/jira/browse/SPARK-19141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058713#comment-16058713 ] Mayur Bhole commented on SPARK-19141: - Is there any possible work around for this iss

[jira] [Created] (SPARK-21170) Utils.tryWithSafeFinallyAndFailureCallbacks throws IllegalArgumentException: Self-suppression not permitted

Devaraj K created SPARK-21170: - Summary: Utils.tryWithSafeFinallyAndFailureCallbacks throws IllegalArgumentException: Self-suppression not permitted Key: SPARK-21170 URL: https://issues.apache.org/jira/browse/SPARK-21

[jira] [Assigned] (SPARK-21170) Utils.tryWithSafeFinallyAndFailureCallbacks throws IllegalArgumentException: Self-suppression not permitted

[ https://issues.apache.org/jira/browse/SPARK-21170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21170: Assignee: (was: Apache Spark) > Utils.tryWithSafeFinallyAndFailureCallbacks throws Ill

[jira] [Commented] (SPARK-21170) Utils.tryWithSafeFinallyAndFailureCallbacks throws IllegalArgumentException: Self-suppression not permitted

[ https://issues.apache.org/jira/browse/SPARK-21170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058775#comment-16058775 ] Apache Spark commented on SPARK-21170: -- User 'devaraj-kavali' has created a pull req

[jira] [Assigned] (SPARK-21170) Utils.tryWithSafeFinallyAndFailureCallbacks throws IllegalArgumentException: Self-suppression not permitted

[ https://issues.apache.org/jira/browse/SPARK-21170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21170: Assignee: Apache Spark > Utils.tryWithSafeFinallyAndFailureCallbacks throws IllegalArgumen

[jira] [Updated] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-18016: Fix Version/s: (was: 2.3.0) 2.2.0 2.1.2 > Code Generation

[jira] [Created] (SPARK-21171) Speculate task scheduling block dirve handle normal task when a job task number more than one hundred thousand

wangminfeng created SPARK-21171: --- Summary: Speculate task scheduling block dirve handle normal task when a job task number more than one hundred thousand Key: SPARK-21171 URL: https://issues.apache.org/jira/browse/S

[jira] [Updated] (SPARK-21171) Speculate task scheduling block dirve handle normal task when a job task number more than one hundred thousand

[ https://issues.apache.org/jira/browse/SPARK-21171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangminfeng updated SPARK-21171: Description: If a job have more then one hundred thousand tasks and spark.speculation is true, when

[jira] [Updated] (SPARK-21171) Speculate task scheduling block dirve handle normal task when a job task number more than one hundred thousand

[ https://issues.apache.org/jira/browse/SPARK-21171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangminfeng updated SPARK-21171: Affects Version/s: (was: 2.1.1) 2.0.0 > Speculate task scheduling block

[jira] [Created] (SPARK-21172) EOFException reached end of stream in UnsafeRowSerializer

liupengcheng created SPARK-21172: Summary: EOFException reached end of stream in UnsafeRowSerializer Key: SPARK-21172 URL: https://issues.apache.org/jira/browse/SPARK-21172 Project: Spark Iss

[jira] [Updated] (SPARK-21172) EOFException reached end of stream in UnsafeRowSerializer

[ https://issues.apache.org/jira/browse/SPARK-21172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liupengcheng updated SPARK-21172: - Description: Spark sql job failed because of the following Exception. Seems like a bug in shuffl

[jira] [Created] (SPARK-21173) There are several configuration about SSL displayed in configuration.md but never be used.

liuzhaokun created SPARK-21173: -- Summary: There are several configuration about SSL displayed in configuration.md but never be used. Key: SPARK-21173 URL: https://issues.apache.org/jira/browse/SPARK-21173

[jira] [Commented] (SPARK-21173) There are several configuration about SSL displayed in configuration.md but never be used.

[ https://issues.apache.org/jira/browse/SPARK-21173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058826#comment-16058826 ] Apache Spark commented on SPARK-21173: -- User 'liu-zhaokun' has created a pull reques

[jira] [Assigned] (SPARK-21173) There are several configuration about SSL displayed in configuration.md but never be used.

[ https://issues.apache.org/jira/browse/SPARK-21173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21173: Assignee: Apache Spark > There are several configuration about SSL displayed in configurat

[jira] [Assigned] (SPARK-21173) There are several configuration about SSL displayed in configuration.md but never be used.

[ https://issues.apache.org/jira/browse/SPARK-21173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21173: Assignee: (was: Apache Spark) > There are several configuration about SSL displayed in

[jira] [Commented] (SPARK-21165) Fail to write into partitioned hive table due to attribute reference not working with cast on partition column

[ https://issues.apache.org/jira/browse/SPARK-21165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058836#comment-16058836 ] Apache Spark commented on SPARK-21165: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-21165) Fail to write into partitioned hive table due to attribute reference not working with cast on partition column

[ https://issues.apache.org/jira/browse/SPARK-21165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21165: Assignee: Apache Spark (was: Xiao Li) > Fail to write into partitioned hive table due to

[jira] [Assigned] (SPARK-21165) Fail to write into partitioned hive table due to attribute reference not working with cast on partition column

[ https://issues.apache.org/jira/browse/SPARK-21165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21165: Assignee: Xiao Li (was: Apache Spark) > Fail to write into partitioned hive table due to

[jira] [Commented] (SPARK-21080) Workaround for HDFS delegation token expiry broken with some Hadoop versions

[ https://issues.apache.org/jira/browse/SPARK-21080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058843#comment-16058843 ] Saisai Shao commented on SPARK-21080: - That PR should be worked, we applied that one

[jira] [Comment Edited] (SPARK-21080) Workaround for HDFS delegation token expiry broken with some Hadoop versions

[ https://issues.apache.org/jira/browse/SPARK-21080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058843#comment-16058843 ] Saisai Shao edited comment on SPARK-21080 at 6/22/17 6:39 AM: -

  1   2   >