[jira] [Updated] (SPARK-29450) [SS] In streaming aggregation, metric for output rows is not measured in append mode

2020-01-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-29450: Fix Version/s: 2.4.5 > [SS] In streaming aggregation, metric for output rows is not measured in

[jira] [Comment Edited] (SPARK-27750) Standalone scheduler - ability to prioritize applications over drivers, many drivers act like Denial of Service

2020-01-15 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989249#comment-16989249 ] t oo edited comment on SPARK-27750 at 1/16/20 6:33 AM: --- WDYT [~Ngone51] [~squito]

[jira] [Resolved] (SPARK-30521) Eliminate deprecation warnings for ExpressionInfo

2020-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30521. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27221

[jira] [Assigned] (SPARK-30521) Eliminate deprecation warnings for ExpressionInfo

2020-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30521: Assignee: Maxim Gekk > Eliminate deprecation warnings for ExpressionInfo >

[jira] [Commented] (SPARK-27868) Better document shuffle / RPC listen backlog

2020-01-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016541#comment-17016541 ] Dongjoon Hyun commented on SPARK-27868: --- Hi, [~vanzin]. Since there is no proper way to set `Fixed

[jira] [Updated] (SPARK-27868) Better document shuffle / RPC listen backlog

2020-01-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27868: -- Labels: release-notes (was: ) > Better document shuffle / RPC listen backlog >

[jira] [Updated] (SPARK-27868) Better document shuffle / RPC listen backlog

2020-01-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27868: -- Fix Version/s: (was: 2.4.4) > Better document shuffle / RPC listen backlog >

[jira] [Commented] (SPARK-27868) Better document shuffle / RPC listen backlog

2020-01-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016540#comment-17016540 ] Dongjoon Hyun commented on SPARK-27868: --- This is reverted from `branch-2.4` via

[jira] [Assigned] (SPARK-30491) Enable dependency audit files to tell dependency classifier

2020-01-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30491: - Assignee: Xinrong Meng > Enable dependency audit files to tell dependency classifier >

[jira] [Resolved] (SPARK-30491) Enable dependency audit files to tell dependency classifier

2020-01-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30491. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27177

[jira] [Assigned] (SPARK-30323) Support filters pushdown in CSV datasource

2020-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30323: Assignee: Maxim Gekk > Support filters pushdown in CSV datasource >

[jira] [Resolved] (SPARK-30323) Support filters pushdown in CSV datasource

2020-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30323. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26973

[jira] [Updated] (SPARK-30522) Spark Streaming dynamic executors override or take default kafka parameters in cluster mode

2020-01-15 Thread phanikumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] phanikumar updated SPARK-30522: --- Description: I have written a spark streaming consumer to consume the data from Kafka. I found a

[jira] [Updated] (SPARK-30522) Spark Streaming dynamic executors override or take default kafka parameters in cluster mode

2020-01-15 Thread phanikumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] phanikumar updated SPARK-30522: --- Description: I have written a spark streaming consumer to consume the data from Kafka. I found a

[jira] [Updated] (SPARK-30522) Spark Streaming dynamic executors override or take default kafka parameters in cluster mode

2020-01-15 Thread phanikumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] phanikumar updated SPARK-30522: --- Description: I have written a spark streaming consumer to consume the data from Kafka. I found a

[jira] [Updated] (SPARK-30325) markPartitionCompleted cause task status inconsistent

2020-01-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-30325: Fix Version/s: 2.4.5 > markPartitionCompleted cause task status inconsistent >

[jira] [Updated] (SPARK-30522) Spark Streaming dynamic executors override or take default kafka parameters in cluster mode

2020-01-15 Thread phanikumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] phanikumar updated SPARK-30522: --- Description: I have written a spark streaming consumer to consume the data from Kafka. I found a

[jira] [Assigned] (SPARK-30502) PeriodicRDDCheckpointer supports storageLevel

2020-01-15 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-30502: Assignee: zhengruifeng > PeriodicRDDCheckpointer supports storageLevel >

[jira] [Resolved] (SPARK-30502) PeriodicRDDCheckpointer supports storageLevel

2020-01-15 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-30502. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27189

[jira] [Resolved] (SPARK-30518) Precision and scale should be same for values between -1.0 and 1.0 in Decimal

2020-01-15 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-30518. -- Fix Version/s: 3.0.0 Assignee: wuyi Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-30524) Disable OptimizeSkewJoin rule if introducing additional shuffle.

2020-01-15 Thread Ke Jia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-30524: --- Description: The OptimizeSkewedJoin will break the outputPartitioning of origin SMJ. And it may introduce

[jira] [Created] (SPARK-30524) Disable OptimizeSkewJoin rule if introducing additional shuffle.

2020-01-15 Thread Ke Jia (Jira)
Ke Jia created SPARK-30524: -- Summary: Disable OptimizeSkewJoin rule if introducing additional shuffle. Key: SPARK-30524 URL: https://issues.apache.org/jira/browse/SPARK-30524 Project: Spark Issue

[jira] [Resolved] (SPARK-26736) if filter condition `And` has non-determined sub function it does not do partition prunning

2020-01-15 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-26736. -- Fix Version/s: 3.0.0 Assignee: Takeshi Yamamuro Resolution: Fixed

[jira] [Comment Edited] (SPARK-27750) Standalone scheduler - ability to prioritize applications over drivers, many drivers act like Denial of Service

2020-01-15 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989249#comment-16989249 ] t oo edited comment on SPARK-27750 at 1/15/20 11:36 PM: WDYT [~Ngone51]

[jira] [Created] (SPARK-30523) Collapse back to back aggregations into a single aggregate to reduce the number of shuffles

2020-01-15 Thread Jason Altekruse (Jira)
Jason Altekruse created SPARK-30523: --- Summary: Collapse back to back aggregations into a single aggregate to reduce the number of shuffles Key: SPARK-30523 URL: https://issues.apache.org/jira/browse/SPARK-30523

[jira] [Closed] (SPARK-23273) Spark Dataset withColumn - schema column order isn't the same as case class paramether order

2020-01-15 Thread Henrique dos Santos Goulart (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henrique dos Santos Goulart closed SPARK-23273. --- > Spark Dataset withColumn - schema column order isn't the same as case

[jira] [Updated] (SPARK-30246) Spark on Yarn External Shuffle Service Memory Leak

2020-01-15 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin updated SPARK-30246: --- Fix Version/s: (was: 2.4.5) 2.4.6 > Spark on Yarn

[jira] [Assigned] (SPARK-30246) Spark on Yarn External Shuffle Service Memory Leak

2020-01-15 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin reassigned SPARK-30246: -- Assignee: Henrique dos Santos Goulart > Spark on Yarn External

[jira] [Resolved] (SPARK-30246) Spark on Yarn External Shuffle Service Memory Leak

2020-01-15 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-30246. Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed

[jira] [Comment Edited] (SPARK-28403) Executor Allocation Manager can add an extra executor when speculative tasks

2020-01-15 Thread Zebing Lin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016316#comment-17016316 ] Zebing Lin edited comment on SPARK-28403 at 1/15/20 8:53 PM: - In our

[jira] [Commented] (SPARK-28403) Executor Allocation Manager can add an extra executor when speculative tasks

2020-01-15 Thread Zebing Lin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016316#comment-17016316 ] Zebing Lin commented on SPARK-28403: In our production, this just caused a fluctuation of requested

[jira] [Resolved] (SPARK-29448) Support the `INTERVAL` type by Parquet datasource

2020-01-15 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-29448. Resolution: Won't Fix > Support the `INTERVAL` type by Parquet datasource >

[jira] [Updated] (SPARK-30511) Spark marks ended speculative tasks as pending leads to holding idle executors

2020-01-15 Thread Zebing Lin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zebing Lin updated SPARK-30511: --- Description: *TL;DR* When speculative tasks finished/failed/got killed, they are still considered

[jira] [Resolved] (SPARK-30495) How to disable 'spark.security.credentials.${service}.enabled' in Structured streaming while connecting to a kafka cluster

2020-01-15 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-30495. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-30495) How to disable 'spark.security.credentials.${service}.enabled' in Structured streaming while connecting to a kafka cluster

2020-01-15 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin reassigned SPARK-30495: -- Assignee: Gabor Somogyi > How to disable

[jira] [Commented] (SPARK-30190) HistoryServerDiskManager will fail on appStoreDir in s3

2020-01-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016263#comment-17016263 ] Steve Loughran commented on SPARK-30190: S3A creates a dir marker and deletes it But I'd rather

[jira] [Updated] (SPARK-30511) Spark marks ended speculative tasks as pending leads to holding idle executors

2020-01-15 Thread Zebing Lin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zebing Lin updated SPARK-30511: --- Description: *TL;DR* When speculative tasks finished/failed/got killed, they are still considered

[jira] [Updated] (SPARK-30511) Spark marks ended speculative tasks as pending leads to holding idle executors

2020-01-15 Thread Zebing Lin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zebing Lin updated SPARK-30511: --- Attachment: Screen Shot 2020-01-15 at 11.13.17.png > Spark marks ended speculative tasks as pending

[jira] [Updated] (SPARK-30511) Spark marks ended speculative tasks as pending leads to holding idle executors

2020-01-15 Thread Zebing Lin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zebing Lin updated SPARK-30511: --- Description: *TL;DR* When speculative tasks finished/failed/got killed, they are still considered

[jira] [Updated] (SPARK-30511) Spark marks ended speculative tasks as pending leads to holding idle executors

2020-01-15 Thread Zebing Lin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zebing Lin updated SPARK-30511: --- Description: *TL;DR* When speculative tasks finished/failed/got killed, they are still considered

[jira] [Updated] (SPARK-30511) Spark marks ended speculative tasks as pending leads to holding idle executors

2020-01-15 Thread Zebing Lin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zebing Lin updated SPARK-30511: --- Description: *TL;DR* When speculative tasks finished/failed/got killed, they are still considered

[jira] [Resolved] (SPARK-30479) Apply compaction of event log to SQL events

2020-01-15 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-30479. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-30479) Apply compaction of event log to SQL events

2020-01-15 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin reassigned SPARK-30479: -- Assignee: Jungtaek Lim > Apply compaction of event log to SQL events

[jira] [Commented] (SPARK-18165) Kinesis support in Structured Streaming

2020-01-15 Thread Sowmya (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016213#comment-17016213 ] Sowmya commented on SPARK-18165: Hi [~itsvikramagr] ,Can this library be used in production with spark

[jira] [Commented] (SPARK-26570) Out of memory when InMemoryFileIndex bulkListLeafFiles

2020-01-15 Thread ShivaKumar SS (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016200#comment-17016200 ] ShivaKumar SS commented on SPARK-26570: --- Unfortunately I have hit the same issue. 

[jira] [Updated] (SPARK-30522) Spark Streaming dynamic executors override or take default kafka parameters in cluster mode

2020-01-15 Thread phanikumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] phanikumar updated SPARK-30522: --- Summary: Spark Streaming dynamic executors override or take default kafka parameters in cluster

[jira] [Created] (SPARK-30522) Spark Streaming dynamic executors overried kafka parameters in cluster mode

2020-01-15 Thread phanikumar (Jira)
phanikumar created SPARK-30522: -- Summary: Spark Streaming dynamic executors overried kafka parameters in cluster mode Key: SPARK-30522 URL: https://issues.apache.org/jira/browse/SPARK-30522 Project:

[jira] [Resolved] (SPARK-30504) OneVsRest and OneVsRestModel _from_java and _to_java should handle weightCol

2020-01-15 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30504. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27190

[jira] [Updated] (SPARK-30504) OneVsRest and OneVsRestModel _from_java and _to_java should handle weightCol

2020-01-15 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-30504: - Priority: Minor (was: Major) > OneVsRest and OneVsRestModel _from_java and _to_java should

[jira] [Assigned] (SPARK-30504) OneVsRest and OneVsRestModel _from_java and _to_java should handle weightCol

2020-01-15 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-30504: Assignee: Maciej Szymkiewicz > OneVsRest and OneVsRestModel _from_java and _to_java

[jira] [Created] (SPARK-30521) Eliminate deprecation warnings for ExpressionInfo

2020-01-15 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30521: -- Summary: Eliminate deprecation warnings for ExpressionInfo Key: SPARK-30521 URL: https://issues.apache.org/jira/browse/SPARK-30521 Project: Spark Issue Type:

[jira] [Created] (SPARK-30520) Eliminate deprecation warnings for UserDefinedAggregateFunction

2020-01-15 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30520: -- Summary: Eliminate deprecation warnings for UserDefinedAggregateFunction Key: SPARK-30520 URL: https://issues.apache.org/jira/browse/SPARK-30520 Project: Spark

[jira] [Updated] (SPARK-30165) Eliminate compilation warnings

2020-01-15 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30165: --- Attachment: spark_warnings.txt > Eliminate compilation warnings > -- >

[jira] [Updated] (SPARK-30165) Eliminate compilation warnings

2020-01-15 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30165: --- Attachment: (was: spark_warnings.txt) > Eliminate compilation warnings >

[jira] [Resolved] (SPARK-29708) Different answers in aggregates of duplicate grouping sets

2020-01-15 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-29708. -- Fix Version/s: 3.0.0 Assignee: Takeshi Yamamuro Resolution: Fixed

[jira] [Resolved] (SPARK-30515) Refactor SimplifyBinaryComparison to reduce the time complexity

2020-01-15 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-30515. -- Fix Version/s: 3.0.0 Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-30177) Eliminate warnings: part 7

2020-01-15 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30177: --- Summary: Eliminate warnings: part 7 (was: Eliminate warnings: part7) > Eliminate warnings: part 7

[jira] [Updated] (SPARK-30172) Eliminate warnings: part 3

2020-01-15 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30172: --- Summary: Eliminate warnings: part 3 (was: Eliminate warnings: part3) > Eliminate warnings: part 3

[jira] [Updated] (SPARK-30174) Eliminate warnings: part 4

2020-01-15 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30174: --- Summary: Eliminate warnings: part 4 (was: Eliminate warnings :part 4) > Eliminate warnings: part 4

[jira] [Updated] (SPARK-30171) Eliminate warnings: part 2

2020-01-15 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30171: --- Summary: Eliminate warnings: part 2 (was: Eliminate warnings: part2) > Eliminate warnings: part 2

[jira] [Resolved] (SPARK-30174) Eliminate warnings :part 4

2020-01-15 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-30174. Resolution: Duplicate > Eliminate warnings :part 4 > -- > >

[jira] [Resolved] (SPARK-30171) Eliminate warnings: part2

2020-01-15 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-30171. Resolution: Won't Fix As per discussion in 

[jira] [Resolved] (SPARK-30490) Eliminate warnings in Avro datasource

2020-01-15 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-30490. Resolution: Won't Fix See [https://github.com/apache/spark/pull/27174#discussion_r365629991] >

[jira] [Created] (SPARK-30519) Executor can't use spark.executorEnv.HADOOP_USER_NAME to change the user accessing to hdfs

2020-01-15 Thread Xiaoming (Jira)
Xiaoming created SPARK-30519: Summary: Executor can't use spark.executorEnv.HADOOP_USER_NAME to change the user accessing to hdfs Key: SPARK-30519 URL: https://issues.apache.org/jira/browse/SPARK-30519

[jira] [Created] (SPARK-30518) Precision and scale should be same for values between -1.0 and 1.0 in Decimal

2020-01-15 Thread wuyi (Jira)
wuyi created SPARK-30518: Summary: Precision and scale should be same for values between -1.0 and 1.0 in Decimal Key: SPARK-30518 URL: https://issues.apache.org/jira/browse/SPARK-30518 Project: Spark

[jira] [Comment Edited] (SPARK-30517) Support SHOW TABLES EXTENDED

2020-01-15 Thread Ajith S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015706#comment-17015706 ] Ajith S edited comment on SPARK-30517 at 1/15/20 8:01 AM: -- [~srowen]

[jira] [Commented] (SPARK-30517) Support SHOW TABLES EXTENDED

2020-01-15 Thread Ajith S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015706#comment-17015706 ] Ajith S commented on SPARK-30517: - [~srowen] [~dongjoon] [~vanzin] Please let me know about your opinion