[jira] [Updated] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-19 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-25144: Target Version/s: 2.2.3, 2.3.2 > distinct on Dataset leads to exception due to Managed memory leak

[jira] [Commented] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-19 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585482#comment-16585482 ] Saisai Shao commented on SPARK-25144: - Does this exist in master branch? > distinct

[jira] [Commented] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585481#comment-16585481 ] Dongjoon Hyun commented on SPARK-25144: --- Ping [~jerryshao] since you are a release

[jira] [Updated] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25144: -- Affects Version/s: 2.0.2 > distinct on Dataset leads to exception due to Managed memory leak d

[jira] [Commented] (SPARK-23679) uiWebUrl show inproper URL when running on YARN

2018-08-19 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585473#comment-16585473 ] Saisai Shao commented on SPARK-23679: - Let me fix this issue. This is mainly a RM HA

[jira] [Updated] (SPARK-23679) uiWebUrl show inproper URL when running on YARN

2018-08-19 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-23679: Component/s: YARN > uiWebUrl show inproper URL when running on YARN >

[jira] [Assigned] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25144: Assignee: Apache Spark > distinct on Dataset leads to exception due to Managed memory lea

[jira] [Assigned] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25144: Assignee: (was: Apache Spark) > distinct on Dataset leads to exception due to Managed

[jira] [Commented] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585472#comment-16585472 ] Apache Spark commented on SPARK-25144: -- User 'dongjoon-hyun' has created a pull req

[jira] [Updated] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25144: -- Environment: (was: spark 2.3.1) > distinct on Dataset leads to exception due to Managed me

[jira] [Updated] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25144: -- Affects Version/s: 2.3.2 2.1.3 2.2.2 > distinct

[jira] [Updated] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25144: -- Component/s: (was: Spark Core) (was: Optimizer) > distinct on Dataset

[jira] [Reopened] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-25144: --- I'll reopen this since I can reproduce this in 2.1.3, 2.2.2, 2.3.2-RC5. I found the difference

[jira] [Commented] (SPARK-25158) Executor accidentally exit because ScriptTransformationWriterThread throws TaskKilledException.

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585467#comment-16585467 ] Apache Spark commented on SPARK-25158: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-25158) Executor accidentally exit because ScriptTransformationWriterThread throws TaskKilledException.

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25158: Assignee: (was: Apache Spark) > Executor accidentally exit because ScriptTransformati

[jira] [Assigned] (SPARK-25158) Executor accidentally exit because ScriptTransformationWriterThread throws TaskKilledException.

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25158: Assignee: Apache Spark > Executor accidentally exit because ScriptTransformationWriterThr

[jira] [Updated] (SPARK-25158) Executor accidentally exit because ScriptTransformationWriterThread throws TaskKilledException.

2018-08-19 Thread Yang Jie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-25158: - External issue URL: https://github.com/apache/spark/pull/22149 > Executor accidentally exit because Scri

[jira] [Updated] (SPARK-25158) Executor accidentally exit because ScriptTransformationWriterThread throws TaskKilledException.

2018-08-19 Thread Yang Jie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-25158: - Description: In production environment, user run Spark-Sql use transform features with config 'spark.sp

[jira] [Updated] (SPARK-25158) Executor accidentally exit because ScriptTransformationWriterThread throws TaskKilledException.

2018-08-19 Thread Yang Jie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-25158: - Description: In Baidu production environment, user run Spark-Sql use transform features with config 'sp

[jira] [Created] (SPARK-25158) Executor accidentally exit because ScriptTransformationWriterThread throws TaskKilledException.

2018-08-19 Thread Yang Jie (JIRA)
Yang Jie created SPARK-25158: Summary: Executor accidentally exit because ScriptTransformationWriterThread throws TaskKilledException. Key: SPARK-25158 URL: https://issues.apache.org/jira/browse/SPARK-25158

[jira] [Updated] (SPARK-25158) Executor accidentally exit because ScriptTransformationWriterThread throws TaskKilledException.

2018-08-19 Thread Yang Jie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-25158: - Description: In Baidu production environment, user run Spark-Sql use transform features with config 'sp

[jira] [Commented] (SPARK-25155) Streaming from storage doesn't work when no directories exists

2018-08-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585438#comment-16585438 ] Steve Loughran commented on SPARK-25155: >From SPARK-17159 I have a more cloud-o

[jira] [Commented] (SPARK-25155) Streaming from storage doesn't work when no directories exists

2018-08-19 Thread Gil Vernik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585388#comment-16585388 ] Gil Vernik commented on SPARK-25155: [~ste...@apache.org] what is your input on the

[jira] [Commented] (SPARK-25155) Streaming from storage doesn't work when no directories exists

2018-08-19 Thread Gil Vernik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585384#comment-16585384 ] Gil Vernik commented on SPARK-25155: [~dongjoon] of course, committers decide versio

[jira] [Commented] (SPARK-25132) Case-insensitive field resolution when reading from Parquet/ORC

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585381#comment-16585381 ] Apache Spark commented on SPARK-25132: -- User 'seancxmao' has created a pull request

[jira] [Commented] (SPARK-25147) GroupedData.apply pandas_udf crashing

2018-08-19 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585374#comment-16585374 ] Hyukjin Kwon commented on SPARK-25147: -- It works on: Python 2.7.14 Pandas 0.19.2 P

[jira] [Resolved] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-19 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25144. -- Resolution: Cannot Reproduce {code} scala> case class Foo(bar: Option[String]) defined class F

[jira] [Updated] (SPARK-25134) Csv column pruning with checking of headers throws incorrect error

2018-08-19 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25134: - Target Version/s: (was: 2.4.0) > Csv column pruning with checking of headers throws incorrect

[jira] [Commented] (SPARK-25149) Personalized Page Rank raises an error if vertexIDs are > MaxInt

2018-08-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585360#comment-16585360 ] Dongjoon Hyun commented on SPARK-25149: --- Thank you for the contribution, [~bago.am

[jira] [Updated] (SPARK-25149) Personalized Page Rank raises an error if vertexIDs are > MaxInt

2018-08-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25149: -- Fix Version/s: (was: 2.4.0) > Personalized Page Rank raises an error if vertexIDs are > Ma

[jira] [Commented] (SPARK-25155) Streaming from storage doesn't work when no directories exists

2018-08-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585355#comment-16585355 ] Dongjoon Hyun commented on SPARK-25155: --- Hi, [~gvernik]. Thank you for reporting,

[jira] [Updated] (SPARK-25155) Streaming from storage doesn't work when no directories exists

2018-08-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25155: -- Target Version/s: (was: 2.3.1) > Streaming from storage doesn't work when no directories exi

[jira] [Updated] (SPARK-25155) Streaming from storage doesn't work when no directories exists

2018-08-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25155: -- Fix Version/s: (was: 2.3.2) > Streaming from storage doesn't work when no directories exis

[jira] [Closed] (SPARK-25156) Same query returns different result

2018-08-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-25156. - > Same query returns different result > --- > > Key:

[jira] [Resolved] (SPARK-25156) Same query returns different result

2018-08-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25156. --- Resolution: Duplicate For now, I'll close this as DUPLICATE of SPARK-23207. Please refer SPA

[jira] [Commented] (SPARK-25156) Same query returns different result

2018-08-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585350#comment-16585350 ] Dongjoon Hyun commented on SPARK-25156: --- Hi, [~leeyh0216]. Yes. It looks like SPAR

[jira] [Resolved] (SPARK-25145) Buffer size too small on spark.sql query with filterPushdown predicate=True

2018-08-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25145. --- Resolution: Cannot Reproduce > Buffer size too small on spark.sql query with filterPushdown

[jira] [Commented] (SPARK-25145) Buffer size too small on spark.sql query with filterPushdown predicate=True

2018-08-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585347#comment-16585347 ] Dongjoon Hyun commented on SPARK-25145: --- Until now, I cannot reproduce this in Apa

[jira] [Resolved] (SPARK-25131) Event logs missing applicationAttemptId for SparkListenerApplicationStart

2018-08-19 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S resolved SPARK-25131. - Resolution: Not A Problem > Event logs missing applicationAttemptId for SparkListenerApplicationStart >

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585326#comment-16585326 ] Apache Spark commented on SPARK-24434: -- User 'onursatici' has created a pull reques

[jira] [Assigned] (SPARK-24434) Support user-specified driver and executor pod templates

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24434: Assignee: Apache Spark > Support user-specified driver and executor pod templates > -

[jira] [Assigned] (SPARK-24434) Support user-specified driver and executor pod templates

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24434: Assignee: (was: Apache Spark) > Support user-specified driver and executor pod templa

[jira] [Commented] (SPARK-25114) RecordBinaryComparator may return wrong result when subtraction between two words is divisible by Integer.MAX_VALUE

2018-08-19 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585321#comment-16585321 ] Saisai Shao commented on SPARK-25114: - What's the ETA of this issue [~jiangxb1987]?

[jira] [Comment Edited] (SPARK-21187) Complete support for remaining Spark data types in Arrow Converters

2018-08-19 Thread Leif Walsh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585286#comment-16585286 ] Leif Walsh edited comment on SPARK-21187 at 8/19/18 10:44 PM:

[jira] [Commented] (SPARK-21187) Complete support for remaining Spark data types in Arrow Converters

2018-08-19 Thread Leif Walsh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585286#comment-16585286 ] Leif Walsh commented on SPARK-21187: [~bryanc] is there anything I can help elaborat

[jira] [Commented] (SPARK-25152) Enable Spark on Kubernetes R Integration Tests

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585280#comment-16585280 ] Apache Spark commented on SPARK-25152: -- User 'ifilonenko' has created a pull reques

[jira] [Assigned] (SPARK-25152) Enable Spark on Kubernetes R Integration Tests

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25152: Assignee: (was: Apache Spark) > Enable Spark on Kubernetes R Integration Tests >

[jira] [Assigned] (SPARK-25152) Enable Spark on Kubernetes R Integration Tests

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25152: Assignee: Apache Spark > Enable Spark on Kubernetes R Integration Tests > ---

[jira] [Assigned] (SPARK-24935) Problem with Executing Hive UDF's from Spark 2.2 Onwards

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24935: Assignee: Apache Spark > Problem with Executing Hive UDF's from Spark 2.2 Onwards > -

[jira] [Commented] (SPARK-24935) Problem with Executing Hive UDF's from Spark 2.2 Onwards

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585259#comment-16585259 ] Apache Spark commented on SPARK-24935: -- User 'pgandhi999' has created a pull reques

[jira] [Assigned] (SPARK-24935) Problem with Executing Hive UDF's from Spark 2.2 Onwards

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24935: Assignee: (was: Apache Spark) > Problem with Executing Hive UDF's from Spark 2.2 Onwa

[jira] [Commented] (SPARK-24961) sort operation causes out of memory

2018-08-19 Thread Markus Breuer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585258#comment-16585258 ] Markus Breuer commented on SPARK-24961: --- I retested the above code and had to corr

[jira] [Commented] (SPARK-25145) Buffer size too small on spark.sql query with filterPushdown predicate=True

2018-08-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585244#comment-16585244 ] Dongjoon Hyun commented on SPARK-25145: --- [~bjensen]. I tested this on both Spark 2

[jira] [Commented] (SPARK-25145) Buffer size too small on spark.sql query with filterPushdown predicate=True

2018-08-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585242#comment-16585242 ] Dongjoon Hyun commented on SPARK-25145: --- Thank you for pinging me, [~mgaido]. I'll

[jira] [Assigned] (SPARK-24647) Sink Should Return Writen Offsets For ProgressReporting

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24647: Assignee: Apache Spark > Sink Should Return Writen Offsets For ProgressReporting > --

[jira] [Commented] (SPARK-24647) Sink Should Return Writen Offsets For ProgressReporting

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585230#comment-16585230 ] Apache Spark commented on SPARK-24647: -- User 'vackosar' has created a pull request

[jira] [Assigned] (SPARK-24647) Sink Should Return Writen Offsets For ProgressReporting

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24647: Assignee: (was: Apache Spark) > Sink Should Return Writen Offsets For ProgressReporti

[jira] [Assigned] (SPARK-25132) Case-insensitive field resolution when reading from Parquet/ORC

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25132: Assignee: Apache Spark > Case-insensitive field resolution when reading from Parquet/ORC

[jira] [Assigned] (SPARK-25132) Case-insensitive field resolution when reading from Parquet/ORC

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25132: Assignee: (was: Apache Spark) > Case-insensitive field resolution when reading from P

[jira] [Commented] (SPARK-25132) Case-insensitive field resolution when reading from Parquet/ORC

2018-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585198#comment-16585198 ] Apache Spark commented on SPARK-25132: -- User 'seancxmao' has created a pull request

[jira] [Updated] (SPARK-25156) Same query returns different result

2018-08-19 Thread Yonghwan Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonghwan Lee updated SPARK-25156: - Description: I performed two joins and two left outer join on five tables. There are several di

[jira] [Updated] (SPARK-25156) Same query returns different result

2018-08-19 Thread Yonghwan Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonghwan Lee updated SPARK-25156: - Description: I performed two joins and two left outer join on five tables. There are several di

[jira] [Updated] (SPARK-25157) Streaming of image files from directory

2018-08-19 Thread Amit Baghel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Baghel updated SPARK-25157: Description: We are doing video analytics for video streams using Spark. At present there is no di

[jira] [Updated] (SPARK-25156) Same query returns different result

2018-08-19 Thread Yonghwan Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonghwan Lee updated SPARK-25156: - Description: I performed two joins and two left outer join on five tables. There are several di

[jira] [Updated] (SPARK-25132) Case-insensitive field resolution when reading from Parquet/ORC

2018-08-19 Thread Chenxiao Mao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenxiao Mao updated SPARK-25132: - Summary: Case-insensitive field resolution when reading from Parquet/ORC (was: Spark returns NU

[jira] [Updated] (SPARK-25157) Streaming of image files from directory

2018-08-19 Thread Amit Baghel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Baghel updated SPARK-25157: Description: We are doing video analytics for video streams using Spark. At present there is no di

[jira] [Updated] (SPARK-25157) Streaming of image files from directory

2018-08-19 Thread Amit Baghel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Baghel updated SPARK-25157: Description: We are doing video analytics for video streams using Spark. At present there is no di

[jira] [Updated] (SPARK-25157) Streaming of image files from directory

2018-08-19 Thread Amit Baghel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Baghel updated SPARK-25157: Priority: Major (was: Minor) > Streaming of image files from directory >

[jira] [Updated] (SPARK-25157) Streaming of image files from directory

2018-08-19 Thread Amit Baghel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Baghel updated SPARK-25157: Description: We are doing video analytics for video streams using Spark. At present there is no di

[jira] [Updated] (SPARK-25157) Streaming of image files from directory

2018-08-19 Thread Amit Baghel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Baghel updated SPARK-25157: Description: We are doing video analytics for video streams using Spark. At present there is no di

[jira] [Created] (SPARK-25157) Streaming of image files from directory

2018-08-19 Thread Amit Baghel (JIRA)
Amit Baghel created SPARK-25157: --- Summary: Streaming of image files from directory Key: SPARK-25157 URL: https://issues.apache.org/jira/browse/SPARK-25157 Project: Spark Issue Type: New Feature

[jira] [Comment Edited] (SPARK-20924) Unable to call the function registered in the not-current database

2018-08-19 Thread Rajesh Chandramohan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585070#comment-16585070 ] Rajesh Chandramohan edited comment on SPARK-20924 at 8/19/18 8:45 AM:

[jira] [Commented] (SPARK-20924) Unable to call the function registered in the not-current database

2018-08-19 Thread Rajesh Chandramohan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585070#comment-16585070 ] Rajesh Chandramohan commented on SPARK-20924: - [~cloud_fan]  Looks like we