[jira] [Updated] (SPARK-18111) Wrong ApproximatePercentile answer when multiple records have the minimum value

[ https://issues.apache.org/jira/browse/SPARK-18111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-18111: - Description: When multiple records have the minimum value, the answer of ApproximatePercentile i

[jira] [Assigned] (SPARK-18111) Wrong ApproximatePercentile answer when multiple records have the minimum value

[ https://issues.apache.org/jira/browse/SPARK-18111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18111: Assignee: (was: Apache Spark) > Wrong ApproximatePercentile answer when multiple recor

[jira] [Commented] (SPARK-18111) Wrong ApproximatePercentile answer when multiple records have the minimum value

[ https://issues.apache.org/jira/browse/SPARK-18111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607669#comment-15607669 ] Apache Spark commented on SPARK-18111: -- User 'wzhfy' has created a pull request for

[jira] [Assigned] (SPARK-18111) Wrong ApproximatePercentile answer when multiple records have the minimum value

[ https://issues.apache.org/jira/browse/SPARK-18111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18111: Assignee: Apache Spark > Wrong ApproximatePercentile answer when multiple records have the

[jira] [Resolved] (SPARK-17693) Fixed Insert Failure To Data Source Tables when the Schema has the Comment Field

[ https://issues.apache.org/jira/browse/SPARK-17693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-17693. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15615 [https://github.com/ap

[jira] [Assigned] (SPARK-17693) Fixed Insert Failure To Data Source Tables when the Schema has the Comment Field

[ https://issues.apache.org/jira/browse/SPARK-17693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-17693: --- Assignee: Xiao Li > Fixed Insert Failure To Data Source Tables when the Schema has the Comment > Fi

[jira] [Commented] (SPARK-13331) AES support for over-the-wire encryption

[ https://issues.apache.org/jira/browse/SPARK-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607851#comment-15607851 ] Junjie Chen commented on SPARK-13331: - Hi [~vanzin] The patch was updated according

[jira] [Commented] (SPARK-15616) Metastore relation should fallback to HDFS size of partitions that are involved in Query if statistics are not available.

[ https://issues.apache.org/jira/browse/SPARK-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607872#comment-15607872 ] Franck Tago commented on SPARK-15616: - Hi Wondering if there are any updates on th

[jira] [Commented] (SPARK-18100) Improve the performance of get_json_object using Gson

[ https://issues.apache.org/jira/browse/SPARK-18100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607875#comment-15607875 ] Liang-Chi Hsieh commented on SPARK-18100: - Looks like Gson doesn't have native su

[jira] [Issue Comment Deleted] (SPARK-18100) Improve the performance of get_json_object using Gson

[ https://issues.apache.org/jira/browse/SPARK-18100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-18100: Comment: was deleted (was: Looks like Gson doesn't have native support for json path?) > I

[jira] [Created] (SPARK-18112) Spark2.x does not support read data from Hive 2.x metastore

KaiXu created SPARK-18112: - Summary: Spark2.x does not support read data from Hive 2.x metastore Key: SPARK-18112 URL: https://issues.apache.org/jira/browse/SPARK-18112 Project: Spark Issue Type: Bu

[jira] [Commented] (SPARK-18107) Insert overwrite statement runs much slower in spark-sql than it does in hive-client

[ https://issues.apache.org/jira/browse/SPARK-18107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607896#comment-15607896 ] Liang-Chi Hsieh commented on SPARK-18107: - Can you provide more information about

[jira] [Created] (SPARK-18113) AskPermissionToCommitOutput response lost, driver enter into task deadloop

xuqing created SPARK-18113: -- Summary: AskPermissionToCommitOutput response lost, driver enter into task deadloop Key: SPARK-18113 URL: https://issues.apache.org/jira/browse/SPARK-18113 Project: Spark

[jira] [Commented] (SPARK-18113) AskPermissionToCommitOutput response lost, driver enter into task deadloop

[ https://issues.apache.org/jira/browse/SPARK-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608015#comment-15608015 ] xuqing commented on SPARK-18113: Fix is easy, when (TaskCommitDenied && attemptNumber ==

[jira] [Updated] (SPARK-18113) AskPermissionToCommitOutput response lost, driver enter into task deadloop

[ https://issues.apache.org/jira/browse/SPARK-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuqing updated SPARK-18113: --- Description: Executor sends *AskPermissionToCommitOutput* to driver, driver receives this message and handle

[jira] [Updated] (SPARK-18113) AskPermissionToCommitOutput response lost, driver enter into task deadloop

[ https://issues.apache.org/jira/browse/SPARK-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuqing updated SPARK-18113: --- Description: Executor sends *AskPermissionToCommitOutput* to driver, driver receives this message and handle

[jira] [Commented] (SPARK-18111) Wrong ApproximatePercentile answer when multiple records have the minimum value

[ https://issues.apache.org/jira/browse/SPARK-18111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608054#comment-15608054 ] Sean Owen commented on SPARK-18111: --- The percentile at 0.5 is the median, and 2 is as g

[jira] [Assigned] (SPARK-18009) Spark 2.0.1 SQL Thrift Error

[ https://issues.apache.org/jira/browse/SPARK-18009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18009: Assignee: (was: Apache Spark) > Spark 2.0.1 SQL Thrift Error > ---

[jira] [Commented] (SPARK-18009) Spark 2.0.1 SQL Thrift Error

[ https://issues.apache.org/jira/browse/SPARK-18009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608088#comment-15608088 ] Apache Spark commented on SPARK-18009: -- User 'dilipbiswal' has created a pull reques

[jira] [Assigned] (SPARK-18009) Spark 2.0.1 SQL Thrift Error

[ https://issues.apache.org/jira/browse/SPARK-18009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18009: Assignee: Apache Spark > Spark 2.0.1 SQL Thrift Error > > >

[jira] [Created] (SPARK-18114) MesosClusterScheduler generate bad command options

Leighton Wong created SPARK-18114: - Summary: MesosClusterScheduler generate bad command options Key: SPARK-18114 URL: https://issues.apache.org/jira/browse/SPARK-18114 Project: Spark Issue Ty

[jira] [Commented] (SPARK-18114) MesosClusterScheduler generate bad command options

[ https://issues.apache.org/jira/browse/SPARK-18114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608138#comment-15608138 ] Apache Spark commented on SPARK-18114: -- User 'LeightonWong' has created a pull reque

[jira] [Assigned] (SPARK-18114) MesosClusterScheduler generate bad command options

[ https://issues.apache.org/jira/browse/SPARK-18114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18114: Assignee: (was: Apache Spark) > MesosClusterScheduler generate bad command options > -

[jira] [Assigned] (SPARK-18114) MesosClusterScheduler generate bad command options

[ https://issues.apache.org/jira/browse/SPARK-18114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18114: Assignee: Apache Spark > MesosClusterScheduler generate bad command options >

[jira] [Commented] (SPARK-18009) Spark 2.0.1 SQL Thrift Error

[ https://issues.apache.org/jira/browse/SPARK-18009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608172#comment-15608172 ] Martha Solarte commented on SPARK-18009: Will be the fix available for 2.0.0 ? >

[jira] [Resolved] (SPARK-18022) java.lang.NullPointerException instead of real exception when saving DF to MySQL

[ https://issues.apache.org/jira/browse/SPARK-18022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18022. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.2 Issue resolved by pull request

[jira] [Assigned] (SPARK-18022) java.lang.NullPointerException instead of real exception when saving DF to MySQL

[ https://issues.apache.org/jira/browse/SPARK-18022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-18022: - Assignee: Sean Owen > java.lang.NullPointerException instead of real exception when saving DF to

[jira] [Assigned] (SPARK-18027) .sparkStaging not clean on RM ApplicationNotFoundException

[ https://issues.apache.org/jira/browse/SPARK-18027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-18027: - Assignee: Sean Owen > .sparkStaging not clean on RM ApplicationNotFoundException > -

[jira] [Resolved] (SPARK-18027) .sparkStaging not clean on RM ApplicationNotFoundException

[ https://issues.apache.org/jira/browse/SPARK-18027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18027. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15598 [https://github.co

[jira] [Updated] (SPARK-4411) Add "kill" link for jobs in the UI

[ https://issues.apache.org/jira/browse/SPARK-4411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4411: - Assignee: Alex Bozarth > Add "kill" link for jobs in the UI > -- > >

[jira] [Updated] (SPARK-4411) Add "kill" link for jobs in the UI

[ https://issues.apache.org/jira/browse/SPARK-4411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4411: - Priority: Minor (was: Major) > Add "kill" link for jobs in the UI > -- >

[jira] [Resolved] (SPARK-4411) Add "kill" link for jobs in the UI

[ https://issues.apache.org/jira/browse/SPARK-4411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4411. -- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15441 [https://github.com/a

[jira] [Updated] (SPARK-17802) Lots of "java.lang.ClassNotFoundException: org.apache.hadoop.ipc.CallerContext" In spark logs

[ https://issues.apache.org/jira/browse/SPARK-17802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17802: -- Assignee: Shuai Lin > Lots of "java.lang.ClassNotFoundException: > org.apache.hadoop.ipc.CallerContext

[jira] [Resolved] (SPARK-17802) Lots of "java.lang.ClassNotFoundException: org.apache.hadoop.ipc.CallerContext" In spark logs

[ https://issues.apache.org/jira/browse/SPARK-17802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17802. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15377 [https://github.co

[jira] [Commented] (SPARK-18088) ChiSqSelector FPR PR cleanups

[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608322#comment-15608322 ] Peng Meng commented on SPARK-18088: --- I am neutral for changing the selectorType "KBest"

[jira] [Updated] (SPARK-17711) Compress rolled executor logs

[ https://issues.apache.org/jira/browse/SPARK-17711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17711: -- Assignee: Yu Peng > Compress rolled executor logs > - > > K

[jira] [Updated] (SPARK-17388) Support for inferring type date/timestamp/decimal for partition column

[ https://issues.apache.org/jira/browse/SPARK-17388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17388: -- Assignee: Hyukjin Kwon > Support for inferring type date/timestamp/decimal for partition column > -

[jira] [Updated] (SPARK-18114) MesosClusterScheduler generate bad command options

[ https://issues.apache.org/jira/browse/SPARK-18114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18114: -- Flags: (was: Patch) Target Version/s: (was: 2.0.1) Fix Version/s: (was: 2.

[jira] [Created] (SPARK-18115) Custom metrics Sink/Source prevent Executor from starting

Kostya Golikov created SPARK-18115: -- Summary: Custom metrics Sink/Source prevent Executor from starting Key: SPARK-18115 URL: https://issues.apache.org/jira/browse/SPARK-18115 Project: Spark

[jira] [Created] (SPARK-18116) spark streaming ui show 0 events when recovering from checkpoint

liujianhui created SPARK-18116: -- Summary: spark streaming ui show 0 events when recovering from checkpoint Key: SPARK-18116 URL: https://issues.apache.org/jira/browse/SPARK-18116 Project: Spark

[jira] [Commented] (SPARK-18041) activedrivers section in http:sparkMasterurl/json is missing Main class information

[ https://issues.apache.org/jira/browse/SPARK-18041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608380#comment-15608380 ] sudheesh k s commented on SPARK-18041: -- We need to kill spark stream applications be

[jira] [Created] (SPARK-18117) Add Test for Interaction of TaskSchedulerImpl with TaskSetBlacklist

Imran Rashid created SPARK-18117: Summary: Add Test for Interaction of TaskSchedulerImpl with TaskSetBlacklist Key: SPARK-18117 URL: https://issues.apache.org/jira/browse/SPARK-18117 Project: Spark

[jira] [Commented] (SPARK-18117) Add Test for Interaction of TaskSchedulerImpl with TaskSetBlacklist

[ https://issues.apache.org/jira/browse/SPARK-18117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608505#comment-15608505 ] Apache Spark commented on SPARK-18117: -- User 'squito' has created a pull request for

[jira] [Assigned] (SPARK-18117) Add Test for Interaction of TaskSchedulerImpl with TaskSetBlacklist

[ https://issues.apache.org/jira/browse/SPARK-18117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18117: Assignee: Imran Rashid (was: Apache Spark) > Add Test for Interaction of TaskSchedulerImp

[jira] [Assigned] (SPARK-18117) Add Test for Interaction of TaskSchedulerImpl with TaskSetBlacklist

[ https://issues.apache.org/jira/browse/SPARK-18117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18117: Assignee: Apache Spark (was: Imran Rashid) > Add Test for Interaction of TaskSchedulerImp

[jira] [Updated] (SPARK-18116) spark streaming ui show 0 events when recovering from checkpoint

[ https://issues.apache.org/jira/browse/SPARK-18116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-18116: --- Description: run a streaming application which souce from kafka.There are many batchs queued in the

[jira] [Commented] (SPARK-18088) ChiSqSelector FPR PR cleanups

[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608643#comment-15608643 ] Yanbo Liang commented on SPARK-18088: - +1 [~peng.m...@intel.com] I vote to change par

[jira] [Commented] (SPARK-18085) Scalability enhancements for the History Server

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608719#comment-15608719 ] Thomas Graves commented on SPARK-18085: --- So there are a few things unclear to me ab

[jira] [Commented] (SPARK-18085) Scalability enhancements for the History Server

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608724#comment-15608724 ] Thomas Graves commented on SPARK-18085: --- Hadn't refreshed and seen your comment abo

[jira] [Resolved] (SPARK-17733) InferFiltersFromConstraints rule never terminates for query

[ https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17733. --- Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.1.0

[jira] [Commented] (SPARK-18085) Scalability enhancements for the History Server

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608760#comment-15608760 ] Thomas Graves commented on SPARK-18085: --- I should also say I don't think we should

[jira] [Resolved] (SPARK-18093) Fix default value test in SQLConfSuite to work regardless of warehouse dir's existence

[ https://issues.apache.org/jira/browse/SPARK-18093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-18093. Resolution: Fixed Assignee: Mark Grover Fix Version/s: 2.1.0

[jira] [Commented] (SPARK-18085) Scalability enhancements for the History Server

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608968#comment-15608968 ] Marcelo Vanzin commented on SPARK-18085: bq. this really sounds very much like th

[jira] [Updated] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-18105: --- Priority: Blocker (was: Major) > LZ4 failed to decompress a stream of shuffled data > --

[jira] [Commented] (SPARK-18100) Improve the performance of get_json_object using Gson

[ https://issues.apache.org/jira/browse/SPARK-18100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609078#comment-15609078 ] Davies Liu commented on SPARK-18100: [~viirya] Jackson does not support it either >

[jira] [Updated] (SPARK-16304) LinkageError should not crash Spark executor

[ https://issues.apache.org/jira/browse/SPARK-16304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-16304: - Fix Version/s: 2.0.2 > LinkageError should not crash Spark executor > ---

[jira] [Commented] (SPARK-18085) Scalability enhancements for the History Server

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609099#comment-15609099 ] Thomas Graves commented on SPARK-18085: --- Can you expand on is the source of most of

[jira] [Commented] (SPARK-18085) Scalability enhancements for the History Server

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609109#comment-15609109 ] Marcelo Vanzin commented on SPARK-18085: It's a little bit of everything. The two

[jira] [Commented] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609137#comment-15609137 ] Apache Spark commented on SPARK-13747: -- User 'zsxwing' has created a pull request fo

[jira] [Commented] (SPARK-18088) ChiSqSelector FPR PR cleanups

[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609141#comment-15609141 ] Joseph K. Bradley commented on SPARK-18088: --- I'd actually propose: * Rename kbe

[jira] [Commented] (SPARK-18088) ChiSqSelector FPR PR cleanups

[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609143#comment-15609143 ] Joseph K. Bradley commented on SPARK-18088: --- But I'm happy to discuss more & mo

[jira] [Assigned] (SPARK-18088) ChiSqSelector FPR PR cleanups

[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18088: Assignee: Apache Spark (was: Joseph K. Bradley) > ChiSqSelector FPR PR cleanups > ---

[jira] [Commented] (SPARK-18088) ChiSqSelector FPR PR cleanups

[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609149#comment-15609149 ] Apache Spark commented on SPARK-18088: -- User 'jkbradley' has created a pull request

[jira] [Assigned] (SPARK-18088) ChiSqSelector FPR PR cleanups

[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18088: Assignee: Joseph K. Bradley (was: Apache Spark) > ChiSqSelector FPR PR cleanups > ---

[jira] [Updated] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-13747: - Target Version/s: 2.0.2, 2.1.0 > Concurrent execution in SQL doesn't work with Scala ForkJoinPool

[jira] [Updated] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-13747: - Fix Version/s: (was: 2.0.0) 2.1.0 > Concurrent execution in SQL doesn't wo

[jira] [Created] (SPARK-18118) SpecificSafeProjection.apply of Java Object from Dataset to JavaRDD Grows Beyond 64 KB

Aleksander Eskilson created SPARK-18118: --- Summary: SpecificSafeProjection.apply of Java Object from Dataset to JavaRDD Grows Beyond 64 KB Key: SPARK-18118 URL: https://issues.apache.org/jira/browse/SPARK-181

[jira] [Resolved] (SPARK-18063) Failed to infer constraints over multiple aliases

[ https://issues.apache.org/jira/browse/SPARK-18063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18063. - Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.1.0 2

[jira] [Resolved] (SPARK-18104) Don't build KafkaSource doc

[ https://issues.apache.org/jira/browse/SPARK-18104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-18104. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.2 > Don't build KafkaSourc

[jira] [Commented] (SPARK-18009) Spark 2.0.1 SQL Thrift Error

[ https://issues.apache.org/jira/browse/SPARK-18009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609295#comment-15609295 ] Dilip Biswal commented on SPARK-18009: -- [~martha.solarte] Not sure [~smilegator] Sea

[jira] [Updated] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-18105: --- Description: When lz4 is used to compress the shuffle files, it may fail to decompress it as "stream

[jira] [Updated] (SPARK-18118) SpecificSafeProjection.apply of Java Object from Dataset to JavaRDD Grows Beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-18118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksander Eskilson updated SPARK-18118: Description: For sufficiently wide or nested Java Objects, when SpecificSafeProject

[jira] [Created] (SPARK-18119) Namenode safemode check is only performed on one namenode which can stuck the startup of SparkHistory server

Nicolas Fraison created SPARK-18119: --- Summary: Namenode safemode check is only performed on one namenode which can stuck the startup of SparkHistory server Key: SPARK-18119 URL: https://issues.apache.org/jira/br

[jira] [Assigned] (SPARK-18119) Namenode safemode check is only performed on one namenode which can stuck the startup of SparkHistory server

[ https://issues.apache.org/jira/browse/SPARK-18119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18119: Assignee: (was: Apache Spark) > Namenode safemode check is only performed on one namen

[jira] [Assigned] (SPARK-18119) Namenode safemode check is only performed on one namenode which can stuck the startup of SparkHistory server

[ https://issues.apache.org/jira/browse/SPARK-18119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18119: Assignee: Apache Spark > Namenode safemode check is only performed on one namenode which c

[jira] [Commented] (SPARK-17829) Stable format for offset log

[ https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609499#comment-15609499 ] Tyson Condie commented on SPARK-17829: -- In the process of adopting a complete JSON s

[jira] [Resolved] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-13747. -- Resolution: Fixed Fix Version/s: 2.0.2 > Concurrent execution in SQL doesn't work with S

[jira] [Updated] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-13747: - Affects Version/s: 2.0.1 > Concurrent execution in SQL doesn't work with Scala ForkJoinPool > ---

[jira] [Created] (SPARK-18120) QueryExecutionListener method doesnt' get executed for DataFrameWriter methods

Salil Surendran created SPARK-18120: --- Summary: QueryExecutionListener method doesnt' get executed for DataFrameWriter methods Key: SPARK-18120 URL: https://issues.apache.org/jira/browse/SPARK-18120

[jira] [Resolved] (SPARK-17961) Add storageLevel to Dataset for SparkR

[ https://issues.apache.org/jira/browse/SPARK-17961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-17961. -- Resolution: Fixed Assignee: Weichen Xu Fix Version/s: 2.1.0 > Add storageLevel

[jira] [Created] (SPARK-18121) Unable to query global temp views when hive support is enabled.

Sunitha Kambhampati created SPARK-18121: --- Summary: Unable to query global temp views when hive support is enabled. Key: SPARK-18121 URL: https://issues.apache.org/jira/browse/SPARK-18121 Proje

[jira] [Commented] (SPARK-18119) Namenode safemode check is only performed on one namenode which can stuck the startup of SparkHistory server

[ https://issues.apache.org/jira/browse/SPARK-18119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609425#comment-15609425 ] Apache Spark commented on SPARK-18119: -- User 'ashangit' has created a pull request f

[jira] [Commented] (SPARK-18121) Unable to query global temp views when hive support is enabled.

[ https://issues.apache.org/jira/browse/SPARK-18121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609579#comment-15609579 ] Sunitha Kambhampati commented on SPARK-18121: - I have a fix for this, will su

[jira] [Updated] (SPARK-14300) Scala MLlib examples code merge and clean up

[ https://issues.apache.org/jira/browse/SPARK-14300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14300: -- Description: Duplicated code that I found in scala/examples/mllib: * scala/mllib ** De

[jira] [Resolved] (SPARK-14300) Scala MLlib examples code merge and clean up

[ https://issues.apache.org/jira/browse/SPARK-14300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14300. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 12195 [h

[jira] [Updated] (SPARK-18121) Unable to query global temp views when hive support is enabled.

[ https://issues.apache.org/jira/browse/SPARK-18121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunitha Kambhampati updated SPARK-18121: Description: Querying on a global temp view throws Table or view not found exceptio

[jira] [Updated] (SPARK-14300) Scala MLlib examples code merge and clean up

[ https://issues.apache.org/jira/browse/SPARK-14300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14300: -- Assignee: Xin Ren > Scala MLlib examples code merge and clean up >

[jira] [Commented] (SPARK-18121) Unable to query global temp views when hive support is enabled.

[ https://issues.apache.org/jira/browse/SPARK-18121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609607#comment-15609607 ] Apache Spark commented on SPARK-18121: -- User 'skambha' has created a pull request fo

[jira] [Assigned] (SPARK-18121) Unable to query global temp views when hive support is enabled.

[ https://issues.apache.org/jira/browse/SPARK-18121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18121: Assignee: Apache Spark > Unable to query global temp views when hive support is enabled.

[jira] [Assigned] (SPARK-18121) Unable to query global temp views when hive support is enabled.

[ https://issues.apache.org/jira/browse/SPARK-18121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18121: Assignee: (was: Apache Spark) > Unable to query global temp views when hive support i

[jira] [Commented] (SPARK-17829) Stable format for offset log

[ https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609653#comment-15609653 ] Cody Koeninger commented on SPARK-17829: Have you considered using a typeclass?

[jira] [Created] (SPARK-18122) Fallback to Kryo for unknown classes in ExpressionEncoder

Michael Armbrust created SPARK-18122: Summary: Fallback to Kryo for unknown classes in ExpressionEncoder Key: SPARK-18122 URL: https://issues.apache.org/jira/browse/SPARK-18122 Project: Spark

[jira] [Resolved] (SPARK-18094) Move group analytics test cases from `SQLQuerySuite` into a query file test

[ https://issues.apache.org/jira/browse/SPARK-18094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18094. - Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.1.0 > Move group analyt

[jira] [Created] (SPARK-18123) org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils.saveTable the case senstivity issue

Paul Wu created SPARK-18123: --- Summary: org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils.saveTable the case senstivity issue Key: SPARK-18123 URL: https://issues.apache.org/jira/browse/SPARK-18123

[jira] [Created] (SPARK-18124) Implement watermarking for handling late data

Tathagata Das created SPARK-18124: - Summary: Implement watermarking for handling late data Key: SPARK-18124 URL: https://issues.apache.org/jira/browse/SPARK-18124 Project: Spark Issue Type: S

[jira] [Assigned] (SPARK-18124) Implement watermarking for handling late data

[ https://issues.apache.org/jira/browse/SPARK-18124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reassigned SPARK-18124: - Assignee: Tathagata Das > Implement watermarking for handling late data > --

[jira] [Created] (SPARK-18125) Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used

Ray Qiu created SPARK-18125: --- Summary: Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used Key: SPARK-18125 URL: https://issues.apache.org/jira/browse/SPARK-18125

[jira] [Commented] (SPARK-17829) Stable format for offset log

[ https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609907#comment-15609907 ] Tyson Condie commented on SPARK-17829: -- Makes sense to me. I'm still wrapping my hea

[jira] [Updated] (SPARK-18123) org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils.saveTable the case senstivity issue

[ https://issues.apache.org/jira/browse/SPARK-18123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-18123: Description: Blindly quoting every field name for inserting is the issue (Line 110-119, https://github.com

[jira] [Created] (SPARK-18126) zipWithIndex accepts negative value as index.

Miao Wang created SPARK-18126: - Summary: zipWithIndex accepts negative value as index. Key: SPARK-18126 URL: https://issues.apache.org/jira/browse/SPARK-18126 Project: Spark Issue Type: Bug

  1   2   >