[jira] [Commented] (SPARK-23443) Spark with Glue as external catalog

2018-09-05 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604441#comment-16604441 ] Ameen Tayyebi commented on SPARK-23443: --- I've been sidetracked with lots of other projects, so at

[jira] [Commented] (SPARK-23443) Spark with Glue as external catalog

2018-03-01 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382117#comment-16382117 ] Ameen Tayyebi commented on SPARK-23443: --- Great, thank you so much. I've been stuck with bunch of

[jira] [Commented] (SPARK-23443) Spark with Glue as external catalog

2018-02-20 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370015#comment-16370015 ] Ameen Tayyebi commented on SPARK-23443: --- Hello, I have this locally working (just limited read

[jira] [Resolved] (SPARK-22913) Hive Partition Pruning, Fractional and Timestamp types

2018-02-15 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ameen Tayyebi resolved SPARK-22913. --- Resolution: Won't Fix Resolving in favor of native Glue integration. These advanced

[jira] [Created] (SPARK-23443) Spark with Glue as external catalog

2018-02-15 Thread Ameen Tayyebi (JIRA)
Ameen Tayyebi created SPARK-23443: - Summary: Spark with Glue as external catalog Key: SPARK-23443 URL: https://issues.apache.org/jira/browse/SPARK-23443 Project: Spark Issue Type: New

[jira] [Comment Edited] (SPARK-22913) Hive Partition Pruning, Fractional and Timestamp types

2017-12-27 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16305018#comment-16305018 ] Ameen Tayyebi edited comment on SPARK-22913 at 12/28/17 3:31 AM: - Note:

[jira] [Commented] (SPARK-22913) Hive Partition Pruning, Fractional and Timestamp types

2017-12-27 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16305018#comment-16305018 ] Ameen Tayyebi commented on SPARK-22913: --- Note: I'll be away since December 30th until January 18th

[jira] [Created] (SPARK-22913) Hive Partition Pruning, Fractional and Timestamp types

2017-12-27 Thread Ameen Tayyebi (JIRA)
Ameen Tayyebi created SPARK-22913: - Summary: Hive Partition Pruning, Fractional and Timestamp types Key: SPARK-22913 URL: https://issues.apache.org/jira/browse/SPARK-22913 Project: Spark

[jira] [Commented] (SPARK-14651) CREATE TEMPORARY TABLE is not supported yet

2017-11-24 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265545#comment-16265545 ] Ameen Tayyebi commented on SPARK-14651: --- This blocks some of our production use cases :( we only

[jira] [Commented] (SPARK-20588) from_utc_timestamp causes bottleneck

2017-05-04 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996794#comment-15996794 ] Ameen Tayyebi commented on SPARK-20588: --- You could consider caching per thread as well which would

[jira] [Comment Edited] (SPARK-20588) from_utc_timestamp causes bottleneck

2017-05-03 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995499#comment-15995499 ] Ameen Tayyebi edited comment on SPARK-20588 at 5/3/17 7:40 PM: --- Hopefully

[jira] [Commented] (SPARK-20588) from_utc_timestamp causes bottleneck

2017-05-03 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995499#comment-15995499 ] Ameen Tayyebi commented on SPARK-20588: --- Hopefully more readable version of the call stack:

[jira] [Created] (SPARK-20588) from_utc_timestamp causes bottleneck

2017-05-03 Thread Ameen Tayyebi (JIRA)
Ameen Tayyebi created SPARK-20588: - Summary: from_utc_timestamp causes bottleneck Key: SPARK-20588 URL: https://issues.apache.org/jira/browse/SPARK-20588 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-17777) Spark Scheduler Hangs Indefinitely

2016-10-05 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ameen Tayyebi updated SPARK-1: -- Attachment: jstack-dump.txt > Spark Scheduler Hangs Indefinitely >

[jira] [Updated] (SPARK-17777) Spark Scheduler Hangs Indefinitely

2016-10-05 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ameen Tayyebi updated SPARK-1: -- Attachment: (was: jstack-dump.txt) > Spark Scheduler Hangs Indefinitely >

[jira] [Updated] (SPARK-17777) Spark Scheduler Hangs Indefinitely

2016-10-05 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ameen Tayyebi updated SPARK-1: -- Attachment: jstack-dump.txt Jstack dump of driver when it's hung. > Spark Scheduler Hangs

[jira] [Commented] (SPARK-17777) Spark Scheduler Hangs Indefinitely

2016-10-05 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15548901#comment-15548901 ] Ameen Tayyebi commented on SPARK-1: --- I'll get you the call stack of the driver shortly. The

[jira] [Commented] (SPARK-17777) Spark Scheduler Hangs Indefinitely

2016-10-05 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15548784#comment-15548784 ] Ameen Tayyebi commented on SPARK-1: --- Thanks for the comments Sean. Your statement is about

[jira] [Commented] (SPARK-17777) Spark Scheduler Hangs Indefinitely

2016-10-04 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546799#comment-15546799 ] Ameen Tayyebi commented on SPARK-1: --- Thanks for the comment. Can you please clarify why you

[jira] [Updated] (SPARK-17777) Spark Scheduler Hangs Indefinitely

2016-10-04 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ameen Tayyebi updated SPARK-1: -- Description: We've identified a problem with Spark scheduling. The issue manifests itself

[jira] [Updated] (SPARK-17777) Spark Scheduler Hangs Indefinitely

2016-10-04 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ameen Tayyebi updated SPARK-1: -- Attachment: repro.scala > Spark Scheduler Hangs Indefinitely >

[jira] [Issue Comment Deleted] (SPARK-17777) Spark Scheduler Hangs Indefinitely

2016-10-04 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ameen Tayyebi updated SPARK-1: -- Comment: was deleted (was: Here's repro code: import org.apache.spark.{Partition,

[jira] [Commented] (SPARK-17777) Spark Scheduler Hangs Indefinitely

2016-10-04 Thread Ameen Tayyebi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546204#comment-15546204 ] Ameen Tayyebi commented on SPARK-1: --- Here's repro code: import org.apache.spark.{Partition,

[jira] [Created] (SPARK-17777) Spark Scheduler Hangs Indefinitely

2016-10-04 Thread Ameen Tayyebi (JIRA)
Ameen Tayyebi created SPARK-1: - Summary: Spark Scheduler Hangs Indefinitely Key: SPARK-1 URL: https://issues.apache.org/jira/browse/SPARK-1 Project: Spark Issue Type: Bug