[jira] [Commented] (SPARK-28902) Spark ML Pipeline with nested Pipelines fails to load when saved from Python

2019-09-10 Thread Saif Addin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927077#comment-16927077 ] Saif Addin commented on SPARK-28902: Ah, here I thought you said you couldn't reprod

[jira] [Commented] (SPARK-28902) Spark ML Pipeline with nested Pipelines fails to load when saved from Python

2019-09-09 Thread Saif Addin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926226#comment-16926226 ] Saif Addin commented on SPARK-28902: Hi [~reconjun] I am not sure how you made it wo

[jira] [Created] (SPARK-28902) Spark ML Pipeline with nested Pipelines fails to load when saved from Python

2019-08-28 Thread Saif Addin (Jira)
Saif Addin created SPARK-28902: -- Summary: Spark ML Pipeline with nested Pipelines fails to load when saved from Python Key: SPARK-28902 URL: https://issues.apache.org/jira/browse/SPARK-28902 Project: Spa

[jira] [Created] (SPARK-21556) PySpark, Unable to save pipeline of non-spark transformers

2017-07-28 Thread Saif Addin (JIRA)
Saif Addin created SPARK-21556: -- Summary: PySpark, Unable to save pipeline of non-spark transformers Key: SPARK-21556 URL: https://issues.apache.org/jira/browse/SPARK-21556 Project: Spark Issue

[jira] [Updated] (SPARK-21511) Unable to load Pipeline or PipelineModel

2017-07-22 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saif Addin updated SPARK-21511: --- Summary: Unable to load Pipeline or PipelineModel (was: Unable to load Pipeline or Pipeline model)

[jira] [Created] (SPARK-21511) Unable to load Pipeline or Pipeline model

2017-07-22 Thread Saif Addin (JIRA)
Saif Addin created SPARK-21511: -- Summary: Unable to load Pipeline or Pipeline model Key: SPARK-21511 URL: https://issues.apache.org/jira/browse/SPARK-21511 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-21281) cannot create empty typed array column

2017-07-02 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16071979#comment-16071979 ] Saif Addin edited comment on SPARK-21281 at 7/3/17 6:44 AM: [

[jira] [Commented] (SPARK-21281) cannot create empty typed array column

2017-07-02 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16071979#comment-16071979 ] Saif Addin commented on SPARK-21281: [~maropu] That works, for array. Thanks, but it

[jira] [Comment Edited] (SPARK-21198) SparkSession catalog is terribly slow

2017-07-02 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16071890#comment-16071890 ] Saif Addin edited comment on SPARK-21198 at 7/3/17 3:41 AM: I

[jira] [Comment Edited] (SPARK-21198) SparkSession catalog is terribly slow

2017-07-02 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16071890#comment-16071890 ] Saif Addin edited comment on SPARK-21198 at 7/3/17 3:41 AM: I

[jira] [Commented] (SPARK-21198) SparkSession catalog is terribly slow

2017-07-02 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16071890#comment-16071890 ] Saif Addin commented on SPARK-21198: I thought sqlContext was going to be deprecated

[jira] [Updated] (SPARK-21281) cannot create empty typed array column

2017-07-02 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saif Addin updated SPARK-21281: --- Description: Hi all I am running this piece of code {code:java} val data = spark.read.parquet("som

[jira] [Updated] (SPARK-21281) cannot create empty typed array column

2017-07-02 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saif Addin updated SPARK-21281: --- Summary: cannot create empty typed array column (was: Casting empty typed array column return differ

[jira] [Updated] (SPARK-21281) Casting empty typed array column return different results depending on the api used

2017-07-02 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saif Addin updated SPARK-21281: --- Priority: Minor (was: Major) > Casting empty typed array column return different results depending o

[jira] [Created] (SPARK-21281) Casting empty typed array column return different results depending on the api used

2017-07-02 Thread Saif Addin (JIRA)
Saif Addin created SPARK-21281: -- Summary: Casting empty typed array column return different results depending on the api used Key: SPARK-21281 URL: https://issues.apache.org/jira/browse/SPARK-21281 Proje

[jira] [Commented] (SPARK-21198) SparkSession catalog is terribly slow

2017-07-02 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16071759#comment-16071759 ] Saif Addin commented on SPARK-21198: [~viirya] any chance you could take a look? > S

[jira] [Comment Edited] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-26 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063406#comment-16063406 ] Saif Addin edited comment on SPARK-21198 at 6/26/17 5:56 PM: -

[jira] [Comment Edited] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-26 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063406#comment-16063406 ] Saif Addin edited comment on SPARK-21198 at 6/26/17 5:55 PM: -

[jira] [Comment Edited] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-26 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063431#comment-16063431 ] Saif Addin edited comment on SPARK-21198 at 6/26/17 5:24 PM: -

[jira] [Comment Edited] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-26 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063431#comment-16063431 ] Saif Addin edited comment on SPARK-21198 at 6/26/17 5:23 PM: -

[jira] [Comment Edited] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-26 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063431#comment-16063431 ] Saif Addin edited comment on SPARK-21198 at 6/26/17 5:22 PM: -

[jira] [Comment Edited] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-26 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063431#comment-16063431 ] Saif Addin edited comment on SPARK-21198 at 6/26/17 5:15 PM: -

[jira] [Commented] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-26 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063431#comment-16063431 ] Saif Addin commented on SPARK-21198: Regarding listtables, here is the code used ins

[jira] [Comment Edited] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-26 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063406#comment-16063406 ] Saif Addin edited comment on SPARK-21198 at 6/26/17 5:03 PM: -

[jira] [Comment Edited] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-26 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063406#comment-16063406 ] Saif Addin edited comment on SPARK-21198 at 6/26/17 5:02 PM: -

[jira] [Commented] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-26 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063406#comment-16063406 ] Saif Addin commented on SPARK-21198: Okay, I think there is something odd somewhere i

[jira] [Comment Edited] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-26 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063406#comment-16063406 ] Saif Addin edited comment on SPARK-21198 at 6/26/17 5:01 PM: -

[jira] [Commented] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-25 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062498#comment-16062498 ] Saif Addin commented on SPARK-21198: [~viirya] I'll take a look again on Monday, but

[jira] [Comment Edited] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-24 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062070#comment-16062070 ] Saif Addin edited comment on SPARK-21198 at 6/24/17 5:27 PM: -

[jira] [Comment Edited] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-24 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062070#comment-16062070 ] Saif Addin edited comment on SPARK-21198 at 6/24/17 5:26 PM: -

[jira] [Comment Edited] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-24 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062070#comment-16062070 ] Saif Addin edited comment on SPARK-21198 at 6/24/17 5:26 PM: -

[jira] [Commented] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-24 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062070#comment-16062070 ] Saif Addin commented on SPARK-21198: Thanks [~viirya] My program lists on a webpage t

[jira] [Updated] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-23 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saif Addin updated SPARK-21198: --- Description: We have a considerably large Hive metastore and a Spark program that goes through Hive

[jira] [Updated] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-23 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saif Addin updated SPARK-21198: --- Description: We have a considerably large Hive metastore and a Spark program that goes through Hive

[jira] [Updated] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-23 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saif Addin updated SPARK-21198: --- Description: We have a considerably large Hive metastore and a Spark program that goes through Hive

[jira] [Created] (SPARK-21198) SparkSession catalog is terribly slow

2017-06-23 Thread Saif Addin (JIRA)
Saif Addin created SPARK-21198: -- Summary: SparkSession catalog is terribly slow Key: SPARK-21198 URL: https://issues.apache.org/jira/browse/SPARK-21198 Project: Spark Issue Type: Bug C

[jira] [Commented] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2017-05-09 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16002814#comment-16002814 ] Saif Addin commented on SPARK-13747: [~dnaumenko] Nonetheless, if I am not mistaken,

[jira] [Commented] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2017-05-08 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16001419#comment-16001419 ] Saif Addin commented on SPARK-13747: [~zsxwing] Thanks. My program is pretty much def

[jira] [Comment Edited] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2017-05-08 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16001405#comment-16001405 ] Saif Addin edited comment on SPARK-13747 at 5/8/17 7:33 PM: [

[jira] [Commented] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2017-05-08 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16001405#comment-16001405 ] Saif Addin commented on SPARK-13747: [~zsxwing] I may be confused then. Which issue I

[jira] [Commented] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2017-05-08 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16001371#comment-16001371 ] Saif Addin commented on SPARK-13747: I did fix it now 100% sure. 1. Used thread-pool

[jira] [Comment Edited] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2017-05-08 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16001356#comment-16001356 ] Saif Addin edited comment on SPARK-13747 at 5/8/17 7:12 PM: S

[jira] [Commented] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2017-05-08 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16001356#comment-16001356 ] Saif Addin commented on SPARK-13747: Sorry for the confusion. No, it doesnt work. I a

[jira] [Issue Comment Deleted] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2017-05-08 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saif Addin updated SPARK-13747: --- Comment: was deleted (was: I explicitly set it to default-executor and it is not failing any more fo

[jira] [Commented] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2017-05-08 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16001233#comment-16001233 ] Saif Addin commented on SPARK-13747: I explicitly set it to default-executor and it i

[jira] [Comment Edited] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2017-05-08 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16001117#comment-16001117 ] Saif Addin edited comment on SPARK-13747 at 5/8/17 5:34 PM: T

[jira] [Comment Edited] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2017-05-08 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16001117#comment-16001117 ] Saif Addin edited comment on SPARK-13747 at 5/8/17 5:33 PM: T

[jira] [Commented] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2017-05-08 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16001117#comment-16001117 ] Saif Addin commented on SPARK-13747: The above solution did help my program to start