[
https://issues.apache.org/jira/browse/SPARK-17661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-17661.
-
Resolution: Fixed
Assignee: Peter Lee
Fix Version/s: 2.1.0
> Consolidate various
[
https://issues.apache.org/jira/browse/SPARK-17919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17919:
Assignee: Apache Spark
> Make timeout to RBackend configurable in SparkR
> ---
[
https://issues.apache.org/jira/browse/SPARK-17919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573210#comment-15573210
]
Apache Spark commented on SPARK-17919:
--
User 'falaki' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-17919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17919:
Assignee: (was: Apache Spark)
> Make timeout to RBackend configurable in SparkR
>
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573166#comment-15573166
]
Cody Koeninger edited comment on SPARK-17812 at 10/13/16 9:17 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-17731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573216#comment-15573216
]
Apache Spark commented on SPARK-17731:
--
User 'tdas' has created a pull request for t
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17812:
---
Comment: was deleted
(was: One other slightly ugly thing...
{noformat}
// starting topicpart
[
https://issues.apache.org/jira/browse/SPARK-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573287#comment-15573287
]
holdenk commented on SPARK-15369:
-
I can understand the hesitancy to adopt this long term
[
https://issues.apache.org/jira/browse/SPARK-17460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Perluss updated SPARK-17460:
--
Component/s: SQL
> Dataset.joinWith broadcasts gigabyte sized table, causes OOM Exception
> ---
kanika dhuria created SPARK-17922:
-
Summary: ClassCastException java.lang.ClassCastException:
org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIterator
cannot be cast to org.apache.spark.sql.catalyst.expressions.UnsafeProjection
[
https://issues.apache.org/jira/browse/SPARK-17922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kanika dhuria updated SPARK-17922:
--
Description:
I am using spark 2.0
Seeing class loading issue because the whole stage code gen i
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573341#comment-15573341
]
Ofir Manor commented on SPARK-17812:
Thanks Cody! great to have a concrete example.
I
[
https://issues.apache.org/jira/browse/SPARK-17922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kanika dhuria updated SPARK-17922:
--
Description:
I am using spark 2.0
Seeing class loading issue because the whole stage code gen i
[
https://issues.apache.org/jira/browse/SPARK-17922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kanika dhuria updated SPARK-17922:
--
Description:
I am using spark 2.0
Seeing class loading issue because the whole stage code gen i
[
https://issues.apache.org/jira/browse/SPARK-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573360#comment-15573360
]
holdenk commented on SPARK-650:
---
Would people feel ok if we marked this as a duplicate of 636
[
https://issues.apache.org/jira/browse/SPARK-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573364#comment-15573364
]
holdenk commented on SPARK-10972:
-
I don't think that actually solves the problem the use
[
https://issues.apache.org/jira/browse/SPARK-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573363#comment-15573363
]
Eugene Zhulenev commented on SPARK-17555:
-
[~brdwrd]
I had the same issue, and I
[
https://issues.apache.org/jira/browse/SPARK-16720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573367#comment-15573367
]
holdenk commented on SPARK-16720:
-
Sounds good - go ahead and close this :)
> Loading CS
[
https://issues.apache.org/jira/browse/SPARK-12916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
holdenk closed SPARK-12916.
---
Resolution: Won't Fix
Since Row is now a subclass of Tuple we don't really need this anymore.
> Support Row.
Evan Zamir created SPARK-17923:
--
Summary: dateFormat unexpected kwarg to df.write.csv
Key: SPARK-17923
URL: https://issues.apache.org/jira/browse/SPARK-17923
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-12916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573371#comment-15573371
]
holdenk commented on SPARK-12916:
-
+1 with Hyukjin, I'll go ahead and close this as a "Wo
[
https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573380#comment-15573380
]
holdenk commented on SPARK-9487:
+1 to [~srowen]'s comment. I would not be surprised to se
[
https://issues.apache.org/jira/browse/SPARK-14212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573381#comment-15573381
]
holdenk commented on SPARK-14212:
-
Please do! I think I've outlined the basic steps in my
[
https://issues.apache.org/jira/browse/SPARK-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573363#comment-15573363
]
Eugene Zhulenev edited comment on SPARK-17555 at 10/13/16 10:21 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573395#comment-15573395
]
Cody Koeninger commented on SPARK-17812:
1. we dont have lists, we have strings.
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573395#comment-15573395
]
Cody Koeninger edited comment on SPARK-17812 at 10/13/16 10:25 PM:
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573432#comment-15573432
]
Cody Koeninger commented on SPARK-17812:
If you're seriously worried that people
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573432#comment-15573432
]
Cody Koeninger edited comment on SPARK-17812 at 10/13/16 10:44 PM:
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573459#comment-15573459
]
Michael Armbrust commented on SPARK-17812:
--
+1 to the suggested was of subscribi
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573457#comment-15573457
]
Ofir Manor commented on SPARK-17812:
I'm with you - I warned you it is bikeshedding..
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573459#comment-15573459
]
Michael Armbrust edited comment on SPARK-17812 at 10/13/16 10:53 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573459#comment-15573459
]
Michael Armbrust edited comment on SPARK-17812 at 10/13/16 10:53 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-17919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573469#comment-15573469
]
Felix Cheung commented on SPARK-17919:
--
Earlier bug:
https://issues.apache.org/jira/
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573479#comment-15573479
]
Cody Koeninger commented on SPARK-17812:
While some decision is better than none,
[
https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573512#comment-15573512
]
Ashish Shrowty commented on SPARK-17709:
[~smilegator] I compiled with the added
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573526#comment-15573526
]
Michael Armbrust commented on SPARK-17812:
--
As far as I understand it, {{auto.of
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573563#comment-15573563
]
Cody Koeninger commented on SPARK-17812:
So a short term question
- with your pro
[
https://issues.apache.org/jira/browse/SPARK-17678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu resolved SPARK-17678.
--
Resolution: Fixed
Assignee: Saisai Shao
Fix Version/s: 1.6.3
> Spark 1.6 Scala-
[
https://issues.apache.org/jira/browse/SPARK-17678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu updated SPARK-17678:
-
Affects Version/s: (was: 1.6.3)
1.6.2
> Spark 1.6 Scala-2.11 repl does
Reynold Xin created SPARK-17924:
---
Summary: Consolidate streaming and batch write path
Key: SPARK-17924
URL: https://issues.apache.org/jira/browse/SPARK-17924
Project: Spark
Issue Type: Improvem
Reynold Xin created SPARK-17925:
---
Summary: Break fileSourceInterfaces.scala into multiple pieces
Key: SPARK-17925
URL: https://issues.apache.org/jira/browse/SPARK-17925
Project: Spark
Issue Typ
[
https://issues.apache.org/jira/browse/SPARK-17925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17925:
Assignee: Reynold Xin (was: Apache Spark)
> Break fileSourceInterfaces.scala into multipl
[
https://issues.apache.org/jira/browse/SPARK-17925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573640#comment-15573640
]
Apache Spark commented on SPARK-17925:
--
User 'rxin' has created a pull request for t
[
https://issues.apache.org/jira/browse/SPARK-17925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17925:
Assignee: Apache Spark (was: Reynold Xin)
> Break fileSourceInterfaces.scala into multipl
[
https://issues.apache.org/jira/browse/SPARK-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573668#comment-15573668
]
Hyukjin Kwon commented on SPARK-17916:
--
Hi [~falaki], this JIRA rings a bell to me.
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573677#comment-15573677
]
Michael Armbrust commented on SPARK-17812:
--
bq. with your proposed interface, wh
[
https://issues.apache.org/jira/browse/SPARK-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573692#comment-15573692
]
Hossein Falaki commented on SPARK-17916:
Thanks for linking it. Yes they are very
[
https://issues.apache.org/jira/browse/SPARK-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-17368.
--
Resolution: Fixed
Fix Version/s: 2.1.0
Issue resolved by pull request 15284
[htt
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573766#comment-15573766
]
Cody Koeninger commented on SPARK-17812:
OK, failing on start is clear (it's real
Tathagata Das created SPARK-17926:
-
Summary: Add methods to convert StreamingQueryStatus to json
Key: SPARK-17926
URL: https://issues.apache.org/jira/browse/SPARK-17926
Project: Spark
Issue T
[
https://issues.apache.org/jira/browse/SPARK-17926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das updated SPARK-17926:
--
Description: Useful for recording StreamingQueryStatuses when exposed
through StreamingQueryLis
[
https://issues.apache.org/jira/browse/SPARK-17926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17926:
Assignee: Tathagata Das (was: Apache Spark)
> Add methods to convert StreamingQueryStatus
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573786#comment-15573786
]
Michael Armbrust commented on SPARK-17812:
--
Please do work on it. It might be g
[
https://issues.apache.org/jira/browse/SPARK-17926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17926:
Assignee: Apache Spark (was: Tathagata Das)
> Add methods to convert StreamingQueryStatus
[
https://issues.apache.org/jira/browse/SPARK-17926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573788#comment-15573788
]
Apache Spark commented on SPARK-17926:
--
User 'tdas' has created a pull request for t
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust reassigned SPARK-17812:
Assignee: Cody Koeninger
> More granular control of starting offsets (assign)
> --
[
https://issues.apache.org/jira/browse/SPARK-17813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573806#comment-15573806
]
Cody Koeninger commented on SPARK-17813:
So issues to be worked out here (assumin
Reynold Xin created SPARK-17927:
---
Summary: Remove dead code in WriterContainer
Key: SPARK-17927
URL: https://issues.apache.org/jira/browse/SPARK-17927
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-17927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17927:
Assignee: Reynold Xin (was: Apache Spark)
> Remove dead code in WriterContainer
> ---
[
https://issues.apache.org/jira/browse/SPARK-17927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17927:
Assignee: Apache Spark (was: Reynold Xin)
> Remove dead code in WriterContainer
> ---
[
https://issues.apache.org/jira/browse/SPARK-17927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573838#comment-15573838
]
Apache Spark commented on SPARK-17927:
--
User 'rxin' has created a pull request for t
[
https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573843#comment-15573843
]
Cody Koeninger commented on SPARK-17812:
So I think this is what we're agreed on:
[
https://issues.apache.org/jira/browse/SPARK-17898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573929#comment-15573929
]
lichenglin commented on SPARK-17898:
I know it.
But how to build these dependencies
[
https://issues.apache.org/jira/browse/SPARK-17898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573929#comment-15573929
]
lichenglin edited comment on SPARK-17898 at 10/14/16 2:41 AM:
-
Drew Robb created SPARK-17928:
-
Summary: No driver.memoryOverhead setting for mesos cluster mode
Key: SPARK-17928
URL: https://issues.apache.org/jira/browse/SPARK-17928
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yanbo Liang reassigned SPARK-12664:
---
Assignee: Yanbo Liang
> Expose raw prediction scores in MultilayerPerceptronClassificationMo
[
https://issues.apache.org/jira/browse/SPARK-17899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573961#comment-15573961
]
Apache Spark commented on SPARK-17899:
--
User 'gatorsmile' has created a pull request
Weizhong created SPARK-17929:
Summary: Deadlock when AM restart send RemoveExecutor
Key: SPARK-17929
URL: https://issues.apache.org/jira/browse/SPARK-17929
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-17929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weizhong updated SPARK-17929:
-
Summary: Deadlock when AM restart and send RemoveExecutor on reset (was:
Deadlock when AM restart send R
Guoqiang Li created SPARK-17930:
---
Summary: The SerializerInstance instance used when deserializing a
TaskResult is not reused
Key: SPARK-17930
URL: https://issues.apache.org/jira/browse/SPARK-17930
Pro
Guoqiang Li created SPARK-17931:
---
Summary: taskScheduler has some unneeded serialization
Key: SPARK-17931
URL: https://issues.apache.org/jira/browse/SPARK-17931
Project: Spark
Issue Type: Impro
[
https://issues.apache.org/jira/browse/SPARK-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15574137#comment-15574137
]
Felix Cheung commented on SPARK-17781:
--
Hmm.. I'm not quite sure what it is just yet
[
https://issues.apache.org/jira/browse/SPARK-17927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-17927.
-
Resolution: Fixed
Fix Version/s: 2.1.0
Issue resolved by pull request 15477
[https://githu
[
https://issues.apache.org/jira/browse/SPARK-16632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-16632:
--
Fix Version/s: 2.0.1
> Vectorized parquet reader fails to read certain fields from Hive tables
[
https://issues.apache.org/jira/browse/SPARK-16632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15574253#comment-15574253
]
Dongjoon Hyun commented on SPARK-16632:
---
{code}
spark-2.0:branch-2.0$ git log --one
[
https://issues.apache.org/jira/browse/SPARK-16632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15574251#comment-15574251
]
Dongjoon Hyun commented on SPARK-16632:
---
This was backported at the following commi
[
https://issues.apache.org/jira/browse/SPARK-17254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-17254:
Attachment: stop-after-physical-plan.pdf
> Filter operator should have “stop if false” sema
[
https://issues.apache.org/jira/browse/SPARK-17884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15574305#comment-15574305
]
Apache Spark commented on SPARK-17884:
--
User 'priyankagargnitk' has created a pull r
pin_zhang created SPARK-17932:
-
Summary: Failed to run SQL "show table extended like table_name"
in Spark2.0.0
Key: SPARK-17932
URL: https://issues.apache.org/jira/browse/SPARK-17932
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15574339#comment-15574339
]
Chirag Vaya commented on SPARK-10063:
-
[~mkim] Can you please tell us in what environ
[
https://issues.apache.org/jira/browse/SPARK-17925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-17925.
-
Resolution: Fixed
Fix Version/s: 2.1.0
Issue resolved by pull request 15473
[https://githu
[
https://issues.apache.org/jira/browse/SPARK-17932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
pin_zhang updated SPARK-17932:
--
Description:
SQL "show table extended like table_name " doesn't work in spark 2.0.0
that works in spar
201 - 282 of 282 matches
Mail list logo