[
https://issues.apache.org/jira/browse/SPARK-38079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-38079:
Description:
*The problem*
When you spark-submit to kubernetes in cluster-mode:
# Kubernetes creates the driver
Ben created SPARK-38079:
---
Summary: Not waiting for configmap before starting driver
Key: SPARK-38079
URL: https://issues.apache.org/jira/browse/SPARK-38079
Project: Spark
Issue Type: Bug
Comp
[
https://issues.apache.org/jira/browse/SPARK-31306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-31306:
Description: The rand() function in PySpark, Spark, and R is documented as
drawing from U[0.0, 1.0]. This suggest
[
https://issues.apache.org/jira/browse/SPARK-31306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-31306:
Description: The rand() function in PySpark, Spark, and R is documented as
drawing from U[0.0, 1.0]. This suggest
[
https://issues.apache.org/jira/browse/SPARK-31306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-31306:
Description:
The rand() function in PySpark, Spark, and R is documented as drawing from
U[0.0, 1.0]. This sugg
[
https://issues.apache.org/jira/browse/SPARK-31306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-31306:
Description:
The rand() function in PySpark, Spark, and R is documented as drawing from
U[0.0, 1.0]. This sugg
[
https://issues.apache.org/jira/browse/SPARK-31306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-31306:
Description:
The rand() function in PySpark, Spark, and R is documented as drawing from
U[0.0, 1.0]. This sugg
Ben created SPARK-31306:
---
Summary: rand() function documentation suggests an inclusive upper
bound of 1.0
Key: SPARK-31306
URL: https://issues.apache.org/jira/browse/SPARK-31306
Project: Spark
Issue T
[
https://issues.apache.org/jira/browse/SPARK-27137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16791744#comment-16791744
]
Osira Ben commented on SPARK-27137:
---
Indeed it works in the current master! Thank you!
Osira Ben created SPARK-27137:
-
Summary: Spark captured variable is null if the code is pasted via
:paste
Key: SPARK-27137
URL: https://issues.apache.org/jira/browse/SPARK-27137
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-27137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Osira Ben updated SPARK-27137:
--
Description:
If I execute this piece of code
{code:java}
val foo = "foo"
def f(arg: Any): Unit = {
[
https://issues.apache.org/jira/browse/SPARK-22563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259517#comment-16259517
]
Ben commented on SPARK-22563:
-
I cannot give you the actual data, but in this case it would b
[
https://issues.apache.org/jira/browse/SPARK-22563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-22563:
Description:
I have a large and complex DataFrame with nested structures in Spark 2.1.0
(pySpark) and I want to ad
[
https://issues.apache.org/jira/browse/SPARK-22563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259367#comment-16259367
]
Ben edited comment on SPARK-22563 at 11/20/17 3:34 PM:
---
Hi [~srowen
[
https://issues.apache.org/jira/browse/SPARK-22563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259367#comment-16259367
]
Ben edited comment on SPARK-22563 at 11/20/17 3:34 PM:
---
Hi [~srowen
[
https://issues.apache.org/jira/browse/SPARK-22563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259367#comment-16259367
]
Ben commented on SPARK-22563:
-
The example is what I would logically expect, but in reality,
[
https://issues.apache.org/jira/browse/SPARK-22563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-22563:
Component/s: Shuffle
PySpark
> Spark row_number() deterministic generation and materialization as
Ben created SPARK-22563:
---
Summary: Spark row_number() deterministic generation and
materialization as a checkpoint
Key: SPARK-22563
URL: https://issues.apache.org/jira/browse/SPARK-22563
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16212513#comment-16212513
]
Ben commented on SPARK-22284:
-
[~kiszk], happy to help, and thanks for your assistance.
So,
[
https://issues.apache.org/jira/browse/SPARK-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-22284:
Attachment: 64KB Error.log
Sure, I just added it as an attachment.
> Code of class
> \"org.apache.spark.sql.catal
[
https://issues.apache.org/jira/browse/SPARK-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16210089#comment-16210089
]
Ben commented on SPARK-22284:
-
[~hyukjin.kwon], thank you very much for your assistance, but
[
https://issues.apache.org/jira/browse/SPARK-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16205608#comment-16205608
]
Ben commented on SPARK-22284:
-
I did try adding
{code:java}
--conf "spark.sql.codegen.wholeS
[
https://issues.apache.org/jira/browse/SPARK-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-22284:
Description:
I am using pySpark 2.1.0 in a production environment, and trying to join two
DataFrames, one of which
[
https://issues.apache.org/jira/browse/SPARK-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16205601#comment-16205601
]
Ben edited comment on SPARK-22284 at 10/16/17 9:10 AM:
---
If I upgrad
[
https://issues.apache.org/jira/browse/SPARK-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16205601#comment-16205601
]
Ben commented on SPARK-22284:
-
If I upgrade to 2.2.0 then I, for myself at least, would not n
[
https://issues.apache.org/jira/browse/SPARK-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-22284:
Component/s: SQL
> Code of class
> \"org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjec
[
https://issues.apache.org/jira/browse/SPARK-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-22284:
Description:
I am using pySpark 2.1.0 in a production environment, and trying to join two
DataFrames, one of which
Ben created SPARK-22284:
---
Summary: Code of class
\"org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection\"
grows beyond 64 KB
Key: SPARK-22284
URL: https://issues.apache.org/jira/browse/SPARK-22
[
https://issues.apache.org/jira/browse/SPARK-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-22284:
Description:
I am using pySpark 2.1.0 in a production environment, and trying to join two
DataFrames, one of which
[
https://issues.apache.org/jira/browse/SPARK-18667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15901403#comment-15901403
]
Ben commented on SPARK-18667:
-
Any news on this?
The issue is still there, at least wil spar
Ben created SPARK-19243:
---
Summary: Error when selecting from DataFrame containing parsed
data from files larger than 1MB
Key: SPARK-19243
URL: https://issues.apache.org/jira/browse/SPARK-19243
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-18667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15821929#comment-15821929
]
Ben commented on SPARK-18667:
-
Happy to help.
Were you also able to reproduce the second issu
[
https://issues.apache.org/jira/browse/SPARK-18667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15821506#comment-15821506
]
Ben edited comment on SPARK-18667 at 1/13/17 3:51 PM:
--
So, I created
[
https://issues.apache.org/jira/browse/SPARK-18667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15821506#comment-15821506
]
Ben edited comment on SPARK-18667 at 1/13/17 9:53 AM:
--
So, I created
[
https://issues.apache.org/jira/browse/SPARK-18667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15821506#comment-15821506
]
Ben commented on SPARK-18667:
-
So, I created a new example now, and here is the code for ever
[
https://issues.apache.org/jira/browse/SPARK-18667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15821188#comment-15821188
]
Ben commented on SPARK-18667:
-
OK, I just tried it with a json and it worked.
To be honest I
[
https://issues.apache.org/jira/browse/SPARK-18667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15821188#comment-15821188
]
Ben edited comment on SPARK-18667 at 1/12/17 3:01 PM:
--
OK, I just tr
[
https://issues.apache.org/jira/browse/SPARK-18667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15821073#comment-15821073
]
Ben edited comment on SPARK-18667 at 1/12/17 2:28 PM:
--
I still have
[
https://issues.apache.org/jira/browse/SPARK-18667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15821073#comment-15821073
]
Ben edited comment on SPARK-18667 at 1/12/17 2:12 PM:
--
I still have
[
https://issues.apache.org/jira/browse/SPARK-18667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15821073#comment-15821073
]
Ben edited comment on SPARK-18667 at 1/12/17 2:10 PM:
--
I still have
[
https://issues.apache.org/jira/browse/SPARK-18667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15821073#comment-15821073
]
Ben commented on SPARK-18667:
-
I still have the same problem on pySpark 2.1.0 and Python 3.5.
41 matches
Mail list logo
