[
https://issues.apache.org/jira/browse/SPARK-47959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841339#comment-17841339
]
PJ Fanning commented on SPARK-47959:
[~zshao] if you have a test environment, could you try it with
[
https://issues.apache.org/jira/browse/SPARK-35253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739895#comment-17739895
]
PJ Fanning commented on SPARK-35253:
Janino 3.1.10 is out today and resolves
[
https://issues.apache.org/jira/browse/SPARK-42854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning resolved SPARK-42854.
Resolution: Duplicate
> Jackson 2.15
>
>
> Key: SPARK-42854
>
[
https://issues.apache.org/jira/browse/SPARK-43263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17715949#comment-17715949
]
PJ Fanning commented on SPARK-43263:
This is a duplicate of SPARK-42854 and it is not a good idea to
[
https://issues.apache.org/jira/browse/SPARK-42854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-42854:
---
Description:
I'm not advocating for an upgrade to [Jackson
[
https://issues.apache.org/jira/browse/SPARK-42854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-42854:
---
Description:
I'm not advocating for an upgrade to Jackson 2.15. 2.15.0-rc1 has just been
released
PJ Fanning created SPARK-42854:
--
Summary: Jackson 2.15
Key: SPARK-42854
URL: https://issues.apache.org/jira/browse/SPARK-42854
Project: Spark
Issue Type: Improvement
Components:
[
https://issues.apache.org/jira/browse/SPARK-40911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-40911:
---
Description:
This 2.14.0 release is still a few weeks a way. There is an rc2 release but
there
[
https://issues.apache.org/jira/browse/SPARK-40911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-40911:
---
Description:
This 2.14.0 release is still a few weeks a way. There is an rc2 release but
there
[
https://issues.apache.org/jira/browse/SPARK-40911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-40911:
---
Description:
This 2.14.0 release is still a few weeks a way. There is an rc2 release but
there
PJ Fanning created SPARK-40911:
--
Summary: Upgrade jackson-module-scala to 2.14.0
Key: SPARK-40911
URL: https://issues.apache.org/jira/browse/SPARK-40911
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-40666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623810#comment-17623810
]
PJ Fanning commented on SPARK-40666:
The recent CVEs are fixed in Jackson 2.13.4.2 and Spark trunk
[
https://issues.apache.org/jira/browse/SPARK-40457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623809#comment-17623809
]
PJ Fanning commented on SPARK-40457:
Maybe this could be closed as a duplicate of SPARK-30466
>
[
https://issues.apache.org/jira/browse/SPARK-30466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623806#comment-17623806
]
PJ Fanning commented on SPARK-30466:
An upcoming release of Hadoop 3 will remove its remaining use
PJ Fanning created SPARK-38665:
--
Summary: upgrade jackson due to CVE-2020-36518
Key: SPARK-38665
URL: https://issues.apache.org/jira/browse/SPARK-38665
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-37630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17487275#comment-17487275
]
PJ Fanning commented on SPARK-37630:
[~jinlow] there is little point commenting on this closed issue
[
https://issues.apache.org/jira/browse/SPARK-37625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458802#comment-17458802
]
PJ Fanning commented on SPARK-37625:
log4j 2.16.0 is out - it might be best to pause this as it
[
https://issues.apache.org/jira/browse/SPARK-37630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458798#comment-17458798
]
PJ Fanning commented on SPARK-37630:
Maybe a duplicate of SPARK-6305
> Security issue from Log4j
[
https://issues.apache.org/jira/browse/SPARK-27683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838086#comment-16838086
]
PJ Fanning edited comment on SPARK-27683 at 5/12/19 3:01 PM:
-
[~srowen]
[
https://issues.apache.org/jira/browse/SPARK-27683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838086#comment-16838086
]
PJ Fanning commented on SPARK-27683:
[~srowen] would it be possible to use the
[
https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-21708:
---
Summary: use sbt 1.x (was: use sbt 1.0.0)
> use sbt 1.x
> ---
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124012#comment-16124012
]
PJ Fanning commented on SPARK-21708:
[~srowen] Your point about IDEs is valid. IntelliJ IDEA has
[
https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-21708:
---
Description:
Should improve sbt build times.
[
https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123451#comment-16123451
]
PJ Fanning commented on SPARK-21708:
[~srowen] the build/sbt scripting will download the preferred
[
https://issues.apache.org/jira/browse/SPARK-21709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-21709:
---
Description:
A preliminary step to SPARK-21708.
Quite a lot of sbt plugin changes needed to get to
PJ Fanning created SPARK-21709:
--
Summary: use sbt 0.13.16 and update sbt plugins
Key: SPARK-21709
URL: https://issues.apache.org/jira/browse/SPARK-21709
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-21708:
---
Description:
I had a quick look and I think we'll need to wait until sbt-launch 1.0 jar is
[
https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-21708:
---
Description:
I had a quick look and I think we'll need to wait until sbt-launch 1.0 jar is
[
https://issues.apache.org/jira/browse/SPARK-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123319#comment-16123319
]
PJ Fanning commented on SPARK-14401:
This would be useful for a general upgrade to sbt 1.0.0
>
[
https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-21708:
---
Description:
I had a quick look and I think we'll need to wait until sbt-launch 1.0 jar is
PJ Fanning created SPARK-21708:
--
Summary: use sbt 1.0.0
Key: SPARK-21708
URL: https://issues.apache.org/jira/browse/SPARK-21708
Project: Spark
Issue Type: Improvement
Components:
[
https://issues.apache.org/jira/browse/SPARK-20871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090125#comment-16090125
]
PJ Fanning commented on SPARK-20871:
[~srowen] One of the main reasons for the Janino compile to fail
[
https://issues.apache.org/jira/browse/SPARK-20871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-20871:
---
Fix Version/s: 2.3.0
> Only log Janino code in debug mode
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-20871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-20871:
---
Component/s: (was: Spark Core)
SQL
> Only log Janino code in debug mode
>
[
https://issues.apache.org/jira/browse/SPARK-21438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-21438:
---
Issue Type: Sub-task (was: Task)
Parent: SPARK-14220
> Update to scalatest 3.x
>
PJ Fanning created SPARK-21438:
--
Summary: Update to scalatest 3.x
Key: SPARK-21438
URL: https://issues.apache.org/jira/browse/SPARK-21438
Project: Spark
Issue Type: Task
Components:
[
https://issues.apache.org/jira/browse/SPARK-20495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998435#comment-15998435
]
PJ Fanning commented on SPARK-20495:
Thanks everyone for working on this change. Is it too late to
PJ Fanning created SPARK-20539:
--
Summary: support optional dataframe name
Key: SPARK-20539
URL: https://issues.apache.org/jira/browse/SPARK-20539
Project: Spark
Issue Type: Improvement
PJ Fanning created SPARK-20458:
--
Summary: support getting Yarn Tracking URL in code
Key: SPARK-20458
URL: https://issues.apache.org/jira/browse/SPARK-20458
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-18896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15769991#comment-15769991
]
PJ Fanning commented on SPARK-18896:
I noticed from the pull request that you are looking at possibly
[
https://issues.apache.org/jira/browse/SPARK-16716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning closed SPARK-16716.
--
Resolution: Duplicate
This looks like it was fixed by SPARK-16664
> calling cache on joined dataframe
[
https://issues.apache.org/jira/browse/SPARK-16716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15419430#comment-15419430
]
PJ Fanning commented on SPARK-16716:
I set up an equivalent notebook for spark 2.0 in Databricks
PJ Fanning created SPARK-16716:
--
Summary: calling cache on joined dataframe can lead to data being
blanked
Key: SPARK-16716
URL: https://issues.apache.org/jira/browse/SPARK-16716
Project: Spark
PJ Fanning created SPARK-15615:
--
Summary: Support for creating a dataframe from JSON in
Dataset[String]
Key: SPARK-15615
URL: https://issues.apache.org/jira/browse/SPARK-15615
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-15463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-15463:
---
Summary: Support for creating a dataframe from CSV in Dataset[String]
(was: Support for creating a
[
https://issues.apache.org/jira/browse/SPARK-15463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299881#comment-15299881
]
PJ Fanning edited comment on SPARK-15463 at 5/25/16 11:09 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-15463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299881#comment-15299881
]
PJ Fanning commented on SPARK-15463:
Dataset[String] to DataFrame conversion seems fine to me
>
PJ Fanning created SPARK-15463:
--
Summary: Support for creating a dataframe from CSV in RDD[String]
Key: SPARK-15463
URL: https://issues.apache.org/jira/browse/SPARK-15463
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-15463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-15463:
---
Issue Type: Improvement (was: Bug)
> Support for creating a dataframe from CSV in RDD[String]
>
[
https://issues.apache.org/jira/browse/SPARK-12956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning closed SPARK-12956.
--
Resolution: Duplicate
> add spark.yarn.hdfs.home.directory property
>
[
https://issues.apache.org/jira/browse/SPARK-12956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223463#comment-15223463
]
PJ Fanning commented on SPARK-12956:
[~tgraves] I think you can close this as a duplicate of
PJ Fanning created SPARK-12956:
--
Summary: add spark.yarn.hdfs.home.directory property
Key: SPARK-12956
URL: https://issues.apache.org/jira/browse/SPARK-12956
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072697#comment-15072697
]
PJ Fanning commented on SPARK-8616:
---
Seems to duplicate the 'In Progress' task, SPARK-12437.
>
[
https://issues.apache.org/jira/browse/SPARK-11640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002537#comment-15002537
]
PJ Fanning commented on SPARK-11640:
[~sowen] Thanks - the hadoop-provided profile does lead to
[
https://issues.apache.org/jira/browse/SPARK-11640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-11640:
---
Issue Type: Wish (was: Bug)
> shading packages in spark-assembly jar
>
PJ Fanning created SPARK-11640:
--
Summary: shading packages in spark-assembly jar
Key: SPARK-11640
URL: https://issues.apache.org/jira/browse/SPARK-11640
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-8494:
--
Description:
I found a similar issue to SPARK-1923 but with Scala 2.10.4.
I used the Test.scala from
[
https://issues.apache.org/jira/browse/SPARK-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-8494:
--
Description:
I found a similar issue to SPARK-1923 but with Scala 2.10.4.
I used the Test.scala from
[
https://issues.apache.org/jira/browse/SPARK-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-8494:
--
Attachment: spark-test-case.zip
ClassNotFoundException when running with sbt, scala 2.10.4, spray
PJ Fanning created SPARK-8494:
-
Summary: ClassNotFoundException when running with sbt, scala
2.10.4, spray 1.3.3
Key: SPARK-8494
URL: https://issues.apache.org/jira/browse/SPARK-8494
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-8494:
--
Description:
I found a similar issue to SPARK-1923 but with Scala 2.10.4.
I used the Test.scala from
[
https://issues.apache.org/jira/browse/SPARK-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PJ Fanning updated SPARK-8494:
--
Description:
I found a similar issue to SPARK-1923 but with Scala 2.10.4.
I used the Test.scala from
[
https://issues.apache.org/jira/browse/SPARK-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594132#comment-14594132
]
PJ Fanning commented on SPARK-8494:
---
[~pwendell] Apologies about the JIRA being assigned
63 matches
Mail list logo