[jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl
[
https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260291#comment-14260291
]
Apache Spark commented on SPARK-3955:
-
User 'srowen' has created a pull request for this issue:
https://github.com/apache/spark/pull/3829
Different versions between jackson-mapper-asl and jackson-core-asl
--
Key: SPARK-3955
URL: https://issues.apache.org/jira/browse/SPARK-3955
Project: Spark
Issue Type: Bug
Components: Build, Spark Core, SQL
Affects Versions: 1.1.0
Reporter: Jongyoul Lee
Assignee: Jongyoul Lee
Fix For: 1.3.0
In the parent pom.xml, specified a version of jackson-mapper-asl. This is
used by sql/hive/pom.xml. When mvn assembly runs, however, jackson-mapper-asl
is not same as jackson-core-asl. This is because other libraries use several
versions of jackson, so other version of jackson-core-asl is assembled.
Simply, fix this problem if pom.xml has a specific version information of
jackson-core-asl. If it's not set, a version 1.9.11 is merged info
assembly.jar and we cannot use jackson library properly.
{code}
[INFO] Including org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 in the
shaded jar.
[INFO] Including org.codehaus.jackson:jackson-core-asl:jar:1.9.11 in the
shaded jar.
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl
[
https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14248176#comment-14248176
]
Sean Owen commented on SPARK-3955:
--
[~jongyoul] That PR was never merged though:
https://github.com/apache/spark/pull/3379
You closed yours too: https://github.com/apache/spark/pull/2818
I don't think this is resolved.
Different versions between jackson-mapper-asl and jackson-core-asl
--
Key: SPARK-3955
URL: https://issues.apache.org/jira/browse/SPARK-3955
Project: Spark
Issue Type: Bug
Components: Build, Spark Core, SQL
Affects Versions: 1.1.0
Reporter: Jongyoul Lee
In the parent pom.xml, specified a version of jackson-mapper-asl. This is
used by sql/hive/pom.xml. When mvn assembly runs, however, jackson-mapper-asl
is not same as jackson-core-asl. This is because other libraries use several
versions of jackson, so other version of jackson-core-asl is assembled.
Simply, fix this problem if pom.xml has a specific version information of
jackson-core-asl. If it's not set, a version 1.9.11 is merged info
assembly.jar and we cannot use jackson library properly.
{code}
[INFO] Including org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 in the
shaded jar.
[INFO] Including org.codehaus.jackson:jackson-core-asl:jar:1.9.11 in the
shaded jar.
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl
[
https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14249369#comment-14249369
]
Apache Spark commented on SPARK-3955:
-
User 'jongyoul' has created a pull request for this issue:
https://github.com/apache/spark/pull/3716
Different versions between jackson-mapper-asl and jackson-core-asl
--
Key: SPARK-3955
URL: https://issues.apache.org/jira/browse/SPARK-3955
Project: Spark
Issue Type: Bug
Components: Build, Spark Core, SQL
Affects Versions: 1.1.0
Reporter: Jongyoul Lee
In the parent pom.xml, specified a version of jackson-mapper-asl. This is
used by sql/hive/pom.xml. When mvn assembly runs, however, jackson-mapper-asl
is not same as jackson-core-asl. This is because other libraries use several
versions of jackson, so other version of jackson-core-asl is assembled.
Simply, fix this problem if pom.xml has a specific version information of
jackson-core-asl. If it's not set, a version 1.9.11 is merged info
assembly.jar and we cannot use jackson library properly.
{code}
[INFO] Including org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 in the
shaded jar.
[INFO] Including org.codehaus.jackson:jackson-core-asl:jar:1.9.11 in the
shaded jar.
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl
[
https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178292#comment-14178292
]
Jeroen van Wilgenburg commented on SPARK-3955:
--
Is it possible to include the latest version (1.9.13) of jackson for both
jackson-core-asl and jackson-mapper-asl? Version 1.8.8 is pretty old (january
2012). We're having some issues with methods that are available in 1.9.x and
not in 1.8.x.
I think parquet-hadoop includes the old jar, when you do a
{{mvn dependency:tree -Dincludes=org.codehaus.jackson}}
on the assembly project it shows this tree (we are compiling with Hadoop 2.5.1,
Yarn and the Hadoop 2.4 profile) :
{noformat}
[INFO] --- maven-dependency-plugin:2.8:tree (default-cli) @ spark-assembly_2.10
---
[INFO] org.apache.spark:spark-assembly_2.10:pom:1.1.0
[INFO] \- org.apache.spark:spark-sql_2.10:jar:1.1.0:compile
[INFO]\- com.twitter:parquet-hadoop:jar:1.4.3:compile
[INFO] +- org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8:compile
[INFO] \- org.codehaus.jackson:jackson-core-asl:jar:1.9.11:compile
{noformat}
Different versions between jackson-mapper-asl and jackson-core-asl
--
Key: SPARK-3955
URL: https://issues.apache.org/jira/browse/SPARK-3955
Project: Spark
Issue Type: Bug
Components: Spark Core, SQL
Affects Versions: 1.1.0
Reporter: Jongyoul Lee
In the parent pom.xml, specified a version of jackson-mapper-asl. This is
used by sql/hive/pom.xml. When mvn assembly runs, however, jackson-mapper-asl
is not same as jackson-core-asl. This is because other libraries use several
versions of jackson, so other version of jackson-core-asl is assembled.
Simply, fix this problem if pom.xml has a specific version information of
jackson-core-asl. If it's not set, a version 1.9.11 is merged info
assembly.jar and we cannot use jackson library properly.
{code}
[INFO] Including org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 in the
shaded jar.
[INFO] Including org.codehaus.jackson:jackson-core-asl:jar:1.9.11 in the
shaded jar.
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl
[
https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178294#comment-14178294
]
Sean Owen commented on SPARK-3955:
--
I think the issue is matching the version used by Hadoop. Your usage of Jackson
shouldn't affect what Spark uses, but I imagine you're saying this is a case of
dependency leakage?
Different versions between jackson-mapper-asl and jackson-core-asl
--
Key: SPARK-3955
URL: https://issues.apache.org/jira/browse/SPARK-3955
Project: Spark
Issue Type: Bug
Components: Spark Core, SQL
Affects Versions: 1.1.0
Reporter: Jongyoul Lee
In the parent pom.xml, specified a version of jackson-mapper-asl. This is
used by sql/hive/pom.xml. When mvn assembly runs, however, jackson-mapper-asl
is not same as jackson-core-asl. This is because other libraries use several
versions of jackson, so other version of jackson-core-asl is assembled.
Simply, fix this problem if pom.xml has a specific version information of
jackson-core-asl. If it's not set, a version 1.9.11 is merged info
assembly.jar and we cannot use jackson library properly.
{code}
[INFO] Including org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 in the
shaded jar.
[INFO] Including org.codehaus.jackson:jackson-core-asl:jar:1.9.11 in the
shaded jar.
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl
[
https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178313#comment-14178313
]
Jeroen van Wilgenburg commented on SPARK-3955:
--
Is is indeed a dependency leakage. I have a few suggestions/options :
- 1) mark the dependency of jackson as provided, since it is included in
Hadoop,
- 2) Add a dependency for mapper and core with version 1.9.x so the version
1.8.8 of parquet-hadoop is overridden.
- 3) Upgrade parquet-hadoop, there is a newer version with a dependency to
jackson 1.9.11
Different versions between jackson-mapper-asl and jackson-core-asl
--
Key: SPARK-3955
URL: https://issues.apache.org/jira/browse/SPARK-3955
Project: Spark
Issue Type: Bug
Components: Spark Core, SQL
Affects Versions: 1.1.0
Reporter: Jongyoul Lee
In the parent pom.xml, specified a version of jackson-mapper-asl. This is
used by sql/hive/pom.xml. When mvn assembly runs, however, jackson-mapper-asl
is not same as jackson-core-asl. This is because other libraries use several
versions of jackson, so other version of jackson-core-asl is assembled.
Simply, fix this problem if pom.xml has a specific version information of
jackson-core-asl. If it's not set, a version 1.9.11 is merged info
assembly.jar and we cannot use jackson library properly.
{code}
[INFO] Including org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 in the
shaded jar.
[INFO] Including org.codehaus.jackson:jackson-core-asl:jar:1.9.11 in the
shaded jar.
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl
[
https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14172148#comment-14172148
]
Sean Owen commented on SPARK-3955:
--
Looks like Jackson is managed to version 1.8.8 for Avro reasons. I think core
just needs to be managed the same way. I'll try it locally to make sure that
works.
Different versions between jackson-mapper-asl and jackson-core-asl
--
Key: SPARK-3955
URL: https://issues.apache.org/jira/browse/SPARK-3955
Project: Spark
Issue Type: Bug
Components: Spark Core, SQL
Affects Versions: 1.1.0
Reporter: Jongyoul Lee
In the parent pom.xml, specified a version of jackson-mapper-asl. This is
used by sql/hive/pom.xml. When mvn assembly runs, however, jackson-mapper-asl
is not same as jackson-core-asl. This is because other libraries use several
versions of jackson, so other version of jackson-core-asl is assembled.
Simply, fix this problem if pom.xml has a specific version information of
jackson-core-asl. If it's not set, a version 1.9.11 is merged info
assembly.jar and we cannot use jackson library properly.
{code}
[INFO] Including org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 in the
shaded jar.
[INFO] Including org.codehaus.jackson:jackson-core-asl:jar:1.9.11 in the
shaded jar.
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl
[
https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14173166#comment-14173166
]
Apache Spark commented on SPARK-3955:
-
User 'jongyoul' has created a pull request for this issue:
https://github.com/apache/spark/pull/2818
Different versions between jackson-mapper-asl and jackson-core-asl
--
Key: SPARK-3955
URL: https://issues.apache.org/jira/browse/SPARK-3955
Project: Spark
Issue Type: Bug
Components: Spark Core, SQL
Affects Versions: 1.1.0
Reporter: Jongyoul Lee
In the parent pom.xml, specified a version of jackson-mapper-asl. This is
used by sql/hive/pom.xml. When mvn assembly runs, however, jackson-mapper-asl
is not same as jackson-core-asl. This is because other libraries use several
versions of jackson, so other version of jackson-core-asl is assembled.
Simply, fix this problem if pom.xml has a specific version information of
jackson-core-asl. If it's not set, a version 1.9.11 is merged info
assembly.jar and we cannot use jackson library properly.
{code}
[INFO] Including org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 in the
shaded jar.
[INFO] Including org.codehaus.jackson:jackson-core-asl:jar:1.9.11 in the
shaded jar.
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
