[jira] [Commented] (MAHOUT-1354) Mahout Support for Hadoop 2
[
https://issues.apache.org/jira/browse/MAHOUT-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13974377#comment-13974377
]
Konstantin Boudnik commented on MAHOUT-1354:
BTW, this code {{+ hadoop-core}} is breaking
the build on hadoop 2, because {{hadoop-core}} artifact doesn't exist anymore
> Mahout Support for Hadoop 2
>
>
> Key: MAHOUT-1354
> URL: https://issues.apache.org/jira/browse/MAHOUT-1354
> Project: Mahout
> Issue Type: Improvement
>Affects Versions: 0.8
>Reporter: Suneel Marthi
>Assignee: Suneel Marthi
> Fix For: 1.0
>
> Attachments: MAHOUT-1354_initial.patch
>
>
> Mahout support for Hadoop , now that Hadoop 2 is official.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (MAHOUT-1354) Mahout Support for Hadoop 2
[ https://issues.apache.org/jira/browse/MAHOUT-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850613#comment-13850613 ] Sergey Svinarchuk commented on MAHOUT-1354: --- In ticket https://issues.apache.org/jira/browse/MAHOUT-1329 was updated patch that include changes for support hadoop 2 > Mahout Support for Hadoop 2 > > > Key: MAHOUT-1354 > URL: https://issues.apache.org/jira/browse/MAHOUT-1354 > Project: Mahout > Issue Type: Improvement >Affects Versions: 0.8 >Reporter: Suneel Marthi >Assignee: Suneel Marthi > Fix For: 1.0 > > Attachments: MAHOUT-1354_initial.patch > > > Mahout support for Hadoop , now that Hadoop 2 is official. -- This message was sent by Atlassian JIRA (v6.1.4#6159)
[jira] [Commented] (MAHOUT-1354) Mahout Support for Hadoop 2
[ https://issues.apache.org/jira/browse/MAHOUT-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13843226#comment-13843226 ] Gokhan Capan commented on MAHOUT-1354: -- Yeah, I agree > Mahout Support for Hadoop 2 > > > Key: MAHOUT-1354 > URL: https://issues.apache.org/jira/browse/MAHOUT-1354 > Project: Mahout > Issue Type: Improvement >Affects Versions: 0.8 >Reporter: Suneel Marthi >Assignee: Suneel Marthi > Fix For: 1.0 > > Attachments: MAHOUT-1354_initial.patch > > > Mahout support for Hadoop , now that Hadoop 2 is official. -- This message was sent by Atlassian JIRA (v6.1.4#6159)
[jira] [Commented] (MAHOUT-1354) Mahout Support for Hadoop 2
[ https://issues.apache.org/jira/browse/MAHOUT-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13843216#comment-13843216 ] Ted Dunning commented on MAHOUT-1354: - It is important to keep modules like mahout math free of the massive Hadoop dependency. > Mahout Support for Hadoop 2 > > > Key: MAHOUT-1354 > URL: https://issues.apache.org/jira/browse/MAHOUT-1354 > Project: Mahout > Issue Type: Improvement >Affects Versions: 0.8 >Reporter: Suneel Marthi >Assignee: Suneel Marthi > Fix For: 1.0 > > Attachments: MAHOUT-1354_initial.patch > > > Mahout support for Hadoop , now that Hadoop 2 is official. -- This message was sent by Atlassian JIRA (v6.1.4#6159)
[jira] [Commented] (MAHOUT-1354) Mahout Support for Hadoop 2
[ https://issues.apache.org/jira/browse/MAHOUT-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13842960#comment-13842960 ] Gokhan Capan commented on MAHOUT-1354: -- Looks like when hadoop-2 profile is activated, this patch fails to apply the hadoop-2 related dependencies to integration and examples modules, despite they are both dependent to core and core is dependent to hadoop-2. For me, moving hadoop dependencies to the root solved the problem, but I think we wouldn't want that since hadoop is not a common dependency for all modules of the project. CC'ing [~frankscholten] > Mahout Support for Hadoop 2 > > > Key: MAHOUT-1354 > URL: https://issues.apache.org/jira/browse/MAHOUT-1354 > Project: Mahout > Issue Type: Improvement >Affects Versions: 0.8 >Reporter: Suneel Marthi >Assignee: Suneel Marthi > Fix For: 1.0 > > Attachments: MAHOUT-1354_initial.patch > > > Mahout support for Hadoop , now that Hadoop 2 is official. -- This message was sent by Atlassian JIRA (v6.1.4#6159)
[jira] [Commented] (MAHOUT-1354) Mahout Support for Hadoop 2
[ https://issues.apache.org/jira/browse/MAHOUT-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13838418#comment-13838418 ] Suneel Marthi commented on MAHOUT-1354: --- Tested the patch on Hadoop 1.2.1 and worked fine for me. > Mahout Support for Hadoop 2 > > > Key: MAHOUT-1354 > URL: https://issues.apache.org/jira/browse/MAHOUT-1354 > Project: Mahout > Issue Type: Improvement >Affects Versions: 0.8 >Reporter: Suneel Marthi >Assignee: Suneel Marthi > Fix For: 1.0 > > Attachments: MAHOUT-1354_initial.patch > > > Mahout support for Hadoop , now that Hadoop 2 is official. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (MAHOUT-1354) Mahout Support for Hadoop 2
[ https://issues.apache.org/jira/browse/MAHOUT-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13837933#comment-13837933 ] Gokhan Capan commented on MAHOUT-1354: -- Today I had some troubles with integration's transitive dependencies, let me dig further. So this still should stay in 1.0 queue > Mahout Support for Hadoop 2 > > > Key: MAHOUT-1354 > URL: https://issues.apache.org/jira/browse/MAHOUT-1354 > Project: Mahout > Issue Type: Improvement >Affects Versions: 0.8 >Reporter: Suneel Marthi >Assignee: Suneel Marthi > Fix For: 1.0 > > > Mahout support for Hadoop , now that Hadoop 2 is official. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (MAHOUT-1354) Mahout Support for Hadoop 2
[ https://issues.apache.org/jira/browse/MAHOUT-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13836965#comment-13836965 ] Gokhan Capan commented on MAHOUT-1354: -- Let me submit a patch first, probably tomorrow. Best > Mahout Support for Hadoop 2 > > > Key: MAHOUT-1354 > URL: https://issues.apache.org/jira/browse/MAHOUT-1354 > Project: Mahout > Issue Type: Improvement >Affects Versions: 0.8 >Reporter: Suneel Marthi >Assignee: Suneel Marthi > Fix For: 1.0 > > > Mahout support for Hadoop , now that Hadoop 2 is official. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (MAHOUT-1354) Mahout Support for Hadoop 2
[ https://issues.apache.org/jira/browse/MAHOUT-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13836961#comment-13836961 ] Suneel Marthi commented on MAHOUT-1354: --- Gokhan, please feel free to assign this to yourself and bring it to 0.9 Release queue if u think its feasible. > Mahout Support for Hadoop 2 > > > Key: MAHOUT-1354 > URL: https://issues.apache.org/jira/browse/MAHOUT-1354 > Project: Mahout > Issue Type: Improvement >Affects Versions: 0.8 >Reporter: Suneel Marthi >Assignee: Suneel Marthi > Fix For: 1.0 > > > Mahout support for Hadoop , now that Hadoop 2 is official. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (MAHOUT-1354) Mahout Support for Hadoop 2
[ https://issues.apache.org/jira/browse/MAHOUT-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13836953#comment-13836953 ] Gokhan Capan commented on MAHOUT-1354: -- Well, I tried something and want to share. Based on: In hadoop-2-stable, compatibility with hadoop-1 is preferred over with hadoop-2-alpha (http://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduce_Compatibility_Hadoop1_Hadoop2.html). For example, return type for ProgramDriver#driver(String) was void in hadoop-1 (which we use in MahoutDriver), int in hadoop-2-alpha, void again in hadoop-2-stable. It seems if we select the right artifacts, there is nothing to worry about the compatibility. My conclusion was: The current hadoop-0.20 and hadoop-0.23 profiles can be utilized: we can rename them to hadoop-1 and hadoop-2, respectively, then make hadoop-2 (stable) the default profile, then set the hadoop.version property to 2.2.0. We need to worry about some third party dependencies though, for instance, hbase-client in mahout-integration is dependent to hadoop-1 (for that particular artifact, simply excluding hadoop-core did not break any tests, by the way). > Mahout Support for Hadoop 2 > > > Key: MAHOUT-1354 > URL: https://issues.apache.org/jira/browse/MAHOUT-1354 > Project: Mahout > Issue Type: Improvement >Affects Versions: 0.8 >Reporter: Suneel Marthi >Assignee: Suneel Marthi > Fix For: 1.0 > > > Mahout support for Hadoop , now that Hadoop 2 is official. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (MAHOUT-1354) Mahout Support for Hadoop 2
[ https://issues.apache.org/jira/browse/MAHOUT-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13836697#comment-13836697 ] Suneel Marthi commented on MAHOUT-1354: --- Yes, we should. > Mahout Support for Hadoop 2 > > > Key: MAHOUT-1354 > URL: https://issues.apache.org/jira/browse/MAHOUT-1354 > Project: Mahout > Issue Type: Improvement >Affects Versions: 0.8 >Reporter: Suneel Marthi >Assignee: Suneel Marthi > Fix For: 1.0 > > > Mahout support for Hadoop , now that Hadoop 2 is official. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (MAHOUT-1354) Mahout Support for Hadoop 2
[ https://issues.apache.org/jira/browse/MAHOUT-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13836661#comment-13836661 ] Gokhan Capan commented on MAHOUT-1354: -- Do you think we should support hadoop-1 and hadoop-2 at the same time? > Mahout Support for Hadoop 2 > > > Key: MAHOUT-1354 > URL: https://issues.apache.org/jira/browse/MAHOUT-1354 > Project: Mahout > Issue Type: Improvement >Affects Versions: 0.8 >Reporter: Suneel Marthi >Assignee: Suneel Marthi > Fix For: 1.0 > > > Mahout support for Hadoop , now that Hadoop 2 is official. -- This message was sent by Atlassian JIRA (v6.1#6144)
