[jira] [Issue Comment Edited] (WHIRR-582) Yarn service does not build in IntelliJ because of missing Hadoop test dependencies

[Frank Scholten (Issue Comment Edited) (JIRA)]

    [ 
https://issues.apache.org/jira/browse/WHIRR-582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13254381#comment-13254381
 ] 

Frank Scholten edited comment on WHIRR-582 at 4/15/12 5:50 PM:
---------------------------------------------------------------

The following imports cannot be found in AbstractHadoopServiceTest:

{noformat}
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.FSDataInputStream;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.LongWritable;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.mapred.FileInputFormat;
import org.apache.hadoop.mapred.FileOutputFormat;
import org.apache.hadoop.mapred.JobClient;
import org.apache.hadoop.mapred.JobConf;
import org.apache.hadoop.mapred.lib.LongSumReducer;
import org.apache.hadoop.mapred.lib.TokenCountMapper;
{noformat} 

And these imports cannot be found in HadoopServiceController:

{noformat} 
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.hdfs.DistributedFileSystem;
import org.apache.hadoop.hdfs.protocol.FSConstants;
import org.apache.hadoop.mapred.ClusterStatus;
import org.apache.hadoop.mapred.JobClient;
import org.apache.hadoop.mapred.JobConf;
{noformat} 

The yarn pom contains 

{noformat}
    <dependency>
      <groupId>org.apache.hadoop</groupId>
      <artifactId>hadoop-client</artifactId>
      <version>0.23.1</version>
      <scope>test</scope>
    </dependency>
{noformat} 

Which Hadoop dependencies are needed here?
                
      was (Author: frankscholten):
    The following imports cannot be found in AbstractHadoopServiceTest:

import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.FSDataInputStream;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.LongWritable;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.mapred.FileInputFormat;
import org.apache.hadoop.mapred.FileOutputFormat;
import org.apache.hadoop.mapred.JobClient;
import org.apache.hadoop.mapred.JobConf;
import org.apache.hadoop.mapred.lib.LongSumReducer;
import org.apache.hadoop.mapred.lib.TokenCountMapper;

And these imports cannot be found in HadoopServiceController:

import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.hdfs.DistributedFileSystem;
import org.apache.hadoop.hdfs.protocol.FSConstants;
import org.apache.hadoop.mapred.ClusterStatus;
import org.apache.hadoop.mapred.JobClient;
import org.apache.hadoop.mapred.JobConf;

The yarn pom contains 

    <dependency>
      <groupId>org.apache.hadoop</groupId>
      <artifactId>hadoop-client</artifactId>
      <version>0.23.1</version>
      <scope>test</scope>
    </dependency>

Which Hadoop dependencies are needed here?
                  
> Yarn service does not build in IntelliJ because of missing Hadoop test 
> dependencies
> -----------------------------------------------------------------------------------
>
>                 Key: WHIRR-582
>                 URL: https://issues.apache.org/jira/browse/WHIRR-582
>             Project: Whirr
>          Issue Type: Bug
>            Reporter: Frank Scholten
>
> This is related to the recent mailinglist discussion about problem with Yarn, 
> Hadoop versions and Maven 3.
> I can't build the project in IntelliJ as the Yarn service misses dependencies 
> on all sorts of Hadoop classes. A mvn clean install from the command line 
> does work however.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira