Flume NG with Eclipse Indigo Service Release 1

[Vibul Imtarnasan]

Hi,

I'm new to Flume NG and am starting to familiarizing myself with the code
using https://cwiki.apache.org/FLUME/getting-started.html.

I am using Eclipse Indigo Service Release 1 and imported the maven project.

I found that I had to add the following to flume-core pom.xml to get
m2eclipse plugin working (note that running "mvn package"
outside eclipse works fine).

  <build>
    <pluginManagement>
      <plugins>
        <plugin>
          <groupId>org.eclipse.m2e</groupId>
          <artifactId>lifecycle-mapping</artifactId>
          <version>1.0.0</version>
          <configuration>
            <lifecycleMappingMetadata>
              <pluginExecutions>
                <pluginExecution>
                  <pluginExecutionFilter>
                    <groupId>org.apache.thrift.tools</groupId>
                    <artifactId>maven-thrift-plugin</artifactId>
                    <versionRange>[0.1.10,)</versionRange>
                    <goals>
                      <goal>compile</goal>
                      <goal>testCompile</goal>
                    </goals>
                  </pluginExecutionFilter>
                  <action>
                    <execute >
                      <runOnIncremental>false</runOnIncremental>
                    </execute >
                  </action>
                </pluginExecution>
                <pluginExecution>
                  <pluginExecutionFilter>
                    <groupId>org.apache.avro</groupId>
                    <artifactId>avro-maven-plugin</artifactId>
                    <versionRange>[1.5.1,)</versionRange>
                    <goals>
                      <goal>idl-protocol</goal>
                    </goals>
                  </pluginExecutionFilter>
                  <action>
                    <execute >
                      <runOnIncremental>false</runOnIncremental>
                    </execute >
                  </action>
                </pluginExecution>
                <pluginExecution>
                  <pluginExecutionFilter>
                    <groupId>com.thoughtworks.paranamer</groupId>
                    <artifactId>paranamer-maven-plugin</artifactId>
                    <versionRange>[2.3,)</versionRange>
                    <goals>
                      <goal>generate</goal>
                    </goals>
                  </pluginExecutionFilter>
                  <action>
                    <execute >
                      <runOnIncremental>false</runOnIncremental>
                    </execute >
                  </action>
                </pluginExecution>
              </pluginExecutions>
            </lifecycleMappingMetadata>
          </configuration>
        </plugin>
      </plugins>
    </pluginManagement>

    <plugins>
       ...
    </plugins>

    ...
</build>

I also had to add target/generated-sources/arvo in flume-ng-core as a
source path.


Now for a couple of questions...

*Question 1*
Just wondering what IDE other developers are using for Flume NG?


*Question 2*
I noted that the hdfs sink requires a "timestamp" event header.

Should the timestamp property be a standard part of an event? i.e.
implemented as part of Event/SimpleEvent?





Thanks

Regards
Vibul