GitHub user yogidevendra opened a pull request:
https://github.com/apache/incubator-apex-malhar/pull/285
Making BytesFileOutputOperator under public scope.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/yogidevendra/incubator
GitHub user yogidevendra reopened a pull request:
https://github.com/apache/incubator-apex-malhar/pull/273
APEXMALHAR-2077 AbstractSingleFileOutputOperator appending partitionID
1. Renamed HDFSOutputOperator to BytesFileOutputOperator
2. Moved partitionID related logic into
Github user yogidevendra closed the pull request at:
https://github.com/apache/incubator-apex-malhar/pull/273
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user yogidevendra closed the pull request at:
https://github.com/apache/incubator-apex-malhar/pull/273
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
GitHub user yogidevendra reopened a pull request:
https://github.com/apache/incubator-apex-malhar/pull/273
APEXMALHAR-2077 AbstractSingleFileOutputOperator appending partitionID
1. Renamed HDFSOutputOperator to BytesFileOutputOperator
2. Moved partitionID related logic into
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/273#discussion_r63518655
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/AbstractSingleFileOutputOperator.java
---
@@ -39,10 +43,42 @@
@NotNull
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/273#discussion_r63352546
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/AbstractSingleFileOutputOperator.java
---
@@ -39,10 +41,37 @@
@NotNull
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/273#discussion_r63352405
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/AbstractSingleFileOutputOperator.java
---
@@ -39,10 +41,37 @@
@NotNull
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/273#discussion_r63321660
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/AbstractSingleFileOutputOperator.java
---
@@ -39,10 +41,37 @@
@NotNull
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/273#discussion_r63314787
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/AbstractSingleFileOutputOperator.java
---
@@ -52,6 +81,7 @@ protected String
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/273#discussion_r63314771
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/AbstractSingleFileOutputOperator.java
---
@@ -52,6 +81,7 @@ protected String
GitHub user yogidevendra opened a pull request:
https://github.com/apache/incubator-apex-malhar/pull/273
APEXMALHAR-2077 AbstractSingleFileOutputOperator appending partitionID
1. Renamed HDFSOutputOperator to BytesFileOutputOperator
2. Moved partitionID related logic into
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/263#discussion_r61708375
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/S3FileSplitter.java ---
@@ -0,0 +1,56 @@
+/**
+ * Licensed to the
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/263#discussion_r61708028
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/S3FileSplitter.java ---
@@ -0,0 +1,56 @@
+/**
+ * Licensed to the
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/263#discussion_r61707966
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/S3BlockReader.java ---
@@ -0,0 +1,89 @@
+/**
+ * Licensed to the
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/263#discussion_r61707948
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/S3BlockReader.java ---
@@ -0,0 +1,89 @@
+/**
+ * Licensed to the
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/233#discussion_r60865659
--- Diff:
library/src/test/java/com/datatorrent/lib/io/fs/HDFSOutputOperatorTest.java ---
@@ -0,0 +1,113 @@
+/**
+ * Licensed to
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/249#discussion_r60455994
--- Diff: pom.xml ---
@@ -75,6 +75,13 @@
+ org.apache.maven.plugins
GitHub user yogidevendra opened a pull request:
https://github.com/apache/incubator-apex-malhar/pull/249
APEXMALHAR-2061 fixing travis build failures
1. Restricting memory for surefire plugin
You can merge this pull request into a Git repository by running:
$ git pull https
GitHub user yogidevendra reopened a pull request:
https://github.com/apache/incubator-apex-malhar/pull/216
APEXMALHAR-2013 : HDFS output module for file copy
1. Added operators required for file copy
2. Added junit tests
3. Added sample app for HDFS to HDFS file copy app
Github user yogidevendra closed the pull request at:
https://github.com/apache/incubator-apex-malhar/pull/216
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
GitHub user yogidevendra reopened a pull request:
https://github.com/apache/incubator-apex-malhar/pull/216
APEXMALHAR-2013 : HDFS output module for file copy
1. Added operators required for file copy
2. Added junit tests
3. Added sample app for HDFS to HDFS file copy app
Github user yogidevendra closed the pull request at:
https://github.com/apache/incubator-apex-malhar/pull/216
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
GitHub user yogidevendra opened a pull request:
https://github.com/apache/incubator-apex-malhar/pull/233
Added concrete implementation for HDFS output operator with unit tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com
Github user yogidevendra closed the pull request at:
https://github.com/apache/incubator-apex-malhar/pull/216
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
GitHub user yogidevendra reopened a pull request:
https://github.com/apache/incubator-apex-malhar/pull/216
APEXMALHAR-2013 : HDFS output module for file copy
1. Added operators required for file copy
2. Added junit tests
3. Added sample app for HDFS to HDFS file copy app
GitHub user yogidevendra reopened a pull request:
https://github.com/apache/incubator-apex-malhar/pull/216
APEXMALHAR-2013 : HDFS output module for file copy
1. Added operators required for file copy
2. Added junit tests
3. Added sample app for HDFS to HDFS file copy app
Github user yogidevendra closed the pull request at:
https://github.com/apache/incubator-apex-malhar/pull/216
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user yogidevendra closed the pull request at:
https://github.com/apache/incubator-apex-malhar/pull/216
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
GitHub user yogidevendra reopened a pull request:
https://github.com/apache/incubator-apex-malhar/pull/216
APEXMALHAR-2013 : HDFS output module for file copy
1. Added operators required for file copy
2. Added junit tests
3. Added sample app for HDFS to HDFS file copy app
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/216#discussion_r57190169
--- Diff: library/src/main/java/com/datatorrent/lib/io/fs/BlockWriter.java
---
@@ -0,0 +1,210 @@
+/**
+ * Licensed to the Apache
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/216#discussion_r56983061
--- Diff: library/src/main/java/com/datatorrent/lib/io/fs/FileStitcher.java
---
@@ -0,0 +1,408 @@
+/**
+ * Licensed to the
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/216#discussion_r56982569
--- Diff: library/src/main/java/com/datatorrent/lib/io/fs/FileMerger.java
---
@@ -0,0 +1,161 @@
+/**
+ * Licensed to the Apache
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/216#discussion_r56794075
--- Diff:
library/src/test/java/com/datatorrent/lib/io/fs/FastMergerDecisionMakerTest.java
---
@@ -0,0 +1,188
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/216#discussion_r56786810
--- Diff: library/src/main/java/com/datatorrent/lib/io/fs/Synchronizer.java
---
@@ -0,0 +1,373 @@
+/**
+ * Licensed to the
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/216#discussion_r56786779
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/HDFSFileMerger.java ---
@@ -0,0 +1,218 @@
+/**
+ * Licensed to the
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/216#discussion_r56786263
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/HDFSFileCopyModule.java ---
@@ -0,0 +1,123 @@
+/**
+ * Licensed to the
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/216#discussion_r56784818
--- Diff: library/src/main/java/com/datatorrent/lib/io/fs/BlockWriter.java
---
@@ -0,0 +1,210 @@
+/**
+ * Licensed to the Apache
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/216#discussion_r56784713
--- Diff: library/src/main/java/com/datatorrent/lib/io/fs/BlockWriter.java
---
@@ -0,0 +1,210 @@
+/**
+ * Licensed to the Apache
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/213#discussion_r56784572
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/AbstractFileSplitter.java ---
@@ -365,6 +365,16 @@ public FileMetadata
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/216#discussion_r56784591
--- Diff:
apps/filecopy/src/main/java/com/datatorrent/apps/copy/HDFSFileCopySampleApp.java
---
@@ -0,0 +1,50
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/213#discussion_r56783660
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/AbstractFileSplitter.java ---
@@ -365,6 +365,16 @@ public FileMetadata
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/213#discussion_r56783614
--- Diff: apps/filecopy/src/site/conf/app-conf.xml ---
@@ -0,0 +1,27
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/213#discussion_r56783606
--- Diff: apps/filecopy/src/site/conf/app-conf.xml ---
@@ -0,0 +1,27
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/213#discussion_r56783574
--- Diff:
apps/filecopy/src/main/java/com/datatorrent/modules/app/HDFSFileCopySampleApp.java
---
@@ -0,0 +1,50
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/213#discussion_r56783001
--- Diff:
apps/filecopy/src/main/java/com/datatorrent/modules/app/HDFSFileCopySampleApp.java
---
@@ -0,0 +1,50
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/213#discussion_r56782919
--- Diff: apps/filecopy/src/assemble/appPackage.xml ---
@@ -0,0 +1,65 @@
+
+http://maven.apache.org/plugins/maven-assembly-plugin
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/213#discussion_r56782890
--- Diff: apps/filecopy/pom.xml ---
@@ -0,0 +1,106 @@
+
+
+http://maven.apache.org/POM/4.0.0";
xmlns:xsi="http://
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/213#discussion_r56782832
--- Diff: apps/filecopy/pom.xml ---
@@ -0,0 +1,106 @@
+
+
+http://maven.apache.org/POM/4.0.0";
xmlns:xsi="http://
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/213#discussion_r56782614
--- Diff: apps/filecopy/pom.xml ---
@@ -0,0 +1,106 @@
+
+
+http://maven.apache.org/POM/4.0.0";
xmlns:xsi="http://
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/213#discussion_r56782603
--- Diff: apps/filecopy/pom.xml ---
@@ -0,0 +1,106 @@
+
+
+http://maven.apache.org/POM/4.0.0";
xmlns:xsi="http://
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/213#discussion_r56782544
--- Diff: apps/filecopy/.gitignore ---
@@ -0,0 +1 @@
+/target/
--- End diff --
Removed this file. parent .gitignore will
GitHub user yogidevendra opened a pull request:
https://github.com/apache/incubator-apex-malhar/pull/213
Apexmalhar 2013 hdfs file copy module
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/yogidevendra/incubator-apex-malhar
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/217#discussion_r56648250
--- Diff:
library/src/test/java/com/datatorrent/lib/projection/ActivateTest.java ---
@@ -0,0 +1,147 @@
+/**
+ * Licensed to the
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/217#discussion_r56650591
--- Diff:
library/src/test/java/com/datatorrent/lib/projection/ProjectionTest.java ---
@@ -0,0 +1,264 @@
+/**
+ * Licensed to
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/217#discussion_r56641705
--- Diff:
library/src/main/java/com/datatorrent/lib/projection/ProjectionOperator.java ---
@@ -0,0 +1,303 @@
+/**
+ * Licensed
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/217#discussion_r56645753
--- Diff:
library/src/main/java/com/datatorrent/lib/projection/ProjectionOperator.java ---
@@ -0,0 +1,303 @@
+/**
+ * Licensed
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/217#discussion_r56649265
--- Diff:
library/src/test/java/com/datatorrent/lib/projection/ProjectionTest.java ---
@@ -0,0 +1,264 @@
+/**
+ * Licensed to
Github user yogidevendra closed the pull request at:
https://github.com/apache/incubator-apex-malhar/pull/213
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/217#discussion_r56642093
--- Diff:
library/src/main/java/com/datatorrent/lib/projection/ProjectionOperator.java ---
@@ -0,0 +1,303 @@
+/**
+ * Licensed
GitHub user yogidevendra opened a pull request:
https://github.com/apache/incubator-apex-malhar/pull/216
APEXMALHAR-2013 : HDFS output module for file copy
1. Added operators required for file copy
2. Added junit tests
3. Added sample app for HDFS to HDFS file copy app
You
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/217#discussion_r56648841
--- Diff:
library/src/test/java/com/datatorrent/lib/projection/DummyProjection.java ---
@@ -0,0 +1,33 @@
+/**
+ * Licensed to
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55635731
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/HDFSInputModule.java ---
@@ -0,0 +1,236 @@
+/**
+ * Licensed to the
Github user yogidevendra commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55525483
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/HDFSInputModule.java ---
@@ -0,0 +1,236 @@
+/**
+ * Licensed to the
GitHub user yogidevendra opened a pull request:
https://github.com/apache/incubator-apex-malhar/pull/149
MLHR-1958: Exposing some fields from AbstractReconciler as protected
1. Making queues as protected for access in derived classes.
You can merge this pull request into a Git
65 matches
Mail list logo
