[1/4] incubator-nifi git commit: NIFI-656-RC1 prepare release nifi-0.2.0-incubating-RC1
Repository: incubator-nifi Updated Branches: refs/heads/release-nifi-0.2.0-incubating-rc1 [created] fbd0a9f24 http://git-wip-us.apache.org/repos/asf/incubator-nifi/blob/19bdb172/nifi/nifi-nar-bundles/nifi-hl7-bundle/nifi-hl7-processors/pom.xml -- diff --git a/nifi/nifi-nar-bundles/nifi-hl7-bundle/nifi-hl7-processors/pom.xml b/nifi/nifi-nar-bundles/nifi-hl7-bundle/nifi-hl7-processors/pom.xml index 12d2d71..575e3b4 100644 --- a/nifi/nifi-nar-bundles/nifi-hl7-bundle/nifi-hl7-processors/pom.xml +++ b/nifi/nifi-nar-bundles/nifi-hl7-bundle/nifi-hl7-processors/pom.xml @@ -19,7 +19,7 @@ parent groupIdorg.apache.nifi/groupId artifactIdnifi-hl7-bundle/artifactId -version0.2.0-incubating-SNAPSHOT/version +version0.2.0-incubating/version /parent artifactIdnifi-hl7-processors/artifactId @@ -52,7 +52,7 @@ dependency groupIdorg.apache.nifi/groupId artifactIdnifi-hl7-query-language/artifactId -version0.2.0-incubating-SNAPSHOT/version +version0.2.0-incubating/version /dependency dependency http://git-wip-us.apache.org/repos/asf/incubator-nifi/blob/19bdb172/nifi/nifi-nar-bundles/nifi-hl7-bundle/pom.xml -- diff --git a/nifi/nifi-nar-bundles/nifi-hl7-bundle/pom.xml b/nifi/nifi-nar-bundles/nifi-hl7-bundle/pom.xml index 7ba20ee..00f5f20 100644 --- a/nifi/nifi-nar-bundles/nifi-hl7-bundle/pom.xml +++ b/nifi/nifi-nar-bundles/nifi-hl7-bundle/pom.xml @@ -19,7 +19,7 @@ parent groupIdorg.apache.nifi/groupId artifactIdnifi-nar-bundles/artifactId -version0.2.0-incubating-SNAPSHOT/version +version0.2.0-incubating/version /parent artifactIdnifi-hl7-bundle/artifactId http://git-wip-us.apache.org/repos/asf/incubator-nifi/blob/19bdb172/nifi/nifi-nar-bundles/nifi-jetty-bundle/pom.xml -- diff --git a/nifi/nifi-nar-bundles/nifi-jetty-bundle/pom.xml b/nifi/nifi-nar-bundles/nifi-jetty-bundle/pom.xml index 702f83a..e9cc8b0 100644 --- a/nifi/nifi-nar-bundles/nifi-jetty-bundle/pom.xml +++ b/nifi/nifi-nar-bundles/nifi-jetty-bundle/pom.xml @@ -17,7 +17,7 @@ parent groupIdorg.apache.nifi/groupId artifactIdnifi-nar-bundles/artifactId -version0.2.0-incubating-SNAPSHOT/version +version0.2.0-incubating/version /parent artifactIdnifi-jetty-bundle/artifactId packagingnar/packaging http://git-wip-us.apache.org/repos/asf/incubator-nifi/blob/19bdb172/nifi/nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-nar/pom.xml -- diff --git a/nifi/nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-nar/pom.xml b/nifi/nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-nar/pom.xml index f725d5b..48a5ef4 100644 --- a/nifi/nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-nar/pom.xml +++ b/nifi/nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-nar/pom.xml @@ -17,7 +17,7 @@ parent groupIdorg.apache.nifi/groupId artifactIdnifi-kafka-bundle/artifactId -version0.2.0-incubating-SNAPSHOT/version +version0.2.0-incubating/version /parent artifactIdnifi-kafka-nar/artifactId packagingnar/packaging http://git-wip-us.apache.org/repos/asf/incubator-nifi/blob/19bdb172/nifi/nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-processors/pom.xml -- diff --git a/nifi/nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-processors/pom.xml b/nifi/nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-processors/pom.xml index b1164df..1ca4ef9 100644 --- a/nifi/nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-processors/pom.xml +++ b/nifi/nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-processors/pom.xml @@ -16,7 +16,7 @@ parent groupIdorg.apache.nifi/groupId artifactIdnifi-kafka-bundle/artifactId -version0.2.0-incubating-SNAPSHOT/version +version0.2.0-incubating/version /parent modelVersion4.0.0/modelVersion artifactIdnifi-kafka-processors/artifactId http://git-wip-us.apache.org/repos/asf/incubator-nifi/blob/19bdb172/nifi/nifi-nar-bundles/nifi-kafka-bundle/pom.xml -- diff --git a/nifi/nifi-nar-bundles/nifi-kafka-bundle/pom.xml b/nifi/nifi-nar-bundles/nifi-kafka-bundle/pom.xml index bb2dae3..6e3da78 100644 --- a/nifi/nifi-nar-bundles/nifi-kafka-bundle/pom.xml +++ b/nifi/nifi-nar-bundles/nifi-kafka-bundle/pom.xml @@ -17,7 +17,7 @@ parent groupIdorg.apache.nifi/groupId artifactIdnifi-nar-bundles/artifactId -version0.2.0-incubating-SNAPSHOT/version +version0.2.0-incubating/version /parent artifactIdnifi-kafka-bundle/artifactId
Git Push Summary
Repository: incubator-nifi Updated Tags: refs/tags/nifi-0.2.0-incubating-RC1 [created] b1cd2af96
[3/4] incubator-nifi git commit: NIFI-656-RC1 prepare for next development iteration
http://git-wip-us.apache.org/repos/asf/incubator-nifi/blob/fbd0a9f2/nifi/nifi-nar-bundles/nifi-mongodb-bundle/nifi-mongodb-nar/pom.xml -- diff --git a/nifi/nifi-nar-bundles/nifi-mongodb-bundle/nifi-mongodb-nar/pom.xml b/nifi/nifi-nar-bundles/nifi-mongodb-bundle/nifi-mongodb-nar/pom.xml index 7c3507c..d84ee47 100644 --- a/nifi/nifi-nar-bundles/nifi-mongodb-bundle/nifi-mongodb-nar/pom.xml +++ b/nifi/nifi-nar-bundles/nifi-mongodb-bundle/nifi-mongodb-nar/pom.xml @@ -19,18 +19,18 @@ parent groupIdorg.apache.nifi/groupId artifactIdnifi-mongodb-bundle/artifactId -version0.2.0-incubating/version +version0.2.1-incubating-SNAPSHOT/version /parent artifactIdnifi-mongodb-nar/artifactId -version0.2.0-incubating/version +version0.2.1-incubating-SNAPSHOT/version packagingnar/packaging dependencies dependency groupIdorg.apache.nifi/groupId artifactIdnifi-mongodb-processors/artifactId -version0.2.0-incubating/version +version0.2.1-incubating-SNAPSHOT/version /dependency /dependencies http://git-wip-us.apache.org/repos/asf/incubator-nifi/blob/fbd0a9f2/nifi/nifi-nar-bundles/nifi-mongodb-bundle/nifi-mongodb-processors/pom.xml -- diff --git a/nifi/nifi-nar-bundles/nifi-mongodb-bundle/nifi-mongodb-processors/pom.xml b/nifi/nifi-nar-bundles/nifi-mongodb-bundle/nifi-mongodb-processors/pom.xml index 31808ad..dcb94fd 100644 --- a/nifi/nifi-nar-bundles/nifi-mongodb-bundle/nifi-mongodb-processors/pom.xml +++ b/nifi/nifi-nar-bundles/nifi-mongodb-bundle/nifi-mongodb-processors/pom.xml @@ -19,7 +19,7 @@ parent groupIdorg.apache.nifi/groupId artifactIdnifi-mongodb-bundle/artifactId -version0.2.0-incubating/version +version0.2.1-incubating-SNAPSHOT/version /parent artifactIdnifi-mongodb-processors/artifactId http://git-wip-us.apache.org/repos/asf/incubator-nifi/blob/fbd0a9f2/nifi/nifi-nar-bundles/nifi-mongodb-bundle/pom.xml -- diff --git a/nifi/nifi-nar-bundles/nifi-mongodb-bundle/pom.xml b/nifi/nifi-nar-bundles/nifi-mongodb-bundle/pom.xml index 6b27b41..6b272b7 100644 --- a/nifi/nifi-nar-bundles/nifi-mongodb-bundle/pom.xml +++ b/nifi/nifi-nar-bundles/nifi-mongodb-bundle/pom.xml @@ -19,12 +19,12 @@ parent groupIdorg.apache.nifi/groupId artifactIdnifi-nar-bundles/artifactId -version0.2.0-incubating/version +version0.2.1-incubating-SNAPSHOT/version /parent groupIdorg.apache.nifi/groupId artifactIdnifi-mongodb-bundle/artifactId -version0.2.0-incubating/version +version0.2.1-incubating-SNAPSHOT/version packagingpom/packaging modules http://git-wip-us.apache.org/repos/asf/incubator-nifi/blob/fbd0a9f2/nifi/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/pom.xml -- diff --git a/nifi/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/pom.xml b/nifi/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/pom.xml index 4d161d5..54400ed 100644 --- a/nifi/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/pom.xml +++ b/nifi/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/pom.xml @@ -17,7 +17,7 @@ parent groupIdorg.apache.nifi/groupId artifactIdnifi-provenance-repository-bundle/artifactId -version0.2.0-incubating/version +version0.2.1-incubating-SNAPSHOT/version /parent artifactIdnifi-persistent-provenance-repository/artifactId packagingjar/packaging http://git-wip-us.apache.org/repos/asf/incubator-nifi/blob/fbd0a9f2/nifi/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-provenance-repository-nar/pom.xml -- diff --git a/nifi/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-provenance-repository-nar/pom.xml b/nifi/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-provenance-repository-nar/pom.xml index 82f3eb7..9160a73 100644 --- a/nifi/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-provenance-repository-nar/pom.xml +++ b/nifi/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-provenance-repository-nar/pom.xml @@ -17,7 +17,7 @@ parent groupIdorg.apache.nifi/groupId artifactIdnifi-provenance-repository-bundle/artifactId -version0.2.0-incubating/version +version0.2.1-incubating-SNAPSHOT/version /parent artifactIdnifi-provenance-repository-nar/artifactId packagingnar/packaging
[jira] [Updated] (NIFI-744) Allow FileSystemRepository to write to the same file for multiple (non-parallel) sessions
[ https://issues.apache.org/jira/browse/NIFI-744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Payne updated NIFI-744: Fix Version/s: 0.3.0 Allow FileSystemRepository to write to the same file for multiple (non-parallel) sessions - Key: NIFI-744 URL: https://issues.apache.org/jira/browse/NIFI-744 Project: Apache NiFi Issue Type: Bug Components: Core Framework Reporter: Mark Payne Fix For: 0.3.0 Currently, when a ProcessSession is committed, the Content Claim that was being written to is now finished and will never be written to again. When a flow has processors that generate many, many FlowFiles, each in their own session, this means that we have many, many files on disk on the Content Repository, as well. Generally, this hasn't been a problem to write to these files. However, when the files are to be archived or destroyed, this is very taxing and can cause erratic behavior. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[2/4] incubator-nifi git commit: NIFI-656-RC1 prepare release nifi-0.2.0-incubating-RC1
NIFI-656-RC1 prepare release nifi-0.2.0-incubating-RC1 Project: http://git-wip-us.apache.org/repos/asf/incubator-nifi/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-nifi/commit/19bdb172 Tree: http://git-wip-us.apache.org/repos/asf/incubator-nifi/tree/19bdb172 Diff: http://git-wip-us.apache.org/repos/asf/incubator-nifi/diff/19bdb172 Branch: refs/heads/release-nifi-0.2.0-incubating-rc1 Commit: 19bdb1722eca1e569a44ee14b365170a771a29b8 Parents: 9fa03b4 Author: Matt Gilman matt.c.gil...@gmail.com Authored: Tue Jul 7 12:26:46 2015 -0400 Committer: Matt Gilman matt.c.gil...@gmail.com Committed: Tue Jul 7 12:26:46 2015 -0400 -- nifi/nifi-api/pom.xml | 2 +- nifi/nifi-assembly/pom.xml | 12 +- nifi/nifi-bootstrap/pom.xml | 2 +- .../nifi-data-provenance-utils/pom.xml | 2 +- .../nifi-expression-language/pom.xml| 2 +- .../nifi-commons/nifi-flowfile-packager/pom.xml | 2 +- .../nifi-hl7-query-language/pom.xml | 2 +- nifi/nifi-commons/nifi-logging-utils/pom.xml| 2 +- .../nifi-processor-utilities/pom.xml| 2 +- nifi/nifi-commons/nifi-properties/pom.xml | 2 +- nifi/nifi-commons/nifi-security-utils/pom.xml | 2 +- .../nifi-site-to-site-client/pom.xml| 4 +- nifi/nifi-commons/nifi-socket-utils/pom.xml | 2 +- nifi/nifi-commons/nifi-utils/pom.xml| 4 +- nifi/nifi-commons/nifi-web-utils/pom.xml| 2 +- nifi/nifi-commons/nifi-write-ahead-log/pom.xml | 2 +- nifi/nifi-commons/pom.xml | 2 +- nifi/nifi-docs/pom.xml | 2 +- .../nifi-nifi-example-nar/pom.xml | 70 +- .../nifi-nifi-example-processors/pom.xml| 140 +-- nifi/nifi-external/nifi-example-bundle/pom.xml | 84 +-- nifi/nifi-external/nifi-spark-receiver/pom.xml | 2 +- nifi/nifi-external/nifi-storm-spout/pom.xml | 2 +- nifi/nifi-external/pom.xml | 2 +- .../nifi-processor-bundle-archetype/pom.xml | 2 +- nifi/nifi-maven-archetypes/pom.xml | 2 +- nifi/nifi-mock/pom.xml | 2 +- .../nifi-aws-bundle/nifi-aws-nar/pom.xml| 4 +- .../nifi-aws-bundle/nifi-aws-processors/pom.xml | 2 +- nifi/nifi-nar-bundles/nifi-aws-bundle/pom.xml | 2 +- .../nifi-framework-nar/pom.xml | 2 +- .../nifi-framework/nifi-administration/pom.xml | 2 +- .../nifi-framework/nifi-client-dto/pom.xml | 2 +- .../nifi-cluster-authorization-provider/pom.xml | 2 +- .../nifi-framework/nifi-documentation/pom.xml | 2 +- .../nifi-file-authorization-provider/pom.xml| 2 +- .../nifi-framework-cluster-protocol/pom.xml | 2 +- .../nifi-framework-cluster-web/pom.xml | 2 +- .../nifi-framework-cluster/pom.xml | 2 +- .../nifi-framework-core-api/pom.xml | 2 +- .../nifi-framework/nifi-framework-core/pom.xml | 2 +- .../nifi-framework/nifi-nar-utils/pom.xml | 2 +- .../nifi-framework/nifi-resources/pom.xml | 2 +- .../nifi-framework/nifi-runtime/pom.xml | 2 +- .../nifi-framework/nifi-security/pom.xml| 2 +- .../nifi-framework/nifi-site-to-site/pom.xml| 2 +- .../nifi-framework/nifi-user-actions/pom.xml| 2 +- .../nifi-web/nifi-custom-ui-utilities/pom.xml | 2 +- .../nifi-framework/nifi-web/nifi-jetty/pom.xml | 2 +- .../nifi-web/nifi-ui-extension/pom.xml | 2 +- .../nifi-web/nifi-web-api/pom.xml | 2 +- .../nifi-web/nifi-web-content-access/pom.xml| 2 +- .../nifi-web/nifi-web-content-viewer/pom.xml| 2 +- .../nifi-web/nifi-web-docs/pom.xml | 2 +- .../nifi-web/nifi-web-error/pom.xml | 2 +- .../nifi-web-optimistic-locking/pom.xml | 2 +- .../nifi-web/nifi-web-security/pom.xml | 2 +- .../nifi-framework/nifi-web/nifi-web-ui/pom.xml | 2 +- .../nifi-framework/nifi-web/pom.xml | 12 +- .../nifi-framework/pom.xml | 2 +- .../nifi-framework-bundle/pom.xml | 38 ++--- .../nifi-geo-bundle/nifi-geo-nar/pom.xml| 2 +- .../nifi-geo-bundle/nifi-geo-processors/pom.xml | 2 +- nifi/nifi-nar-bundles/nifi-geo-bundle/pom.xml | 4 +- .../nifi-hadoop-bundle/nifi-hadoop-nar/pom.xml | 2 +- .../nifi-hdfs-processors/pom.xml| 2 +- .../nifi-nar-bundles/nifi-hadoop-bundle/pom.xml | 4 +- .../nifi-hadoop-libraries-nar/pom.xml | 2 +- .../nifi-hadoop-libraries-bundle/pom.xml| 2 +- .../nifi-hl7-bundle/nifi-hl7-nar/pom.xml| 4 +- .../nifi-hl7-bundle/nifi-hl7-processors/pom.xml | 4 +- nifi/nifi-nar-bundles/nifi-hl7-bundle/pom.xml | 2 +- nifi/nifi-nar-bundles/nifi-jetty-bundle/pom.xml | 2 +-
[4/4] incubator-nifi git commit: NIFI-656-RC1 prepare for next development iteration
NIFI-656-RC1 prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/incubator-nifi/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-nifi/commit/fbd0a9f2 Tree: http://git-wip-us.apache.org/repos/asf/incubator-nifi/tree/fbd0a9f2 Diff: http://git-wip-us.apache.org/repos/asf/incubator-nifi/diff/fbd0a9f2 Branch: refs/heads/release-nifi-0.2.0-incubating-rc1 Commit: fbd0a9f2482b242676c970b25fd91d642c2617de Parents: 19bdb17 Author: Matt Gilman matt.c.gil...@gmail.com Authored: Tue Jul 7 12:26:57 2015 -0400 Committer: Matt Gilman matt.c.gil...@gmail.com Committed: Tue Jul 7 12:26:57 2015 -0400 -- nifi/nifi-api/pom.xml | 2 +- nifi/nifi-assembly/pom.xml | 12 +-- nifi/nifi-bootstrap/pom.xml | 2 +- .../nifi-data-provenance-utils/pom.xml | 2 +- .../nifi-expression-language/pom.xml| 2 +- .../nifi-commons/nifi-flowfile-packager/pom.xml | 2 +- .../nifi-hl7-query-language/pom.xml | 2 +- nifi/nifi-commons/nifi-logging-utils/pom.xml| 2 +- .../nifi-processor-utilities/pom.xml| 2 +- nifi/nifi-commons/nifi-properties/pom.xml | 2 +- nifi/nifi-commons/nifi-security-utils/pom.xml | 2 +- .../nifi-site-to-site-client/pom.xml| 4 +- nifi/nifi-commons/nifi-socket-utils/pom.xml | 2 +- nifi/nifi-commons/nifi-utils/pom.xml| 4 +- nifi/nifi-commons/nifi-web-utils/pom.xml| 2 +- nifi/nifi-commons/nifi-write-ahead-log/pom.xml | 2 +- nifi/nifi-commons/pom.xml | 2 +- nifi/nifi-docs/pom.xml | 2 +- .../nifi-nifi-example-nar/pom.xml | 2 +- .../nifi-nifi-example-processors/pom.xml| 2 +- nifi/nifi-external/nifi-example-bundle/pom.xml | 4 +- nifi/nifi-external/nifi-spark-receiver/pom.xml | 2 +- nifi/nifi-external/nifi-storm-spout/pom.xml | 2 +- nifi/nifi-external/pom.xml | 2 +- .../nifi-processor-bundle-archetype/pom.xml | 2 +- nifi/nifi-maven-archetypes/pom.xml | 2 +- nifi/nifi-mock/pom.xml | 2 +- .../nifi-aws-bundle/nifi-aws-nar/pom.xml| 4 +- .../nifi-aws-bundle/nifi-aws-processors/pom.xml | 2 +- nifi/nifi-nar-bundles/nifi-aws-bundle/pom.xml | 2 +- .../nifi-framework-nar/pom.xml | 2 +- .../nifi-framework/nifi-administration/pom.xml | 2 +- .../nifi-framework/nifi-client-dto/pom.xml | 2 +- .../nifi-cluster-authorization-provider/pom.xml | 2 +- .../nifi-framework/nifi-documentation/pom.xml | 2 +- .../nifi-file-authorization-provider/pom.xml| 2 +- .../nifi-framework-cluster-protocol/pom.xml | 2 +- .../nifi-framework-cluster-web/pom.xml | 2 +- .../nifi-framework-cluster/pom.xml | 2 +- .../nifi-framework-core-api/pom.xml | 2 +- .../nifi-framework/nifi-framework-core/pom.xml | 2 +- .../nifi-framework/nifi-nar-utils/pom.xml | 2 +- .../nifi-framework/nifi-resources/pom.xml | 2 +- .../nifi-framework/nifi-runtime/pom.xml | 2 +- .../nifi-framework/nifi-security/pom.xml| 2 +- .../nifi-framework/nifi-site-to-site/pom.xml| 2 +- .../nifi-framework/nifi-user-actions/pom.xml| 2 +- .../nifi-web/nifi-custom-ui-utilities/pom.xml | 2 +- .../nifi-framework/nifi-web/nifi-jetty/pom.xml | 2 +- .../nifi-web/nifi-ui-extension/pom.xml | 2 +- .../nifi-web/nifi-web-api/pom.xml | 2 +- .../nifi-web/nifi-web-content-access/pom.xml| 2 +- .../nifi-web/nifi-web-content-viewer/pom.xml| 2 +- .../nifi-web/nifi-web-docs/pom.xml | 2 +- .../nifi-web/nifi-web-error/pom.xml | 2 +- .../nifi-web-optimistic-locking/pom.xml | 2 +- .../nifi-web/nifi-web-security/pom.xml | 2 +- .../nifi-framework/nifi-web/nifi-web-ui/pom.xml | 2 +- .../nifi-framework/nifi-web/pom.xml | 12 +-- .../nifi-framework/pom.xml | 2 +- .../nifi-framework-bundle/pom.xml | 38 - .../nifi-geo-bundle/nifi-geo-nar/pom.xml| 2 +- .../nifi-geo-bundle/nifi-geo-processors/pom.xml | 2 +- nifi/nifi-nar-bundles/nifi-geo-bundle/pom.xml | 4 +- .../nifi-hadoop-bundle/nifi-hadoop-nar/pom.xml | 2 +- .../nifi-hdfs-processors/pom.xml| 2 +- .../nifi-nar-bundles/nifi-hadoop-bundle/pom.xml | 4 +- .../nifi-hadoop-libraries-nar/pom.xml | 2 +- .../nifi-hadoop-libraries-bundle/pom.xml| 2 +- .../nifi-hl7-bundle/nifi-hl7-nar/pom.xml| 4 +- .../nifi-hl7-bundle/nifi-hl7-processors/pom.xml | 4 +- nifi/nifi-nar-bundles/nifi-hl7-bundle/pom.xml | 2 +- nifi/nifi-nar-bundles/nifi-jetty-bundle/pom.xml | 2 +- .../nifi-kafka-bundle/nifi-kafka-nar/pom.xml| 2 +- .../nifi-kafka-processors/pom.xml | 2 +-
[jira] [Commented] (NIFI-656) Release Manager: Release 0.2.0
[ https://issues.apache.org/jira/browse/NIFI-656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617049#comment-14617049 ] ASF subversion and git services commented on NIFI-656: -- Commit fbd0a9f2482b242676c970b25fd91d642c2617de in incubator-nifi's branch refs/heads/release-nifi-0.2.0-incubating-rc1 from [~mcgilman] [ https://git-wip-us.apache.org/repos/asf?p=incubator-nifi.git;h=fbd0a9f ] NIFI-656-RC1 prepare for next development iteration Release Manager: Release 0.2.0 -- Key: NIFI-656 URL: https://issues.apache.org/jira/browse/NIFI-656 Project: Apache NiFi Issue Type: Task Components: Tools and Build Reporter: Joseph Witt Assignee: Matt Gilman Fix For: 0.2.0 This is a ticket to track general commits needed to conduct the release management activities themselves. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Git Push Summary
Repository: incubator-nifi Updated Branches: refs/heads/release-nifi-0.2.0-incubating [created] 9fa03b432
[jira] [Commented] (NIFI-656) Release Manager: Release 0.2.0
[ https://issues.apache.org/jira/browse/NIFI-656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617048#comment-14617048 ] ASF subversion and git services commented on NIFI-656: -- Commit 19bdb1722eca1e569a44ee14b365170a771a29b8 in incubator-nifi's branch refs/heads/release-nifi-0.2.0-incubating-rc1 from [~mcgilman] [ https://git-wip-us.apache.org/repos/asf?p=incubator-nifi.git;h=19bdb17 ] NIFI-656-RC1 prepare release nifi-0.2.0-incubating-RC1 Release Manager: Release 0.2.0 -- Key: NIFI-656 URL: https://issues.apache.org/jira/browse/NIFI-656 Project: Apache NiFi Issue Type: Task Components: Tools and Build Reporter: Joseph Witt Assignee: Matt Gilman Fix For: 0.2.0 This is a ticket to track general commits needed to conduct the release management activities themselves. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-751) Add Processor To Convert Avro Formats
[ https://issues.apache.org/jira/browse/NIFI-751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617466#comment-14617466 ] ASF GitHub Bot commented on NIFI-751: - GitHub user jackowaya opened a pull request: https://github.com/apache/incubator-nifi/pull/70 NIFI-751 Add Processor To Convert Avro Formats Implemented a new NiFi processor that allows avro records to be converted from one Avro schema to another. This supports.. * Flattening records using . notation like parent.id * Simple type conversions to String or base primitive types. You can merge this pull request into a Git repository by running: $ git pull https://github.com/jackowaya/incubator-nifi avroconvert Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-nifi/pull/70.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #70 commit d50171381f853334bb670edb5581445fdfef0e46 Author: Alan Jackoway al...@cloudera.com Date: 2015-07-07T21:28:26Z NIFI-751 Add Processor To Convert Avro Formats Implemented a new NiFi processor that allows avro records to be converted from one Avro schema to another. This supports.. * Flattening records using . notation like parent.id * Simple type conversions to String or base primitive types. Add Processor To Convert Avro Formats - Key: NIFI-751 URL: https://issues.apache.org/jira/browse/NIFI-751 Project: Apache NiFi Issue Type: Improvement Components: Extensions Affects Versions: 0.1.0 Reporter: Alan Jackoway When working with data from external sources, such as complex WSDL, I frequently wind up with complex nested data that is difficult to work with even when converted to Avro format. Specifically, I often have two needs: * Converting types of data, usually from string to long, double, etc. when APIs give only string data back. * Flattening data by taking fields out of nested records and putting them on the top level of the Avro file. Unfortunately the Kite JSONToAvro processor only supports exact conversions from JSON to a matching Avro schema and will not do data transformations of this type. Proposed processor to come. Discussed this with [~rdblue], so tagging him here as I don't have permission to set a CC for some reason. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-751) Add Processor To Convert Avro Formats
[ https://issues.apache.org/jira/browse/NIFI-751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617468#comment-14617468 ] Alan Jackoway commented on NIFI-751: Created PR #70 with a first pass at how this would work: https://github.com/apache/incubator-nifi/pull/70 Add Processor To Convert Avro Formats - Key: NIFI-751 URL: https://issues.apache.org/jira/browse/NIFI-751 Project: Apache NiFi Issue Type: Improvement Components: Extensions Affects Versions: 0.1.0 Reporter: Alan Jackoway When working with data from external sources, such as complex WSDL, I frequently wind up with complex nested data that is difficult to work with even when converted to Avro format. Specifically, I often have two needs: * Converting types of data, usually from string to long, double, etc. when APIs give only string data back. * Flattening data by taking fields out of nested records and putting them on the top level of the Avro file. Unfortunately the Kite JSONToAvro processor only supports exact conversions from JSON to a matching Avro schema and will not do data transformations of this type. Proposed processor to come. Discussed this with [~rdblue], so tagging him here as I don't have permission to set a CC for some reason. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (NIFI-751) Add Processor To Convert Avro Formats
Alan Jackoway created NIFI-751: -- Summary: Add Processor To Convert Avro Formats Key: NIFI-751 URL: https://issues.apache.org/jira/browse/NIFI-751 Project: Apache NiFi Issue Type: Improvement Components: Extensions Affects Versions: 0.1.0 Reporter: Alan Jackoway When working with data from external sources, such as complex WSDL, I frequently wind up with complex nested data that is difficult to work with even when converted to Avro format. Specifically, I often have two needs: * Converting types of data, usually from string to long, double, etc. when APIs give only string data back. * Flattening data by taking fields out of nested records and putting them on the top level of the Avro file. Unfortunately the Kite JSONToAvro processor only supports exact conversions from JSON to a matching Avro schema and will not do data transformations of this type. Proposed processor to come. Discussed this with [~rdblue], so tagging him here as I don't have permission to set a CC for some reason. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (NIFI-752) Swapping and out of FlowFiles should be driven by FlowFileQueue, rather than in background thread
Mark Payne created NIFI-752: --- Summary: Swapping and out of FlowFiles should be driven by FlowFileQueue, rather than in background thread Key: NIFI-752 URL: https://issues.apache.org/jira/browse/NIFI-752 Project: Apache NiFi Issue Type: Bug Components: Core Framework Reporter: Mark Payne Fix For: 0.3.0 As-is, if a huge number of FlowFiles are generated quickly enough, the JVM heap can fill before FlowFiles are swapped in. Conversely, if FlowFiles are swapped out, are NiFi is able to work those FlowFiles off, it ends up pausing, waiting for more FlowFiles to be swapped in. If the queue itself has control of this, these issues will both be alleviated. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (NIFI-753) NPE when reading in provenance data
Mark Payne created NIFI-753: --- Summary: NPE when reading in provenance data Key: NIFI-753 URL: https://issues.apache.org/jira/browse/NIFI-753 Project: Apache NiFi Issue Type: Bug Components: Core Framework Affects Versions: 0.2.0 Reporter: Mark Payne Assignee: Mark Payne Priority: Blocker Fix For: 0.2.0 If an attribute is removed, NiFi will fail to restart: Caused by: java.lang.RuntimeException: Unable to create Provenance Repository at org.apache.nifi.controller.FlowController.init(FlowController.java:411) ~[na:na] at org.apache.nifi.controller.FlowController.createStandaloneInstance(FlowController.java:350) ~[na:na] at org.apache.nifi.spring.FlowControllerFactoryBean.getObject(FlowControllerFactoryBean.java:63) ~[na:na] at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:168) ~[na:na] ... 130 common frames omitted Caused by: java.lang.NullPointerException: null at org.apache.nifi.provenance.StandardRecordReader.readAttributes(StandardRecordReader.java:372) ~[na:na] at org.apache.nifi.provenance.StandardRecordReader.nextRecord(StandardRecordReader.java:313) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.mergeJournals(PersistentProvenanceRepository.java:1356) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.recoverJournalFiles(PersistentProvenanceRepository.java:1136) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.recover(PersistentProvenanceRepository.java:572) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.initialize(PersistentProvenanceRepository.java:212) ~[na:na] at org.apache.nifi.controller.FlowController.init(FlowController.java:407) ~[na:na] ... 133 common frames omitted -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Git Push Summary
Repository: incubator-nifi Updated Branches: refs/heads/release-nifi-0.2.0-incubating-rc1 [deleted] fbd0a9f24
[jira] [Updated] (NIFI-753) NPE when reading in provenance data
[ https://issues.apache.org/jira/browse/NIFI-753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Payne updated NIFI-753: Attachment: 0001-NIFI-753-when-truncating-value-take-null-values-into.patch NPE when reading in provenance data --- Key: NIFI-753 URL: https://issues.apache.org/jira/browse/NIFI-753 Project: Apache NiFi Issue Type: Bug Components: Core Framework Affects Versions: 0.2.0 Reporter: Mark Payne Assignee: Mark Payne Priority: Blocker Fix For: 0.2.0 Attachments: 0001-NIFI-753-when-truncating-value-take-null-values-into.patch If an attribute is removed, NiFi will fail to restart: Caused by: java.lang.RuntimeException: Unable to create Provenance Repository at org.apache.nifi.controller.FlowController.init(FlowController.java:411) ~[na:na] at org.apache.nifi.controller.FlowController.createStandaloneInstance(FlowController.java:350) ~[na:na] at org.apache.nifi.spring.FlowControllerFactoryBean.getObject(FlowControllerFactoryBean.java:63) ~[na:na] at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:168) ~[na:na] ... 130 common frames omitted Caused by: java.lang.NullPointerException: null at org.apache.nifi.provenance.StandardRecordReader.readAttributes(StandardRecordReader.java:372) ~[na:na] at org.apache.nifi.provenance.StandardRecordReader.nextRecord(StandardRecordReader.java:313) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.mergeJournals(PersistentProvenanceRepository.java:1356) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.recoverJournalFiles(PersistentProvenanceRepository.java:1136) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.recover(PersistentProvenanceRepository.java:572) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.initialize(PersistentProvenanceRepository.java:212) ~[na:na] at org.apache.nifi.controller.FlowController.init(FlowController.java:407) ~[na:na] ... 133 common frames omitted -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-753) NPE when reading in provenance data
[ https://issues.apache.org/jira/browse/NIFI-753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617782#comment-14617782 ] Aldrin Piri commented on NIFI-753: -- Build looks good, contrib passes and code addresses the provided stacktrace. +1 NPE when reading in provenance data --- Key: NIFI-753 URL: https://issues.apache.org/jira/browse/NIFI-753 Project: Apache NiFi Issue Type: Bug Components: Core Framework Affects Versions: 0.2.0 Reporter: Mark Payne Assignee: Mark Payne Priority: Blocker Fix For: 0.2.0 Attachments: 0001-NIFI-753-when-truncating-value-take-null-values-into.patch If an attribute is removed, NiFi will fail to restart: Caused by: java.lang.RuntimeException: Unable to create Provenance Repository at org.apache.nifi.controller.FlowController.init(FlowController.java:411) ~[na:na] at org.apache.nifi.controller.FlowController.createStandaloneInstance(FlowController.java:350) ~[na:na] at org.apache.nifi.spring.FlowControllerFactoryBean.getObject(FlowControllerFactoryBean.java:63) ~[na:na] at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:168) ~[na:na] ... 130 common frames omitted Caused by: java.lang.NullPointerException: null at org.apache.nifi.provenance.StandardRecordReader.readAttributes(StandardRecordReader.java:372) ~[na:na] at org.apache.nifi.provenance.StandardRecordReader.nextRecord(StandardRecordReader.java:313) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.mergeJournals(PersistentProvenanceRepository.java:1356) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.recoverJournalFiles(PersistentProvenanceRepository.java:1136) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.recover(PersistentProvenanceRepository.java:572) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.initialize(PersistentProvenanceRepository.java:212) ~[na:na] at org.apache.nifi.controller.FlowController.init(FlowController.java:407) ~[na:na] ... 133 common frames omitted -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[2/2] incubator-nifi git commit: Merge branch 'develop' of http://git-wip-us.apache.org/repos/asf/incubator-nifi into develop
Merge branch 'develop' of http://git-wip-us.apache.org/repos/asf/incubator-nifi into develop Project: http://git-wip-us.apache.org/repos/asf/incubator-nifi/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-nifi/commit/3125036d Tree: http://git-wip-us.apache.org/repos/asf/incubator-nifi/tree/3125036d Diff: http://git-wip-us.apache.org/repos/asf/incubator-nifi/diff/3125036d Branch: refs/heads/develop Commit: 3125036d3f463c97a10466d244952f10f0054b64 Parents: c0f1104 9fa03b4 Author: Mark Payne marka...@hotmail.com Authored: Tue Jul 7 21:08:34 2015 -0400 Committer: Mark Payne marka...@hotmail.com Committed: Tue Jul 7 21:08:34 2015 -0400 -- nifi/nifi-external/nifi-storm-spout/pom.xml | 2 +- .../java/org/apache/nifi/storm/NiFiSpout.java | 38 ++-- .../ConfigurableComponentInitializer.java | 9 - .../apache/nifi/documentation/DocGenerator.java | 2 ++ .../init/ControllerServiceInitializer.java | 11 -- .../init/ProcessorInitializer.java | 11 -- .../init/ReportingTaskingInitializer.java | 11 -- .../html/HtmlDocumentationWriterTest.java | 10 +++--- .../html/ProcessorDocumentationWriterTest.java | 7 ++-- 9 files changed, 82 insertions(+), 19 deletions(-) --
[jira] [Commented] (NIFI-753) NPE when reading in provenance data
[ https://issues.apache.org/jira/browse/NIFI-753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617785#comment-14617785 ] ASF subversion and git services commented on NIFI-753: -- Commit c0f110467997d1e05e58ef444385478ba05a59e5 in incubator-nifi's branch refs/heads/develop from [~markap14] [ https://git-wip-us.apache.org/repos/asf?p=incubator-nifi.git;h=c0f1104 ] NIFI-753: when truncating value, take null values into account NPE when reading in provenance data --- Key: NIFI-753 URL: https://issues.apache.org/jira/browse/NIFI-753 Project: Apache NiFi Issue Type: Bug Components: Core Framework Affects Versions: 0.2.0 Reporter: Mark Payne Assignee: Mark Payne Priority: Blocker Fix For: 0.2.0 Attachments: 0001-NIFI-753-when-truncating-value-take-null-values-into.patch If an attribute is removed, NiFi will fail to restart: Caused by: java.lang.RuntimeException: Unable to create Provenance Repository at org.apache.nifi.controller.FlowController.init(FlowController.java:411) ~[na:na] at org.apache.nifi.controller.FlowController.createStandaloneInstance(FlowController.java:350) ~[na:na] at org.apache.nifi.spring.FlowControllerFactoryBean.getObject(FlowControllerFactoryBean.java:63) ~[na:na] at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:168) ~[na:na] ... 130 common frames omitted Caused by: java.lang.NullPointerException: null at org.apache.nifi.provenance.StandardRecordReader.readAttributes(StandardRecordReader.java:372) ~[na:na] at org.apache.nifi.provenance.StandardRecordReader.nextRecord(StandardRecordReader.java:313) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.mergeJournals(PersistentProvenanceRepository.java:1356) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.recoverJournalFiles(PersistentProvenanceRepository.java:1136) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.recover(PersistentProvenanceRepository.java:572) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.initialize(PersistentProvenanceRepository.java:212) ~[na:na] at org.apache.nifi.controller.FlowController.init(FlowController.java:407) ~[na:na] ... 133 common frames omitted -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-753) NPE when reading in provenance data
[ https://issues.apache.org/jira/browse/NIFI-753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617806#comment-14617806 ] ASF subversion and git services commented on NIFI-753: -- Commit c0f110467997d1e05e58ef444385478ba05a59e5 in incubator-nifi's branch refs/heads/release-nifi-0.2.0-incubating from [~markap14] [ https://git-wip-us.apache.org/repos/asf?p=incubator-nifi.git;h=c0f1104 ] NIFI-753: when truncating value, take null values into account NPE when reading in provenance data --- Key: NIFI-753 URL: https://issues.apache.org/jira/browse/NIFI-753 Project: Apache NiFi Issue Type: Bug Components: Core Framework Affects Versions: 0.2.0 Reporter: Mark Payne Assignee: Mark Payne Priority: Blocker Fix For: 0.2.0 Attachments: 0001-NIFI-753-when-truncating-value-take-null-values-into.patch If an attribute is removed, NiFi will fail to restart: Caused by: java.lang.RuntimeException: Unable to create Provenance Repository at org.apache.nifi.controller.FlowController.init(FlowController.java:411) ~[na:na] at org.apache.nifi.controller.FlowController.createStandaloneInstance(FlowController.java:350) ~[na:na] at org.apache.nifi.spring.FlowControllerFactoryBean.getObject(FlowControllerFactoryBean.java:63) ~[na:na] at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:168) ~[na:na] ... 130 common frames omitted Caused by: java.lang.NullPointerException: null at org.apache.nifi.provenance.StandardRecordReader.readAttributes(StandardRecordReader.java:372) ~[na:na] at org.apache.nifi.provenance.StandardRecordReader.nextRecord(StandardRecordReader.java:313) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.mergeJournals(PersistentProvenanceRepository.java:1356) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.recoverJournalFiles(PersistentProvenanceRepository.java:1136) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.recover(PersistentProvenanceRepository.java:572) ~[na:na] at org.apache.nifi.provenance.PersistentProvenanceRepository.initialize(PersistentProvenanceRepository.java:212) ~[na:na] at org.apache.nifi.controller.FlowController.init(FlowController.java:407) ~[na:na] ... 133 common frames omitted -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[2/2] incubator-nifi git commit: Merge branch 'develop' of http://git-wip-us.apache.org/repos/asf/incubator-nifi into develop
Merge branch 'develop' of http://git-wip-us.apache.org/repos/asf/incubator-nifi into develop Project: http://git-wip-us.apache.org/repos/asf/incubator-nifi/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-nifi/commit/3125036d Tree: http://git-wip-us.apache.org/repos/asf/incubator-nifi/tree/3125036d Diff: http://git-wip-us.apache.org/repos/asf/incubator-nifi/diff/3125036d Branch: refs/heads/release-nifi-0.2.0-incubating Commit: 3125036d3f463c97a10466d244952f10f0054b64 Parents: c0f1104 9fa03b4 Author: Mark Payne marka...@hotmail.com Authored: Tue Jul 7 21:08:34 2015 -0400 Committer: Mark Payne marka...@hotmail.com Committed: Tue Jul 7 21:08:34 2015 -0400 -- nifi/nifi-external/nifi-storm-spout/pom.xml | 2 +- .../java/org/apache/nifi/storm/NiFiSpout.java | 38 ++-- .../ConfigurableComponentInitializer.java | 9 - .../apache/nifi/documentation/DocGenerator.java | 2 ++ .../init/ControllerServiceInitializer.java | 11 -- .../init/ProcessorInitializer.java | 11 -- .../init/ReportingTaskingInitializer.java | 11 -- .../html/HtmlDocumentationWriterTest.java | 10 +++--- .../html/ProcessorDocumentationWriterTest.java | 7 ++-- 9 files changed, 82 insertions(+), 19 deletions(-) --
[1/2] incubator-nifi git commit: NIFI-753: when truncating value, take null values into account
Repository: incubator-nifi
Updated Branches:
refs/heads/release-nifi-0.2.0-incubating 9fa03b432 - 3125036d3
NIFI-753: when truncating value, take null values into account
Project: http://git-wip-us.apache.org/repos/asf/incubator-nifi/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-nifi/commit/c0f11046
Tree: http://git-wip-us.apache.org/repos/asf/incubator-nifi/tree/c0f11046
Diff: http://git-wip-us.apache.org/repos/asf/incubator-nifi/diff/c0f11046
Branch: refs/heads/release-nifi-0.2.0-incubating
Commit: c0f110467997d1e05e58ef444385478ba05a59e5
Parents: 2084024
Author: Mark Payne marka...@hotmail.com
Authored: Tue Jul 7 20:44:03 2015 -0400
Committer: Mark Payne marka...@hotmail.com
Committed: Tue Jul 7 20:44:03 2015 -0400
--
.../org/apache/nifi/provenance/StandardRecordReader.java | 10 +-
1 file changed, 9 insertions(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/incubator-nifi/blob/c0f11046/nifi/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/StandardRecordReader.java
--
diff --git
a/nifi/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/StandardRecordReader.java
b/nifi/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/StandardRecordReader.java
index 0939107..5221ebc 100644
---
a/nifi/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/StandardRecordReader.java
+++
b/nifi/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/StandardRecordReader.java
@@ -369,7 +369,15 @@ public class StandardRecordReader implements RecordReader {
for (int i = 0; i numAttributes; i++) {
final String key = readLongString(dis);
final String value = valueNullable ? readLongNullableString(dis) :
readLongString(dis);
-final String truncatedValue = value.length() maxAttributeChars ?
value.substring(0, maxAttributeChars) : value;
+final String truncatedValue;
+if (value == null) {
+truncatedValue = null;
+} else if (value.length() maxAttributeChars) {
+truncatedValue = value.substring(0, maxAttributeChars);
+} else {
+truncatedValue = value;
+}
+
attrs.put(key, truncatedValue);
}
Git Push Summary
Repository: incubator-nifi Updated Tags: refs/tags/nifi-0.2.0-incubating-RC1 [deleted] b1cd2af96
[jira] [Commented] (NIFI-751) Add Processor To Convert Avro Formats
[
https://issues.apache.org/jira/browse/NIFI-751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617932#comment-14617932
]
ASF GitHub Bot commented on NIFI-751:
-
Github user joewitt commented on the pull request:
https://github.com/apache/incubator-nifi/pull/70#issuecomment-119416855
Alan,
Thanks for contributing! We'll work with you to get this promptly merged.
Here are some findings of an initial review:
* Please run the build with 'mvn clean install -Pcontrib-check'. You'll
find there many formatting issues. It appears that many of the lines have had
extraneous newlines and tabs added to them. Please take a look and tweak until
the contrib check runs cleanly and that you still think the code looks good.
* There do not appear to be any unit tests for the processor itself. I do
see a couple unit tests for the converter class/logic which is good but it is
best to also have a test or two, particularly for something that seems as
easily tested as this one is. You can find lots of examples throughout the
codebase including in this kite bundle.
* The conversion routines for Long, Double, Float, etc.. you really should
consider adding regex checks before calling those methods. Since the Java
methods use exception handling for flow control the performance penalty can be
extremely severe compared to simply doing a regex check beforehand. In the
event that the data is clean you'll be good to go but when it isn't the impact
to the system as a whole can be dramatic. Given the nature of this sort of
processor that is probably something to tackle right away.
* This processor is probably a great candidate to use the 'Advanced
Documentation' feature. Users will need this to understand the schema/syntax
of the conversion configuration and examples would go a long way for that. You
can see more about this here
http://nifi.incubator.apache.org/docs/nifi-docs/html/developer-guide.html#advanced-documentation
and there are some examples in the existing standard processors to consider.
* There are a couple of copy/paste errors in the processor from the
CSV/Avro converter. Look for these Failed to convert {}/{} records from CSV
to Avro and Failed to convert {}/{} records from CSV to Avro
I realize this looks like a lot of stuff but it should be pretty easy to
address and is a good first step. If you have any questions on it just let us
know.
Thanks
Joe
Add Processor To Convert Avro Formats
-
Key: NIFI-751
URL: https://issues.apache.org/jira/browse/NIFI-751
Project: Apache NiFi
Issue Type: Improvement
Components: Extensions
Affects Versions: 0.1.0
Reporter: Alan Jackoway
When working with data from external sources, such as complex WSDL, I
frequently wind up with complex nested data that is difficult to work with
even when converted to Avro format. Specifically, I often have two needs:
* Converting types of data, usually from string to long, double, etc. when
APIs give only string data back.
* Flattening data by taking fields out of nested records and putting them on
the top level of the Avro file.
Unfortunately the Kite JSONToAvro processor only supports exact conversions
from JSON to a matching Avro schema and will not do data transformations of
this type. Proposed processor to come.
Discussed this with [~rdblue], so tagging him here as I don't have permission
to set a CC for some reason.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
