[GitHub] nifi issue #3079: NIFI-5706 : Added ConvertAvroToParquet processor

2018-10-23 Thread mohitgargk
Github user mohitgargk commented on the issue:

https://github.com/apache/nifi/pull/3079
  
@bbende Make sense ! I have merged the ParquetBuilderProperties merged in 
ParquetUtils in the latest commit. 


---


[GitHub] nifi issue #3079: NIFI-5706 : Added ConvertAvroToParquet processor

2018-10-21 Thread mohitgargk
Github user mohitgargk commented on the issue:

https://github.com/apache/nifi/pull/3079
  
@bbende i have made the suggested changes. Please review.


---


[GitHub] nifi issue #3079: NIFI-5706 : Added ConvertAvroToParquet processor

2018-10-18 Thread mohitgargk
Github user mohitgargk commented on the issue:

https://github.com/apache/nifi/pull/3079
  
> What is the use case for having Parquet files flow through NiFi?
I have a use case where I am writing the parquet files into data lake (in 
azure) and also need to write them on a network storage device. The intent here 
is keep the parquet in flowfile, so that it can flow into any sink later on. If 
we don't have Convert*ToParquet (or similar processors), we would require a hop 
(an i/o endpoint) that may not give good performance. 




---


[GitHub] nifi issue #3079: NIFI-5706 : Added ConvertAvroToParquet processor

2018-10-17 Thread mohitgargk
Github user mohitgargk commented on the issue:

https://github.com/apache/nifi/pull/3079
  
thanks @bbende for the feedback, will work on the fix tomorrow. 


---


[GitHub] nifi pull request #3079: NIFI-5706 : Added ConvertAvroToParquet processor

2018-10-15 Thread mohitgargk
GitHub user mohitgargk opened a pull request:

https://github.com/apache/nifi/pull/3079

NIFI-5706 : Added ConvertAvroToParquet processor

Thank you for submitting a contribution to Apache NiFi.

In order to streamline the review of the contribution we ask you
to ensure the following steps have been taken:

### For all changes:
- [ ] Is there a JIRA ticket associated with this PR? Is it referenced 
 in the commit message?

- [ ] Does your PR title start with NIFI- where  is the JIRA number 
you are trying to resolve? Pay particular attention to the hyphen "-" character.

- [ ] Has your PR been rebased against the latest commit within the target 
branch (typically master)?

- [ ] Is your initial contribution a single, squashed commit?

### For code changes:
- [ ] Have you ensured that the full suite of tests is executed via mvn 
-Pcontrib-check clean install at the root nifi folder?
- [ ] Have you written or updated unit tests to verify your changes?
- [ ] If adding new dependencies to the code, are these dependencies 
licensed in a way that is compatible for inclusion under [ASF 
2.0](http://www.apache.org/legal/resolved.html#category-a)? 
- [ ] If applicable, have you updated the LICENSE file, including the main 
LICENSE file under nifi-assembly?
- [ ] If applicable, have you updated the NOTICE file, including the main 
NOTICE file found under nifi-assembly?
- [ ] If adding new Properties, have you added .displayName in addition to 
.name (programmatic access) for each of the new properties?

### For documentation related changes:
- [ ] Have you ensured that format looks appropriate for the output in 
which it is rendered?

### Note:
Please ensure that once the PR is submitted, you check travis-ci for build 
issues and submit an update to your PR as soon as possible.


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mohitgargk/nifi NIFI-5706

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/nifi/pull/3079.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3079


commit 18fa9bf070fda41fc78f5399757eb622b4049776
Author: Mohit Garg 
Date:   2018-10-16T06:10:14Z

Added ConvertAvroToParquet processor




---


[GitHub] nifi issue #2158: NIFI-4360 Adding support for ADLS Processors. Feature incl...

2018-09-26 Thread mohitgargk
Github user mohitgargk commented on the issue:

https://github.com/apache/nifi/pull/2158
  
Hi @milanchandna, was wondering if you are still working on this. I need 
this feature for my use case and was going the same path as you. Seems you are 
almost there.  In case you are working on it, Can you please try syncing your 
fork and rebase your commits.


---


[GitHub] nifi issue #3007: NIFI-5596 Upgraded splunk-sdk-java version

2018-09-18 Thread mohitgargk
Github user mohitgargk commented on the issue:

https://github.com/apache/nifi/pull/3007
  
Thanks @MikeThomsen .


---


[GitHub] nifi pull request #3007: NIFI-5596 Upgraded splunk-sdk-java version

2018-09-18 Thread mohitgargk
Github user mohitgargk closed the pull request at:

https://github.com/apache/nifi/pull/3007


---


[GitHub] nifi pull request #3007: Upgraded splunk-sdk-java version

2018-09-16 Thread mohitgargk
GitHub user mohitgargk opened a pull request:

https://github.com/apache/nifi/pull/3007

Upgraded splunk-sdk-java version

Thank you for submitting a contribution to Apache NiFi.

In order to streamline the review of the contribution we ask you
to ensure the following steps have been taken:

### For all changes:
- [ ] Is there a JIRA ticket associated with this PR? Is it referenced 
 in the commit message?

- [ ] Does your PR title start with NIFI- where  is the JIRA number 
you are trying to resolve? Pay particular attention to the hyphen "-" character.

- [ ] Has your PR been rebased against the latest commit within the target 
branch (typically master)?

- [ ] Is your initial contribution a single, squashed commit?

### For code changes:
- [ ] Have you ensured that the full suite of tests is executed via mvn 
-Pcontrib-check clean install at the root nifi folder?
- [ ] Have you written or updated unit tests to verify your changes?
- [ ] If adding new dependencies to the code, are these dependencies 
licensed in a way that is compatible for inclusion under [ASF 
2.0](http://www.apache.org/legal/resolved.html#category-a)? 
- [ ] If applicable, have you updated the LICENSE file, including the main 
LICENSE file under nifi-assembly?
- [ ] If applicable, have you updated the NOTICE file, including the main 
NOTICE file found under nifi-assembly?
- [ ] If adding new Properties, have you added .displayName in addition to 
.name (programmatic access) for each of the new properties?

### For documentation related changes:
- [ ] Have you ensured that format looks appropriate for the output in 
which it is rendered?

### Note:
Please ensure that once the PR is submitted, you check travis-ci for build 
issues and submit an update to your PR as soon as possible.


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mohitgargk/nifi NIFI-5596

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/nifi/pull/3007.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3007


commit ec175b285c23cc2325f3f31a830ceaa6704594e2
Author: Mohit Garg 
Date:   2018-09-16T10:23:56Z

Upgraded splunk-sdk-java version




---


[GitHub] nifi pull request #3003: NIFI-5596 : Upgraded splunk-sdk-java version

2018-09-16 Thread mohitgargk
Github user mohitgargk closed the pull request at:

https://github.com/apache/nifi/pull/3003


---


[GitHub] nifi issue #3003: NIFI-5596 : Upgraded splunk-sdk-java version

2018-09-16 Thread mohitgargk
Github user mohitgargk commented on the issue:

https://github.com/apache/nifi/pull/3003
  
@MikeThomsen I tried with 6.6.6 and 7.1.2 after building nifi. Besides, the 
splunk-sdk-java 1.6.3.0 is released by Splunk and tested on Splunk 5.0 onwards. 
I doubt if splunk-sdk-java is causing nifi's CI tests to get failed. Any 
thoughts?


---


[GitHub] nifi pull request #3003: NIFI-5596 : Upgraded splunk-sdk-java version

2018-09-16 Thread mohitgargk
GitHub user mohitgargk reopened a pull request:

https://github.com/apache/nifi/pull/3003

NIFI-5596 : Upgraded splunk-sdk-java version

Thank you for submitting a contribution to Apache NiFi.

In order to streamline the review of the contribution we ask you
to ensure the following steps have been taken:

### For all changes:
- [ ] Is there a JIRA ticket associated with this PR? Is it referenced 
 in the commit message?

- [ ] Does your PR title start with NIFI- where  is the JIRA number 
you are trying to resolve? Pay particular attention to the hyphen "-" character.

- [ ] Has your PR been rebased against the latest commit within the target 
branch (typically master)?

- [ ] Is your initial contribution a single, squashed commit?

### For code changes:
- [ ] Have you ensured that the full suite of tests is executed via mvn 
-Pcontrib-check clean install at the root nifi folder?
- [ ] Have you written or updated unit tests to verify your changes?
- [ ] If adding new dependencies to the code, are these dependencies 
licensed in a way that is compatible for inclusion under [ASF 
2.0](http://www.apache.org/legal/resolved.html#category-a)? 
- [ ] If applicable, have you updated the LICENSE file, including the main 
LICENSE file under nifi-assembly?
- [ ] If applicable, have you updated the NOTICE file, including the main 
NOTICE file found under nifi-assembly?
- [ ] If adding new Properties, have you added .displayName in addition to 
.name (programmatic access) for each of the new properties?

### For documentation related changes:
- [ ] Have you ensured that format looks appropriate for the output in 
which it is rendered?

### Note:
Please ensure that once the PR is submitted, you check travis-ci for build 
issues and submit an update to your PR as soon as possible.


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mohitgargk/nifi NIFI-5596

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/nifi/pull/3003.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3003


commit 3fd80061cb95362aaa02409aa2e2288544bf85e5
Author: Mohit Garg 
Date:   2018-09-14T07:24:57Z

NIFI-5596 : Upgraded splunk-sdk-java version




---


[GitHub] nifi pull request #3003: NIFI-5596 : Upgraded splunk-sdk-java version

2018-09-16 Thread mohitgargk
Github user mohitgargk closed the pull request at:

https://github.com/apache/nifi/pull/3003


---


[GitHub] nifi issue #3003: NIFI-5596 : Upgraded splunk-sdk-java version

2018-09-16 Thread mohitgargk
Github user mohitgargk commented on the issue:

https://github.com/apache/nifi/pull/3003
  
Retrying CI again.


---


[GitHub] nifi pull request #3003: NIFI-5596 : Upgraded splunk-sdk-java version

2018-09-14 Thread mohitgargk
GitHub user mohitgargk reopened a pull request:

https://github.com/apache/nifi/pull/3003

NIFI-5596 : Upgraded splunk-sdk-java version

Thank you for submitting a contribution to Apache NiFi.

In order to streamline the review of the contribution we ask you
to ensure the following steps have been taken:

### For all changes:
- [ ] Is there a JIRA ticket associated with this PR? Is it referenced 
 in the commit message?

- [ ] Does your PR title start with NIFI- where  is the JIRA number 
you are trying to resolve? Pay particular attention to the hyphen "-" character.

- [ ] Has your PR been rebased against the latest commit within the target 
branch (typically master)?

- [ ] Is your initial contribution a single, squashed commit?

### For code changes:
- [ ] Have you ensured that the full suite of tests is executed via mvn 
-Pcontrib-check clean install at the root nifi folder?
- [ ] Have you written or updated unit tests to verify your changes?
- [ ] If adding new dependencies to the code, are these dependencies 
licensed in a way that is compatible for inclusion under [ASF 
2.0](http://www.apache.org/legal/resolved.html#category-a)? 
- [ ] If applicable, have you updated the LICENSE file, including the main 
LICENSE file under nifi-assembly?
- [ ] If applicable, have you updated the NOTICE file, including the main 
NOTICE file found under nifi-assembly?
- [ ] If adding new Properties, have you added .displayName in addition to 
.name (programmatic access) for each of the new properties?

### For documentation related changes:
- [ ] Have you ensured that format looks appropriate for the output in 
which it is rendered?

### Note:
Please ensure that once the PR is submitted, you check travis-ci for build 
issues and submit an update to your PR as soon as possible.


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mohitgargk/nifi NIFI-5596

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/nifi/pull/3003.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3003


commit 3fd80061cb95362aaa02409aa2e2288544bf85e5
Author: Mohit Garg 
Date:   2018-09-14T07:24:57Z

NIFI-5596 : Upgraded splunk-sdk-java version




---


[GitHub] nifi issue #3003: NIFI-5596 : Upgraded splunk-sdk-java version

2018-09-14 Thread mohitgargk
Github user mohitgargk commented on the issue:

https://github.com/apache/nifi/pull/3003
  
Retrying CI again. 


---


[GitHub] nifi pull request #3003: NIFI-5596 : Upgraded splunk-sdk-java version

2018-09-14 Thread mohitgargk
Github user mohitgargk closed the pull request at:

https://github.com/apache/nifi/pull/3003


---


[GitHub] nifi pull request #3003: NIFI-5596 : Upgraded splunk-sdk-java version

2018-09-14 Thread mohitgargk
GitHub user mohitgargk opened a pull request:

https://github.com/apache/nifi/pull/3003

NIFI-5596 : Upgraded splunk-sdk-java version

Thank you for submitting a contribution to Apache NiFi.

In order to streamline the review of the contribution we ask you
to ensure the following steps have been taken:

### For all changes:
- [ ] Is there a JIRA ticket associated with this PR? Is it referenced 
 in the commit message?

- [ ] Does your PR title start with NIFI- where  is the JIRA number 
you are trying to resolve? Pay particular attention to the hyphen "-" character.

- [ ] Has your PR been rebased against the latest commit within the target 
branch (typically master)?

- [ ] Is your initial contribution a single, squashed commit?

### For code changes:
- [ ] Have you ensured that the full suite of tests is executed via mvn 
-Pcontrib-check clean install at the root nifi folder?
- [ ] Have you written or updated unit tests to verify your changes?
- [ ] If adding new dependencies to the code, are these dependencies 
licensed in a way that is compatible for inclusion under [ASF 
2.0](http://www.apache.org/legal/resolved.html#category-a)? 
- [ ] If applicable, have you updated the LICENSE file, including the main 
LICENSE file under nifi-assembly?
- [ ] If applicable, have you updated the NOTICE file, including the main 
NOTICE file found under nifi-assembly?
- [ ] If adding new Properties, have you added .displayName in addition to 
.name (programmatic access) for each of the new properties?

### For documentation related changes:
- [ ] Have you ensured that format looks appropriate for the output in 
which it is rendered?

### Note:
Please ensure that once the PR is submitted, you check travis-ci for build 
issues and submit an update to your PR as soon as possible.


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mohitgargk/nifi NIFI-5596

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/nifi/pull/3003.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3003


commit 3fd80061cb95362aaa02409aa2e2288544bf85e5
Author: Mohit Garg 
Date:   2018-09-14T07:24:57Z

NIFI-5596 : Upgraded splunk-sdk-java version




---


[GitHub] nifi pull request #3002: Upgraded splunk-sdk-java version to 1.6.3.0

2018-09-14 Thread mohitgargk
Github user mohitgargk closed the pull request at:

https://github.com/apache/nifi/pull/3002


---


[GitHub] nifi pull request #3002: Upgraded splunk-sdk-java version to 1.6.3.0

2018-09-13 Thread mohitgargk
GitHub user mohitgargk opened a pull request:

https://github.com/apache/nifi/pull/3002

Upgraded splunk-sdk-java version to 1.6.3.0

Thank you for submitting a contribution to Apache NiFi.

In order to streamline the review of the contribution we ask you
to ensure the following steps have been taken:

### For all changes:
- [ ] Is there a JIRA ticket associated with this PR? Is it referenced 
 in the commit message?

- [ ] Does your PR title start with NIFI- where  is the JIRA number 
you are trying to resolve? Pay particular attention to the hyphen "-" character.

- [ ] Has your PR been rebased against the latest commit within the target 
branch (typically master)?

- [ ] Is your initial contribution a single, squashed commit?

### For code changes:
- [ ] Have you ensured that the full suite of tests is executed via mvn 
-Pcontrib-check clean install at the root nifi folder?
- [ ] Have you written or updated unit tests to verify your changes?
- [ ] If adding new dependencies to the code, are these dependencies 
licensed in a way that is compatible for inclusion under [ASF 
2.0](http://www.apache.org/legal/resolved.html#category-a)? 
- [ ] If applicable, have you updated the LICENSE file, including the main 
LICENSE file under nifi-assembly?
- [ ] If applicable, have you updated the NOTICE file, including the main 
NOTICE file found under nifi-assembly?
- [ ] If adding new Properties, have you added .displayName in addition to 
.name (programmatic access) for each of the new properties?

### For documentation related changes:
- [ ] Have you ensured that format looks appropriate for the output in 
which it is rendered?

### Note:
Please ensure that once the PR is submitted, you check travis-ci for build 
issues and submit an update to your PR as soon as possible.


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mohitgargk/nifi NIFI-5596

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/nifi/pull/3002.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3002


commit 441052bfcc0f01707f6a6e5f46cd9ae2e2dda7bb
Author: Mohit Garg 
Date:   2018-09-14T06:52:32Z

Upgraded splunk-sdk-java version to 1.6.3.0




---