Github user pvillard31 commented on the issue:
https://github.com/apache/nifi/pull/379
Closing this one as I don't have time to get back into it at the moment.
For anyone interested, it would at least be necessary to upgrade Alluxio
version to the latest. (@HorizonNet - I see you're
Github user joewitt commented on the issue:
https://github.com/apache/nifi/pull/379
@pvillard31 this poor PR has been hanging out for quite a while. Shall we
try again? Can you update?
---
Github user trixpan commented on the issue:
https://github.com/apache/nifi/pull/379
@pvillard31 that connection strategy is agnostic to the underlying
filesystem supporting alluxio. What it does is to allow a hadoop compatible
application to access alluxio without further coding and
Github user pvillard31 commented on the issue:
https://github.com/apache/nifi/pull/379
Hey @trixpan, I didn't try but maybe that would work, I honestly don't
know. However, Alluxio can run on top of a lot of storage solutions, so it
makes sense to have a dedicated processor. Anyway,
Github user trixpan commented on the issue:
https://github.com/apache/nifi/pull/379
And by last comment I naturally refer to use a customised core-site.xml
that includes:
```
fs.alluxio.impl
alluxio.hadoop.FileSystem
The Alluxio FileSystem (Hadoop 1.x
Github user trixpan commented on the issue:
https://github.com/apache/nifi/pull/379
@pvillard31 not sure if it is the case but have you by any chance tried to
use the Hadoop alluxio interfaces with puthdfs and co instead of a new
processor?
e.g
Github user joewitt commented on the issue:
https://github.com/apache/nifi/pull/379
@jdye64 any chance you could have some cycles to review this as the
originator of the JIRA?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as
Github user joewitt commented on the issue:
https://github.com/apache/nifi/pull/379
i dont know anything about the target systems so I probably won't be a
great reviewer. If nobody else is in a good position to help though I'll give
it a whirl.
---
If your project is set up for
Github user pvillard31 commented on the issue:
https://github.com/apache/nifi/pull/379
and... almost forgot to link a template to play with the processors:
https://gist.github.com/pvillard31/2bf996adefaf1709339451d71c343ac1
---
If your project is set up for it, you can reply to
Github user pvillard31 commented on the issue:
https://github.com/apache/nifi/pull/379
@apiri @joewitt
I updated the PR with the following changes:
- Alluxio version changed to 1.4.0 to include the expected improvement
(https://github.com/Alluxio/alluxio/pull/4422) and
Github user pvillard31 commented on the issue:
https://github.com/apache/nifi/pull/379
Hey @joewitt, I will update the PR asap this week.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user joewitt commented on the issue:
https://github.com/apache/nifi/pull/379
@pvillard31 do you still think we can get this across the finish line?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user apiri commented on the issue:
https://github.com/apache/nifi/pull/379
no rush! was just trying to revisit items in the queue
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user pvillard31 commented on the issue:
https://github.com/apache/nifi/pull/379
Hey @apiri, yes Alluxio guys informed me about this, I'll try to update the
PR asap. Will let you know when it's done.
---
If your project is set up for it, you can reply to this email and have
Github user apiri commented on the issue:
https://github.com/apache/nifi/pull/379
@pvillard31 I saw that the referenced ticket seems to now be resolved. Not
sure if this was still of interest, but if so would be happy to revisit upon
updating.
---
If your project is set up for it,
Github user pvillard31 commented on the issue:
https://github.com/apache/nifi/pull/379
Hey guys,
I've done some rework on this PR. After some discussions with Alluxio
folks, it seems that there are some limitations at the moment (v1.3.0) and I've
made some modifications to
16 matches
Mail list logo
