Thanks Matt for reply...
So is there any other way to read data from have table into batches because
my table having millions of row and i am using NiFi 1.3
I tried with below processor:-
1. ExecuteHQL(Customer processor of Kylo) -- creating single file to
downstream.
2. SelectHiveQL - "Max Rows
Hi team ,
We are using nifi copy framework to copy data across clusters but are
facing issues in terms of duplicates ( can nifi stops or check if table is
already present in the destination cluster ?) . Moreover if volume is more
than 1 tb we are finding distcp a better option as nifi flow is taki
Hi Everyone,
I am looking for a processor for Azure Data Lake which can work in cluster mode
setup with separate zookeeper instance.
If any one has worked on a similar use case, appreciate your help here. I see
that there is no inbuilt ADL processor which comes up with Nifi. What is the
recomm
Atul,
If you're finding distcp to be a good enough tool for the job then I
would definitely use it. For the things distcp works for it is very
stable/very to the point/and if your use case fits squarely inside
there you'll be in a good position.
If you need more than direct file replication from
This sounds like a bug in HiveJdbcCommon, we should be able to support
a Hive SMALLINT into an Avro integer or something.
On Tue, Mar 20, 2018 at 11:53 AM, Rohit wrote:
> Hi Matt,
>
> Issue got resolved after casting smallint to int, as avro not supported
> smallint datatype.
>
> Thanks.
>
>
>
>
On behalf of the Apache NiFI PMC, I am very pleased to announce that Mike
has accepted the PMC's invitation to become a committer on the Apache NiFi
project. We greatly appreciate all of Mike's hard work and generous
contributions to the project. We look forward to his continued involvement
in the
Congrats, Mike!
On 3/21/18, 09:42, "Tony Kurc" wrote:
On behalf of the Apache NiFI PMC, I am very pleased to announce that Mike
has accepted the PMC's invitation to become a committer on the Apache NiFi
project. We greatly appreciate all of Mike's hard work and generous
contribu
Mike
Thanks for all the great contributions and reviews and discussions and
congratulations on the well deserved commit bit!
Thanks
Joe
On Wed, Mar 21, 2018 at 1:53 PM, Kevin Doran wrote:
> Congrats, Mike!
>
> On 3/21/18, 09:42, "Tony Kurc" wrote:
>
> On behalf of the Apache NiFI PMC, I a
Thanks everyone!
On Wed, Mar 21, 2018 at 9:55 AM, Joe Witt wrote:
> Mike
>
> Thanks for all the great contributions and reviews and discussions and
> congratulations on the well deserved commit bit!
>
> Thanks
> Joe
>
> On Wed, Mar 21, 2018 at 1:53 PM, Kevin Doran wrote:
> > Congrats, Mike!
> >
Congrats Mike, well deserved!
2018-03-21 14:55 GMT+01:00 Mike Thomsen :
> Thanks everyone!
>
> On Wed, Mar 21, 2018 at 9:55 AM, Joe Witt wrote:
>
> > Mike
> >
> > Thanks for all the great contributions and reviews and discussions and
> > congratulations on the well deserved commit bit!
> >
> > T
Congrats!
On Wed, Mar 21, 2018 at 10:15 AM, Pierre Villard <
pierre.villard...@gmail.com> wrote:
> Congrats Mike, well deserved!
>
> 2018-03-21 14:55 GMT+01:00 Mike Thomsen :
>
> > Thanks everyone!
> >
> > On Wed, Mar 21, 2018 at 9:55 AM, Joe Witt wrote:
> >
> > > Mike
> > >
> > > Thanks for all
Congrats Mike!
On Wed, Mar 21, 2018 at 11:20 AM Scott Aslan wrote:
> Congrats!
>
> On Wed, Mar 21, 2018 at 10:15 AM, Pierre Villard <
> pierre.villard...@gmail.com> wrote:
>
> > Congrats Mike, well deserved!
> >
> > 2018-03-21 14:55 GMT+01:00 Mike Thomsen :
> >
> > > Thanks everyone!
> > >
> > >
Congratulations, Mike :)
On Wed, 21 Mar 2018 at 8:57 PM, Jeff wrote:
> Congrats Mike!
>
> On Wed, Mar 21, 2018 at 11:20 AM Scott Aslan
> wrote:
>
> > Congrats!
> >
> > On Wed, Mar 21, 2018 at 10:15 AM, Pierre Villard <
> > pierre.villard...@gmail.com> wrote:
> >
> > > Congrats Mike, well deserv
Congrats Mike! Well deserved!
On Wed, 21 Mar 2018, 16:53 Sivaprasanna, wrote:
> Congratulations, Mike :)
>
> On Wed, 21 Mar 2018 at 8:57 PM, Jeff wrote:
>
> > Congrats Mike!
> >
> > On Wed, Mar 21, 2018 at 11:20 AM Scott Aslan
> > wrote:
> >
> > > Congrats!
> > >
> > > On Wed, Mar 21, 2018 at
Looks like Oracle just dropped Java 10 on us:
http://www.oracle.com/technetwork/java/javase/downloads/jdk10-downloads-4416644.html
Announcement for anyone interested:
http://mail.openjdk.java.net/pipermail/announce/2018-March/000247.html
Thank you for your prior and continued contributions Mike, and congrats!
On Wed, Mar 21, 2018 at 12:59 PM, Marco Gaido
wrote:
> Congrats Mike! Well deserved!
>
> On Wed, 21 Mar 2018, 16:53 Sivaprasanna,
> wrote:
>
> > Congratulations, Mike :)
> >
> > On Wed, 21 Mar 2018 at 8:57 PM, Jeff wrote:
I've initiated the request for the nifi-fds.git repository in the ASF
git-wip. Should be ready in about an hour.
I *think* it has github mirroring by default but if not we'll file a
JIRA with asf-infra to enable that.
Thanks
On Mon, Mar 12, 2018 at 4:28 PM, Scott Aslan wrote:
> All,
>
> This v
Great news. Wish this new initiative achieves the same success that NiFi
has achieved. With a community as good as ours, I have no doubt in it. All
the very best!
-
Sivaprasanna
On Wed, 21 Mar 2018 at 11:25 PM, Joe Witt wrote:
> I've initiated the request for the nifi-fds.git repository in the
Team: I did receive confirmation that the github mirroring is being
setup and it may take up to 24 hours.
So I think we're all set with this. Thanks
On Wed, Mar 21, 2018 at 2:03 PM, Sivaprasanna wrote:
> Great news. Wish this new initiative achieves the same success that NiFi
> has achieved. Wi
Hi Animesh,
There is an ADLS connector underway but is lacking traction.
Here is the PR: https://github.com/apache/nifi/pull/2158
Probably you can self build this and use it.
Will be great if you come back and provide some feedback on this.
Thanks,
Milan.
-Original Message-
From: Animesh
Hi,
Need reviewers for PR: https://github.com/apache/nifi/pull/2158
Please pitch in for review or recommend someone who can give insights.
ADLS is gaining attention among NIFI users lately.
Just to quote an example, Animesh yesterday asked for this on user group.
P.S: ADLS is Azure Data Lake St
Team,
An update. After a couple important findings mentioned in NIFI-4995
I've got the RC staged now. Will do some final validation in the
morning and send out the RC vote assuming all is well.
I've created 1.7.0 for any new commits to master to be set to in JIRA.
Thanks
Joe
On Tue, Mar 20, 20
I had a chance to attempt a question raised on stackoverflow regarding
moving data from SQL Server to MySQL using NiFi. The user is using
GenerateTableFetch to read data from SQL Server and then try to use LOAD
DATA command in ExecuteSQL but this involves writing the read SQL Server
data to filesys
23 matches
Mail list logo
