To show the problem please find the sample tracelog generated by nifi 1.16.1
Regards,
Mike
From: Michal Tomaszewski
Date: Wednesday, 4 May 2022 at 10:01
To: users@nifi.apache.org
Subject: NiFi 1.16.1 Re: nifi 15.3 - puthive3streaming
Hi,
I think the issue described below was not solved yet. In
still need to use nar from 1.15.1 version or there is any patch for it?
Regards,
Mike
From: Michal Tomaszewski
Date: Friday, 21 January 2022 at 15:37
To: users@nifi.apache.org
Subject: RE: nifi 15.3 - puthive3streaming
Joe,
Please find trace enclosed.
Martin wrote it works for him with 1.15.1 nar
ing is quite conservative (nifi.properties):
> nifi.content.repository.archive.max.usage.percentage=50%
>
> Please try to set it higher, e.g. 80%
>
> Best,
> Peter Turcsanyi
>
> On Fri, Jan 21, 2022 at 4:35 PM Michal Tomaszewski
> wrote:
>>
>> Find enclose
Find enclosed pictures with setting for ReplaceText
From: Michal Tomaszewski
Hi,
We found next issues in 1.15.3:
#1
GenrateFlowFile, when anything is set in custom text (e.g. 1,2,3,4) having all
other standard settings - flow is not generated, component hangs doing nothing
with nothing in
Hi,
We found next issues in 1.15.3:
#1
GenrateFlowFile, when anything is set in custom text (e.g. 1,2,3,4) having all
other standard settings - flow is not generated, component hangs doing nothing
with nothing in logs.
When custom text is not filled-in - it generates flow without any problem.
#
i 15.3 installation I have replaced the
>> nifi-hive3-nar-1.15.3.nar through the nifi-hive3-nar-1.15.1.nar and it
>> worked again. So it must be a problem with the 15.3 version and not a
>> compilation problem on your side.
>>
>>
>>
>> Kind regards
>>
&
Hi again,
After compiling 15.3 with hive3 using options:
mvn -T C2.0 clean install -DskipTests -Dhive.version=3.1.0 -Dhbase.version=2.0.2
processor puthive3streaming is not working with error message:
"java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost"
Isn't it related t
as those in the kite nar.
>
>
> Cheers,
>
> Chris Sampson
>
> On Thu, 20 Jan 2022, 18:08 Michal Tomaszewski,
> wrote:
>>
>> Joe,
>>
>> Does it mean ConvertCSVToAvro will disappear too?
>>
>> Or you discontinue only a part of org.apache.nifi.
ded.
On Wed, Jan 19, 2022 at 8:48 AM Michal Tomaszewski
mailto:michal.tomaszew...@cca.pl>> wrote:
>
> OK, but there is information that log4j-core:jar:2.17.1 is blocked:
>
> [WARNING] Rule 0: org.apache.maven.plugins.enforcer.BannedDependencies fail
22 at 8:27 AM Michal Tomaszewski
mailto:michal.tomaszew...@cca.pl>> wrote:
Compilation with -Dhive.version=3.1.0 makes the problem.
mvn -e -X -T C2.0 clean install -DskipTests -Dhive.version=3.1.0
is not successful.
We also tested -Dhive.version=3.1.2, that is most recent on Apache Hive
this though, so if you can figure out
which dependency path is the issue, the fix is to add some exclusions and then
to ensure that log4j-to-slf4j dependency is added.
On Wed, Jan 19, 2022 at 8:48 AM Michal Tomaszewski
wrote:
>
> OK, but there is information that log4j-core:jar:2.17.1 is b
x27;s including problematic transitive
dependencies for log4j. I think those are coming with the specific versions of
HBase/Hive you're using. Not a maven expert but I guess there is a way to
exclude the step "enforce-banned-dependencies" from the build.
Le mer. 19 janv. 2022 à 12:57
Hi,
We are trying to compile nifi from sources.
There is no problem with 1.15.1 compilation but in case of 1.15.2 and 1.15.3
there are compilation errors.
Can you suggest how to solve this problem?
mvn dependency:tree has no errors:
$ tail log1.txt
[INFO] nifi-toolkit-flowfile-repo ...
Thanks!
Regards,
Michal
From: Mark Payne
Sent: Friday, March 19, 2021 3:01 PM
To: users@nifi.apache.org
Subject: Re: SplitText issue
Michal,
We are working on a 1.13.2 release currently that should address this.
Thanks
-Mark
On Mar 19, 2021, at 9:31 AM, Michal Tomaszewski
Hello,
Please advice if there is any solution to use nifi with Elasticsearch 7.2?
We need to use bulk load API PutElasticsearchHTTPrecord as we load quite big
amount of data but after Elasticsearch upgrade to 7.x this component is not
loading any data and reporting timeouts.
Regards,
and I will look into it from the NiFi side.
Thanks,
Matt
[1] https://issues.apache.org/jira/browse/HIVE-20428
On Mon, Aug 20, 2018 at 11:39 AM Michal Tomaszewski
mailto:michal.tomaszew...@cca.pl>> wrote:
Hello,
I’m using PutHive3Streaming processor working on 3 nodes cluster.
Processor is
s to do with being authenticated and passing the
> username to Ranger, but I'm not sure. Having said that, there may be some
> properties you could set in hive-site.xml to specify a username/password. I'll
> ask around and follow up if I find out anything.
>
> Regards,
> Ma
ll be a nifi-hive3-nar created in nifi-hive3-nar/target.
> The
> processors include SelectHive3QL, PutHive3QL, PutHive3Streaming, and
> PutORC, as well as a Hive3ConnectionPool for the JDBC processors
> (Select/Put).
>
> Regards,
> Matt
>
> On Mon, Jul 30, 2018 at
From: Pierre Villard
Sent: Monday, July 30, 2018 11:40 AM
To: users@nifi.apache.org
Subject: Re: PutHiveStreaming + Hive 3.0
Hi Mike,
By any chance, could you share the full stack trace from nifi-app.log?
Thanks,
Pierre
2018-07-30 11:19 GMT+02:00 Michal Tomaszewski
<mailto:michal.tomas
Hello,
Is PutHiveStreaming processor working with Hive 3.0?
We installed Hortonworks HDP 3.0, compiled newest NiFi 1.8 snapshot and got
errors:
Failed connecting to Hive endpoint table: hivetest3 at thrift://servername.
NiFi has access to all site.xml's. Configuration is exactly the same as with
age-
> From: Michal Tomaszewski
> Sent: Monday, February 19, 2018 4:10 PM
> To: users@nifi.apache.org
> Subject: RE: PutHiveStreaming NullPointerException error
>
> Matt,
>
> Regarding all mentioned points:
>
> > The post you mention has a comment in there suggesting
l - so I
believe it is not an issue caused by [2].
Regards,
Mike
>
> On Mon, Feb 19, 2018 at 8:35 AM, Michal Tomaszewski
> wrote:
> > Hi Matt,
> > Thank you for reply.
> > NiFi is compiled exactly like you mentioned. Otherwise we could not use
> PutHiveQL proce
rifying.
> >
> > I think the issue is that to interact properly with the Hive version
> > in HDP we have to swap out some dependencies at build time.
> >
> > Mattyb is definitely more knowledgeable so hopefully he can comment
> soon.
> >
> > On Mon, Feb 19,
> >> The libraries involved are different than what we build/provide
> >> directly. If you can recreate the same problem using apache nifi as
> >> we provide it as a community it would be easier for someone to help
> >> here and otherwise you migh
that configuration.
>
> Thanks
>
> On Mon, Feb 19, 2018 at 6:13 AM, Michal Tomaszewski
> wrote:
> > Hi Team,
> >
> > Should I send this question to NiFi dev list instead of NiFi users?
> >
> > Regards,
> > Mike
> >
> &
Hi Team,
Should I send this question to NiFi dev list instead of NiFi users?
Regards,
Mike
>> 2018-02-15 17:42:29,901 ERROR [Timer-Driven Process Thread-11] hive.log Got
>> exception: java.lang.NullPointerException null
>> java.lang.NullPointerException: null
>>at
>> org.apache.hadoop
Hi All,
PutHiveStreaming throws lots of errors like bellow:
ERROR [Timer-Driven Process Thread-11] hive.log Got exception:
java.lang.NullPointerException null
java.lang.NullPointerException: null
Errors appear when PutHiveStreaming is working. It appears from every few
seconds to few times a s
27 matches
Mail list logo
