Howdy,
As suggested I ran "mvn clean install" and in another session
ran:
ps -hax -o user | grep whateverusernameyoubuildas | uniq -c
I ran it lots of times. It gave answers like
$ ps -hax -o user | grep plj | uniq -c
14 plj
Then I ran it after I started getting the "Caused by:
java.lang.OutOfMemoryError: unable to create new native thread
$ ps -hax -o user | grep plj | uniq -c
-bash: fork: retry: Resource temporarily unavailable
-bash: fork: retry: Resource temporarily unavailable
-bash: fork: retry: Resource temporarily unavailable
-bash: fork: retry: Resource temporarily unavailable
-bash: fork: Resource temporarily unavailable
I get the OutOfMemoryError many times and now it hangs (it used to finish with
errors) when it gets to:
Running org.apache.nifi.processors.standard.TestListenUDP
Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0 sec - in
org.apache.nifi.processors.standard.TestListenUDP
My env is below.
Thank you very much for the help
Pat
---------------
$ env
TERM=xterm
SHELL=/bin/bash
XDG_SESSION_COOKIE=xxx
SSH_CLIENT=xx.xxx.xx.xx xxxxx xx
SSH_TTY=/dev/pts/6
http_proxy=http://xxx.xxx.org:80/
USER=plj
LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lz=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.axa=00;36:*.oga=00;36:*.spx=00;36:*.xspf=00;36:
ftp_proxy=ftp://xxx.xxx.org:80/
MAVEN_OPTS=-Xms1024m -Xmx3076m -XX:MaxPermSize=256m
MAIL=/var/mail/plj
PATH=/usr/lib/jvm/java-7-oracle/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
QT_QPA_PLATFORMTHEME=appmenu-qt5
PWD=/home/plj/incubator-nifi/nifi
JAVA_HOME=/usr/lib/jvm/java-7-oracle
socks_proxy=socks://xxx.xxx.org:80/
LANG=en_US.UTF-8
https_proxy=https://xxx.xxx.org:80/
KRB5CCNAME=FILE:/tmp/xxx
SHLVL=1
HOME=/home/plj
LOGNAME=plj
SSH_CONNECTION=xxx.xxx.xx.xx xxxx xx.xx.xx.xx xx
LESSOPEN=| /usr/bin/lesspipe %s
DISPLAY=localhost:10.0
LESSCLOSE=/usr/bin/lesspipe %s %s
_=/usr/bin/env
OLDPWD=/home/plj
I also changed to a more recent java (doesn't seem to matter)
$ java -version
java version "1.7.0_80"
Java(TM) SE Runtime Environment (build 1.7.0_80-b15)
Java HotSpot(TM) 64-Bit Server VM (build 24.80-b11, mixed mode)
From: Joe Witt [via Apache NiFi (incubating) Developer List]
[mailto:[email protected]]
Sent: Thursday, June 18, 2015 10:22 PM
To: Jones, Patrick L.
Subject: Re: mvn fail
Pat
You can ignore that error/warning when attempting to set the network
parameter. It is likely less relevant with newer kernels and it is
more of an optimization than a work/not work setting.
As for the actual AssertionError it is likely a side effect of the
other error condition previously included which was
"Caused by: java.lang.OutOfMemoryError: unable to create new native thread
at java.lang.Thread.start0(Native Method)
at java.lang.Thread.start(Thread.java:714)"
This is the error that needs the attention. Your 'ulimit -a' output
shows a max of 10,000 user processes. This should be *way more* than
enough so there must be more to this story. While building nifi you
can run in another session the following
ps -hax -o user | grep whateverusernameyoubuildas | uniq -c
It should never get close to the max of 10000 you have indicated. How
much memory does this system have? Have you tried using a smaller
amount of memory for the build info with Maven? Consider perhaps
having
MAVEN_OPTS=-Xms1024m -Xmx3076m -XX:MaxPermSize=256m
Also can you please paste the results of typing 'env' here as well
(remove anything sensitive of course please).
Thanks
Joe
On Thu, Jun 18, 2015 at 1:39 PM, plj <[hidden
email]</user/SendEmail.jtp?type=node&node=1969&i=0>> wrote:
> I'm still getting the errors when I run mvn clean install from the nifi
> directory.
> Before I said that I had done the various sys admin required. When I went
> over it again I discovered that when I issued:
> $ sudo sysctl -w net.ipv4.netfilter.ip_conntrack_tcp_timeout_time_wait="1"
> I get
> sysctl: cannot stat
> /proc/sys/net/ipv4/netfilter/ip_conntrack_tcp_timeout_time_wait: No such
> file or directory
>
> Note there is no directory /proc/sys/net/ipv4/netfilter and no file
> tcp_timeout_time_wait
>
> any thoughts?
>
>
> ------ error as reported previously --------
> Running org.apache.nifi.processors.standard.TestHandleHttpRequest
> Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 6.675 sec
> <<< FAILURE! - in org.apache.nifi.processors.standard.TestHandleHttpRequest
> testRequestAddedToService(org.apache.nifi.processors.standard.TestHandleHttpRequest)
> Time elapsed: 6.675 sec <<< FAILURE!
> java.lang.AssertionError: Could not invoke methods annotated with
> @OnScheduled annotation due to: java.lang.reflect.InvocationTargetException
> at org.junit.Assert.fail(Assert.java:88)
> at
> org.apache.nifi.util.StandardProcessorTestRunner.run(StandardProcessorTestRunner.java:199)
> at
> org.apache.nifi.util.StandardProcessorTestRunner.run(StandardProcessorTestRunner.java:182)
> at
> org.apache.nifi.processors.standard.TestHandleHttpRequest.testRequestAddedToService(TestHandleHttpRequest.java:100)
>
> Running org.apache.nifi.processors.standard.TestReplaceTextWithMapping
> Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec -
> in org.apache.nifi.processors.standard.TestReplaceTextWithMapping
> Running org.apache.nifi.processors.standard.TestJmsConsumer
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec -
> in org.apache.nifi.processors.standard.TestJmsConsumer
> Running org.apache.nifi.processors.standard.TestSplitText
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in
> org.apache.nifi.processors.standard.TestSplitText
> Running org.apache.nifi.processors.standard.TestSplitXml
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec -
> in org.apache.nifi.processors.standard.TestSplitXml
> Running org.apache.nifi.processors.standard.TestBase64EncodeContent
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec -
> in org.apache.nifi.processors.standard.TestBase64EncodeContent
> Running org.apache.nifi.processors.standard.TestUnpackContent
> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec -
> in org.apache.nifi.processors.standard.TestUnpackContent
> Running org.apache.nifi.processors.standard.TestExtractText
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec -
> in org.apache.nifi.processors.standard.TestExtractText
> Running org.apache.nifi.processors.standard.TestConvertCharacterSet
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in
> org.apache.nifi.processors.standard.TestConvertCharacterSet
> Running org.apache.nifi.processors.standard.TestSegmentContent
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec -
> in org.apache.nifi.processors.standard.TestSegmentContent
> Running org.apache.nifi.processors.standard.TestCompressContent
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in
> org.apache.nifi.processors.standard.TestCompressContent
> Running org.apache.nifi.processors.standard.TestMonitorActivity
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.063 sec -
> in org.apache.nifi.processors.standard.TestMonitorActivity
> Running org.apache.nifi.processors.standard.TestExecuteStreamCommand
> Tests run: 7, Failures: 5, Errors: 1, Skipped: 1, Time elapsed: 2.723 sec
> <<< FAILURE! - in
> org.apache.nifi.processors.standard.TestExecuteStreamCommand
> testExecuteIngestAndUpdateWithWorkingDir(org.apache.nifi.processors.standard.TestExecuteStreamCommand)
> Time elapsed: 0.115 sec <<< FAILURE!
> java.lang.AssertionError: java.lang.OutOfMemoryError: unable to create new
> native thread
> at
> org.apache.nifi.util.StandardProcessorTestRunner.run(StandardProcessorTestRunner.java:219)
> at
> org.apache.nifi.util.StandardProcessorTestRunner.run(StandardProcessorTestRunner.java:182)
> at
> org.apache.nifi.util.StandardProcessorTestRunner.run(StandardProcessorTestRunner.java:177)
> at
> org.apache.nifi.processors.standard.TestExecuteStreamCommand.testExecuteIngestAndUpdateWithWorkingDir(TestExecuteStreamCommand.java:150)
> Caused by: java.lang.OutOfMemoryError: unable to create new native thread
> at java.lang.Thread.start0(Native Method)
> at java.lang.Thread.start(Thread.java:714)
> at
> org.apache.nifi.processors.standard.ExecuteStreamCommand$StdInWriterCallback$1.process(ExecuteStreamCommand.java:376)
> at
> org.apache.nifi.util.MockProcessSession.write(MockProcessSession.java:593)
> at
> org.apache.nifi.util.MockProcessSession.write(MockProcessSession.java:58)
> at
> org.apache.nifi.processors.standard.ExecuteStreamCommand$StdInWriterCallback.process(ExecuteStreamCommand.java:357)
> at
> org.apache.nifi.util.MockProcessSession.read(MockProcessSession.java:411)
> at
> org.apache.nifi.processors.standard.ExecuteStreamCommand.onTrigger(ExecuteStreamCommand.java:292)
> at
> org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
> at
> org.apache.nifi.util.StandardProcessorTestRunner$RunProcessor.call(StandardProcessorTestRunner.java:269)
> at
> org.apache.nifi.util.StandardProcessorTestRunner$RunProcessor.call(StandardProcessorTestRunner.java:263)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
>
>
>
> --
> View this message in context:
> http://apache-nifi-incubating-developer-list.39713.n7.nabble.com/mvn-fail-tp1716p1962.html
> Sent from the Apache NiFi (incubating) Developer List mailing list archive at
> Nabble.com.
________________________________
If you reply to this email, your message will be added to the discussion below:
http://apache-nifi-incubating-developer-list.39713.n7.nabble.com/mvn-fail-tp1716p1969.html
To unsubscribe from mvn fail, click
here<http://apache-nifi-incubating-developer-list.39713.n7.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1716&code=cGxqQG1pdHJlLm9yZ3wxNzE2fDU1MTMzODA1>.
NAML<http://apache-nifi-incubating-developer-list.39713.n7.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
--
View this message in context:
http://apache-nifi-incubating-developer-list.39713.n7.nabble.com/mvn-fail-tp1716p1971.html
Sent from the Apache NiFi (incubating) Developer List mailing list archive at
Nabble.com.
