Thanks sebb. And do you agree with my analysis ?
Regards Philippe On Mon, Jan 14, 2013 at 6:23 PM, sebb <[email protected]> wrote: > Thanks! > > On 13 January 2013 15:25, Philippe Mouawad <[email protected]> > wrote: > > Hello, > > Regarding this error I think it does not reflect a real bug. > > > > I compared the contents of the 2 files, for CSV they contain the same > data > > but order of some samplers have been changed due to threading in some > > samplers. > > As Batch mode cumulates sample results before sending them we end up > having > > a set written differently. > > > > REgarding XML file, there is a difference as content is stripped by > > SampleListener we don't have it in results (so we should modify the XML > > file). > > > > So what I did is the following: > > - I set in jmeter-batch.properties num_sample_threshold=1 > > > > > > I introduced BatchTestLocalRemote.jmx which is a copy/paste of > > BatchTestLocal.jmx with the following changes: > > > > - Response data is not saved > > > > Regards > > > > Philippe > > > > On Sun, Jan 13, 2013 at 2:30 PM, Apache Jenkins Server < > > [email protected]> wrote: > > > >> See <https://builds.apache.org/job/JMeter-trunk/2840/> > >> > >> ------------------------------------------ > >> [...truncated 678 lines...] > >> [anakia] Input: changes_history.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/changes_history.html > >> > > >> [anakia] Input: download_jmeter.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/download_jmeter.html > >> > > >> [anakia] Input: index.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/index.html > >> > > >> [anakia] Input: issues.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/issues.html > >> > > >> [anakia] Input: jmeter_irc.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/jmeter_irc.html > >> > > >> [anakia] Input: localising/index.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/localising/index.html > >> > > >> [anakia] Input: mail.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/mail.html > >> > > >> [anakia] Input: mail2.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/mail2.html > >> > > >> [anakia] Input: nightly.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/nightly.html > >> > > >> [anakia] Input: svnindex.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/svnindex.html > >> > > >> [anakia] Input: usermanual/best-practices.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/best-practices.html > >> > > >> [anakia] Input: usermanual/boss.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/boss.html > >> > > >> [anakia] Input: usermanual/build-adv-web-test-plan.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-adv-web-test-plan.html > >> > > >> [anakia] Input: usermanual/build-db-test-plan.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-db-test-plan.html > >> > > >> [anakia] Input: usermanual/build-ftp-test-plan.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-ftp-test-plan.html > >> > > >> [anakia] Input: usermanual/build-jms-point-to-point-test-plan.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-jms-point-to-point-test-plan.html > >> > > >> [anakia] Input: usermanual/build-jms-topic-test-plan.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-jms-topic-test-plan.html > >> > > >> [anakia] Input: usermanual/build-ldap-test-plan.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-ldap-test-plan.html > >> > > >> [anakia] Input: usermanual/build-ldapext-test-plan.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-ldapext-test-plan.html > >> > > >> [anakia] Input: usermanual/build-monitor-test-plan.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-monitor-test-plan.html > >> > > >> [anakia] Input: usermanual/build-test-plan.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-test-plan.html > >> > > >> [anakia] Input: usermanual/build-web-test-plan.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-web-test-plan.html > >> > > >> [anakia] Input: usermanual/build-ws-test-plan.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-ws-test-plan.html > >> > > >> [anakia] Input: usermanual/component_reference.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/component_reference.html > >> > > >> [anakia] Input: usermanual/functions.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/functions.html > >> > > >> [anakia] Input: usermanual/get-started.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/get-started.html > >> > > >> [anakia] Input: usermanual/glossary.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/glossary.html > >> > > >> [anakia] Input: usermanual/hints_and_tips.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/hints_and_tips.html > >> > > >> [anakia] Input: usermanual/index.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/index.html > >> > > >> [anakia] Input: usermanual/intro.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/intro.html > >> > > >> [anakia] Input: usermanual/ldapanswer_xml.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/ldapanswer_xml.html > >> > > >> [anakia] Input: usermanual/ldapops_tutor.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/ldapops_tutor.html > >> > > >> [anakia] Input: usermanual/listeners.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/listeners.html > >> > > >> [anakia] Input: usermanual/regular_expressions.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/regular_expressions.html > >> > > >> [anakia] Input: usermanual/remote-test.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/remote-test.html > >> > > >> [anakia] Input: usermanual/test_plan.xml > >> [anakia] Output: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/test_plan.html > >> > > >> [echo] Fixing EOL > >> [echo] Removing unnecessary </br> tags > >> [echo] Copying files > >> [copy] Copying 16 files to < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/demos> > >> [copy] Copying 5 files to < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual > >> > > >> [copy] Copying 1 file to < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/extending > >> > > >> > >> pack-nightly: > >> > >> _pack-binaries: > >> [tar] Building tar: < > >> > https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_bin.tar > >> > > >> [gzip] Building: < > >> > https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_bin.tgz > >> > > >> [delete] Deleting: < > >> > https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_bin.tar > >> > > >> [zip] Building zip: < > >> > https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_bin.zip > >> > > >> > >> _pack-libraries: > >> [tar] Building tar: < > >> > https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_lib.tar > >> > > >> [gzip] Building: < > >> > https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_lib.tgz > >> > > >> [delete] Deleting: < > >> > https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_lib.tar > >> > > >> [zip] Building zip: < > >> > https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_lib.zip > >> > > >> > >> _pack-source: > >> [tar] Building tar: < > >> > https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_src.tar > >> > > >> [gzip] Building: < > >> > https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_src.tgz > >> > > >> [delete] Deleting: < > >> > https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_src.tar > >> > > >> [zip] Building zip: < > >> > https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_src.zip > >> > > >> > >> nightly: > >> > >> compile-tests: > >> [javac] Compiling 98 source files to < > >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/build/test> > >> > >> _test: > >> [echo] > >> [echo] gump.run = false > >> [echo] java.awt.headless = true > >> [echo] test.headless = true > >> [echo] user.dir = < > >> https://builds.apache.org/job/JMeter-trunk/ws/trunk> > >> [echo] basedir = < > >> https://builds.apache.org/job/JMeter-trunk/ws/trunk> > >> [echo] test dir = build/test > >> [echo] test dir gump = build/test > >> [echo] testsaveservice.saveout = ${testsaveservice.saveout} > >> [echo] test.encoding = UTF-8 > >> [echo] > >> [java] Setting JMeterHome: < > >> https://builds.apache.org/job/JMeter-trunk/ws/trunk> > >> [java] Setting up logging props using file: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/testfiles/jmetertest.properties > >> > > >> [java] Using initializeProperties() from > >> org.apache.jmeter.util.JMeterUtils > >> [java] Setting up initial properties using: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/testfiles/jmetertest.properties > >> > > >> [java] Initializing Properties: < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/testfiles/jmetertest.properties > >> > > >> [java] JMeterVersion=r1432525 > >> [java] java.version=1.6.0_27 > >> [java] java.home=/home/jenkins/tools/java/jdk1.6.0_27-32/jre > >> [java] file.encoding=UTF-8 > >> [java] default encoding=UTF-8 > >> [java] user.dir=< > >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin> > >> [java] Locale=en_US > >> [java] os.name=Linux > >> [java] os.version=3.2.0-31-generic > >> [java] +++++++++++ > >> [java] java.awt.headless=true > >> [java] java.awt.graphicsenv=sun.awt.X11GraphicsEnvironment > >> [java] ------------ > >> [java] Creating test suite > >> [java] Scanning build/test for test cases > >> [java] ClassFinder found: 87 TestCase classes > >> [java] Last > >> class=org.apache.jmeter.visualizers.ViewResultsFullVisualizer > >> [java] objects.size=106 > >> [java] Last error=null > >> [java] ERROR: (see logfile) could not add test for class > >> org.apache.jmeter.junit.JMeterTest > >> java.lang.reflect.InvocationTargetException > >> [java] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native > >> Method) > >> [java] at > >> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > >> [java] at > >> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > >> [java] at java.lang.reflect.Method.invoke(Method.java:597) > >> [java] at > >> org.apache.jorphan.test.AllTests.suite(AllTests.java:356) > >> [java] at > org.apache.jorphan.test.AllTests.main(AllTests.java:213) > >> [java] Caused by: java.lang.ExceptionInInitializerError > >> [java] at > >> > org.apache.jmeter.visualizers.SearchTextExtension.createSearchTextPanel(SearchTextExtension.java:208) > >> [java] at > >> > org.apache.jmeter.visualizers.SearchTextExtension.createSearchTextExtensionPane(SearchTextExtension.java:220) > >> [java] at > >> > org.apache.jmeter.visualizers.SamplerResultTab.createResponseDataPanel(SamplerResultTab.java:462) > >> [java] at > >> > org.apache.jmeter.visualizers.SamplerResultTab.init(SamplerResultTab.java:208) > >> [java] at > >> > org.apache.jmeter.visualizers.ViewResultsFullVisualizer.init(ViewResultsFullVisualizer.java:229) > >> [java] at > >> > org.apache.jmeter.visualizers.ViewResultsFullVisualizer.<init>(ViewResultsFullVisualizer.java:122) > >> [java] at > >> sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) > >> [java] at > >> > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > >> [java] at > >> > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > >> [java] at > >> java.lang.reflect.Constructor.newInstance(Constructor.java:513) > >> [java] at java.lang.Class.newInstance0(Class.java:355) > >> [java] at java.lang.Class.newInstance(Class.java:308) > >> [java] at > >> org.apache.jmeter.junit.JMeterTest.getObjects(JMeterTest.java:578) > >> [java] at > >> > org.apache.jmeter.junit.JMeterTest.suiteGUIComponents(JMeterTest.java:279) > >> [java] at > >> org.apache.jmeter.junit.JMeterTest.suite(JMeterTest.java:141) > >> [java] ... 6 more > >> [java] Caused by: java.awt.HeadlessException > >> [java] at > >> sun.awt.HeadlessToolkit.getMenuShortcutKeyMask(HeadlessToolkit.java:213) > >> [java] at > >> org.apache.jmeter.gui.action.KeyStrokes.<clinit>(KeyStrokes.java:37) > >> [java] ... 21 more > >> [java] > >> [java] Created: 86 tests including 7 suites > >> [java] Starting test run, test count = 1443 > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ......................................... > >> [java] ........ > >> [java] Time: 55.915 > >> [java] > >> [java] OK (1443 tests) > >> [java] > >> > >> batchtest: > >> [echo] Starting BatchTestLocal using -X > >> [jmeter] Created the tree successfully using > >> testfiles/BatchTestLocal.jmx > >> [jmeter] Starting the test @ Sun Jan 13 13:28:18 UTC 2013 > >> (1358083698301) > >> [jmeter] Waiting for possible shutdown message on port 4445 > >> [jmeter] Tidying up ... @ Sun Jan 13 13:28:55 UTC 2013 > >> (1358083735949) > >> [jmeter] ... end of run > >> [echo] BatchTestLocal output files compared OK > >> > >> batchtestserver: > >> [server] Created remote object: UnicastServerRef [liveRef: > >> [endpoint:[67.195.138.8:57057 > ](local),objID:[3e82746c:13c34194627:-7fff, > >> -3479301346160186332]]] > >> > >> batchtest: > >> [echo] Starting BatchTestLocal using -Rlocalhost:2099 > >> [client] Created the tree successfully using > >> testfiles/BatchTestLocal.jmx > >> [client] Configuring remote engine for localhost:2099 > >> [client] Using remote object: UnicastRef [liveRef: > >> [endpoint:[67.195.138.8:57057 > ](remote),objID:[3e82746c:13c34194627:-7fff, > >> -3479301346160186332]]] > >> [client] Starting remote engines > >> [client] Starting the test @ Sun Jan 13 13:28:58 UTC 2013 > >> (1358083738729) > >> [server] Starting the test on host localhost:2099 @ Sun Jan 13 > 13:28:59 > >> UTC 2013 (1358083739471) > >> [client] Remote engines have been started > >> [client] Waiting for possible shutdown message on port 4445 > >> [server] Finished the test on host localhost:2099 @ Sun Jan 13 > 13:29:37 > >> UTC 2013 (1358083777418) - exit requested. > >> [client] Tidying up remote @ Sun Jan 13 13:29:37 UTC 2013 > >> (1358083777418) > >> [client] ... end of run > >> > >> BUILD FAILED > >> <https://builds.apache.org/job/JMeter-trunk/ws/trunk/build.xml>:2309: > The > >> following error occurred while executing this line: > >> <https://builds.apache.org/job/JMeter-trunk/ws/trunk/build.xml>:2409: > CSV > >> Files are not identical. > >> < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/testfiles/BatchTestLocal.csv > >> > > >> < > >> > https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/BatchTestLocal.csv > >> > > >> > >> Total time: 3 minutes 4 seconds > >> Build step 'Invoke Ant' marked build as failure > >> [locks-and-latches] Releasing all the locks > >> [locks-and-latches] All the locks released > >> Archiving artifacts > >> > > > > > > > > -- > > Cordialement. > > Philippe Mouawad. > -- Cordialement. Philippe Mouawad.
