Ah Ha! Found it.
in lime.php, the last statement for lime_test::__destruct needs to be
flush() -- at least under windows.
On 1/15/07, *Scott Pascoe* <[EMAIL PROTECTED]
<mailto:[EMAIL PROTECTED]>> wrote:
OK, I've narrowed the issue down. The full text of the output is
not getting written out under PHP 5.2.0 on Windows.
I've created a simple tool that shows the problem. The code is
attached to this message.
To use it, do the following:
I put this file in the symfony/test/bin folder
'php pass.php <path-to-individual-test-file>'
running this against the functional/authTest.php gave me the
following result:
-------------------------------------
C:\dev\symfony\test>php bin\pass.php functional/authtest.php
CLI: c:\xampp\php\\php.EXEFILE: functional/authtest.php# get /auth/basic
----------------------------------------
Running the test directly gives the expected result:
------------------------------------
C:\dev\symfony\test>php functional/authtest.php
# get /auth/basic
ok 1 - status code is 401
ok 2 - request parameter module is auth
ok 3 - request parameter action is basic
ok 4 - response selector #user matches ""
ok 5 - response selector #password matches ""
ok 6 - response selector #msg matches KO
# get /auth/basic
ok 7 - status code is 200
ok 8 - request parameter module is auth
ok 9 - request parameter action is basic
ok 10 - response selector #user matches foo
ok 11 - response selector #password matches bar
ok 12 - response selector #msg matches OK
# get /auth/basic
ok 13 - status code is 401
ok 14 - request parameter module is auth
ok 15 - request parameter action is basic
ok 16 - response selector #user matches ""
ok 17 - response selector #password matches ""
ok 18 - response selector #msg matches KO
1..18
----------------------------------------------
Can anyone duplicate this behavior, or even, not duplicate it on a
windows box?
Thanks, Scott
On 1/15/07, *Scott Pascoe* <[EMAIL PROTECTED]
<mailto:[EMAIL PROTECTED]>> wrote:
Sorry, I'm long on talk and short on looking at the code and
understanding sometimes. I figured out about the ob_start and
callback in the test_harness::run(). So I'll just keep looking
and let you know what I find.
Scott
On 1/15/07, *Scott Pascoe* <[EMAIL PROTECTED]
<mailto:[EMAIL PROTECTED]>> wrote:
I've been working on this one today. It appears that some of
the tests, when run by the test_harness, will actually
return the number of tests run back to the harness. Others
do not return anything to the harness. Those that return
nothing, show as being OK, when actually the count isn't
really true.
Those tests that somehow return the number of tests run to
the test_harness, show as failing because it isn't expecting
a 'plan'.
I hacked the sfTestBrowser.php to allow passing the options
of array('plan'=>[someNumber]) and now a test
(autoloadTest.php) that didn't pass anything back, passes
back that the plan was for 4 test, and that no tests were run.
The browseTest.php said before that it was ran 124 tests
while expecting none. So I gave it a plan=>124 and it
failed, coming back and saying that it ran 64 tests and that
the return value from php was 255 [I also adjusted the
return status on the delta count mismatch code to be 256 for
too many planned, and 257 for too many run tests.
I'm unsure how any of the tests are returning data to the
test_harness since each individual test is being run with a
php_cli instance. Is there shared memory, or am I seeing a
buffer overrun and overwriting of data incorrectly? ---- I
don't know yet.
Is there a mechanism in php to allow a script that is run
via passthru to get to variables that are defined in the
parent script?
I'll work on finding this out tonight, but would be glad if
anyone could shortcircuit my research.
Thanks,
Scott
On 1/15/07, *Fabien POTENCIER* <
[EMAIL PROTECTED]
<mailto:[EMAIL PROTECTED]>> wrote:
All tests run fine on *nix machines. There are known
problems on Windows
but as I work on a Mac, I don't have time to look at the
specific
problems on Windows. It looks like a lime problem (for
the most part).
Fabien
Scott Pascoe wrote:
> Hi,
>
> When I run the entire test suite for symfony on my
Windows XP box, it
> fails as shown in the attached text file.
>
> Many of the test do run correctly when individually
selected, for
> example, functional/backend/browsetest.php, but
other's actually fail.
>
> Do the tests all succeed completely on non Windows
Boxes, or are others
> having the same issues?
>
> Thanks, Scott
>
> >
>
> E:\projects\symfony\test>php bin\prove.php
>
functional/authTest..................................................ok
>
functional/autoloadTest..............................................ok
>
functional/backend/browseTest.........................................#
> Looks like you planned test but ran 124 extra.
>
functional/backend/browseTest........................................dubious
>
> Failed tests: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12,
13, 14, 15, 16,
> 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29,
30, 31,
> 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44,
45, 46, 47, 48, 49,
> 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62,
63, 64,
> 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77,
78, 79, 80, 81, 82,
> 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95,
96, 97,
> 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108,
109, 110, 111, 112,
> 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124
>
> Test returned status 255
>
functional/backend/customizationTest..................................#
> Looks like you planned test but ran 64 extra.
>
functional/backend/customizationTest.................................dubious
>
> Failed tests: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12,
13, 14, 15, 16,
> 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29,
30, 31,
> 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44,
45, 46, 47, 48, 49,
> 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64
> Test returned status 255
>
functional/backend/editfieldnameTest.................................ok
>
functional/backend/filterTest........................................ok
>
functional/backend/inheritanceTest...................................ok
>
functional/backend/m2mTest............................................#
> Looks like you planned test but ran 55 extra.
>
functional/backend/m2mTest...........................................dubious
>
> Failed tests: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12,
13, 14, 15, 16,
> 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29,
30, 31,
> 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44,
45, 46, 47, 48, 49,
> 50, 51, 52, 53, 54, 55
> Test returned status 255
>
functional/backend/maxperpageTest....................................ok
>
functional/backend/partialTest.......................................ok
>
functional/backend/timeTest...........................................#
> Looks like you planned test but ran 4 extra.
>
functional/backend/timeTest..........................................dubious
>
> Failed tests: 1, 2, 3, 4
> Test returned status 255
>
functional/backend/validationTest....................................ok
>
functional/cacheTest.................................................dubious
>
> Test returned status 255
>
functional/configTest................................................ok
>
functional/crudTest...................................................#
> Looks like you planned test but ran 67 extra.
>
functional/crudTest..................................................dubious
>
> Failed tests: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12,
13, 14, 15, 16,
> 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29,
30, 31,
> 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44,
45, 46, 47, 48, 49,
> 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62,
63, 64,
> 65, 66, 67
> Test returned status 255
>
functional/fillInFilterTest..........................................ok
>
functional/filterTest................................................ok
>
functional/genericTest...............................................ok
>
functional/i18nTest..................................................ok
>
functional/prodTest..................................................ok
>
functional/sfTestBrowserTest.........................................ok
>
functional/validationTest.............................................#
> Looks like you planned test but ran 47 extra.
>
functional/validationTest............................................dubious
>
> Failed tests: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12,
13, 14, 15, 16,
> 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29,
30, 31,
> 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44,
45, 46, 47
> Test returned status 255
>
other/tasksTest.......................................................#
> Looks like you planned 33 test but ran 2 extra.
>
other/tasksTest......................................................dubious
>
> Failed tests: 23, 0, 29, 0, 34, 35
> Test returned status 255
>
unit/action/sfComponentTest..........................................not
ok
> Failed tests: 6
>
unit/addon/sfMailTest................................................ok
>
unit/cache/sfCacheTest...............................................ok
>
unit/cache/sfFileCacheTest...........................................ok
>
unit/cache/sfSQLiteCacheTest.........................................ok
>
unit/config/sfConfigHandlerTest......................................ok
>
unit/config/sfConfigTest.............................................ok
>
unit/config/sfDefineEnvironmentConfigHandlerTest.....................ok
>
unit/config/sfFilterConfigHandlerTest................................ok
>
unit/config/sfGeneratorConfigHandlerTest.............................ok
>
unit/config/sfSimpleYamlConfigHandlerTest............................ok
>
unit/config/sfValidatorConfigHandlerTest.............................ok
>
unit/config/sfViewConfigHandlerTest..................................not
ok
> Failed tests: 1
>
unit/config/sfYamlConfigHandlerTest..................................ok
>
unit/controller/sfControllerTest.....................................ok
>
unit/controller/sfRoutingTest.........................................#
> Looks like you planned 64 tests but only ran 63.
>
unit/controller/sfRoutingTest........................................dubious
>
> Failed tests: 64
> Test returned status 255
>
unit/controller/sfWebControllerTest..................................ok
>
unit/database/sfDatabaseTest.........................................ok
>
unit/exception/sfExceptionsTest......................................ok
>
unit/filter/sfCommonFilterTest.......................................ok
>
unit/filter/sfFilterTest.............................................ok
>
unit/filter/sfFlashFilterTest........................................ok
>
unit/generator/sfGeneratorTest.......................................ok
>
unit/helper/AssetHelperTest..........................................ok
>
unit/helper/DateFormHelperTest.......................................ok
>
unit/helper/DateHelperTest...........................................not
ok
> Failed tests: 486, 487, 488, 489
>
unit/helper/EscapingHelperTest.......................................ok
>
unit/helper/FormHelperTest...........................................dubious
>
> Test returned status 255
>
unit/helper/NumberHelperTest.........................................ok
>
unit/helper/ObjectHelperTest.........................................ok
>
unit/helper/TagHelperTest............................................ok
>
unit/helper/TextHelperTest...........................................ok
>
unit/helper/UrlHelperTest............................................ok
>
unit/i18n/dataTest...................................................ok
>
unit/i18n/sfChoiceFormatTest.........................................ok
>
unit/i18n/sfCultureInfoTest..........................................ok
>
unit/i18n/sfNumberFormatInfoTest.....................................ok
>
unit/request/sfRequestTest...........................................ok
>
unit/request/sfWebRequestTest........................................ok
>
unit/response/sfResponseTest.........................................ok
>
unit/response/sfWebResponseTest......................................ok
>
unit/storage/sfStorageTest...........................................ok
>
unit/user/sfBasicSecurityUserTest....................................ok
>
unit/user/sfUserTest.................................................ok
>
unit/util/SpycTest...................................................ok
>
unit/util/sfBrowserTest..............................................not
ok
> Failed tests: 21, 24
>
unit/util/sfDomCssSelectorTest.......................................ok
>
unit/util/sfFillInFormTest...........................................ok
>
unit/util/sfInflectorTest............................................ok
>
unit/util/sfMixerTest................................................ok
>
unit/util/sfParameterHolderTest......................................ok
>
unit/util/sfToolkitTest..............................................ok
>
unit/validator/sfCallbackValidatorTest...............................ok
>
unit/validator/sfEmailValidatorTest..................................ok
>
unit/validator/sfNumberValidatorTest.................................ok
>
unit/validator/sfRegexValidatorTest..................................ok
>
unit/validator/sfStringValidatorTest.................................ok
>
unit/validator/sfUrlValidatorTest....................................ok
>
unit/validator/sfValidatorTest.......................................ok
>
unit/view/sfViewCacheManagerTest.....................................ok
>
unit/view/sfViewTest.................................................ok
> Failed Test Stat Total
Fail List of Failed
>
------------------------------------------------------------------
> functional/backend/browseTest 255 124 124 1
2 3 4 5 6 7 8 9 10
> 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
29 30
> 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48
49 50 51 52 53 54
> 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72
73 74
> 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92
93 94 95 96 97 98
> 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113
> 114 115 116 117 118 119 120 121 122 123 124
> onal/backend/customizationTest 255 64 64 1
2 3 4 5 6 7 8 9 10
> 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
29 30
> 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48
49 50 51 52 53 54
> 55 56 57 58 59 60 61 62 63 64
> functional/backend/m2mTest 255 55 55 1
2 3 4 5 6 7 8 9 10
> 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
29 30
> 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48
49 50 51 52 53 54 55
> functional/backend/timeTest 255 4 4 1
2 3 4
> functional/cacheTest 255 0 0
> functional/crudTest 255 67 67 1
2 3 4 5 6 7 8 9 10
> 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
29 30
> 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48
49 50 51 52 53 54
> 55 56 57 58 59 60 61 62 63 64 65 66 67
> functional/validationTest 255 47 47 1
2 3 4 5 6 7 8 9 10
> 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
29 30
> 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47
> other/tasksTest 255 6 6 23
0 29 0 34 35
> unit/action/sfComponentTest 0 1 1 6
> config/sfViewConfigHandlerTest 0 1 1 1
> unit/controller/sfRoutingTest 255 1 1 64
> unit/helper/DateHelperTest
0 4 4 486 487 488 489
> unit/helper/FormHelperTest 255 0 0
> unit/util/sfBrowserTest 0 2 2 21 24
> Failed 14/84 test scripts, 83.33% okay. 376/2901
subtests failed, 87.04%
> okay.
>
> E:\projects\symfony\test>
>
