I've been working on this one today. It appears that some of the tests, when
run by the test_harness, will actually return the number of tests run back
to the harness.  Others do not return anything to the harness.  Those that
return nothing, show as being OK, when actually the count isn't really true.

Those tests that somehow return the number of tests run to the test_harness,
show as failing because it isn't expecting a 'plan'.

I hacked the sfTestBrowser.php to allow passing the options of
array('plan'=>[someNumber]) and now a test (autoloadTest.php) that didn't
pass anything back, passes back that the plan was for 4 test, and that no
tests were run.

The browseTest.php said before that it was ran 124 tests while expecting
none.  So I gave it a plan=>124 and it failed, coming back and saying that
it ran 64 tests and that the return value from php was 255 [I also adjusted
the return status on the delta count mismatch code to be 256 for too many
planned, and 257 for too many run tests.

I'm unsure how any of the tests are returning data to the test_harness since
each individual test is being run with a php_cli instance.  Is there shared
memory, or am I seeing a buffer overrun and overwriting of data
incorrectly?  ---- I don't know yet.

Is there a mechanism in php to allow a script that is run via passthru to
get to variables that are defined in the parent script?

I'll work on finding this out tonight, but would be glad if anyone could
shortcircuit my research.

Thanks,
Scott

On 1/15/07, Fabien POTENCIER <[EMAIL PROTECTED]> wrote:


All tests run fine on *nix machines. There are known problems on Windows
but as I work on a Mac, I don't have time to look at the specific
problems on Windows. It looks like a lime problem (for the most part).

Fabien

Scott Pascoe wrote:
> Hi,
>
> When I run the entire test suite for symfony on my Windows XP box, it
> fails as shown in the attached text file.
>
> Many of the test do run correctly when individually selected, for
> example, functional/backend/browsetest.php, but other's actually fail.
>
> Do the tests all succeed completely on non Windows Boxes, or are others
> having the same issues?
>
> Thanks, Scott
>
> >
>
> E:\projects\symfony\test>php bin\prove.php
> functional/authTest..................................................ok
> functional/autoloadTest..............................................ok
> functional/backend/browseTest.........................................#
> Looks like you planned  test but ran 124 extra.
>
functional/backend/browseTest........................................dubious
>
>    Failed tests: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16,
> 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31,
> 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49,
> 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64,
> 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82,
> 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97,
> 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112,
> 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124
>
>    Test returned status 255
> functional/backend/customizationTest..................................#
> Looks like you planned  test but ran 64 extra.
>
functional/backend/customizationTest.................................dubious
>
>    Failed tests: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16,
> 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31,
> 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49,
> 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64
>    Test returned status 255
> functional/backend/editfieldnameTest.................................ok
> functional/backend/filterTest........................................ok
> functional/backend/inheritanceTest...................................ok
> functional/backend/m2mTest............................................#
> Looks like you planned  test but ran 55 extra.
>
functional/backend/m2mTest...........................................dubious
>
>    Failed tests: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16,
> 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31,
> 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49,
> 50, 51, 52, 53, 54, 55
>    Test returned status 255
> functional/backend/maxperpageTest....................................ok
> functional/backend/partialTest.......................................ok
> functional/backend/timeTest...........................................#
> Looks like you planned  test but ran 4 extra.
>
functional/backend/timeTest..........................................dubious
>
>    Failed tests: 1, 2, 3, 4
>    Test returned status 255
> functional/backend/validationTest....................................ok
>
functional/cacheTest.................................................dubious
>
>    Test returned status 255
> functional/configTest................................................ok
> functional/crudTest...................................................#
> Looks like you planned  test but ran 67 extra.
>
functional/crudTest..................................................dubious
>
>    Failed tests: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16,
> 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31,
> 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49,
> 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64,
> 65, 66, 67
>    Test returned status 255
> functional/fillInFilterTest..........................................ok
> functional/filterTest................................................ok
> functional/genericTest...............................................ok
> functional/i18nTest..................................................ok
> functional/prodTest..................................................ok
> functional/sfTestBrowserTest.........................................ok
> functional/validationTest.............................................#
> Looks like you planned  test but ran 47 extra.
>
functional/validationTest............................................dubious
>
>    Failed tests: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16,
> 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31,
> 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47
>    Test returned status 255
> other/tasksTest.......................................................#
> Looks like you planned 33 test but ran 2 extra.
>
other/tasksTest......................................................dubious
>
>    Failed tests: 23, 0, 29, 0, 34, 35
>    Test returned status 255
> unit/action/sfComponentTest..........................................not
ok
>    Failed tests: 6
> unit/addon/sfMailTest................................................ok
> unit/cache/sfCacheTest...............................................ok
> unit/cache/sfFileCacheTest...........................................ok
> unit/cache/sfSQLiteCacheTest.........................................ok
> unit/config/sfConfigHandlerTest......................................ok
> unit/config/sfConfigTest.............................................ok
> unit/config/sfDefineEnvironmentConfigHandlerTest.....................ok
> unit/config/sfFilterConfigHandlerTest................................ok
> unit/config/sfGeneratorConfigHandlerTest.............................ok
> unit/config/sfSimpleYamlConfigHandlerTest............................ok
> unit/config/sfValidatorConfigHandlerTest.............................ok
> unit/config/sfViewConfigHandlerTest..................................not
ok
>    Failed tests: 1
> unit/config/sfYamlConfigHandlerTest..................................ok
> unit/controller/sfControllerTest.....................................ok
> unit/controller/sfRoutingTest.........................................#
> Looks like you planned 64 tests but only ran 63.
>
unit/controller/sfRoutingTest........................................dubious
>
>    Failed tests: 64
>    Test returned status 255
> unit/controller/sfWebControllerTest..................................ok
> unit/database/sfDatabaseTest.........................................ok
> unit/exception/sfExceptionsTest......................................ok
> unit/filter/sfCommonFilterTest.......................................ok
> unit/filter/sfFilterTest.............................................ok
> unit/filter/sfFlashFilterTest........................................ok
> unit/generator/sfGeneratorTest.......................................ok
> unit/helper/AssetHelperTest..........................................ok
> unit/helper/DateFormHelperTest.......................................ok
> unit/helper/DateHelperTest...........................................not
ok
>    Failed tests: 486, 487, 488, 489
> unit/helper/EscapingHelperTest.......................................ok
>
unit/helper/FormHelperTest...........................................dubious
>
>    Test returned status 255
> unit/helper/NumberHelperTest.........................................ok
> unit/helper/ObjectHelperTest.........................................ok
> unit/helper/TagHelperTest............................................ok
> unit/helper/TextHelperTest...........................................ok
> unit/helper/UrlHelperTest............................................ok
> unit/i18n/dataTest...................................................ok
> unit/i18n/sfChoiceFormatTest.........................................ok
> unit/i18n/sfCultureInfoTest..........................................ok
> unit/i18n/sfNumberFormatInfoTest.....................................ok
> unit/request/sfRequestTest...........................................ok
> unit/request/sfWebRequestTest........................................ok
> unit/response/sfResponseTest.........................................ok
> unit/response/sfWebResponseTest......................................ok
> unit/storage/sfStorageTest...........................................ok
> unit/user/sfBasicSecurityUserTest....................................ok
> unit/user/sfUserTest.................................................ok
> unit/util/SpycTest...................................................ok
> unit/util/sfBrowserTest..............................................not
ok
>    Failed tests: 21, 24
> unit/util/sfDomCssSelectorTest.......................................ok
> unit/util/sfFillInFormTest...........................................ok
> unit/util/sfInflectorTest............................................ok
> unit/util/sfMixerTest................................................ok
> unit/util/sfParameterHolderTest......................................ok
> unit/util/sfToolkitTest..............................................ok
> unit/validator/sfCallbackValidatorTest...............................ok
> unit/validator/sfEmailValidatorTest..................................ok
> unit/validator/sfNumberValidatorTest.................................ok
> unit/validator/sfRegexValidatorTest..................................ok
> unit/validator/sfStringValidatorTest.................................ok
> unit/validator/sfUrlValidatorTest....................................ok
> unit/validator/sfValidatorTest.......................................ok
> unit/view/sfViewCacheManagerTest.....................................ok
> unit/view/sfViewTest.................................................ok
> Failed Test                     Stat  Total   Fail  List of Failed
> ------------------------------------------------------------------
> functional/backend/browseTest    255    124    124  1 2 3 4 5 6 7 8 9 10
> 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
> 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54
> 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74
> 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98
> 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113
> 114 115 116 117 118 119 120 121 122 123 124
> onal/backend/customizationTest   255     64     64  1 2 3 4 5 6 7 8 9 10
> 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
> 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54
> 55 56 57 58 59 60 61 62 63 64
> functional/backend/m2mTest       255     55     55  1 2 3 4 5 6 7 8 9 10
> 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
> 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54
55
> functional/backend/timeTest      255      4      4  1 2 3 4
> functional/cacheTest             255      0      0
> functional/crudTest              255     67     67  1 2 3 4 5 6 7 8 9 10
> 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
> 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54
> 55 56 57 58 59 60 61 62 63 64 65 66 67
> functional/validationTest        255     47     47  1 2 3 4 5 6 7 8 9 10
> 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
> 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47
> other/tasksTest                  255      6      6  23 0 29 0 34 35
> unit/action/sfComponentTest        0      1      1  6
> config/sfViewConfigHandlerTest     0      1      1  1
> unit/controller/sfRoutingTest    255      1      1  64
> unit/helper/DateHelperTest         0      4      4  486 487 488 489
> unit/helper/FormHelperTest       255      0      0
> unit/util/sfBrowserTest            0      2      2  21 24
> Failed 14/84 test scripts, 83.33% okay. 376/2901 subtests failed, 87.04%
> okay.
>
> E:\projects\symfony\test>

>


--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups "symfony 
developers" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at 
http://groups.google.com/group/symfony-devs?hl=en
-~----------~----~----~----~------~----~------~--~---

Reply via email to