Re: [SMW-devel] Upgrade to SMW 2.3 RebuildData exception StripState.php

2015-11-20 Thread James HK 
Hi,

The only other thing that comes to my mind is [0, 1].

[0] https://github.com/SemanticMediaWiki/SemanticMediaWiki/issues/880

[1] https://phabricator.wikimedia.org/T58226

Cheers

On 11/20/15, Krabina Bernhard  wrote:
> I followed the advice to remove all extensions prior to running the script.
> Finally, I only had SMW installed, nothing more. Then I deleted the store
> and rebuilt everything from scratch. Still, the errors persist.
>
> cheers,
> Bernhard
>
> - Am 6. Nov 2015 um 12:33 schrieb Bernhard Krabina krab...@kdz.or.at:
>
>> Hi,
>>
>> I updated two wikis to SMW 2.3 and in one the rebuildData throws an
>> exception in
>> ~20 pages. I am able to continut the update after the pages with errors
>> with
>> rebuildData.php -v -s 64, but the pages with error did not have any
>> properties
>> set.
>>
>> I assume that the IDs of the pages that rebuildData are the page-IDs that
>> can be
>> accessed like this:
>> http://www.ogdcockpit.eu/index.php?curid=63
>>
>> other examples are the ids
>> 73, 125, 171,175-178, 201 and others
>>
>> Here is the exception:
>>
>> [8868c940] [no req]   Exception from line 77 of
>> /home/kdz/ogdcockpit/includes/parser/StripState.php: Invalid
>> marker:UNIQ7830edce1aa1edea-h-5--QIN
>> Backtrace:
>> #0 ../includes/parser/StripState.php(66): StripState->addItem(string,
>> string,
>> string)
>> #1 ../includes/parser/Preprocessor_DOM.php(1194):
>> StripState->addGeneral(string,
>> string)
>> #2 ../includes/parser/Parser.php(3492): PPFrame_DOM->expand(PPNode_DOM)
>> #3 ../includes/parser/Preprocessor_DOM.php(1113):
>> Parser->braceSubstitution(array, PPFrame_DOM)
>> #4 ../includes/parser/Parser.php(3153): PPFrame_DOM->expand(PPNode_DOM,
>> integer)
>> #5 ../includes/parser/Parser.php(1216): Parser->replaceVariables(string)
>> #6 ../includes/parser/Parser.php(395): Parser->internalParse(string)
>> #7 ../extensions/SemanticMediaWiki/includes/ContentParser.php(202):
>> Parser->parse(string, Title, ParserOptions, boolean, boolean, integer)
>> #8 ../extensions/SemanticMediaWiki/includes/ContentParser.php(147):
>> SMW\ContentParser->fetchFromParser()
>> #9 ../extensions/SemanticMediaWiki/src/MediaWiki/Jobs/UpdateJob.php(136):
>> SMW\ContentParser->parse()
>> #10
>> ../extensions/SemanticMediaWiki/src/MediaWiki/Jobs/UpdateJob.php(119):
>> SMW\MediaWiki\Jobs\UpdateJob->needToParsePageContentBeforeUpdate()
>> #11 ../extensions/SemanticMediaWiki/src/MediaWiki/Jobs/UpdateJob.php(88):
>> SMW\MediaWiki\Jobs\UpdateJob->doPrepareForUpdate()
>> #12 ../extensions/SemanticMediaWiki/src/MediaWiki/Jobs/UpdateJob.php(57):
>> SMW\MediaWiki\Jobs\UpdateJob->doUpdate()
>> #13
>> ../extensions/SemanticMediaWiki/src/SQLStore/ByIdDataRebuildDispatcher.php(171):
>> SMW\MediaWiki\Jobs\UpdateJob->run()
>> #14
>> ../extensions/SemanticMediaWiki/src/Maintenance/DataRebuilder.php(247):
>> SMW\SQLStore\ByIdDataRebuildDispatcher->dispatchRebuildFor(integer)
>> #15
>> ../extensions/SemanticMediaWiki/src/Maintenance/DataRebuilder.php(147):
>> SMW\Maintenance\DataRebuilder->doRebuildAll()
>> #16 ../extensions/SemanticMediaWiki/maintenance/rebuildData.php(141):
>> SMW\Maintenance\DataRebuilder->rebuild()
>> #17 ../maintenance/doMaintenance.php(104):
>> SMW\Maintenance\RebuildData->execute()
>> #18 ../extensions/SemanticMediaWiki/maintenance/rebuildData.php(174):
>> require_once(string)
>> #19 ../extensions/SemanticMediaWiki/maintenance/SMW_refreshData.php(9):
>> require_once(string)
>> #20 {main}
>>
>> The envorinment can be seen here:
>> http://www.ogdcockpit.eu/index.php?title=Spezial:Version
>>
>> I also tried to "Rebuild everything"
>> https://semantic-mediawiki.org/wiki/Help:Repairing_SMW's_data#Rebuilding_everything
>> but this did not change the outcome.
>>
>> Any ideas?
>>
>> cheers,
>> Bernhard
>>
>> --
>> ___
>> Semediawiki-devel mailing list
>> Semediawiki-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/semediawiki-devel
>
> --
> ___
> Semediawiki-devel mailing list
> Semediawiki-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/semediawiki-devel
>

--
___
Semediawiki-devel mailing list
Semediawiki-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/semediawiki-devel

Re: [SMW-devel] Upgrade to SMW 2.3 RebuildData exception StripState.php

2015-11-20 Thread Krabina Bernhard 
I followed the advice to remove all extensions prior to running the script. 
Finally, I only had SMW installed, nothing more. Then I deleted the store and 
rebuilt everything from scratch. Still, the errors persist.

cheers,
Bernhard

- Am 6. Nov 2015 um 12:33 schrieb Bernhard Krabina krab...@kdz.or.at:

> Hi,
> 
> I updated two wikis to SMW 2.3 and in one the rebuildData throws an exception 
> in
> ~20 pages. I am able to continut the update after the pages with errors with
> rebuildData.php -v -s 64, but the pages with error did not have any properties
> set.
> 
> I assume that the IDs of the pages that rebuildData are the page-IDs that can 
> be
> accessed like this:
> http://www.ogdcockpit.eu/index.php?curid=63
> 
> other examples are the ids
> 73, 125, 171,175-178, 201 and others
> 
> Here is the exception:
> 
> [8868c940] [no req]   Exception from line 77 of
> /home/kdz/ogdcockpit/includes/parser/StripState.php: Invalid
> marker:UNIQ7830edce1aa1edea-h-5--QIN
> Backtrace:
> #0 ../includes/parser/StripState.php(66): StripState->addItem(string, string,
> string)
> #1 ../includes/parser/Preprocessor_DOM.php(1194): 
> StripState->addGeneral(string,
> string)
> #2 ../includes/parser/Parser.php(3492): PPFrame_DOM->expand(PPNode_DOM)
> #3 ../includes/parser/Preprocessor_DOM.php(1113):
> Parser->braceSubstitution(array, PPFrame_DOM)
> #4 ../includes/parser/Parser.php(3153): PPFrame_DOM->expand(PPNode_DOM, 
> integer)
> #5 ../includes/parser/Parser.php(1216): Parser->replaceVariables(string)
> #6 ../includes/parser/Parser.php(395): Parser->internalParse(string)
> #7 ../extensions/SemanticMediaWiki/includes/ContentParser.php(202):
> Parser->parse(string, Title, ParserOptions, boolean, boolean, integer)
> #8 ../extensions/SemanticMediaWiki/includes/ContentParser.php(147):
> SMW\ContentParser->fetchFromParser()
> #9 ../extensions/SemanticMediaWiki/src/MediaWiki/Jobs/UpdateJob.php(136):
> SMW\ContentParser->parse()
> #10 ../extensions/SemanticMediaWiki/src/MediaWiki/Jobs/UpdateJob.php(119):
> SMW\MediaWiki\Jobs\UpdateJob->needToParsePageContentBeforeUpdate()
> #11 ../extensions/SemanticMediaWiki/src/MediaWiki/Jobs/UpdateJob.php(88):
> SMW\MediaWiki\Jobs\UpdateJob->doPrepareForUpdate()
> #12 ../extensions/SemanticMediaWiki/src/MediaWiki/Jobs/UpdateJob.php(57):
> SMW\MediaWiki\Jobs\UpdateJob->doUpdate()
> #13
> ../extensions/SemanticMediaWiki/src/SQLStore/ByIdDataRebuildDispatcher.php(171):
> SMW\MediaWiki\Jobs\UpdateJob->run()
> #14 ../extensions/SemanticMediaWiki/src/Maintenance/DataRebuilder.php(247):
> SMW\SQLStore\ByIdDataRebuildDispatcher->dispatchRebuildFor(integer)
> #15 ../extensions/SemanticMediaWiki/src/Maintenance/DataRebuilder.php(147):
> SMW\Maintenance\DataRebuilder->doRebuildAll()
> #16 ../extensions/SemanticMediaWiki/maintenance/rebuildData.php(141):
> SMW\Maintenance\DataRebuilder->rebuild()
> #17 ../maintenance/doMaintenance.php(104):
> SMW\Maintenance\RebuildData->execute()
> #18 ../extensions/SemanticMediaWiki/maintenance/rebuildData.php(174):
> require_once(string)
> #19 ../extensions/SemanticMediaWiki/maintenance/SMW_refreshData.php(9):
> require_once(string)
> #20 {main}
> 
> The envorinment can be seen here:
> http://www.ogdcockpit.eu/index.php?title=Spezial:Version
> 
> I also tried to "Rebuild everything"
> https://semantic-mediawiki.org/wiki/Help:Repairing_SMW's_data#Rebuilding_everything
> but this did not change the outcome.
> 
> Any ideas?
> 
> cheers,
> Bernhard
> 
> --
> ___
> Semediawiki-devel mailing list
> Semediawiki-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/semediawiki-devel

--
___
Semediawiki-devel mailing list
Semediawiki-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/semediawiki-devel

Re: [SMW-devel] Upgrade to SMW 2.3 RebuildData exception StripState.php

2015-11-06 Thread James HK 
Hi,

> thing about these it that they have attribute themselves:

No.

The issue with the Parser is when things like `
marker:UNIQ7830edce1aa1edea-h-5--QIN` appear it is mostly caused by
different {{#..:}} parser functions embedded in a page. The parser
encodes those tags (it includes ref/nowiki as well etc.) before
starting the parse process and as in above case has a problem when
decoding the marker (this all happens before any SMW hook is called).

`rebuildData` relies on the Parser to process (and run all registered
hooks that extensions have registered) the string components of a
page.

I'm guessing the IDs displayed are the preceding IDs (not the one that
fail) before the Parser fails.

Cheers

On 11/6/15, Krabina Bernhard  wrote:
>> No, those are internal IDs that can be queried using [0, 1] (Object ID
>> lookup).
>
> ah, interesting. So it seems it are all attribute pages. The only special
> thing about these it that they have attribute themselves:
> http://www.ogdcockpit.eu/index.php?title=Spezial:Durchsuchen/Attribut:Eindeutiger_Identifikator
>
> This has not been a problem so far. Might this have to do with the script
> error?
>
> cheers,
> Bernhard
>
> - Am 6. Nov 2015 um 15:32 schrieb James HK
> jamesin.hongkon...@gmail.com:
>
>> Hi,
>>
>>> > [8868c940] [no req]   Exception from line 77 of
>>> /home/kdz/ogdcockpit/includes/parser/StripState.php: Invalid
>>> marker:UNIQ7830edce1aa1edea-h-5--QIN
>>> Backtrace:
>>> #0 ../includes/parser/StripState.php(66): StripState->addItem(string,
>>
>> Something on those pages causes the Parser to trip.
>>
>>> I assume that the IDs of the pages that rebuildData are the page-IDs that
>>> can be
>>> accessed like this:
>> http://www.ogdcockpit.eu/index.php?curid=63
>>
>> other examples are the ids
>> 73, 125, 171,175-178, 201 and others
>>
>> No, those are internal IDs that can be queried using [0, 1] (Object ID
>> lookup).
>>
>> [0] https://semantic-mediawiki.org/wiki/Help:Special:SMWAdmin
>>
>> [1] https://semantic-mediawiki.org/wiki/Help:Object_ID_lookup
>>
>> Cheers
>>
>> On 11/6/15, Krabina Bernhard  wrote:
>>> Hi,
>>>
>>> I updated two wikis to SMW 2.3 and in one the rebuildData throws an
>>> exception in ~20 pages. I am able to continut the update after the pages
>>> with errors with  rebuildData.php -v -s 64, but the pages with error did
>>> not
>>> have any properties set.
>>>
>>> I assume that the IDs of the pages that rebuildData are the page-IDs
>>> that
>>> can be accessed like this:
>>> http://www.ogdcockpit.eu/index.php?curid=63
>>>
>>> other examples are the ids
>>> 73, 125, 171,175-178, 201 and others
>>>
>>> Here is the exception:
>>>
>>> [8868c940] [no req]   Exception from line 77 of
>>> /home/kdz/ogdcockpit/includes/parser/StripState.php: Invalid
>>> marker:UNIQ7830edce1aa1edea-h-5--QIN
>>> Backtrace:
>>> #0 ../includes/parser/StripState.php(66): StripState->addItem(string,
>>> string, string)
>>> #1 ../includes/parser/Preprocessor_DOM.php(1194):
>>> StripState->addGeneral(string, string)
>>> #2 ../includes/parser/Parser.php(3492): PPFrame_DOM->expand(PPNode_DOM)
>>> #3 ../includes/parser/Preprocessor_DOM.php(1113):
>>> Parser->braceSubstitution(array, PPFrame_DOM)
>>> #4 ../includes/parser/Parser.php(3153): PPFrame_DOM->expand(PPNode_DOM,
>>> integer)
>>> #5 ../includes/parser/Parser.php(1216): Parser->replaceVariables(string)
>>> #6 ../includes/parser/Parser.php(395): Parser->internalParse(string)
>>> #7 ../extensions/SemanticMediaWiki/includes/ContentParser.php(202):
>>> Parser->parse(string, Title, ParserOptions, boolean, boolean, integer)
>>> #8 ../extensions/SemanticMediaWiki/includes/ContentParser.php(147):
>>> SMW\ContentParser->fetchFromParser()
>>> #9
>>> ../extensions/SemanticMediaWiki/src/MediaWiki/Jobs/UpdateJob.php(136):
>>> SMW\ContentParser->parse()
>>> #10
>>> ../extensions/SemanticMediaWiki/src/MediaWiki/Jobs/UpdateJob.php(119):
>>> SMW\MediaWiki\Jobs\UpdateJob->needToParsePageContentBeforeUpdate()
>>> #11
>>> ../extensions/SemanticMediaWiki/src/MediaWiki/Jobs/UpdateJob.php(88):
>>> SMW\MediaWiki\Jobs\UpdateJob->doPrepareForUpdate()
>>> #12
>>> ../extensions/SemanticMediaWiki/src/MediaWiki/Jobs/UpdateJob.php(57):
>>> SMW\MediaWiki\Jobs\UpdateJob->doUpdate()
>>> #13
>>> ../extensions/SemanticMediaWiki/src/SQLStore/ByIdDataRebuildDispatcher.php(171):
>>> SMW\MediaWiki\Jobs\UpdateJob->run()
>>> #14
>>> ../extensions/SemanticMediaWiki/src/Maintenance/DataRebuilder.php(247):
>>> SMW\SQLStore\ByIdDataRebuildDispatcher->dispatchRebuildFor(integer)
>>> #15
>>> ../extensions/SemanticMediaWiki/src/Maintenance/DataRebuilder.php(147):
>>> SMW\Maintenance\DataRebuilder->doRebuildAll()
>>> #16 ../extensions/SemanticMediaWiki/maintenance/rebuildData.php(141):
>>> SMW\Maintenance\DataRebuilder->rebuild()
>>> #17 ../maintenance/doMaintenance.php(104):
>>> SMW\Maintenance\RebuildData->execute()
>>> #18 ../extensions/SemanticMediaWiki/maintenance/rebuildData.php(174):
>>> require_once(string)
>>>