[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-09 Thread DannyS712 
DannyS712 added a comment.


  In T249596#6042709 , 
@Addshore wrote:
  
  > @DannyS712 ping to the above list ^^ if it helps and you didn't see it.
  > I believe some of these will need to be dealt with in T249613 
 as I believe these are fake true 
duplicates almost, for items that are since deleted or have been turned into 
redirects, but still claim their sitelinks in the table.
  
  Wow, thats a lot; too many to look through manually. I'll wait for the ticker 
for running over the redirects and see what that leaves us with

TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, DannyS712
Cc: Marostegui, DannyS712, Sakretsu, ArielGlenn, Liuxinyu970226, Addshore, 
Aklapper, Tarrow, Iflorez, darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Jonas, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread DannyS712 
DannyS712 added a comment.


  @Addshore if you end up with a list of duplicates and can share it with me I 
can delete the items

TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, DannyS712
Cc: Marostegui, DannyS712, Sakretsu, ArielGlenn, Liuxinyu970226, Addshore, 
Aklapper, Tarrow, Iflorez, darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Jonas, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread Addshore 
Addshore added a comment.


Processed 347899 entities.
Processed 347999 entities.
Processed 348095 entities.
Rebuild done.
  
  Rebuild script run is done

TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Marostegui, DannyS712, Sakretsu, ArielGlenn, Liuxinyu970226, Addshore, 
Aklapper, Tarrow, Iflorez, darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Jonas, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread Addshore 
Addshore added a comment.


  I cancelled the rebuild of list 5 as we will defintly run into more 
redirects, and instead am running from the start using list 6 which should have 
no redirects.

TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Sakretsu, ArielGlenn, Liuxinyu970226, Addshore, Aklapper, Tarrow, Iflorez, 
darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread Stashbot 
Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2020-04-07T12:50:45Z]  
addshore@mwmaint1002:~$ mwscript 
extensions/Wikibase/repo/maintenance/rebuildItemsPerSite.php 
--wiki=wikidatawiki --file T249596 
-6.list > T249596 
-6.out # T249565 


TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, Stashbot
Cc: Sakretsu, ArielGlenn, Liuxinyu970226, Addshore, Aklapper, Tarrow, Iflorez, 
darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread Stashbot 
Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2020-04-07T12:50:45Z]  
addshore@mwmaint1002:~$ mwscript 
extensions/Wikibase/repo/maintenance/rebuildItemsPerSite.php 
--wiki=wikidatawiki --file T249596 
-6.list > T249596 
-6.out # T249565 


TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, Stashbot
Cc: Sakretsu, ArielGlenn, Liuxinyu970226, Addshore, Aklapper, Tarrow, Iflorez, 
darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread Addshore 
Addshore added a comment.


  I also regenerated a new list without redirects incase we get stuck again...
  
addshore@stat1007:~$ analytics-mysql wikidatawiki -e "select DISTINCT 
rc_title from recentchanges JOIN page ON rc_cur_id = page_id where rc_timestamp 
> 2020040623 and rc_namespace = 0 and page_is_redirect = 0 ORDE R BY 
rc_cur_id ASC;" -N -B > T249596-6.list
addshore@stat1007:~$ wc -l T249596-6.list
348096 T249596-6.list

TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Sakretsu, ArielGlenn, Liuxinyu970226, Addshore, Aklapper, Tarrow, Iflorez, 
darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread Stashbot 
Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2020-04-07T12:42:57Z]  
addshore@mwmaint1002:~$ mwscript 
extensions/Wikibase/repo/maintenance/rebuildItemsPerSite.php 
--wiki=wikidatawiki --file T249596 
-5.list > T249596 
-5.out # T249565 


TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, Stashbot
Cc: Sakretsu, ArielGlenn, Liuxinyu970226, Addshore, Aklapper, Tarrow, Iflorez, 
darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread Stashbot 
Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2020-04-07T12:42:57Z]  
addshore@mwmaint1002:~$ mwscript 
extensions/Wikibase/repo/maintenance/rebuildItemsPerSite.php 
--wiki=wikidatawiki --file T249596 
-5.list > T249596 
-5.out # T249565 


TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, Stashbot
Cc: Sakretsu, ArielGlenn, Liuxinyu970226, Addshore, Aklapper, Tarrow, Iflorez, 
darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread Addshore 
Addshore added a comment.


  Script stopped after this point
  
addshore@mwmaint1002:~$ tail T249596-4.out
Processed 204292 entities.
Processed 204392 entities.
Processed 204492 entities.
Processed 204592 entities.
Processed 204692 entities.
Saving sitelinks for Item Q16166079 failed
Processed 204792 entities.
Saving sitelinks for Item Q10799549 failed
Saving sitelinks for Item Q10806956 failed
Processed 204892 entities.
  
  Excpetion was:
  
addshore@mwmaint1002:~$ mwscript 
extensions/Wikibase/repo/maintenance/rebuildItemsPerSite.php 
--wiki=wikidatawiki --file T249596-4.list > T249596-4.out
Wikibase\Lib\Store\RevisionedUnresolvedRedirectException from line 127 of 
/srv/mediawiki/php-1.35.0-wmf.26/extensions/Wikibase/lib/includes/Store/Sql/WikiPageEntityRevisionLookup.php:
 Unresolved redirect from Q32228765 to Q10826732
#0 
/srv/mediawiki/php-1.35.0-wmf.26/extensions/Wikibase/lib/includes/Store/TypeDispatchingEntityRevisionLookup.php(54):
 
Wikibase\Lib\Store\Sql\WikiPageEntityRevisionLookup->getEntityRevision(Object(Wikibase\DataModel\Entity\ItemId),
 0, 'replica')
#1 
/srv/mediawiki/php-1.35.0-wmf.26/extensions/Wikibase/data-access/src/ByTypeDispatchingEntityRevisionLookup.php(54):
 
Wikibase\Lib\Store\TypeDispatchingEntityRevisionLookup->getEntityRevision(Object(Wikibase\DataModel\Entity\ItemId),
 0, 'replica')
#2 
/srv/mediawiki/php-1.35.0-wmf.26/extensions/Wikibase/lib/includes/Store/TypeDispatchingEntityRevisionLookup.php(54):
 
Wikibase\DataAccess\ByTypeDispatchingEntityRevisionLookup->getEntityRevision(Object(Wikibase\DataModel\Entity\ItemId),
 0, 'replica')
#3 
/srv/mediawiki/php-1.35.0-wmf.26/extensions/Wikibase/lib/includes/Store/CacheRetrievingEntityRevisionLookup.php(75):
 
Wikibase\Lib\Store\TypeDispatchingEntityRevisionLookup->getEntityRevision(Object(Wikibase\DataModel\Entity\ItemId),
 0, 'replica')
#4 
/srv/mediawiki/php-1.35.0-wmf.26/extensions/Wikibase/lib/includes/Store/RevisionBasedEntityLookup.php(40):
 
Wikibase\Lib\Store\CacheRetrievingEntityRevisionLookup->getEntityRevision(Object(Wikibase\DataModel\Entity\ItemId))
#5 
/srv/mediawiki/php-1.35.0-wmf.26/vendor/wikibase/data-model-services/src/Lookup/RedirectResolvingEntityLookup.php(53):
 
Wikibase\Lib\Store\RevisionBasedEntityLookup->getEntity(Object(Wikibase\DataModel\Entity\ItemId))
#6 
/srv/mediawiki/php-1.35.0-wmf.26/extensions/Wikibase/repo/includes/Store/Sql/ItemsPerSiteBuilder.php(113):
 
Wikibase\DataModel\Services\Lookup\RedirectResolvingEntityLookup->getEntity(Object(Wikibase\DataModel\Entity\ItemId))
#7 
/srv/mediawiki/php-1.35.0-wmf.26/extensions/Wikibase/repo/includes/Store/Sql/ItemsPerSiteBuilder.php(92):
 Wikibase\Repo\Store\Sql\ItemsPerSiteBuilder->rebuildSiteLinks(Array)
#8 
/srv/mediawiki/php-1.35.0-wmf.26/extensions/Wikibase/repo/maintenance/rebuildItemsPerSite.php(89):
 
Wikibase\Repo\Store\Sql\ItemsPerSiteBuilder->rebuild(Object(Wikibase\DataModel\Services\EntityId\InMemoryEntityIdPager))
#9 /srv/mediawiki/php-1.35.0-wmf.26/maintenance/doMaintenance.php(99): 
Wikibase\Repo\Maintenance\RebuildItemsPerSite->execute()
#10 
/srv/mediawiki/php-1.35.0-wmf.26/extensions/Wikibase/repo/maintenance/rebuildItemsPerSite.php(117):
 require_once('/srv/mediawiki/...')
#11 /srv/mediawiki/multiversion/MWScript.php(101): 
require_once('/srv/mediawiki/...')
#12 {main}
  
  I'll split the input file at this id and skip over this ID.
  Seems the script isn't too resilient against redirects.

TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Sakretsu, ArielGlenn, Liuxinyu970226, Addshore, Aklapper, Tarrow, Iflorez, 
darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread Stashbot 
Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2020-04-07T12:06:28Z]  
addshore@mwmaint1002:~$ mwscript 
extensions/Wikibase/repo/maintenance/rebuildItemsPerSite.php 
--wiki=wikidatawiki --file T249596 
-4.list > T249596 
-4.out # T249565 
 T249596 


TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, Stashbot
Cc: ArielGlenn, Liuxinyu970226, Addshore, Aklapper, Tarrow, Iflorez, 
darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread Stashbot 
Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2020-04-07T12:06:28Z]  
addshore@mwmaint1002:~$ mwscript 
extensions/Wikibase/repo/maintenance/rebuildItemsPerSite.php 
--wiki=wikidatawiki --file T249596 
-4.list > T249596 
-4.out # T249565 
 T249596 


TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, Stashbot
Cc: ArielGlenn, Liuxinyu970226, Addshore, Aklapper, Tarrow, Iflorez, 
darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread Addshore 
Addshore added a comment.


  Quite a few items are reporting failures in restoring sitelinks to the table.
  These are likely due to the duplicates created in the last 14 hours.
  I'll create a dump of these item IDs at the end of the restore to be reviewed.

TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: ArielGlenn, Liuxinyu970226, Addshore, Aklapper, Tarrow, Iflorez, 
darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread Stashbot 
Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2020-04-07T12:06:28Z]  
addshore@mwmaint1002:~$ mwscript 
extensions/Wikibase/repo/maintenance/rebuildItemsPerSite.php 
--wiki=wikidatawiki --file T249596 
-4.list > T249596 
-4.out # T249565 
 T249596 


TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, Stashbot
Cc: ArielGlenn, Liuxinyu970226, Addshore, Aklapper, Tarrow, Iflorez, 
darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread Addshore 
Addshore added a comment.


addshore@stat1007:~$ analytics-mysql wikidatawiki -e "select DISTINCT 
rc_title from recentchanges where rc_timestamp > 2020040623 and 
rc_namespace = 0 ORDER BY rc_cur_id ASC;" -N -B > T249596-4.list
addshore@stat1007:~$ wc -l T249596-4.list
336053 T249596-4.list
  
  This is the list that I will use so 336053 entities to rebuild for

TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: ArielGlenn, Liuxinyu970226, Addshore, Aklapper, Tarrow, Iflorez, 
darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread Addshore 
Addshore added a comment.


  The following can be used the generate a list of ids to run over once the 
tables restored to the point before the drop.
  
addshore@stat1007:~$ analytics-mysql wikidatawiki -e "select DISTINCT 
rc_title from recentchanges where rc_timestamp > 2020040623 and 
rc_namespace = 0 ORDER BY rc_cur_id ASC;" -N -B > T249596-3.list

addshore@stat1007:~$
addshore@stat1007:~$ head T249596-3.list
Q18
Q31
Q2
Q4
Q23
Q49
Q59
Q68
Q82
Q94
addshore@stat1007:~$ wc -l T249596-3.list
330814 T249596-3.list

TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Liuxinyu970226, Addshore, Aklapper, Tarrow, Iflorez, darthmon_wmde, 
alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
_jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, Lydia_Pintscher, 
Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread Addshore 
Addshore added a comment.


  Currently it looks like the maintenance script will only need to run over 
~300k items
  
mysql:research@dbstore1005.eqiad.wmnet [wikidatawiki]> select 
count(DISTINCT rc_title) from recentchanges where rc_timestamp > 2020040623 
and rc_namespace = 0 limit 10;
+--+
| count(DISTINCT rc_title) |
+--+
|   316126 |
+--+
1 row in set (9.67 sec)
  
  This may still increase while the table continue to be restored, but it does 
mean the run of the maint script shouldn't take too long.
  
  First change (roughly) that we need to be concerned with rebuilding for 
(it'll probably be more efficient to use this rc_id nd the rc_id at the point 
the restored table is restored rather than a timestamp range) (but also might 
not matter)
  
mysql:research@dbstore1005.eqiad.wmnet [wikidatawiki]> select rc_id, 
rc_title, rc_namespace, rc_timestamp from recentchanges where rc_timestamp = 
2020040623 limit 1;
++---+--++
| rc_id  | rc_title  | rc_namespace | rc_timestamp   |
++---+--++
| 1190150512 | Q13161841 |0 | 2020040623 |
++---+--++
1 row in set (0.31 sec)

TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Addshore, Aklapper, Tarrow, Oblanco79, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, Iflorez, darthmon_wmde, 
Kent7301, alaa_wmde, Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, 
Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, 
Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, 
Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, 
Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread gerritbot 
gerritbot added a comment.


  Change 587217 **merged** by jenkins-bot:
  [mediawiki/extensions/Wikibase@wmf/1.35.0-wmf.26] Add entityid input file 
option to rebuildItemsPerSite
  
  https://gerrit.wikimedia.org/r/587217

TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Tarrow, gerritbot
Cc: Addshore, Aklapper, Tarrow, Oblanco79, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, Iflorez, darthmon_wmde, 
Kent7301, alaa_wmde, Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, 
Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, 
Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, 
Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, 
Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread gerritbot 
gerritbot added a comment.


  Change 587211 **merged** by jenkins-bot:
  [mediawiki/extensions/Wikibase@master] Add entityid input file option to 
rebuildItemsPerSite
  
  https://gerrit.wikimedia.org/r/587211

TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Tarrow, gerritbot
Cc: Addshore, Aklapper, Tarrow, Oblanco79, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, Iflorez, darthmon_wmde, 
Kent7301, alaa_wmde, Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, 
Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, 
Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, 
Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, 
Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread Addshore 
Addshore added a comment.


  I'll backport the change now in preparation for running the script later.

TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Tarrow, Addshore
Cc: Addshore, Aklapper, Tarrow, Oblanco79, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, Iflorez, darthmon_wmde, 
Kent7301, alaa_wmde, Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, 
Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, 
Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, 
Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, 
Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249596: Rebuild wb_items_per_site, after incident where wb_items_per_site was dropped

2020-04-07 Thread gerritbot 
gerritbot added a comment.


  Change 587217 had a related patch set uploaded (by Addshore; owner: Tarrow):
  [mediawiki/extensions/Wikibase@wmf/1.35.0-wmf.26] Add entityid input file 
option to rebuildItemsPerSite
  
  https://gerrit.wikimedia.org/r/587217

TASK DETAIL
  https://phabricator.wikimedia.org/T249596

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Tarrow, gerritbot
Cc: Aklapper, Tarrow, Oblanco79, Alter-paule, Beast1978, Un1tY, Hook696, 
Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, Iflorez, darthmon_wmde, Kent7301, 
alaa_wmde, Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, 
Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, 
Af420, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, 
Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, 
Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs