[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2022-04-08 Thread JAllemandou
JAllemandou closed subtask T299059: Write an Airflow job converting commons structured data dump to Hive as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T258834 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: JAllemandou Cc: AKhatun_WMF,

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2022-03-30 Thread JAllemandou
JAllemandou closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T258834 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: JAllemandou Cc: AKhatun_WMF, JAllemandou, cchen, Nuria, Miriam, nettrom_WMF, Fernandobacasegua34, Astuth

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2022-02-22 Thread Gehel
Gehel removed a project: Discovery-Search (Current work). Gehel moved this task from Current work to Tracking on the Wikidata-Query-Service board. TASK DETAIL https://phabricator.wikimedia.org/T258834 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL PREFERENCES https:/

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2022-01-12 Thread gerritbot
gerritbot added a comment. Change 740590 **merged** by Joal: [analytics/refinery@master] Add structured_data.commons_entity table create https://gerrit.wikimedia.org/r/740590 TASK DETAIL https://phabricator.wikimedia.org/T258834 EMAIL PREFERENCES https://phabricator.wikimedia.or

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2022-01-12 Thread gerritbot
gerritbot added a comment. Change 747508 **merged** by jenkins-bot: [analytics/refinery/source@master] Update structured_data dumps parsing job https://gerrit.wikimedia.org/r/747508 TASK DETAIL https://phabricator.wikimedia.org/T258834 EMAIL PREFERENCES https://phabricator.wikim

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2022-01-11 Thread odimitrijevic
odimitrijevic removed a project: Analytics. TASK DETAIL https://phabricator.wikimedia.org/T258834 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: JAllemandou, odimitrijevic Cc: AKhatun_WMF, JAllemandou, cchen, Nuria, Miriam, nettrom_WMF, ntsako, 786,

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2022-01-11 Thread gerritbot
gerritbot added a comment. Change 738874 **merged** by Ottomata: [operations/puppet@production] Import commons mediainfo json dumps to HDFS https://gerrit.wikimedia.org/r/738874 TASK DETAIL https://phabricator.wikimedia.org/T258834 EMAIL PREFERENCES https://phabricator.wikimedia

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2021-12-16 Thread JAllemandou
JAllemandou added a comment. Code is ready: - Import `commons-mediainfo` json dumps to HDFS (https://gerrit.wikimedia.org/r/738874) - Update spark transformation job to work with both wikidata and commons dumps (https://gerrit.wikimedia.org/r/739129) - Update `wikidata_entity` table

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2021-12-15 Thread gerritbot
gerritbot added a comment. Change 747508 had a related patch set uploaded (by Joal; author: Joal): [analytics/refinery/source@master] Update structured_data dumps parsing job https://gerrit.wikimedia.org/r/747508 TASK DETAIL https://phabricator.wikimedia.org/T258834 EMAIL PREFEREN

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2021-12-15 Thread JAllemandou
JAllemandou added a project: Data-Engineering-Kanban. TASK DETAIL https://phabricator.wikimedia.org/T258834 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: JAllemandou Cc: AKhatun_WMF, JAllemandou, cchen, Nuria, Miriam, nettrom_WMF, 786, EChetty, Sur

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2021-11-23 Thread Gehel
Gehel reassigned this task from AKhatun_WMF to JAllemandou. Gehel moved this task from Incoming to Blocked (from outside the team) on the Discovery-Search (Current work) board. TASK DETAIL https://phabricator.wikimedia.org/T258834 WORKBOARD https://phabricator.wikimedia.org/project/board/122

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2021-11-22 Thread gerritbot
gerritbot added a comment. Change 740590 had a related patch set uploaded (by Joal; author: Joal): [analytics/refinery@master] Add structured_data.commons_entity table create https://gerrit.wikimedia.org/r/740590 TASK DETAIL https://phabricator.wikimedia.org/T258834 EMAIL PREFEREN

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2021-11-22 Thread gerritbot
gerritbot added a comment. Change 739129 **merged** by jenkins-bot: [analytics/refinery/source@master] Save commons json dumps as a table and add fields for wikidata https://gerrit.wikimedia.org/r/739129 TASK DETAIL https://phabricator.wikimedia.org/T258834 EMAIL PREFERENCES ht

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2021-11-16 Thread gerritbot
gerritbot added a comment. Change 739129 had a related patch set uploaded (by AKhatun; author: AKhatun): [analytics/refinery/source@master] Save commons json dumps as a table https://gerrit.wikimedia.org/r/739129 TASK DETAIL https://phabricator.wikimedia.org/T258834 EMAIL PREFEREN

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2021-11-15 Thread gerritbot
gerritbot added a comment. Change 738874 had a related patch set uploaded (by Joal; author: Joal): [operations/puppet@production] Import commons mediainfo json dumps to HDFS https://gerrit.wikimedia.org/r/738874 TASK DETAIL https://phabricator.wikimedia.org/T258834 EMAIL PREFERENC

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2021-11-15 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T258834 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AKhatun_WMF, gerritbot Cc: AKhatun_WMF, JAllemandou, cchen, Nuria, Miriam, nettrom_WMF, 786, EChetty, S

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2021-11-15 Thread gerritbot
gerritbot added a comment. Change 738874 had a related patch set uploaded (by Joal; author: Joal): [operations/puppet@production] Import commons mediainfo json dumps to HDFS https://gerrit.wikimedia.org/r/738874 TASK DETAIL https://phabricator.wikimedia.org/T258834 EMAIL PREFERENC

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2021-11-14 Thread AKhatun_WMF
AKhatun_WMF claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T258834 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AKhatun_WMF Cc: AKhatun_WMF, JAllemandou, cchen, Nuria, Miriam, nettrom_WMF, EChetty, toberto, ldelench_wmf, Invadibo

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2021-11-11 Thread AKhatun_WMF
AKhatun_WMF moved this task from Analysis to Current work on the Wikidata-Query-Service board. AKhatun_WMF added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T258834 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2021-11-01 Thread Gehel
Gehel moved this task from All WDQS-related tasks to Analysis on the Wikidata-Query-Service board. Gehel triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T258834 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL PREFERENCES https://pha

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2021-10-28 Thread odimitrijevic
odimitrijevic added a project: Data-Engineering. TASK DETAIL https://phabricator.wikimedia.org/T258834 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: odimitrijevic Cc: AKhatun_WMF, JAllemandou, cchen, Nuria, Miriam, nettrom_WMF, EChetty, toberto, ld

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2021-10-28 Thread Maintenance_bot
Maintenance_bot added a project: Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T258834 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Maintenance_bot Cc: AKhatun_WMF, JAllemandou, cchen, Nuria, Miriam, nettrom_WMF, EChetty, toberto, ldelen

[Wikidata-bugs] [Maniphest] T258834: Create a Commons equivalent of the wikidata_entity table in the Data Lake

2021-10-28 Thread Gehel
Gehel added a project: Wikidata-Query-Service. Gehel added a subscriber: AKhatun_WMF. TASK DETAIL https://phabricator.wikimedia.org/T258834 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: AKhatun_WMF, JAllemandou, cchen, Nuria, Miriam, nettr