Re: [Analytics] Content of wmf.wdqs_extract

2018-05-14 Thread Adrian Bielefeldt
t.hql . > > Best, > Leila > > > > On Mon, May 7, 2018, 18:15 Andrew Otto <mailto:o...@wikimedia.org>> wrote: > > CCing Stas, he might know more. > > On Sun, May 6, 2018 at 9:58 AM, Adrian Bielefeldt > <mailto:adrian.bielefe...@mailb

[Analytics] Content of wmf.wdqs_extract

2018-05-06 Thread Adrian Bielefeldt
Hello everyone, I wanted to ask if anyone can tell me what wmf.wdqs_extract contains. I know generally that it is the query log of the SPARQL endpoint. However, I do not know if it is all requests, only uncached requests etc. If anyone knows or knows where I can read up on it that would be great.

Re: [Analytics] [wdqs_extract] Failed to fetch wmf.wdqs_extract entries 23.08.2017 hour 9-17

2017-09-10 Thread Adrian Bielefeldt
nd look > at it with the parquet-tools command line. As I mentioned earlier > probably pinging us on irc would be best. > > On Sat, Sep 9, 2017 at 7:42 AM, Adrian Bielefeldt > <mailto:adrian.bielefe...@mailbox.tu-dresden.de>> wrote: > > Hello everyone, > >

[Analytics] [wdqs_extract] Failed to fetch wmf.wdqs_extract entries 23.08.2017 hour 9-17

2017-09-09 Thread Adrian Bielefeldt
Hello everyone, I'm having trouble with the entries in wmf.wdqs_extract on 23.08.2017, specifically the hours 9-17. The call hive -e "insert overwrite local directory 'temp' row format delimited fields terminated by '\t' select uri_query, uri_path, user_agent, ts, agent_type, hour, http_status fr

Re: [Analytics] Resources stat1005

2017-08-12 Thread Adrian Bielefeldt
y cores are there anyway? > > > > Cheers, > > Erik > > > > *From:*Analytics [mailto:analytics-boun...@lists.wikimedia.org > <mailto:analytics-boun...@lists.wikimedia.org>] *On Behalf Of > *Adrian Bielefeldt > *Sent:* Sa

[Analytics] Resources stat1005

2017-08-12 Thread Adrian Bielefeldt
Hello everyone, I wanted to ask about resource allocation on stat1005. We need quite a bit since we process every entry in wdqs_extract and I was wondering how many cores and how much memory we can use without conflicting wi

Re: [Analytics] Additional python libraries

2017-06-03 Thread Adrian Bielefeldt
Am 03.06.2017 17:47 schrieb "Adrian Bielefeldt" > <mailto:adrian.bielefe...@mailbox.tu-dresden.de>>: > > Hello everyone, > > I wanted to ask about installing additional python libraries on the > analytics machines (specifically stat1002.eqiad.w

[Analytics] Additional python libraries

2017-06-03 Thread Adrian Bielefeldt
Hello everyone, I wanted to ask about installing additional python libraries on the analytics machines (specifically stat1002.eqiad.wmnet, regarding csvsort). Are we allowed to install libraries, or do we have to file a request with someone? Greetings, Adrian __

Re: [Analytics] Connect to wikidata.org from stat1002.eqiad.wmnet

2017-05-14 Thread Adrian Bielefeldt
; On Sat, 13 May 2017 at 15:23 Adrian Bielefeldt > <mailto:adrian.bielefe...@mailbox.tu-dresden.de>> wrote: > > Hello Nuri, > > I'm working on a project > <https://meta.wikimedia.org/wiki/Research:Understanding_Wikidata_Queries> > analyzing t

[Analytics] Connect to wikidata.org from stat1002.eqiad.wmnet

2017-05-12 Thread Adrian Bielefeldt
Hello everyone, I wanted to ask how I have to proceed to be able to connect to wikidata.org from a java program running on stat1002.eqiad.wmnet. I am specifically acessing the example queries for query.wikidata.org to check the logs for occurences. Greetings, Adrian ___

[Analytics] Timeout stat1002.eqiad.wmnet

2017-03-04 Thread Adrian Bielefeldt
Hi everyone, since yesterday we are having trouble logging in to the server. We receive an error message: connect to host bast3001.wikimedia.org port 22: Network is unreachable Just wanted to know if this is a known problem and if not whom I have to report it to.

[Analytics] [Query Logs] Research:Understanding Wikidata Queries

2016-12-27 Thread Adrian Bielefeldt
Hi all, I'm Adrian Bielefeldt an writing on behalf of Research:Understanding Wikidata Queries <https://meta.wikimedia.org/wiki/Research:Understanding_Wikidata_Queries>, a research project aimed at gaining an insight into the way the query service <https://query.wikidata.org/> of