Hi,
I am having an issues with getting data out of MR......
If I run on a few particular days I get the below error and returns almost
immediate. On other days returns valid data. I am using a key filter to
select by day when I noticed that a date range was failing.
key_filter.starts_with('20121207'). I am running on a three node cluster
with 2 cores each an 4 gigs of ram. When it works it returns data pretty
fast. So..per the below error..a key did exist from that day.
Even further, I can get the values of that key in the error.
Why the time out error? I have a generous timeout.
for result in query.run(timeout=300000):
#print pprint(result)
for k,v in result.iteritems():
print k,v
Traceback (most recent call last):
File
"/home/ubuntu/workspace/rtbopsConfig/rtbServers/rtbWorkerServer/riak/mapreduce_v1.py",
line 61, in <module>
main()
File
"/home/ubuntu/workspace/rtbopsConfig/rtbServers/rtbWorkerServer/riak/mapreduce_v1.py",
line 57, in main
for result in query.run(timeout=30000):
File
"/usr/local/lib/python2.7/dist-packages/riak-1.5.0-py2.7.egg/riak/mapreduce.py",
line 232, in run
result = t.mapred(self._inputs, query, timeout)
File
"/usr/local/lib/python2.7/dist-packages/riak-1.5.0-py2.7.egg/riak/transports/pbc.py",
line 454, in mapred
_handle_response)
File
"/usr/local/lib/python2.7/dist-packages/riak-1.5.0-py2.7.egg/riak/transports/pbc.py",
line 548, in send_msg_multi
msg_code, resp = self.recv_msg(conn, expect)
File
"/usr/local/lib/python2.7/dist-packages/riak-1.5.0-py2.7.egg/riak/transports/pbc.py",
line 589, in recv_msg
raise Exception(msg.errmsg)
Exception:
{"phase":0,"error":"[timeout]","input":"{<<\"impressions\">>,<<\"0109d84f-20d9-48cd-b098-716e016cae9b:cid6587015966:agid5748040653:2012120107:SG\">>}","type":"forward_preflist","stack":"[]"}
So....how do I get data out without causing an exception? Otherwise I have
to write a loop that skips a day which does not quite seem right.
Thanks
_______________________________________________
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
