It looks as if it is the ets:new/2 operation that fails due to system_limit.
Like with the number of concurrently running processes, the system limit
is by default pretty low (1400 tables), but can be increased by setting the
OS environment variable ERL_MAX_ETS_TABLES.
Now, I have no idea if Riak Search is supposed to need tons of ets
tables. I know of situations where reaching the ets system limit can be a
symptom of growing backlog in the system - e.g. if mnesia is falling behind,
since every pending mnesia transaction keeps at least one ets table for
the temporary transaction store.
BR,
Ulf W
On 31 Oct 2010, at 09:23, Prometheus WillSurvive wrote:
> Hi,
>
> We started a batch index test (wikipedia) when we reached around 600K docs
> system gave below error.. Any idea ?
>
> We can not index any more doc in this index.
>
>
>
> =ERROR REPORT==== 31-Oct-2010::10:22:42 ===
> ** Too many db tables **
>
> DEBUG: riak_search_dir_indexer:197 - "{ error , Type , Error , erlang :
> get_stacktrace ( ) }"
>
> {error,error,system_limit,
> [{ets,new,[batch,[protected,duplicate_bag]]},
> {riak_search_client,process_terms_1,5},
> {riak_search_client,process_terms_1,5},
> {riak_search_client,index_docs,3},
> {riak_search_client,index_docs,2},
> {riak_solr_search_client,run_solr_command,4},
> {solr_search,'-index_dir/2-lc$^0/1-0-',2},
> {riak_search_dir_indexer,worker_loop,5}]}
>
>
> =ERROR REPORT==== 31-Oct-2010::10:22:44 ===
> Error in process <0.22187.14> on node '[email protected]' with exit
> value: {system_limit,[{riak_search_dir_indexer,worker_loop,5}]}
>
> RPC to '[email protected]' failed: {'EXIT',
> {system_limit,
> [{riak_search_dir_indexer,
> worker_loop,5}]}}
>
>
> _______________________________________________
> riak-users mailing list
> [email protected]
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Ulf Wiger, CTO, Erlang Solutions, Ltd.
http://erlang-solutions.com
_______________________________________________
riak-users mailing list
[email protected]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
