You are correct that cookies are not shared among threads. That is by design.
The only way to set cookies for the WebConnector is to have there be a "login sequence". The login sequence sets cookies that are then used by all subsequent fetches. Thanks, Karl On Thu, Jul 19, 2018 at 3:38 PM Gustavo Beneitez <gustavo.benei...@gmail.com> wrote: > Hi everyone, > > I have tried to look for an answer before writing this email, no luck. > Sorry for the inconvenience if it is already answered. > > I need to set a cookie at the begining of the web crawling. The cookie > rules the language you get the content, and while there are several > choices, if no cookie is found there will be a "default language". > > I made a JSP which sets the cookie and contains several links (href), and > pointed ManifoldCF to this page as the repository seed. I expected to get > the crawling engine starting to capture links with correct language > indicated by the cookie, but what I really got is a lot of content shown in > default language. > > What I think about that is that cookies are not shared between thread > spiders, so it is not possible to get cookies remain between links. Cookie > domain is correct, also cookie expiration > > I would appreciate so much if you can help me on this. > > Thanks in advance! > > >
