[ https://issues.apache.org/jira/browse/NUTCH-3018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tim Allison updated NUTCH-3018: ------------------------------- Description: It looks like it takes between 2x and 4x of the time to initialize the remote webdriver in selenium than it does to render/fetch a couple of test pages I'm working with. On linux with a chrome driver, ~1.5 seconds to load the driver and then .5 of a second to fetch/render the page. On a mac, ~1.2 seconds to load and then .5 of a second to fetch/render. On a mac with firefox driver, ~3.7 seconds to load the driver and ~1 second to fetch/render a page. Is it worth pooling webdrivers or does that add too much complexity/overhead? was: It looks like it takes between 2x and 4x of the time to initialize the remote webdriver in selenium than it does to render/fetch a couple of test pages I'm working with. On a mac with a chrome driver, ~1.5 seconds to load the driver and then .5 of a second to fetch/render the page. On a mac, ~1.2 seconds to load and then .5 of a second to fetch/render. On a mac with firefox driver, ~3.7 seconds to load the driver and ~1 second to fetch/render a page. Is it worth pooling webdrivers or does that add too much complexity/overhead? > Consider pooling remote webdrivers for Selenium? > ------------------------------------------------ > > Key: NUTCH-3018 > URL: https://issues.apache.org/jira/browse/NUTCH-3018 > Project: Nutch > Issue Type: Task > Reporter: Tim Allison > Priority: Minor > > It looks like it takes between 2x and 4x of the time to initialize the remote > webdriver in selenium than it does to render/fetch a couple of test pages I'm > working with. > On linux with a chrome driver, ~1.5 seconds to load the driver and then .5 of > a second to fetch/render the page. On a mac, ~1.2 seconds to load and then .5 > of a second to fetch/render. > On a mac with firefox driver, ~3.7 seconds to load the driver and ~1 second > to fetch/render a page. > Is it worth pooling webdrivers or does that add too much complexity/overhead? -- This message was sent by Atlassian Jira (v8.20.10#820010)