I think we still have an issue of reliability. I can never reliably get them all to pass. I have no idea which failures are real. Am I the only one that experiences this?
We need a reliable pass/fail on these before we talk about adding them to the checklist. For example, I just tried to run them on METRON-1771. I don't think we have a problem with these changes, but I have not been able to get one run to fully pass. See the attached output of those runs. On Wed, Oct 3, 2018 at 7:36 AM Shane Ardell <shane.m.ard...@gmail.com> wrote: > I ran them locally a handful of times just now, and on average they took > approximately 15 minutes to complete. > > On Tue, Oct 2, 2018, 18:22 Michael Miklavcic <michael.miklav...@gmail.com> > wrote: > > > @Shane Just how much time are we talking about, on average? I don't think > > many in the community have had much exposure to running the e2e tests in > > their current form. It might still be worth it in the short term. > > > > On Tue, Oct 2, 2018 at 10:20 AM Shane Ardell <shane.m.ard...@gmail.com> > > wrote: > > > > > The protractor-flake package should catch and re-run false failures, so > > > people shouldn't get failing tests when they are done running. I just > > meant > > > that we often re-run flaky tests with protractor-flake, so it can take > a > > > while to run and could increase the build time considerably. > > > > > > On Tue, Oct 2, 2018, 18:00 Casey Stella <ceste...@gmail.com> wrote: > > > > > > > Are the tests so brittle that, even with flaky, people will run upon > > > false > > > > failures as part of contributing a PR? If so, do we have a list of > the > > > > brittle ones (and the things that would disambiguate a true failure > > from > > > a > > > > false failure) that we can add to the documentation? > > > > > > > > On Tue, Oct 2, 2018 at 11:58 AM Shane Ardell < > shane.m.ard...@gmail.com > > > > > > > wrote: > > > > > > > > > I also would like to eventually have these tests automated. There > > are a > > > > > couple hurdles to setting up our e2e tests to run with our build. I > > > think > > > > > the biggest hurdle is setting up a dedicated server with data for > the > > > e2e > > > > > tests to use. I would assume this requires funding, engineering > > > support, > > > > > obfuscated data, etc. I also think we should migrate our e2e tests > to > > > > > Cypress first because Protractor lacks debugging tools that would > > make > > > > our > > > > > life much easier if, for example, we had a failure in our CI build > > but > > > > > could not reproduce locally. In addition, our current Protractor > > tests > > > > are > > > > > brittle and extremely slow. > > > > > > > > > > All that said, it seems we agree that we could add another PR > > checklist > > > > > item in the meantime. Clarifying those e2e test instructions should > > be > > > > part > > > > > of that task. > > > > > > > > > > On Mon, Oct 1, 2018 at 2:36 PM Casey Stella <ceste...@gmail.com> > > > wrote: > > > > > > > > > > > I'd also like to make sure that clear instructions are provided > (or > > > > > linked > > > > > > to) about how to run them. Also, we need to make sure the > > > instructions > > > > > are > > > > > > rock-solid for running them. > > > > > > Looking at > > > > > > > > > > > > > > > > > > > > > > > > > > > https://github.com/apache/metron/tree/master/metron-interface/metron-alerts#e2e-tests > > > > > > , > > > > > > would someone who doesn't have much or any knowledge of the UI be > > > able > > > > to > > > > > > run that without assistance? > > > > > > > > > > > > For instance, we use full-dev, do we need to stop data from being > > > > played > > > > > > into full-dev for the tests to work? > > > > > > > > > > > > Casey > > > > > > > > > > > > On Mon, Oct 1, 2018 at 8:29 AM Casey Stella <ceste...@gmail.com> > > > > wrote: > > > > > > > > > > > > > I'm not super keen on expanding the steps to contribute, > > especially > > > > in > > > > > an > > > > > > > avenue that should be automated. > > > > > > > That being said, I think that until we get to the point of > > > automating > > > > > the > > > > > > > e2e tests, it's sensible to add them to the checklist. > > > > > > > So, I would support it, but I would also urge us to move > forward > > > the > > > > > > > efforts of running these tests as part of the CI build. > > > > > > > > > > > > > > What is the current gap there? > > > > > > > > > > > > > > Casey > > > > > > > > > > > > > > On Mon, Oct 1, 2018 at 7:41 AM Shane Ardell < > > > > shane.m.ard...@gmail.com> > > > > > > > wrote: > > > > > > > > > > > > > >> Hello everyone, > > > > > > >> > > > > > > >> In another discussion thread from July, I briefly mentioned > the > > > idea > > > > > of > > > > > > >> adding a step to the pull request checklist asking > contributors > > to > > > > run > > > > > > the > > > > > > >> UI end-to-end tests. Since we aren't running e2e tests as part > > of > > > > the > > > > > CI > > > > > > >> build, it's easy for contributors to unintentionally break > these > > > > > tests. > > > > > > >> Reminding contributors to run these tests will hopefully help > > > catch > > > > > > >> situations like this before opening a pull request. > > > > > > >> > > > > > > >> Does this make sense to everyone? > > > > > > >> > > > > > > >> Regards, > > > > > > >> Shane > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > >
$ npm run e2e > metron-alerts@0.6.1 pree2e > /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts > webdriver-manager update [14:58:40] I/file_manager - creating folder /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/webdriver-manager/selenium [14:58:40] I/config_source - curl -o/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/webdriver-manager/selenium/standalone-response.xml https://selenium-release.storage.googleapis.com/ [14:58:40] I/config_source - curl -o/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/webdriver-manager/selenium/chrome-response.xml https://chromedriver.storage.googleapis.com/ [14:58:40] I/config_source - curl -o/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/webdriver-manager/selenium/gecko-response.json https://api.github.com/repos/mozilla/geckodriver/releases [14:58:41] I/downloader - curl -o/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/webdriver-manager/selenium/chromedriver_2.42.zip https://chromedriver.storage.googleapis.com/2.42/chromedriver_mac64.zip [14:58:41] I/downloader - curl -o/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/webdriver-manager/selenium/selenium-server-standalone-3.14.0.jar https://selenium-release.storage.googleapis.com/3.14/selenium-server-standalone-3.14.0.jar [14:58:41] I/update - chromedriver: unzipping chromedriver_2.42.zip [14:58:42] I/update - chromedriver: setting permissions to 0755 for /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/webdriver-manager/selenium/chromedriver_2.42 [14:58:42] I/downloader - curl -o/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/webdriver-manager/selenium/geckodriver-v0.23.0.tar.gz https://github.com/mozilla/geckodriver/releases/download/v0.23.0/geckodriver-v0.23.0-macos.tar.gz [14:58:44] I/update - geckodriver: unzipping geckodriver-v0.23.0.tar.gz [14:58:44] I/update - geckodriver: setting permissions to 0755 for /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/webdriver-manager/selenium/geckodriver-v0.23.0 > metron-alerts@0.6.1 e2e > /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts > protractor-flake --protractor-path=./node_modules/.bin/protractor > --max-attempts=3 -- ./protractor.conf.js [14:58:45] I/launcher - Running 1 instances of WebDriver [14:58:45] I/direct - Using ChromeDriver directly... Started Spec started . Test spec for login page ✓ should display error message for invalid credentials . ✓ should login for valid credentials . ✓ should logout . Test spec for all ui elements & list view ✓ should have all the UI elements . ✓ should have all pagination controls and they should be working . ✓ should have all settings controls and they should be working . ✓ play pause should start polling and stop polling . ✓ should select columns from table configuration . ✓ should have all time-range controls F ✗ should have all time range values populated - 1 - Expected 'Last 7 days,NaN' to equal 'Last 7 days,604800000' for last 7 days at UserContext.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/alerts-list.e2e-spec.ts:427:55) at step (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/alerts-list.e2e-spec.ts:32:23) at Object.next (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/alerts-list.e2e-spec.ts:13:53) at fulfilled (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/alerts-list.e2e-spec.ts:4:58) at <anonymous> at process._tickCallback (internal/process/next_tick.js:182:7) . ✓ should have all time range values populated - 2 . ✓ should have all time range values populated - 3 . ✓ should have all time range values populated - 4 . ✓ should disable date picker when timestamp is present in search . ✓ should have now included when to date is empty . ✓ should have all time-range included while searching . Test spec for table column configuration ✓ should select columns from table configuration . ✓ should rename columns from table configuration . Test spec for search and save search ✓ should display all the default values for saved searches . ✓ should have all save search controls and they save search should be working . ✓ should delete search items from search box . ✓ should delete first search items from search box having multiple search fields . ✓ manually entering search queries to search box and pressing enter key should search FA Jasmine spec timed out. Resetting the WebDriver Control Flow. A Jasmine spec timed out. Resetting the WebDriver Control Flow. Test spec for tree view ✗ should have all group by elements - Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. at ontimeout (timers.js:466:11) at tryOnTimeout (timers.js:304:5) - Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. at ontimeout (timers.js:466:11) at tryOnTimeout (timers.js:304:5) **. ✓ should have group details for multiple group by . ✓ should have sort working for group details for multiple sub groups . ✓ should have search working for group details for multiple sub groups . Alerts Table should sort by colum: ✓ sorting ASC by ip_src_addr F ✗ sorting DESC by ip_src_addr - Expected $[0] = '192.168.65.1' to equal '192.168.138.160'. at UserContext.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:157:47) at step (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:32:23) at Object.next (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:13:53) at fulfilled (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:4:58) at <anonymous> at process._tickCallback (internal/process/next_tick.js:182:7) . ✓ sorting ASC by Score F ✗ sorting DESC by Score - Failed: stale element reference: element is not attached to the page document (Session info: headless chrome=69.0.3497.100) (Driver info: chromedriver=2.42.591059 (a3d9684d10d61aa0c45f6723b327283be1ebaad8),platform=Mac OS X 10.13.6 x86_64) (Session info: headless chrome=69.0.3497.100) (Driver info: chromedriver=2.42.591059 (a3d9684d10d61aa0c45f6723b327283be1ebaad8),platform=Mac OS X 10.13.6 x86_64) at Object.checkLegacyResponse (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/error.js:546:15) at parseHttpResponse (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/http.js:509:13) at doSend.then.response (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/http.js:441:30) at <anonymous> at process._tickCallback (internal/process/next_tick.js:182:7) From: Task: WebElement.getText() at Driver.schedule (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/webdriver.js:807:17) at WebElement.schedule_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/webdriver.js:2010:25) at WebElement.getText (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/webdriver.js:2277:17) at actionFn (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:89:44) at Array.map (<anonymous>) at actionResults.getWebElements.then (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:461:65) at ManagedPromise.invokeCallback_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:1376:14) at TaskQueue.execute_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:3084:14) at TaskQueue.executeNext_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:3067:27) at asyncRun (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:2927:27)Error at ElementArrayFinder.applyAction_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:459:27) at ElementArrayFinder.(anonymous function).args [as getText] (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:91:29) at ElementFinder.(anonymous function).args [as getText] (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:831:22) at /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/utils/e2e_util.ts:89:23 at ManagedPromise.invokeCallback_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:1376:14) at TaskQueue.execute_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:3084:14) at TaskQueue.executeNext_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:3067:27) at asyncRun (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:2927:27) at /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:668:7 at <anonymous> From: Task: Run it("sorting DESC by Score") in control flow at UserContext.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/jasminewd2/index.js:94:19) at /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/jasminewd2/index.js:64:48 at ControlFlow.emit (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/events.js:62:21) at ControlFlow.shutdown_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:2674:10) at shutdownTask_.MicroTask (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:2599:53) From asynchronous test: Error at Suite.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:190:9) at Suite.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:85:5) at Object.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:59:1) . Test spec for facet filters ✓ should display facets data . ✓ should search when facet is selected . Test spec for changing alert status in list view & tree view ✓ should change alert status for multiple alerts to OPEN . ✓ should change alert status for multiple alerts to DISMISS . ✓ should change alert status for multiple alerts to ESCALATE . ✓ should change alert status for multiple alerts to RESOLVE . ✓ should change alert status for multiple alerts to OPEN in tree view ***. Test spec for meta alerts workflow ✓ should have all the steps for meta alerts workflow FA Jasmine spec timed out. Resetting the WebDriver Control Flow. A Jasmine spec timed out. Resetting the WebDriver Control Flow. ✗ should create a meta alert from nesting of more than one level - Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. at ontimeout (timers.js:466:11) at tryOnTimeout (timers.js:304:5) - Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. at ontimeout (timers.js:466:11) at tryOnTimeout (timers.js:304:5) Failures: 1) Test spec for all ui elements & list view should have all time range values populated - 1 Message: Expected 'Last 7 days,NaN' to equal 'Last 7 days,604800000' for last 7 days Stack: Error: Failed expectation at UserContext.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/alerts-list.e2e-spec.ts:427:55) at step (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/alerts-list.e2e-spec.ts:32:23) at Object.next (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/alerts-list.e2e-spec.ts:13:53) at fulfilled (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/alerts-list.e2e-spec.ts:4:58) at <anonymous> at process._tickCallback (internal/process/next_tick.js:182:7) 2) Test spec for tree view should have all group by elements Message: Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. Stack: Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. at ontimeout (timers.js:466:11) at tryOnTimeout (timers.js:304:5) at Timer.listOnTimeout (timers.js:267:5) Message: Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. Stack: Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. at ontimeout (timers.js:466:11) at tryOnTimeout (timers.js:304:5) at Timer.listOnTimeout (timers.js:267:5) 3) Alerts Table should sort by colum: sorting DESC by ip_src_addr Message: Expected $[0] = '192.168.65.1' to equal '192.168.138.160'. Stack: Error: Failed expectation at UserContext.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:157:47) at step (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:32:23) at Object.next (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:13:53) at fulfilled (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:4:58) at <anonymous> at process._tickCallback (internal/process/next_tick.js:182:7) 4) Alerts Table should sort by colum: sorting DESC by Score Message: Failed: stale element reference: element is not attached to the page document (Session info: headless chrome=69.0.3497.100) (Driver info: chromedriver=2.42.591059 (a3d9684d10d61aa0c45f6723b327283be1ebaad8),platform=Mac OS X 10.13.6 x86_64) Stack: StaleElementReferenceError: stale element reference: element is not attached to the page document (Session info: headless chrome=69.0.3497.100) (Driver info: chromedriver=2.42.591059 (a3d9684d10d61aa0c45f6723b327283be1ebaad8),platform=Mac OS X 10.13.6 x86_64) at Object.checkLegacyResponse (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/error.js:546:15) at parseHttpResponse (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/http.js:509:13) at doSend.then.response (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/http.js:441:30) at <anonymous> at process._tickCallback (internal/process/next_tick.js:182:7) From: Task: WebElement.getText() at Driver.schedule (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/webdriver.js:807:17) at WebElement.schedule_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/webdriver.js:2010:25) at WebElement.getText (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/webdriver.js:2277:17) at actionFn (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:89:44) at Array.map (<anonymous>) at actionResults.getWebElements.then (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:461:65) at ManagedPromise.invokeCallback_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:1376:14) at TaskQueue.execute_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:3084:14) at TaskQueue.executeNext_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:3067:27) at asyncRun (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:2927:27)Error at ElementArrayFinder.applyAction_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:459:27) at ElementArrayFinder.(anonymous function).args [as getText] (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:91:29) at ElementFinder.(anonymous function).args [as getText] (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:831:22) at /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/utils/e2e_util.ts:89:23 at ManagedPromise.invokeCallback_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:1376:14) at TaskQueue.execute_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:3084:14) at TaskQueue.executeNext_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:3067:27) at asyncRun (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:2927:27) at /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:668:7 at <anonymous> From: Task: Run it("sorting DESC by Score") in control flow at UserContext.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/jasminewd2/index.js:94:19) at /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/jasminewd2/index.js:64:48 at ControlFlow.emit (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/events.js:62:21) at ControlFlow.shutdown_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:2674:10) at shutdownTask_.MicroTask (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:2599:53) From asynchronous test: Error at Suite.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:190:9) at Suite.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:85:5) at Object.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:59:1) 5) Test spec for meta alerts workflow should create a meta alert from nesting of more than one level Message: Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. Stack: Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. at ontimeout (timers.js:466:11) at tryOnTimeout (timers.js:304:5) at Timer.listOnTimeout (timers.js:267:5) Message: Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. Stack: Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. at ontimeout (timers.js:466:11) at tryOnTimeout (timers.js:304:5) at Timer.listOnTimeout (timers.js:267:5) Pending: 1) Test spec for tree view drag and drop should change group order Temporarily disabled with xit 2) Test spec for tree view should have group details for single group by Temporarily disabled with xit 3) Test spec for metron details page should change alert statuses Temporarily disabled with xit 4) Test spec for metron details page should add comments for table view Temporarily disabled with xit 5) Test spec for metron details page should add comments for tree view Temporarily disabled with xit 45 specs, 5 failures, 5 pending specs Finished in 408.987 seconds ************************************************** * Failures * ************************************************** 1) Test spec for all ui elements & list view should have all time range values populated - 1 - Expected 'Last 7 days,NaN' to equal 'Last 7 days,604800000' for last 7 days 2) Test spec for tree view should have all group by elements - Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. - Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. 3) Alerts Table should sort by colum: sorting DESC by ip_src_addr - Expected $[0] = '192.168.65.1' to equal '192.168.138.160'. 4) Alerts Table should sort by colum: sorting DESC by Score - Failed: stale element reference: element is not attached to the page document (Session info: headless chrome=69.0.3497.100) (Driver info: chromedriver=2.42.591059 (a3d9684d10d61aa0c45f6723b327283be1ebaad8),platform=Mac OS X 10.13.6 x86_64) 5) Test spec for meta alerts workflow should create a meta alert from nesting of more than one level - Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. - Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. ************************************************** * Pending * ************************************************** 1) Test spec for tree view drag and drop should change group order Temporarily disabled with xit 2) Test spec for tree view should have group details for single group by Temporarily disabled with xit 3) Test spec for metron details page should change alert statuses Temporarily disabled with xit 4) Test spec for metron details page should add comments for table view Temporarily disabled with xit 5) Test spec for metron details page should add comments for tree view Temporarily disabled with xit Executed 40 of 45 specs (5 FAILED) (5 PENDING) in 6 mins 49 secs. [15:05:42] I/launcher - 0 instance(s) of WebDriver still running [15:05:42] I/launcher - chrome #01 failed 5 test(s) [15:05:42] I/launcher - overall: 5 failed spec(s) [15:05:42] E/launcher - Process exited with error code 1 Using standard to parse output Re-running tests: test attempt 2 Re-running the following test files: /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/alerts-list.e2e-spec.ts /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts [15:05:43] I/launcher - Running 1 instances of WebDriver [15:05:43] I/direct - Using ChromeDriver directly... Started Spec started . Test spec for all ui elements & list view ✓ should have all the UI elements . ✓ should have all pagination controls and they should be working . ✓ should have all settings controls and they should be working . ✓ play pause should start polling and stop polling . ✓ should select columns from table configuration . ✓ should have all time-range controls . ✓ should have all time range values populated - 1 . ✓ should have all time range values populated - 2 . ✓ should have all time range values populated - 3 . ✓ should have all time range values populated - 4 . ✓ should disable date picker when timestamp is present in search . ✓ should have now included when to date is empty . ✓ should have all time-range included while searching . Alerts Table should sort by colum: ✓ sorting ASC by ip_src_addr F ✗ sorting DESC by ip_src_addr - Expected $[0] = '192.168.65.1' to equal '192.168.138.160'. at UserContext.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:157:47) at step (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:32:23) at Object.next (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:13:53) at fulfilled (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:4:58) at <anonymous> at process._tickCallback (internal/process/next_tick.js:182:7) . ✓ sorting ASC by Score . ✓ sorting DESC by Score Failures: 1) Alerts Table should sort by colum: sorting DESC by ip_src_addr Message: Expected $[0] = '192.168.65.1' to equal '192.168.138.160'. Stack: Error: Failed expectation at UserContext.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:157:47) at step (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:32:23) at Object.next (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:13:53) at fulfilled (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:4:58) at <anonymous> at process._tickCallback (internal/process/next_tick.js:182:7) 17 specs, 1 failure Finished in 105.042 seconds ************************************************** * Failures * ************************************************** 1) Alerts Table should sort by colum: sorting DESC by ip_src_addr - Expected $[0] = '192.168.65.1' to equal '192.168.138.160'. Executed 17 of 17 specs (1 FAILED) in 1 min 45 secs. [15:07:30] I/launcher - 0 instance(s) of WebDriver still running [15:07:30] I/launcher - chrome #01 failed 1 test(s) [15:07:30] I/launcher - overall: 1 failed spec(s) [15:07:30] E/launcher - Process exited with error code 1 Using standard to parse output Re-running tests: test attempt 3 Re-running the following test files: /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts [15:07:32] I/launcher - Running 1 instances of WebDriver [15:07:32] I/direct - Using ChromeDriver directly... Started Spec started F Alerts Table should sort by colum: ✗ sorting ASC by ip_src_addr - Expected $[0] = '192.168.138.158' to equal '192.168.65.1'. at UserContext.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:127:46) at step (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:32:23) at Object.next (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:13:53) at fulfilled (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:4:58) at <anonymous> at process._tickCallback (internal/process/next_tick.js:182:7) F ✗ sorting DESC by ip_src_addr - Expected $[0] = '192.168.65.1' to equal '192.168.138.160'. at UserContext.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:157:47) at step (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:32:23) at Object.next (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:13:53) at fulfilled (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:4:58) at <anonymous> at process._tickCallback (internal/process/next_tick.js:182:7) . ✓ sorting ASC by Score . ✓ sorting DESC by Score Failures: 1) Alerts Table should sort by colum: sorting ASC by ip_src_addr Message: Expected $[0] = '192.168.138.158' to equal '192.168.65.1'. Stack: Error: Failed expectation at UserContext.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:127:46) at step (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:32:23) at Object.next (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:13:53) at fulfilled (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:4:58) at <anonymous> at process._tickCallback (internal/process/next_tick.js:182:7) 2) Alerts Table should sort by colum: sorting DESC by ip_src_addr Message: Expected $[0] = '192.168.65.1' to equal '192.168.138.160'. Stack: Error: Failed expectation at UserContext.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:157:47) at step (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:32:23) at Object.next (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:13:53) at fulfilled (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:4:58) at <anonymous> at process._tickCallback (internal/process/next_tick.js:182:7) 4 specs, 2 failures Finished in 19.227 seconds ************************************************** * Failures * ************************************************** 1) Alerts Table should sort by colum: sorting ASC by ip_src_addr - Expected $[0] = '192.168.138.158' to equal '192.168.65.1'. 2) Alerts Table should sort by colum: sorting DESC by ip_src_addr - Expected $[0] = '192.168.65.1' to equal '192.168.138.160'. Executed 4 of 4 specs (2 FAILED) in 19 secs. [15:07:53] I/launcher - 0 instance(s) of WebDriver still running [15:07:53] I/launcher - chrome #01 failed 2 test(s) [15:07:53] I/launcher - overall: 2 failed spec(s) [15:07:53] E/launcher - Process exited with error code 1 npm ERR! code ELIFECYCLE npm ERR! errno 1 npm ERR! metron-alerts@0.6.1 e2e: `protractor-flake --protractor-path=./node_modules/.bin/protractor --max-attempts=3 -- ./protractor.conf.js` npm ERR! Exit status 1 npm ERR! npm ERR! Failed at the metron-alerts@0.6.1 e2e script. npm ERR! This is probably not a problem with npm. There is likely additional logging output above. npm ERR! A complete log of this run can be found in: npm ERR! /Users/nallen/.npm/_logs/2018-10-04T19_07_53_129Z-debug.log nallen@HW12402 : ~/tmp/metron-pr1190/metron-interface/metron-alerts $ npm run e2e > metron-alerts@0.6.1 pree2e > /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts > webdriver-manager update [15:08:44] I/update - chromedriver: file exists /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/webdriver-manager/selenium/chromedriver_2.42.zip [15:08:44] I/update - chromedriver: unzipping chromedriver_2.42.zip [15:08:44] I/update - chromedriver: setting permissions to 0755 for /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/webdriver-manager/selenium/chromedriver_2.42 [15:08:44] I/update - chromedriver: chromedriver_2.42 up to date [15:08:44] I/update - selenium standalone: file exists /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/webdriver-manager/selenium/selenium-server-standalone-3.14.0.jar [15:08:44] I/update - selenium standalone: selenium-server-standalone-3.14.0.jar up to date [15:08:44] I/update - geckodriver: file exists /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/webdriver-manager/selenium/geckodriver-v0.23.0.tar.gz [15:08:44] I/update - geckodriver: unzipping geckodriver-v0.23.0.tar.gz [15:08:44] I/update - geckodriver: setting permissions to 0755 for /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/webdriver-manager/selenium/geckodriver-v0.23.0 [15:08:44] I/update - geckodriver: geckodriver-v0.23.0 up to date > metron-alerts@0.6.1 e2e > /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts > protractor-flake --protractor-path=./node_modules/.bin/protractor > --max-attempts=3 -- ./protractor.conf.js [15:08:45] I/launcher - Running 1 instances of WebDriver [15:08:45] I/direct - Using ChromeDriver directly... Started Spec started . Test spec for login page ✓ should display error message for invalid credentials . ✓ should login for valid credentials . ✓ should logout . Test spec for all ui elements & list view ✓ should have all the UI elements . ✓ should have all pagination controls and they should be working . ✓ should have all settings controls and they should be working . ✓ play pause should start polling and stop polling . ✓ should select columns from table configuration . ✓ should have all time-range controls . ✓ should have all time range values populated - 1 . ✓ should have all time range values populated - 2 . ✓ should have all time range values populated - 3 . ✓ should have all time range values populated - 4 . ✓ should disable date picker when timestamp is present in search . ✓ should have now included when to date is empty . ✓ should have all time-range included while searching . Test spec for table column configuration ✓ should select columns from table configuration . ✓ should rename columns from table configuration . Test spec for search and save search ✓ should display all the default values for saved searches . ✓ should have all save search controls and they save search should be working . ✓ should delete search items from search box . ✓ should delete first search items from search box having multiple search fields . ✓ manually entering search queries to search box and pressing enter key should search FA Jasmine spec timed out. Resetting the WebDriver Control Flow. A Jasmine spec timed out. Resetting the WebDriver Control Flow. Test spec for tree view ✗ should have all group by elements - Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. at ontimeout (timers.js:466:11) at tryOnTimeout (timers.js:304:5) - Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. at ontimeout (timers.js:466:11) at tryOnTimeout (timers.js:304:5) **. ✓ should have group details for multiple group by . ✓ should have sort working for group details for multiple sub groups . ✓ should have search working for group details for multiple sub groups . Alerts Table should sort by colum: ✓ sorting ASC by ip_src_addr . ✓ sorting DESC by ip_src_addr F ✗ sorting ASC by Score - Failed: stale element reference: element is not attached to the page document (Session info: headless chrome=69.0.3497.100) (Driver info: chromedriver=2.42.591059 (a3d9684d10d61aa0c45f6723b327283be1ebaad8),platform=Mac OS X 10.13.6 x86_64) (Session info: headless chrome=69.0.3497.100) (Driver info: chromedriver=2.42.591059 (a3d9684d10d61aa0c45f6723b327283be1ebaad8),platform=Mac OS X 10.13.6 x86_64) at Object.checkLegacyResponse (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/error.js:546:15) at parseHttpResponse (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/http.js:509:13) at doSend.then.response (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/http.js:441:30) at <anonymous> at process._tickCallback (internal/process/next_tick.js:182:7) From: Task: WebElement.getText() at Driver.schedule (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/webdriver.js:807:17) at WebElement.schedule_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/webdriver.js:2010:25) at WebElement.getText (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/webdriver.js:2277:17) at actionFn (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:89:44) at Array.map (<anonymous>) at actionResults.getWebElements.then (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:461:65) at ManagedPromise.invokeCallback_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:1376:14) at TaskQueue.execute_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:3084:14) at TaskQueue.executeNext_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:3067:27) at asyncRun (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:2927:27)Error at ElementArrayFinder.applyAction_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:459:27) at ElementArrayFinder.(anonymous function).args [as getText] (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:91:29) at ElementFinder.(anonymous function).args [as getText] (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:831:22) at /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/utils/e2e_util.ts:89:23 at ManagedPromise.invokeCallback_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:1376:14) at TaskQueue.execute_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:3084:14) at TaskQueue.executeNext_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:3067:27) at asyncRun (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:2927:27) at /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:668:7 at <anonymous> From: Task: Run it("sorting ASC by Score") in control flow at UserContext.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/jasminewd2/index.js:94:19) at /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/jasminewd2/index.js:64:48 at ControlFlow.emit (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/events.js:62:21) at ControlFlow.shutdown_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:2674:10) at shutdownTask_.MicroTask (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:2599:53) From asynchronous test: Error at Suite.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:163:9) at Suite.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:85:5) at Object.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:59:1) . ✓ sorting DESC by Score . Test spec for facet filters ✓ should display facets data . ✓ should search when facet is selected . Test spec for changing alert status in list view & tree view ✓ should change alert status for multiple alerts to OPEN . ✓ should change alert status for multiple alerts to DISMISS . ✓ should change alert status for multiple alerts to ESCALATE . ✓ should change alert status for multiple alerts to RESOLVE . ✓ should change alert status for multiple alerts to OPEN in tree view ***. Test spec for meta alerts workflow ✓ should have all the steps for meta alerts workflow . ✓ should create a meta alert from nesting of more than one level Failures: 1) Test spec for tree view should have all group by elements Message: Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. Stack: Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. at ontimeout (timers.js:466:11) at tryOnTimeout (timers.js:304:5) at Timer.listOnTimeout (timers.js:267:5) Message: Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. Stack: Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. at ontimeout (timers.js:466:11) at tryOnTimeout (timers.js:304:5) at Timer.listOnTimeout (timers.js:267:5) 2) Alerts Table should sort by colum: sorting ASC by Score Message: Failed: stale element reference: element is not attached to the page document (Session info: headless chrome=69.0.3497.100) (Driver info: chromedriver=2.42.591059 (a3d9684d10d61aa0c45f6723b327283be1ebaad8),platform=Mac OS X 10.13.6 x86_64) Stack: StaleElementReferenceError: stale element reference: element is not attached to the page document (Session info: headless chrome=69.0.3497.100) (Driver info: chromedriver=2.42.591059 (a3d9684d10d61aa0c45f6723b327283be1ebaad8),platform=Mac OS X 10.13.6 x86_64) at Object.checkLegacyResponse (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/error.js:546:15) at parseHttpResponse (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/http.js:509:13) at doSend.then.response (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/http.js:441:30) at <anonymous> at process._tickCallback (internal/process/next_tick.js:182:7) From: Task: WebElement.getText() at Driver.schedule (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/webdriver.js:807:17) at WebElement.schedule_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/webdriver.js:2010:25) at WebElement.getText (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/webdriver.js:2277:17) at actionFn (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:89:44) at Array.map (<anonymous>) at actionResults.getWebElements.then (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:461:65) at ManagedPromise.invokeCallback_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:1376:14) at TaskQueue.execute_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:3084:14) at TaskQueue.executeNext_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:3067:27) at asyncRun (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:2927:27)Error at ElementArrayFinder.applyAction_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:459:27) at ElementArrayFinder.(anonymous function).args [as getText] (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:91:29) at ElementFinder.(anonymous function).args [as getText] (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/built/element.js:831:22) at /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/utils/e2e_util.ts:89:23 at ManagedPromise.invokeCallback_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:1376:14) at TaskQueue.execute_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:3084:14) at TaskQueue.executeNext_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:3067:27) at asyncRun (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:2927:27) at /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:668:7 at <anonymous> From: Task: Run it("sorting ASC by Score") in control flow at UserContext.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/jasminewd2/index.js:94:19) at /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/jasminewd2/index.js:64:48 at ControlFlow.emit (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/events.js:62:21) at ControlFlow.shutdown_ (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:2674:10) at shutdownTask_.MicroTask (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/node_modules/protractor/node_modules/selenium-webdriver/lib/promise.js:2599:53) From asynchronous test: Error at Suite.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:163:9) at Suite.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:85:5) at Object.<anonymous> (/Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts:59:1) Pending: 1) Test spec for tree view drag and drop should change group order Temporarily disabled with xit 2) Test spec for tree view should have group details for single group by Temporarily disabled with xit 3) Test spec for metron details page should change alert statuses Temporarily disabled with xit 4) Test spec for metron details page should add comments for table view Temporarily disabled with xit 5) Test spec for metron details page should add comments for tree view Temporarily disabled with xit 45 specs, 2 failures, 5 pending specs Finished in 311.388 seconds ************************************************** * Failures * ************************************************** 1) Test spec for tree view should have all group by elements - Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. - Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL. 2) Alerts Table should sort by colum: sorting ASC by Score - Failed: stale element reference: element is not attached to the page document (Session info: headless chrome=69.0.3497.100) (Driver info: chromedriver=2.42.591059 (a3d9684d10d61aa0c45f6723b327283be1ebaad8),platform=Mac OS X 10.13.6 x86_64) ************************************************** * Pending * ************************************************** 1) Test spec for tree view drag and drop should change group order Temporarily disabled with xit 2) Test spec for tree view should have group details for single group by Temporarily disabled with xit 3) Test spec for metron details page should change alert statuses Temporarily disabled with xit 4) Test spec for metron details page should add comments for table view Temporarily disabled with xit 5) Test spec for metron details page should add comments for tree view Temporarily disabled with xit Executed 40 of 45 specs (2 FAILED) (5 PENDING) in 5 mins 11 secs. [15:13:58] I/launcher - 0 instance(s) of WebDriver still running [15:13:58] I/launcher - chrome #01 failed 2 test(s) [15:13:58] I/launcher - overall: 2 failed spec(s) [15:13:58] E/launcher - Process exited with error code 1 Using standard to parse output Re-running tests: test attempt 2 Re-running the following test files: /Users/nallen/tmp/metron-pr1190/metron-interface/metron-alerts/e2e/alerts-list/table-view/table-view.e2e-spec.ts [15:13:58] I/launcher - Running 1 instances of WebDriver [15:13:58] I/direct - Using ChromeDriver directly... Started Spec started . Alerts Table should sort by colum: ✓ sorting ASC by ip_src_addr . ✓ sorting DESC by ip_src_addr . ✓ sorting ASC by Score . ✓ sorting DESC by Score 4 specs, 0 failures Finished in 11.171 seconds Executed 4 of 4 specs SUCCESS in 11 secs. [15:14:11] I/launcher - 0 instance(s) of WebDriver still running [15:14:11] I/launcher - chrome #01 passed
