[ https://issues.apache.org/jira/browse/METRON-1592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16496889#comment-16496889 ]
ASF GitHub Bot commented on METRON-1592: ---------------------------------------- GitHub user nickwallen opened a pull request: https://github.com/apache/metron/pull/1042 METRON-1592 Unable to use third party parser with Storm versions >= 1.1.0 When launching a third party parser using `$METRON_HOME/bin/start_parser_topology.sh` in HDP 2.6, Storm 1.1.0 the following exception is thrown. ``` ClassNotFoundException: org.apache.metron.parsers.topology.MergeAndShadeTransformer ``` ## Changes * Updated `$METRON_HOME/bin/start_parser_topology.sh` to detect the Storm version. * When using third party parsers and running a Storm version <1.1.0, the `MergeAndShadeTransformer` is used as it has been. * When using third party parsers with Storm versions >=1.1.0, the new `--jars` argument is used. * Updated the third party parsers README as the 'upload to zookeeper' step was out-of-order. Also, corrected some minor formatting issues in the README. ## Testing * Launch a development environment. * Ensure that the Alerts UI is being populated with alerts. This confirms that the the default parsers; like Bro and Snort that do not use 3rd party libs can be launched successfully. * Follow the example instructions in `metron-platform/metron-parsers/3rdPartyParser.md` to deploy a parser that uses a 3rd party library. If the parser can be launched and parse messages, then this change is a success. * The development environments are based on HDP 2.6 with Storm 1.1.0. If you want a gold star, spin this up in an environment based on HDP 2.5 and ensure that 3rd party parser can be launched. ## Pull Request Checklist - [ ] Is there a JIRA ticket associated with this PR? If not one needs to be created at [Metron Jira](https://issues.apache.org/jira/browse/METRON/?selectedTab=com.atlassian.jira.jira-projects-plugin:summary-panel). - [ ] Does your PR title start with METRON-XXXX where XXXX is the JIRA number you are trying to resolve? Pay particular attention to the hyphen "-" character. - [ ] Has your PR been rebased against the latest commit within the target branch (typically master)? - [ ] Have you included steps to reproduce the behavior or problem that is being changed or addressed? - [ ] Have you included steps or a guide to how the change may be verified and tested manually? - [ ] Have you ensured that the full suite of tests and checks have been executed in the root metron folder via: - [ ] Have you written or updated unit tests and or integration tests to verify your changes? - [ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under [ASF 2.0](http://www.apache.org/legal/resolved.html#category-a)? - [ ] Have you verified the basic functionality of the build by building and running locally with Vagrant full-dev environment or the equivalent? You can merge this pull request into a Git repository by running: $ git pull https://github.com/nickwallen/metron METRON-1592 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/metron/pull/1042.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1042 ---- commit c53037878987159b15f544349cf92b3f17b7481f Author: Nick Allen <nick@...> Date: 2018-05-31T17:07:36Z METRON-1592 Unable to use third party parser with Storm versions >= 1.1.0 ---- > Unable to use third party parser with Storm versions >= 1.1.0 > ------------------------------------------------------------- > > Key: METRON-1592 > URL: https://issues.apache.org/jira/browse/METRON-1592 > Project: Metron > Issue Type: Bug > Reporter: Nick Allen > Assignee: Nick Allen > Priority: Major > > When launching a third party parser using > $METRON_HOME/bin/start_parser_topology.sh in HDP 2.6, Storm 1.1.0 the > following exception is thrown. > > {code:java} > ClassNotFoundException: > org.apache.metron.parsers.topology.MergeAndShadeTransformer{code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)