GitHub user nickwallen opened a pull request:
https://github.com/apache/metron/pull/1162
METRON-1736 Enhance Batch Profiler Integration Test
The integration test for the Batch Profiler should use the Profiler Client
API and `PROFILE_GET` to validate the values that are produced. This is more
effective end-to-end validation that the Batch Profiler is working.
This is a pull request against the `METRON-1699-create-batch-profiler`
feature branch.
This is dependent on #1161 . By filtering on the last commit, this PR can
be reviewed before the others are reviewed and merged.
## Pull Request Checklist
- [x] Have you included steps to reproduce the behavior or problem that is
being changed or addressed?
- [x] Have you included steps or a guide to how the change may be verified
and tested manually?
- [x] Have you ensured that the full suite of tests and checks have been
executed in the root metron folder via:
- [x] Have you written or updated unit tests and or integration tests to
verify your changes?
- [x] If adding new dependencies to the code, are these dependencies
licensed in a way that is compatible for inclusion under [ASF
2.0](http://www.apache.org/legal/resolved.html#category-a)?
- [x] Have you verified the basic functionality of the build by building
and running locally with Vagrant full-dev environment or the equivalent?
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/nickwallen/metron METRON-1736
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/metron/pull/1162.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1162
----
commit 6ce28594659928a8c87c57edddd22e1ab00d798d
Author: Nick Allen <nick@...>
Date: 2018-07-10T14:08:48Z
METRON-1703 Make Core Profiler Components Serializable
commit 0051359cbb277881de896526345bb4fce1d5139c
Author: Nick Allen <nick@...>
Date: 2018-07-10T19:42:19Z
METRON-1704 Message Timestamp Logic Should be Shared
commit 2413726bdf96221ec775a9c8de524e3ec92148b7
Author: Nick Allen <nick@...>
Date: 2018-07-27T17:20:15Z
METRON-1706: HbaseClient.mutate should return the number of mutations
commit 21980ca764b98ddb96c4c8732e0ef7a6c5ea2c56
Author: Nick Allen <nick@...>
Date: 2018-07-24T18:02:36Z
METRON-1705 Create ProfilePeriod Using Period ID
commit be15126419a2862864a7acd67349281b086f52cf
Author: Nick Allen <nick@...>
Date: 2018-07-31T19:26:20Z
METRON-1707 Port Profiler to Spark
commit c410e412c50f4510f8674cd4fa5d4481f28a4a13
Author: Nick Allen <nick@...>
Date: 2018-08-09T15:54:41Z
No need to handle packaging yet. That will come in a future PR
commit f1a8b49f99029e8d801dc62cfa9c2a0827a46cd8
Author: Nick Allen <nick@...>
Date: 2018-08-13T13:25:56Z
Renamed execute() to run()
commit 7f585e0afaa76386934f785407eecc5d65175d8c
Author: Nick Allen <nick@...>
Date: 2018-08-13T14:52:17Z
Reducing the size of the telemetry for the integration test. No need to
have so much data
commit 6bce4797b33bee6c161b81188f94b4fa3e931a53
Author: Nick Allen <nick@...>
Date: 2018-08-13T19:14:48Z
Only create an Hbase connection if there are measurements to write
commit ca038f9e4e65212158970046ce95c681a2ebda1b
Author: Nick Allen <nick@...>
Date: 2018-08-13T20:24:58Z
METRON-1736 Enahnce Batch Profiler Integration Test
----
---
