[GitHub] kafka pull request: KAFKA-3558; Add compression_type parameter to ...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/kafka/pull/1225


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request: KAFKA-3558; Add compression_type parameter to ...

[ijuma]

GitHub user ijuma opened a pull request:

https://github.com/apache/kafka/pull/1225

KAFKA-3558; Add compression_type parameter to benchmarks in 
benchmark_test.py

* Use a fixed `Random` seed in `EndToEndLatency.scala` for determinism
* Add `compression_type` to and remove `consumer_fetch_max_wait` from 
`end_to_end_latency.py`. The latter was never used.
* Tweak logging of `end_to_end_latency.py` to be similar to 
`consumer_performance.py`.
* Add `compression_type` to `benchmark_test.py` methods and add `snappy` to 
`matrix` annotation
* Use randomly generated bytes from a restricted range for 
`ProducerPerformance` payload. This is a simple fix for now. It can be improved 
in the PR for KAFKA-3554.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ijuma/kafka 
kafka-3558-add-compression_type-benchmark_test.py

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/1225.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1225


commit 861208470c511881063876e7834f9526795cafb2
Author: Ismael Juma 
Date:   2016-04-14T12:52:33Z

Minor clean-ups in `ConsumerPerformance`

commit da504f09d141adc9e0330e682d5d7a67f4992522
Author: Ismael Juma 
Date:   2016-04-14T12:53:49Z

Use a fixed `Random` seed in `EndToEndLatency.scala` and minor clean-up

commit 629cd7400e3b31b87119704052e685fead153eab
Author: Ismael Juma 
Date:   2016-04-14T13:06:48Z

Add `compression_type` to and remove `consumer_fetch_max_wait` from 
`end_to_end_latency.py`

Also tweak logging in `end_to_end_latency.py` to match what we do in 
`consumer_performance.py`

commit b3de8b0083ee5b81c9c50fcd326374500558f710
Author: Ismael Juma 
Date:   2016-04-14T13:08:51Z

Add `compression_type` to `benchmark_test.py`

commit 06d58913e54025a1cb2ca97dc6fe2b3ca91ea281
Author: Ismael Juma 
Date:   2016-04-14T13:31:52Z

Use randomly generated bytes from a restricted range for 
`ProducerPerformance` payload

Used the same range as `EndToEndLatency`




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request: KAFKA-3558; Add compression_type parameter to ...

[ijuma]

Github user ijuma closed the pull request at:

https://github.com/apache/kafka/pull/1221


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request: KAFKA-3558; Add compression_type parameter to ...

[ijuma]

GitHub user ijuma opened a pull request:

https://github.com/apache/kafka/pull/1221

KAFKA-3558; Add compression_type parameter to benchmarks in 
benchmark_test.py

* Accept an optional `compress_type` argument in `EndToEndLatency.scala`
* Use a fixed `Random` seed in `EndToEndLatency.scala` for determinism
* Add `compression_type` to and remove `consumer_fetch_max_wait` from 
`end_to_end_latency.py`. The latter was never used.
* Add `compression_type` to `benchmark_test.py` methods and add `snappy` to 
`matrix` annotation
* Use randomly generated bytes from a restricted range for 
`ProducerPerformance` payload. This is a simple fix for now. It can be improved 
in the PR for KAFKA-3554.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ijuma/kafka 
kafka-3558-add-compression_type-benchmark_test.py

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/1221.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1221


commit e74e3757e42e3c23dd1d37b84f3a19a36a3f4e73
Author: Ismael Juma 
Date:   2016-04-14T12:52:33Z

Minor clean-ups in `ConsumerPerformance`

commit d6323b16ddbaa0994012cd6e5270f5413cbabf87
Author: Ismael Juma 
Date:   2016-04-14T12:53:49Z

Accept an optional compress_type argument in `EndToEndLatency.scala`

commit a01c12c85a7201fbe3e6fa352f81a04517a34076
Author: Ismael Juma 
Date:   2016-04-14T12:54:23Z

Use a fixed `Random` seed in `EndToEndLatency.scala`

commit dfcec34fb2e5a6d522ff8ac26233d06c8f26ee1f
Author: Ismael Juma 
Date:   2016-04-14T13:06:48Z

Add `compression_type` to and remove `consumer_fetch_max_wait` from 
`end_to_end_latency.py`

commit d9862262c2dc1b4b600f78241ebc38f01060f40f
Author: Ismael Juma 
Date:   2016-04-14T13:08:51Z

Add `compression_type` to `benchmark_test.py`

commit 076e9d8720c5534d7bf4cc4fea7cceb72a178626
Author: Ismael Juma 
Date:   2016-04-14T13:31:52Z

Use randomly generated bytes from a restricted range for 
`ProducerPerformance` payload

Used the same range as `EndToEndLatency`




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---