[jira] [Commented] (BEAM-2175) Support state API in Spark batch mode.

2017-11-01 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234069#comment-16234069 ] Aviem Zur commented on BEAM-2175: - Marked as Resolved > Support state API in Spark batch m

[jira] [Updated] (BEAM-1294) Long running UnboundedSource Readers

2017-02-17 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1294: Summary: Long running UnboundedSource Readers (was: Long running UnboundedSource Readers via Broadcasts) >

[jira] [Created] (BEAM-1512) Optimize leaf transformation materialization

2017-02-19 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1512: --- Summary: Optimize leaf transformation materialization Key: BEAM-1512 URL: https://issues.apache.org/jira/browse/BEAM-1512 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-1512) Optimize leaf transforms materialization

2017-02-19 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1512: Summary: Optimize leaf transforms materialization (was: Optimize leaf transformation materialization) > Opt

[jira] [Assigned] (BEAM-1512) Optimize leaf transforms materialization

2017-02-19 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1512: --- Assignee: Aviem Zur (was: Amit Sela) > Optimize leaf transforms materialization > ---

[jira] [Created] (BEAM-1513) Skip slower verifications if '-DskipTests' specified

2017-02-19 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1513: --- Summary: Skip slower verifications if '-DskipTests' specified Key: BEAM-1513 URL: https://issues.apache.org/jira/browse/BEAM-1513 Project: Beam Issue Type: Improvement

[jira] [Assigned] (BEAM-1513) Skip slower verifications if '-DskipTests' specified

2017-02-19 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1513: --- Assignee: Aviem Zur (was: Davor Bonaci) > Skip slower verifications if '-DskipTests' specified >

[jira] [Updated] (BEAM-1513) Skip slower verifications if '-DskipTests' specified

2017-02-19 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1513: Priority: Minor (was: Major) > Skip slower verifications if '-DskipTests' specified > --

[jira] [Updated] (BEAM-1513) Skip slower verifications if '-DskipTests' specified

2017-02-19 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1513: Description: Skip slower verifications (checkstyle, rat and findbugs) if '-DskipTests' was specified in the

[jira] [Updated] (BEAM-1513) Skip slower verifications if '-DskipTests' specified

2017-02-19 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1513: Description: Skip slower verifications (checkstyle, rat and findbugs) if '-DskipTests' was specified in the

[jira] [Updated] (BEAM-1513) Skip slower verifications if '-DskipTests' specified

2017-02-19 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1513: Description: Skip slower verifications (checkstyle, rat and findbugs) if '-DskipTests' was specified in the

[jira] [Updated] (BEAM-1513) Skip slower verifications if '-Dquick' specified

2017-02-20 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1513: Summary: Skip slower verifications if '-Dquick' specified (was: Skip slower verifications if '-DskipTests' s

[jira] [Updated] (BEAM-1513) Skip slower verifications if '-Dquick' specified. Enable them otherwise

2017-02-20 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1513: Description: Skip slower verifications (checkstyle, rat and findbugs) if '-Dquick' was specified in the mave

[jira] [Commented] (BEAM-1513) Skip slower verifications if '-Dquick' specified. Enable them otherwise

2017-02-20 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875341#comment-15875341 ] Aviem Zur commented on BEAM-1513: - Yes, that makes sense. Changed to -Dquick > Skip slower

[jira] [Updated] (BEAM-1513) Skip slower verifications if '-Dquick' specified. Enable them otherwise

2017-02-20 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1513: Summary: Skip slower verifications if '-Dquick' specified. Enable them otherwise (was: Skip slower verificat

[jira] [Updated] (BEAM-1513) Skip slower verifications if '-Dquick' specified. Enable them otherwise

2017-02-20 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1513: Description: Skip slower verifications (checkstyle, rat and findbugs) if '-Dquick' was specified in the mave

[jira] [Assigned] (BEAM-1356) `mvn clean install -DskipTests` still runs python tests

2017-02-20 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1356: --- Assignee: Aviem Zur (was: Ahmet Altay) > `mvn clean install -DskipTests` still runs python tests > --

[jira] [Updated] (BEAM-1465) No natural place to flush outputs in FileBasedWriter

2017-02-21 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1465: Description: {{FileBasedWriter}} API does not have a natural place to flush/close resources opened by the wr

[jira] [Updated] (BEAM-1465) No natural place to flush/close resources in FileBasedWriter

2017-02-21 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1465: Summary: No natural place to flush/close resources in FileBasedWriter (was: No natural place to flush output

[jira] [Assigned] (BEAM-1465) No natural place to flush/close resources in FileBasedWriter

2017-02-21 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1465: --- Assignee: Aviem Zur (was: Daniel Halperin) > No natural place to flush/close resources in FileBasedWr

[jira] [Assigned] (BEAM-1513) Skip slower verifications if '-Dquick' specified. Enable them otherwise

2017-02-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1513: --- Assignee: Davor Bonaci (was: Aviem Zur) > Skip slower verifications if '-Dquick' specified. Enable th

[jira] [Updated] (BEAM-1398) KafkaIO metrics

2017-02-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1398: Description: Add metrics to {{KafkaIO}} using the metrics API. Metrics (Feel free to add more ideas here) pe

[jira] [Updated] (BEAM-1398) KafkaIO metrics

2017-02-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1398: Description: Add metrics to {{KafkaIO}} using the metrics API. Metrics (Feel free to add more ideas here) pe

[jira] [Updated] (BEAM-1398) KafkaIO metrics

2017-02-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1398: Description: Add metrics to {{KafkaIO}} using the metrics API. Metrics (Feel free to add more ideas here) pe

[jira] [Updated] (BEAM-1529) First sentence should end with a period. [JavadocStyle]

2017-02-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1529: Description: See a tricky error with mvn verify in my local IDE: {code} [INFO] Starting audit... [ERROR] /Us

[jira] [Updated] (BEAM-1465) No natural place to flush resources in FileBasedWriter

2017-02-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1465: Summary: No natural place to flush resources in FileBasedWriter (was: No natural place to flush/close resour

[jira] [Updated] (BEAM-1465) No natural place to flush resources in FileBasedWriter

2017-02-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1465: Description: {{FileBasedWriter}} API does not have a natural place to flush resources opened by the writer.

[jira] [Resolved] (BEAM-1465) No natural place to flush resources in FileBasedWriter

2017-02-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1465. - Resolution: Fixed Fix Version/s: 0.6.0 > No natural place to flush resources in FileBasedWriter > --

[jira] [Assigned] (BEAM-1446) Create should take a TypeDescriptor as an alternative to explicitly specifying the Coder

2017-02-23 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1446: --- Assignee: Aviem Zur > Create should take a TypeDescriptor as an alternative to explicitly > specifyin

[jira] [Assigned] (BEAM-1061) PreCommit test with side inputs

2017-02-24 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1061: --- Assignee: Aviem Zur > PreCommit test with side inputs > --- > >

[jira] [Assigned] (BEAM-1379) Shade Guava in beam-sdks-java-io-kafka module

2017-02-24 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1379: --- Assignee: Aviem Zur (was: Davor Bonaci) > Shade Guava in beam-sdks-java-io-kafka module > ---

[jira] [Assigned] (BEAM-1061) PreCommit test with side inputs

2017-02-24 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1061: --- Assignee: (was: Aviem Zur) > PreCommit test with side inputs > --- > >

[jira] [Updated] (BEAM-1146) Decrease spark runner startup overhead

2017-02-24 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1146: Description: BEAM-921 introduced a lazy singleton instantiated once in each JVM (driver & executors) which u

[jira] [Updated] (BEAM-1146) Decrease spark runner startup overhead

2017-02-24 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1146: Description: BEAM-921 introduced a lazy singleton instantiated once in each JVM (driver & executors) which u

[jira] [Updated] (BEAM-1145) Remove classifier from shaded spark runner artifact

2017-02-24 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1145: Description: Shade plugin configured in spark runner's pom adds a classifier to spark runner shaded jar {cod

[jira] [Assigned] (BEAM-1551) Allow PAssert#that to take a message

2017-02-26 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1551: --- Assignee: Aviem Zur > Allow PAssert#that to take a message > > >

[jira] [Assigned] (BEAM-351) Add DisplayData to KafkaIO

2017-02-26 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-351: -- Assignee: Aviem Zur > Add DisplayData to KafkaIO > -- > > Key: BE

[jira] [Updated] (BEAM-1337) Use our coder infrastructure for coders for state

2017-02-27 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1337: Description: Today the user must explicitly provide any coders needed for serializing state data. We'd rathe

[jira] [Updated] (BEAM-1563) Flatten Spark runner libraries.

2017-02-27 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1563: Description: Flatten Spark runner libraries into a single package (or two) so that everything is private. Se

[jira] [Commented] (BEAM-1572) Add per-stage matching of scope in metrics for the DirectRunner

2017-02-27 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887219#comment-15887219 ] Aviem Zur commented on BEAM-1572: - Please note that this relates to https://issues.apache.o

[jira] [Updated] (BEAM-1581) JsonIO / JsonSink

2017-03-01 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1581: Summary: JsonIO / JsonSink (was: JsonIO) > JsonIO / JsonSink > - > > Key: BE

[jira] [Assigned] (BEAM-1581) JsonIO / JsonSink

2017-03-01 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1581: --- Assignee: Aviem Zur (was: Davor Bonaci) > JsonIO / JsonSink > - > > K

[jira] [Created] (BEAM-1581) JsonIO

2017-03-01 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1581: --- Summary: JsonIO Key: BEAM-1581 URL: https://issues.apache.org/jira/browse/BEAM-1581 Project: Beam Issue Type: New Feature Components: sdk-java-extensions

[jira] [Assigned] (BEAM-1565) Update Spark runner PostCommit Jenkins job.

2017-03-01 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1565: --- Assignee: Aviem Zur > Update Spark runner PostCommit Jenkins job. > --

[jira] [Updated] (BEAM-1565) Update Spark runner PostCommit Jenkins job.

2017-03-02 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1565: Fix Version/s: 0.6.0 > Update Spark runner PostCommit Jenkins job. >

[jira] [Updated] (BEAM-351) Add DisplayData to KafkaIO

2017-03-02 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-351: --- Fix Version/s: 0.6.0 > Add DisplayData to KafkaIO > -- > > Key: BEAM-351

[jira] [Updated] (BEAM-1565) Update Spark runner PostCommit Jenkins job.

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1565: Fix Version/s: (was: 0.6.0) > Update Spark runner PostCommit Jenkins job. > -

[jira] [Assigned] (BEAM-1603) Enable programmatic execution of spark pipelines.

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1603: --- Assignee: Aviem Zur (was: Amit Sela) > Enable programmatic execution of spark pipelines. > --

[jira] [Assigned] (BEAM-1591) Implement Combine optimizations for GABW in streaming.

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1591: --- Assignee: Aviem Zur > Implement Combine optimizations for GABW in streaming. > ---

[jira] [Updated] (BEAM-147) Introduce an easy API for pipeline metrics

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-147: --- Description: The existing Aggregators are confusing both because of their name and because they serve multiple

[jira] [Created] (BEAM-1613) Meter metric type

2017-03-03 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1613: --- Summary: Meter metric type Key: BEAM-1613 URL: https://issues.apache.org/jira/browse/BEAM-1613 Project: Beam Issue Type: New Feature Components: beam-model,

[jira] [Created] (BEAM-1615) Add Meter metric type to Python SDK

2017-03-03 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1615: --- Summary: Add Meter metric type to Python SDK Key: BEAM-1615 URL: https://issues.apache.org/jira/browse/BEAM-1615 Project: Beam Issue Type: Sub-task Component

[jira] [Assigned] (BEAM-1613) Meter metric type

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1613: --- Assignee: Ben Chambers (was: Frances Perry) > Meter metric type > - > >

[jira] [Created] (BEAM-1614) Add Meter metric type to Java SDK

2017-03-03 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1614: --- Summary: Add Meter metric type to Java SDK Key: BEAM-1614 URL: https://issues.apache.org/jira/browse/BEAM-1614 Project: Beam Issue Type: Sub-task Components:

[jira] [Assigned] (BEAM-1614) Add Meter metric type to Java SDK

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1614: --- Assignee: (was: Aviem Zur) > Add Meter metric type to Java SDK > -

[jira] [Assigned] (BEAM-1614) Add Meter metric type to Java SDK

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1614: --- Assignee: Aviem Zur (was: Davor Bonaci) > Add Meter metric type to Java SDK > ---

[jira] [Updated] (BEAM-1613) Meter metric type

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1613: Description: Add support for Meter metric type to the SDK. Compare to http://metrics.dropwizard.io/3.1.0/ap

[jira] [Updated] (BEAM-1613) Meter metric type

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1613: Description: Add support for Meter metric type to the SDK. Interface should be along the lines of: {code} vo

[jira] [Created] (BEAM-1617) Add Gauge metric type to Java SDK

2017-03-03 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1617: --- Summary: Add Gauge metric type to Java SDK Key: BEAM-1617 URL: https://issues.apache.org/jira/browse/BEAM-1617 Project: Beam Issue Type: Sub-task Components:

[jira] [Created] (BEAM-1616) Gauge Metric type

2017-03-03 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1616: --- Summary: Gauge Metric type Key: BEAM-1616 URL: https://issues.apache.org/jira/browse/BEAM-1616 Project: Beam Issue Type: Bug Components: beam-model, sdk-java

[jira] [Assigned] (BEAM-1616) Gauge Metric type

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1616: --- Assignee: Ben Chambers (was: Frances Perry) > Gauge Metric type > - > >

[jira] [Assigned] (BEAM-1617) Add Gauge metric type to Java SDK

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1617: --- Assignee: Aviem Zur (was: Davor Bonaci) > Add Gauge metric type to Java SDK > ---

[jira] [Created] (BEAM-1618) Add Gauge metric type to Python SDK

2017-03-03 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1618: --- Summary: Add Gauge metric type to Python SDK Key: BEAM-1618 URL: https://issues.apache.org/jira/browse/BEAM-1618 Project: Beam Issue Type: Sub-task Component

[jira] [Commented] (BEAM-1616) Gauge Metric type

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895525#comment-15895525 ] Aviem Zur commented on BEAM-1616: - [~bchambers] you raise interesting questions. Since pipe

[jira] [Assigned] (BEAM-1623) Transform Reshuffle directly in Spark runner

2017-03-04 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1623: --- Assignee: Aviem Zur (was: Amit Sela) > Transform Reshuffle directly in Spark runner > ---

[jira] [Created] (BEAM-1623) Transform Reshuffle directly in Spark runner

2017-03-04 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1623: --- Summary: Transform Reshuffle directly in Spark runner Key: BEAM-1623 URL: https://issues.apache.org/jira/browse/BEAM-1623 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-1625) BoundedDataset action() does not materialize RDD

2017-03-05 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1625: --- Summary: BoundedDataset action() does not materialize RDD Key: BEAM-1625 URL: https://issues.apache.org/jira/browse/BEAM-1625 Project: Beam Issue Type: Bug C

[jira] [Updated] (BEAM-1625) BoundedDataset action() does not materialize RDD

2017-03-05 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1625: Description: {{BoundedDataset#action}} does not materialize RDD since it uses {{foreachPartition}} which is

[jira] [Updated] (BEAM-1616) Gauge Metric type

2017-03-05 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1616: Issue Type: New Feature (was: Bug) > Gauge Metric type > - > > Key: BEAM-161

[jira] [Updated] (BEAM-147) Introduce an easy API for pipeline metrics

2017-03-05 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-147: --- Issue Type: New Feature (was: Bug) > Introduce an easy API for pipeline metrics > -

[jira] [Created] (BEAM-1629) Make metrics/aggregators accumulators available on driver

2017-03-06 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1629: --- Summary: Make metrics/aggregators accumulators available on driver Key: BEAM-1629 URL: https://issues.apache.org/jira/browse/BEAM-1629 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-1629) Make metrics/aggregators accumulators available on driver

2017-03-06 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1629: Description: Today aggregators and metrics accumulators are instantiated after pipeline is traversed, and so,

[jira] [Updated] (BEAM-1625) BoundedDataset action() does not materialize RDD

2017-03-07 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1625: Description: {{BoundedDataset#action}} does not materialize RDD since it uses {{foreachPartition}} which is

[jira] [Created] (BEAM-1636) UnboundedDataset action() does not materialize RDD

2017-03-07 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1636: --- Summary: UnboundedDataset action() does not materialize RDD Key: BEAM-1636 URL: https://issues.apache.org/jira/browse/BEAM-1636 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-1629) Init metrics/aggregators accumulators before traversing pipeline

2017-03-07 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1629: Summary: Init metrics/aggregators accumulators before traversing pipeline (was: Make metrics/aggregators acc

[jira] [Created] (BEAM-1650) Add IntelliJ code style xml to the project repo and website

2017-03-08 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1650: --- Summary: Add IntelliJ code style xml to the project repo and website Key: BEAM-1650 URL: https://issues.apache.org/jira/browse/BEAM-1650 Project: Beam Issue Type: Ne

[jira] [Created] (BEAM-1652) Add link to IntelliJ code style xml in the website

2017-03-08 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1652: --- Summary: Add link to IntelliJ code style xml in the website Key: BEAM-1652 URL: https://issues.apache.org/jira/browse/BEAM-1652 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-1651) Add IntelliJ code style xml to the project repository

2017-03-08 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1651: --- Summary: Add IntelliJ code style xml to the project repository Key: BEAM-1651 URL: https://issues.apache.org/jira/browse/BEAM-1651 Project: Beam Issue Type: Sub-task

[jira] [Updated] (BEAM-1629) Init metrics/aggregators accumulators before traversing pipeline

2017-03-08 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1629: Description: Today aggregators and metrics accumulators are instantiated after pipeline is traversed, and so

[jira] [Assigned] (BEAM-1336) A StateSpec that doesn't care about the key shouldn't be forced to declare it as type Object

2017-03-08 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1336: --- Assignee: Aviem Zur > A StateSpec that doesn't care about the key shouldn't be forced to declare it >

[jira] [Assigned] (BEAM-1276) StateSpecs.combiningValue interface is very awkward to use

2017-03-08 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1276: --- Assignee: Aviem Zur (was: Kenneth Knowles) > StateSpecs.combiningValue interface is very awkward to u

[jira] [Created] (BEAM-1672) Extract interface MetricData

2017-03-08 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1672: --- Summary: Extract interface MetricData Key: BEAM-1672 URL: https://issues.apache.org/jira/browse/BEAM-1672 Project: Beam Issue Type: Improvement Components: s

[jira] [Updated] (BEAM-1629) Metrics/aggregators accumulators should be instantiated before traversing pipeline

2017-03-08 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1629: Summary: Metrics/aggregators accumulators should be instantiated before traversing pipeline (was: Init metri

[jira] [Updated] (BEAM-1629) Init metrics/aggregators accumulators before traversing pipeline

2017-03-08 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1629: Description: Today aggregators and metrics accumulators are instantiated after pipeline is traversed, and so

[jira] [Assigned] (BEAM-1115) Support for new Timer API in Spark runner

2017-03-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1115: --- Assignee: Aviem Zur > Support for new Timer API in Spark runner >

[jira] [Assigned] (BEAM-866) Support set/delete of timer by ID in Spark runner

2017-03-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-866: -- Assignee: Aviem Zur (was: Amit Sela) > Support set/delete of timer by ID in Spark runner > -

[jira] [Commented] (BEAM-1650) Add IntelliJ code style xml to the project repo and website

2017-03-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15903560#comment-15903560 ] Aviem Zur commented on BEAM-1650: - We might be able to leverage https://github.com/revelc/f

[jira] [Updated] (BEAM-1650) Add code style xml to the project repo and website

2017-03-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1650: Summary: Add code style xml to the project repo and website (was: Add IntelliJ code style xml to the projec

[jira] [Updated] (BEAM-1652) Add code style xml in the website

2017-03-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1652: Summary: Add code style xml in the website (was: Add link to IntelliJ code style xml in the website) > Add

[jira] [Updated] (BEAM-1650) Add code style xml to the project repo and website

2017-03-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1650: Description: Contributors who develop using IntelliJ IDEa or Eclipse could benefit from having an Eclipse co

[jira] [Updated] (BEAM-1652) Add code style xml to the website

2017-03-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1652: Summary: Add code style xml to the website (was: Add code style xml in the website) > Add code style xml to

[jira] [Updated] (BEAM-1651) Add code style xml to the project repository

2017-03-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1651: Summary: Add code style xml to the project repository (was: Add IntelliJ code style xml to the project repos

[jira] [Comment Edited] (BEAM-1650) Add code style xml to the project repo and website

2017-03-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15903560#comment-15903560 ] Aviem Zur edited comment on BEAM-1650 at 3/10/17 5:28 AM: -- Changed

[jira] [Comment Edited] (BEAM-1650) Add code style xml to the project repo and website

2017-03-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15903560#comment-15903560 ] Aviem Zur edited comment on BEAM-1650 at 3/10/17 5:30 AM: -- Changed

[jira] [Updated] (BEAM-1581) JsonIO

2017-03-10 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1581: Summary: JsonIO (was: JsonIO / JsonSink) > JsonIO > -- > > Key: BEAM-1581 >

[jira] [Updated] (BEAM-1581) JsonIO

2017-03-10 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1581: Description: A new IO (with source and sink) which will read/write Json files. Similar to {{XmlSink}}. Consid

[jira] [Created] (BEAM-1692) Convert to Codahale Metric interfaces where possible in WithMetricsSupport MetricRegistry

2017-03-11 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1692: --- Summary: Convert to Codahale Metric interfaces where possible in WithMetricsSupport MetricRegistry Key: BEAM-1692 URL: https://issues.apache.org/jira/browse/BEAM-1692 Project:

[jira] [Updated] (BEAM-1692) Convert to Codahale Metric interfaces where possible in WithMetricsSupport MetricRegistry

2017-03-11 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1692: Description: Currently in Spark runner all Beam metrics are reported by Codahale metrics as Codahale {{Gauge

[jira] [Updated] (BEAM-1692) Convert to Codahale Metric interfaces where possible in WithMetricsSupport MetricRegistry

2017-03-11 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1692: Description: Currently in Spark runner all Beam metrics are reported by Codahale metrics as Codahale {{Gauge

[jira] [Commented] (BEAM-1581) JsonIO

2017-03-11 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906228#comment-15906228 ] Aviem Zur commented on BEAM-1581: - Yes, these should definitely be a {{FileBasedSource}}/{{

<    1   2   3   4   5   >