[jira] [Assigned] (BEAM-1758) Option to disable metrics reporting (Metrics API)

2017-04-23 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1758: --- Assignee: Ismaël Mejía (was: Aviem Zur) > Option to disable metrics reporting (Metrics API) >

[jira] [Updated] (BEAM-1672) Reduce duplication in runners metrics implementations

2017-04-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1672: Summary: Reduce duplication in runners metrics implementations (was: Extract interface MetricData) >

[jira] [Updated] (BEAM-1672) Reduce duplication in runners metrics implementations

2017-04-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1672: Description: Refactor metrics implementations to reduce duplication. For example: Making

[jira] [Updated] (BEAM-1672) Reduce duplication in runners metrics implementations

2017-04-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1672: Description: Refactor metrics implementations to reduce duplication. For example: Making

[jira] [Updated] (BEAM-1672) Accumulable MetricsContainers.

2017-04-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1672: Description: Make {{MetricsContainer}} accumulable. This can reduce duplication between runners and make

[jira] [Updated] (BEAM-1672) Accumulable MetricsContainers.

2017-04-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1672: Description: Make {{MetricsContainer}} accumulable. This can reduce duplication between runners and make

[jira] [Commented] (BEAM-2027) get error sometimes while running the same code using beam0.6

2017-04-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979797#comment-15979797 ] Aviem Zur commented on BEAM-2027: - {{local class incompatible}} happens when trying to deserialize a Java

[jira] [Resolved] (BEAM-2027) get error sometimes while running the same code using beam0.6

2017-04-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-2027. - Resolution: Not A Bug Fix Version/s: Not applicable No problem! > get error sometimes while

[jira] [Comment Edited] (BEAM-2027) get error sometimes while running the same code using beam0.6

2017-04-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980259#comment-15980259 ] Aviem Zur edited comment on BEAM-2027 at 4/23/17 4:26 AM: -- No problem, you're

[jira] [Comment Edited] (BEAM-1940) Add Capabilities info to "Built-in I/O Transforms" page

2017-04-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980269#comment-15980269 ] Aviem Zur edited comment on BEAM-1940 at 4/23/17 5:13 AM: -- This may be a bit much

[jira] [Commented] (BEAM-1940) Add Capabilities info to "Built-in I/O Transforms" page

2017-04-22 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980269#comment-15980269 ] Aviem Zur commented on BEAM-1940: - This may be a bit much for the table in

[jira] [Updated] (BEAM-1650) Add code style xml to the project repo and website

2017-03-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1650: Description: Contributors who develop using IntelliJ IDEa or Eclipse could benefit from having an Eclipse

[jira] [Updated] (BEAM-1651) Add code style xml to the project repository

2017-03-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1651: Summary: Add code style xml to the project repository (was: Add IntelliJ code style xml to the project

[jira] [Comment Edited] (BEAM-1650) Add code style xml to the project repo and website

2017-03-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903560#comment-15903560 ] Aviem Zur edited comment on BEAM-1650 at 3/10/17 5:28 AM: -- Changed to use Eclipse

[jira] [Comment Edited] (BEAM-1650) Add code style xml to the project repo and website

2017-03-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903560#comment-15903560 ] Aviem Zur edited comment on BEAM-1650 at 3/10/17 5:30 AM: -- Changed to use Eclipse

[jira] [Updated] (BEAM-1650) Add code style xml to the project repo and website

2017-03-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1650: Summary: Add code style xml to the project repo and website (was: Add IntelliJ code style xml to the

[jira] [Updated] (BEAM-1581) JsonIO

2017-03-10 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1581: Description: A new IO (with source and sink) which will read/write Json files. Similar to {{XmlSink}}.

[jira] [Updated] (BEAM-1581) JsonIO

2017-03-10 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1581: Summary: JsonIO (was: JsonIO / JsonSink) > JsonIO > -- > > Key: BEAM-1581 >

[jira] [Commented] (BEAM-1650) Add IntelliJ code style xml to the project repo and website

2017-03-09 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903560#comment-15903560 ] Aviem Zur commented on BEAM-1650: - We might be able to leverage

[jira] [Commented] (BEAM-1616) Gauge Metric type

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895525#comment-15895525 ] Aviem Zur commented on BEAM-1616: - [~bchambers] you raise interesting questions. Since pipelines runs on

[jira] [Assigned] (BEAM-1623) Transform Reshuffle directly in Spark runner

2017-03-04 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1623: --- Assignee: Aviem Zur (was: Amit Sela) > Transform Reshuffle directly in Spark runner >

[jira] [Created] (BEAM-1623) Transform Reshuffle directly in Spark runner

2017-03-04 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1623: --- Summary: Transform Reshuffle directly in Spark runner Key: BEAM-1623 URL: https://issues.apache.org/jira/browse/BEAM-1623 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-1629) Init metrics/aggregators accumulators before traversing pipeline

2017-03-08 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1629: Description: Today aggregators and metrics accumulators are instantiated after pipeline is traversed, and

[jira] [Assigned] (BEAM-1336) A StateSpec that doesn't care about the key shouldn't be forced to declare it as type Object

2017-03-08 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1336: --- Assignee: Aviem Zur > A StateSpec that doesn't care about the key shouldn't be forced to declare it

[jira] [Created] (BEAM-1672) Extract interface MetricData

2017-03-08 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1672: --- Summary: Extract interface MetricData Key: BEAM-1672 URL: https://issues.apache.org/jira/browse/BEAM-1672 Project: Beam Issue Type: Improvement Components:

[jira] [Updated] (BEAM-1629) Metrics/aggregators accumulators should be instantiated before traversing pipeline

2017-03-08 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1629: Summary: Metrics/aggregators accumulators should be instantiated before traversing pipeline (was: Init

[jira] [Commented] (BEAM-1581) JsonIO

2017-03-11 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15906228#comment-15906228 ] Aviem Zur commented on BEAM-1581: - Yes, these should definitely be a {{FileBasedSource}}/{{FileBasedSink}}.

[jira] [Updated] (BEAM-1692) Convert to Codahale Metric interfaces where possible in WithMetricsSupport MetricRegistry

2017-03-11 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1692: Description: Currently in Spark runner all Beam metrics are reported by Codahale metrics as Codahale

[jira] [Updated] (BEAM-1692) Convert to Codahale Metric interfaces where possible in WithMetricsSupport MetricRegistry

2017-03-11 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1692: Description: Currently in Spark runner all Beam metrics are reported by Codahale metrics as Codahale

[jira] [Updated] (BEAM-1629) Metrics/aggregators accumulators should be instantiated before traversing pipeline

2017-03-12 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1629: Fix Version/s: First stable release > Metrics/aggregators accumulators should be instantiated before

[jira] [Updated] (BEAM-1581) JsonIO

2017-03-11 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1581: Description: A new IO (with source and sink) which will read/write Json files. Similarly to

[jira] [Resolved] (BEAM-1629) Metrics/aggregators accumulators should be instantiated before traversing pipeline

2017-03-12 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1629. - Resolution: Fixed > Metrics/aggregators accumulators should be instantiated before traversing > pipeline

[jira] [Created] (BEAM-1698) Comply with metrics querying semantics in Spark Runner

2017-03-12 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1698: --- Summary: Comply with metrics querying semantics in Spark Runner Key: BEAM-1698 URL: https://issues.apache.org/jira/browse/BEAM-1698 Project: Beam Issue Type: Bug

[jira] [Assigned] (BEAM-1344) Uniform metrics step name semantics

2017-03-12 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1344: --- Assignee: Ben Chambers (was: Aviem Zur) > Uniform metrics step name semantics >

[jira] [Assigned] (BEAM-1344) Uniform metrics step name semantics

2017-03-12 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1344: --- Assignee: Aviem Zur (was: Ben Chambers) > Uniform metrics step name semantics >

[jira] [Created] (BEAM-1699) Timer metric type

2017-03-12 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1699: --- Summary: Timer metric type Key: BEAM-1699 URL: https://issues.apache.org/jira/browse/BEAM-1699 Project: Beam Issue Type: New Feature Components: beam-model,

[jira] [Created] (BEAM-1701) Add Meter metric type to Python SDK

2017-03-12 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1701: --- Summary: Add Meter metric type to Python SDK Key: BEAM-1701 URL: https://issues.apache.org/jira/browse/BEAM-1701 Project: Beam Issue Type: Sub-task

[jira] [Resolved] (BEAM-1651) Add code style xml to the project repository

2017-03-13 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1651. - Resolution: Fixed Fix Version/s: First stable release > Add code style xml to the project

[jira] [Created] (BEAM-1651) Add IntelliJ code style xml to the project repository

2017-03-08 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1651: --- Summary: Add IntelliJ code style xml to the project repository Key: BEAM-1651 URL: https://issues.apache.org/jira/browse/BEAM-1651 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-1650) Add IntelliJ code style xml to the project repo and website

2017-03-08 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1650: --- Summary: Add IntelliJ code style xml to the project repo and website Key: BEAM-1650 URL: https://issues.apache.org/jira/browse/BEAM-1650 Project: Beam Issue Type:

[jira] [Created] (BEAM-1704) Create.TimestampedValues should take a TypeDescriptor as an alternative to explicitly specifying the Coder

2017-03-13 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1704: --- Summary: Create.TimestampedValues should take a TypeDescriptor as an alternative to explicitly specifying the Coder Key: BEAM-1704 URL: https://issues.apache.org/jira/browse/BEAM-1704

[jira] [Assigned] (BEAM-1704) Create.TimestampedValues should take a TypeDescriptor as an alternative to explicitly specifying the Coder

2017-03-13 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1704: --- Assignee: Aviem Zur (was: Davor Bonaci) > Create.TimestampedValues should take a TypeDescriptor as

[jira] [Created] (BEAM-1706) Ban Guava as a transitive dependency

2017-03-13 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1706: --- Summary: Ban Guava as a transitive dependency Key: BEAM-1706 URL: https://issues.apache.org/jira/browse/BEAM-1706 Project: Beam Issue Type: Improvement

[jira] [Assigned] (BEAM-848) A better shuffle after reading from within mapWithState.

2017-03-14 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-848: -- Assignee: Aviem Zur (was: Amit Sela) > A better shuffle after reading from within mapWithState. >

[jira] [Created] (BEAM-1629) Make metrics/aggregators accumulators available on driver

2017-03-06 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1629: --- Summary: Make metrics/aggregators accumulators available on driver Key: BEAM-1629 URL: https://issues.apache.org/jira/browse/BEAM-1629 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-1629) Make metrics/aggregators accumulators available on driver

2017-03-06 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1629: Description: Today aggregators and metrics accumulators are instantiated after pipeline is traversed, and

[jira] [Updated] (BEAM-1625) BoundedDataset action() does not materialize RDD

2017-03-07 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1625: Description: {{BoundedDataset#action}} does not materialize RDD since it uses {{foreachPartition}} which is

[jira] [Created] (BEAM-1636) UnboundedDataset action() does not materialize RDD

2017-03-07 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1636: --- Summary: UnboundedDataset action() does not materialize RDD Key: BEAM-1636 URL: https://issues.apache.org/jira/browse/BEAM-1636 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-1625) BoundedDataset action() does not materialize RDD

2017-03-05 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1625: --- Summary: BoundedDataset action() does not materialize RDD Key: BEAM-1625 URL: https://issues.apache.org/jira/browse/BEAM-1625 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-1625) BoundedDataset action() does not materialize RDD

2017-03-05 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1625: Description: {{BoundedDataset#action}} does not materialize RDD since it uses {{foreachPartition}} which is

[jira] [Updated] (BEAM-147) Introduce an easy API for pipeline metrics

2017-03-05 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-147: --- Issue Type: New Feature (was: Bug) > Introduce an easy API for pipeline metrics >

[jira] [Updated] (BEAM-1616) Gauge Metric type

2017-03-05 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1616: Issue Type: New Feature (was: Bug) > Gauge Metric type > - > > Key:

[jira] [Assigned] (BEAM-1614) Add Meter metric type to Java SDK

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1614: --- Assignee: (was: Aviem Zur) > Add Meter metric type to Java SDK >

[jira] [Assigned] (BEAM-1614) Add Meter metric type to Java SDK

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1614: --- Assignee: Aviem Zur (was: Davor Bonaci) > Add Meter metric type to Java SDK >

[jira] [Updated] (BEAM-1613) Meter metric type

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1613: Description: Add support for Meter metric type to the SDK. Compare to

[jira] [Updated] (BEAM-1613) Meter metric type

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1613: Description: Add support for Meter metric type to the SDK. Interface should be along the lines of: {code}

[jira] [Created] (BEAM-1618) Add Gauge metric type to Python SDK

2017-03-03 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1618: --- Summary: Add Gauge metric type to Python SDK Key: BEAM-1618 URL: https://issues.apache.org/jira/browse/BEAM-1618 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-1617) Add Gauge metric type to Java SDK

2017-03-03 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1617: --- Summary: Add Gauge metric type to Java SDK Key: BEAM-1617 URL: https://issues.apache.org/jira/browse/BEAM-1617 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-1616) Gauge Metric type

2017-03-03 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1616: --- Summary: Gauge Metric type Key: BEAM-1616 URL: https://issues.apache.org/jira/browse/BEAM-1616 Project: Beam Issue Type: Bug Components: beam-model,

[jira] [Assigned] (BEAM-1616) Gauge Metric type

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1616: --- Assignee: Ben Chambers (was: Frances Perry) > Gauge Metric type > - > >

[jira] [Assigned] (BEAM-1617) Add Gauge metric type to Java SDK

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1617: --- Assignee: Aviem Zur (was: Davor Bonaci) > Add Gauge metric type to Java SDK >

[jira] [Created] (BEAM-1613) Meter metric type

2017-03-03 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1613: --- Summary: Meter metric type Key: BEAM-1613 URL: https://issues.apache.org/jira/browse/BEAM-1613 Project: Beam Issue Type: New Feature Components: beam-model,

[jira] [Created] (BEAM-1615) Add Meter metric type to Python SDK

2017-03-03 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1615: --- Summary: Add Meter metric type to Python SDK Key: BEAM-1615 URL: https://issues.apache.org/jira/browse/BEAM-1615 Project: Beam Issue Type: Sub-task

[jira] [Assigned] (BEAM-1613) Meter metric type

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1613: --- Assignee: Ben Chambers (was: Frances Perry) > Meter metric type > - > >

[jira] [Created] (BEAM-1614) Add Meter metric type to Java SDK

2017-03-03 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1614: --- Summary: Add Meter metric type to Java SDK Key: BEAM-1614 URL: https://issues.apache.org/jira/browse/BEAM-1614 Project: Beam Issue Type: Sub-task

[jira] [Assigned] (BEAM-1591) Implement Combine optimizations for GABW in streaming.

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1591: --- Assignee: Aviem Zur > Implement Combine optimizations for GABW in streaming. >

[jira] [Updated] (BEAM-147) Introduce an easy API for pipeline metrics

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-147: --- Description: The existing Aggregators are confusing both because of their name and because they serve multiple

[jira] [Updated] (BEAM-1565) Update Spark runner PostCommit Jenkins job.

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1565: Fix Version/s: (was: 0.6.0) > Update Spark runner PostCommit Jenkins job. >

[jira] [Assigned] (BEAM-1603) Enable programmatic execution of spark pipelines.

2017-03-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1603: --- Assignee: Aviem Zur (was: Amit Sela) > Enable programmatic execution of spark pipelines. >

[jira] [Updated] (BEAM-1581) JsonIO / JsonSink

2017-03-01 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1581: Summary: JsonIO / JsonSink (was: JsonIO) > JsonIO / JsonSink > - > > Key:

[jira] [Assigned] (BEAM-1581) JsonIO / JsonSink

2017-03-01 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1581: --- Assignee: Aviem Zur (was: Davor Bonaci) > JsonIO / JsonSink > - > >

[jira] [Created] (BEAM-1581) JsonIO

2017-03-01 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1581: --- Summary: JsonIO Key: BEAM-1581 URL: https://issues.apache.org/jira/browse/BEAM-1581 Project: Beam Issue Type: New Feature Components: sdk-java-extensions

[jira] [Updated] (BEAM-351) Add DisplayData to KafkaIO

2017-03-02 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-351: --- Fix Version/s: 0.6.0 > Add DisplayData to KafkaIO > -- > > Key:

[jira] [Updated] (BEAM-1565) Update Spark runner PostCommit Jenkins job.

2017-03-02 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1565: Fix Version/s: 0.6.0 > Update Spark runner PostCommit Jenkins job. >

[jira] [Updated] (BEAM-1720) Consider minimization on shaded jars

2017-04-07 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1720: Description: Some of our modules shade and relocate Guava as part of their build, this adds a considerable

[jira] [Assigned] (BEAM-1720) Consider minimization on shaded jars

2017-04-07 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1720: --- Assignee: (was: Aviem Zur) > Consider minimization on shaded jars >

[jira] [Commented] (BEAM-1581) JSON source and sink

2017-04-06 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960271#comment-15960271 ] Aviem Zur commented on BEAM-1581: - We probably won't solve the entire space in one commit, as you said -

[jira] [Commented] (BEAM-1700) Add Timer metric type to Java SDK

2017-04-06 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960288#comment-15960288 ] Aviem Zur commented on BEAM-1700: - No current deadline for this issue, metrics are still experimental. >

[jira] [Updated] (BEAM-1763) TestPipeline should ensure that all assertions succeeded

2017-04-06 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1763: Fix Version/s: First stable release > TestPipeline should ensure that all assertions succeeded >

[jira] [Updated] (BEAM-1763) TestPipeline should ensure that all assertions succeeded

2017-04-06 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1763: Priority: Blocker (was: Major) > TestPipeline should ensure that all assertions succeeded >

[jira] [Updated] (BEAM-1763) TestPipeline should ensure that all assertions succeeded

2017-04-07 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1763: Description: This doesn't need to be part of each {{PipelineRunner}} implementation if it goes through the

[jira] [Updated] (BEAM-1763) TestPipeline should ensure that all assertions succeeded

2017-04-07 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1763: Description: This doesn't need to be part of each {{PipelineRunner}} implementation if it goes through the

[jira] [Updated] (BEAM-1919) Standard IO Metrics

2017-04-08 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1919: Description: A foundation for standard IO metrics, which could be used by all IOs. A standard IO metric is a

[jira] [Assigned] (BEAM-1919) Standard IO Metrics

2017-04-08 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1919: --- Assignee: Aviem Zur (was: Davor Bonaci) > Standard IO Metrics > --- > >

[jira] [Created] (BEAM-1919) Standard IO Metrics

2017-04-08 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1919: --- Summary: Standard IO Metrics Key: BEAM-1919 URL: https://issues.apache.org/jira/browse/BEAM-1919 Project: Beam Issue Type: New Feature Components: sdk-ideas

[jira] [Created] (BEAM-1964) pylint failing in pre-commit.

2017-04-13 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1964: --- Summary: pylint failing in pre-commit. Key: BEAM-1964 URL: https://issues.apache.org/jira/browse/BEAM-1964 Project: Beam Issue Type: Bug Components: sdk-py

[jira] [Commented] (BEAM-2002) Verify PAssert execution in TestSparkRunner

2017-04-18 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15973490#comment-15973490 ] Aviem Zur commented on BEAM-2002: - Looks like the validation of {{PAssert}} execution in Spark runner is

[jira] [Comment Edited] (BEAM-2671) CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner

2017-07-30 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106440#comment-16106440 ] Aviem Zur edited comment on BEAM-2671 at 7/30/17 11:41 AM: --- CreateStreamTest has

[jira] [Comment Edited] (BEAM-2671) CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner

2017-07-30 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106440#comment-16106440 ] Aviem Zur edited comment on BEAM-2671 at 7/30/17 11:13 AM: --- CreateStreamTest has

[jira] [Commented] (BEAM-2671) CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner

2017-07-30 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106440#comment-16106440 ] Aviem Zur commented on BEAM-2671: - 20820fa5477ffcdd4a9ef2e9340353ed3c5691a9 added an element of flakiness

[jira] [Comment Edited] (BEAM-2671) CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner

2017-08-02 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106440#comment-16106440 ] Aviem Zur edited comment on BEAM-2671 at 8/2/17 6:44 AM: - CreateStreamTest has

[jira] [Created] (BEAM-2669) Kryo serialization exception when DStreams containing non-Kryo-serializable data are cached

2017-07-24 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-2669: --- Summary: Kryo serialization exception when DStreams containing non-Kryo-serializable data are cached Key: BEAM-2669 URL: https://issues.apache.org/jira/browse/BEAM-2669

[jira] [Updated] (BEAM-2669) Kryo serialization exception when DStreams containing non-Kryo-serializable data are cached

2017-07-24 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2669: Description: Today, when we detect re-use of a dataset in a pipeline in Spark runner we eagerly cache it to

[jira] [Resolved] (BEAM-2359) SparkTimerInternals inputWatermarkTime does not get updated in cluster mode

2017-07-04 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-2359. - Resolution: Fixed > SparkTimerInternals inputWatermarkTime does not get updated in cluster mode >

[jira] [Commented] (BEAM-2359) SparkTimerInternals inputWatermarkTime does not get updated in cluster mode

2017-07-04 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073258#comment-16073258 ] Aviem Zur commented on BEAM-2359: - Yeah, the PR was merged, marking as resolved. > SparkTimerInternals

[jira] [Assigned] (BEAM-2176) Support state API in Spark streaming mode.

2017-07-05 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-2176: --- Assignee: (was: Aviem Zur) > Support state API in Spark streaming mode. >

[jira] [Commented] (BEAM-1582) ResumeFromCheckpointStreamingTest flakes with what appears as a second firing.

2017-04-26 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15985205#comment-15985205 ] Aviem Zur commented on BEAM-1582: - AFAIK there is no current solution for this in sight for the near

[jira] [Updated] (BEAM-2057) Test metrics are reported to Spark Metrics sink.

2017-04-26 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2057: Description: Test that metrics are reported to Spark's metric sink. Use {{InMemoryMetrics}} and

[jira] [Assigned] (BEAM-2057) Test metrics are reported to Spark Metrics sink.

2017-04-26 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-2057: --- Assignee: Holden Karau > Test metrics are reported to Spark Metrics sink. >

[jira] [Updated] (BEAM-1958) Standard IO Metrics in Java SDK

2017-04-26 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1958: Fix Version/s: First stable release > Standard IO Metrics in Java SDK > --- > >

<    1   2   3   4   >