[jira] [Commented] (BEAM-321) Hash encoded keys in Flink batch mode

2016-08-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402422#comment-15402422 ] Daniel Halperin commented on BEAM-321: -- Thanks. I think what happened is we accidentally removed on

[jira] [Commented] (BEAM-321) Hash encoded keys in Flink batch mode

2016-08-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402426#comment-15402426 ] Daniel Halperin commented on BEAM-321: -- Naive question: is labeling issues with "desired fix version"

[jira] [Updated] (BEAM-458) Support for Flink Metrics

2016-07-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-458: - Component/s: (was: runner-flink) (was: runner-core)

[jira] [Resolved] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-445. -- Resolution: Fixed > Beam-examples-java build failed through local "mvn install" >

[jira] [Updated] (BEAM-478) Create Vector, Matrix types and operations to enable linear algebra API

2016-07-31 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-478: - Fix Version/s: (was: 0.2.0-incubating) > Create Vector, Matrix types and operations to enable

[jira] [Assigned] (BEAM-450) Modules are shaded to the same path

2016-07-27 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-450: Assignee: Daniel Halperin (was: Manu Zhang) > Modules are shaded to the same path >

[jira] [Updated] (BEAM-285) Make MinLongFn and MaxLongFn mimic SumLongFn and use BinaryCombineLongFn

2016-07-27 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-285: - Issue Type: Improvement (was: Bug) > Make MinLongFn and MaxLongFn mimic SumLongFn and use

[jira] [Resolved] (BEAM-416) Jenkins Python Verify post commit tests are timing out

2016-07-27 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-416. -- Resolution: Fixed > Jenkins Python Verify post commit tests are timing out >

[jira] [Reopened] (BEAM-416) Jenkins Python Verify post commit tests are timing out

2016-07-27 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reopened BEAM-416: -- > Jenkins Python Verify post commit tests are timing out >

[jira] [Updated] (BEAM-416) Jenkins Python Verify post commit tests are timing out

2016-07-27 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-416: - Fix Version/s: (was: 0.2.0-incubating) Not applicable > Jenkins Python

[jira] [Resolved] (BEAM-489) remove headerLocation from maven-checkstyle-plugin configuration

2016-07-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-489. -- Resolution: Fixed Fix Version/s: Not applicable > remove headerLocation from

[jira] [Updated] (BEAM-372) CoderProperties: Test that the coder doesn't consume more bytes than it produces

2016-07-27 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-372: - Issue Type: Test (was: Bug) > CoderProperties: Test that the coder doesn't consume more bytes than

[jira] [Closed] (BEAM-514) Add all mandatory links

2016-08-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-514. > Add all mandatory links > --- > > Key: BEAM-514 >

[jira] [Closed] (BEAM-337) Cleanup NOTICE file

2016-08-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-337. Resolution: Fixed Fix Version/s: (was: 0.2.0-incubating) Not applicable

[jira] [Resolved] (BEAM-514) Add all mandatory links

2016-08-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-514. -- Resolution: Fixed Fix Version/s: Not applicable > Add all mandatory links >

[jira] [Closed] (BEAM-369) Add travis config to website

2016-08-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-369. Resolution: Fixed Fix Version/s: Not applicable > Add travis config to website >

[jira] [Closed] (BEAM-515) Add feature logo and incubator logo

2016-08-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-515. Resolution: Fixed Fix Version/s: Not applicable > Add feature logo and incubator logo >

[jira] [Created] (BEAM-510) releases: link to source release should use Apache mirror script

2016-08-01 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-510: Summary: releases: link to source release should use Apache mirror script Key: BEAM-510 URL: https://issues.apache.org/jira/browse/BEAM-510 Project: Beam

[jira] [Created] (BEAM-513) Broken link on programming-guide page

2016-08-01 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-513: Summary: Broken link on programming-guide page Key: BEAM-513 URL: https://issues.apache.org/jira/browse/BEAM-513 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-514) Add all mandatory links

2016-08-01 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-514: Summary: Add all mandatory links Key: BEAM-514 URL: https://issues.apache.org/jira/browse/BEAM-514 Project: Beam Issue Type: Bug Components:

[jira] [Created] (BEAM-515) Add feature logo and incubator logo

2016-08-01 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-515: Summary: Add feature logo and incubator logo Key: BEAM-515 URL: https://issues.apache.org/jira/browse/BEAM-515 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-515) Add feature logo and incubator logo

2016-08-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-515: - Priority: Critical (was: Major) > Add feature logo and incubator logo >

[jira] [Closed] (BEAM-383) BigQueryIO: update sink to shard into multiple write jobs

2016-08-04 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-383. > BigQueryIO: update sink to shard into multiple write jobs >

[jira] [Resolved] (BEAM-383) BigQueryIO: update sink to shard into multiple write jobs

2016-08-04 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-383. -- Resolution: Fixed Fix Version/s: 0.3.0-incubating > BigQueryIO: update sink to shard into

[jira] [Created] (BEAM-532) Let users specify compression mode in WordCount

2016-08-03 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-532: Summary: Let users specify compression mode in WordCount Key: BEAM-532 URL: https://issues.apache.org/jira/browse/BEAM-532 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-532) Let users specify compression mode in WordCount

2016-08-14 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420602#comment-15420602 ] Daniel Halperin commented on BEAM-532: -- I decided that this is probably unnecessary -- keep wordcount

[jira] [Closed] (BEAM-429) minor: remove an obsolete comment in KafakIOTest.java

2016-08-10 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-429. Resolution: Fixed Fix Version/s: Not applicable > minor: remove an obsolete comment in

[jira] [Closed] (BEAM-426) Update to Bigtable version 0.9.0

2016-08-10 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-426. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Update to Bigtable version 0.9.0 >

[jira] [Commented] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-12 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374380#comment-15374380 ] Daniel Halperin commented on BEAM-445: -- The uber jar is not supported by gRPC yet, so we cannot use it.

[jira] [Assigned] (BEAM-124) Testing -- End to End WordCount Batch and Streaming Tests

2016-07-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-124: Assignee: Daniel Halperin (was: Jason Kuster) > Testing -- End to End WordCount Batch and

[jira] [Updated] (BEAM-466) QuantileStateCoder should be a StandardCoder

2016-07-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-466: - Assignee: (was: Davor Bonaci) > QuantileStateCoder should be a StandardCoder >

[jira] [Updated] (BEAM-469) NullableCoder should encode using the context given and not always use the nested context

2016-07-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-469: - Assignee: (was: Davor Bonaci) > NullableCoder should encode using the context given and not

[jira] [Commented] (BEAM-461) Create custom Kinesis source

2016-07-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383130#comment-15383130 ] Daniel Halperin commented on BEAM-461: -- +1 > Create custom Kinesis source >

[jira] [Created] (BEAM-467) Spark flaky tests?

2016-07-18 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-467: Summary: Spark flaky tests? Key: BEAM-467 URL: https://issues.apache.org/jira/browse/BEAM-467 Project: Beam Issue Type: Bug Components:

[jira] [Updated] (BEAM-383) BigQueryIO: update sink to shard into multiple write jobs

2016-07-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-383: - Assignee: Ian Zhou > BigQueryIO: update sink to shard into multiple write jobs >

[jira] [Updated] (BEAM-124) Testing -- End to End WordCount Batch and Streaming Tests

2016-07-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-124: - Assignee: Mark Liu (was: Daniel Halperin) > Testing -- End to End WordCount Batch and Streaming

[jira] [Resolved] (BEAM-468) NullableCoder should not ask valueCoder isRegisterByteSizeObserverCheap when value is null

2016-07-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-468. -- Resolution: Fixed Fix Version/s: 0.2.0-incubating > NullableCoder should not ask

[jira] [Resolved] (BEAM-434) Limit the number of output files a beam-examples execution writes

2016-07-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-434. -- Resolution: Fixed Assignee: Thomas Groh (was: Amit Sela) Fix Version/s:

[jira] [Resolved] (BEAM-88) DataflowPipelineOptions.tempLocation doesn't really default to stagingLocation

2016-07-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-88?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-88. - Resolution: Won't Fix Fix Version/s: Not applicable This is actually working as intended. >

[jira] [Created] (BEAM-475) High-quality javadoc for Beam

2016-07-19 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-475: Summary: High-quality javadoc for Beam Key: BEAM-475 URL: https://issues.apache.org/jira/browse/BEAM-475 Project: Beam Issue Type: Improvement

[jira] [Reopened] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-20 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reopened BEAM-445: -- > Beam-examples-java build failed through local "mvn install" >

[jira] [Created] (BEAM-476) BigQueryIO.Write: schema not known at construction time

2016-07-20 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-476: Summary: BigQueryIO.Write: schema not known at construction time Key: BEAM-476 URL: https://issues.apache.org/jira/browse/BEAM-476 Project: Beam Issue Type:

[jira] [Commented] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-15 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379630#comment-15379630 ] Daniel Halperin commented on BEAM-445: -- Thanks -- it's good to make sure everyone involved knows that

[jira] [Created] (BEAM-457) Upgrade Avro

2016-07-15 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-457: Summary: Upgrade Avro Key: BEAM-457 URL: https://issues.apache.org/jira/browse/BEAM-457 Project: Beam Issue Type: Improvement Components:

[jira] [Resolved] (BEAM-285) Make MinLongFn and MaxLongFn mimic SumLongFn and use BinaryCombineLongFn

2016-07-15 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-285. -- Resolution: Fixed Fix Version/s: 0.2.0-incubating > Make MinLongFn and MaxLongFn mimic

[jira] [Resolved] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-15 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-445. -- Resolution: Fixed Fix Version/s: Not applicable > Beam-examples-java build failed through

[jira] [Updated] (BEAM-384) Streaming BigQueryIO should support user-provided IDs

2016-07-15 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-384: - Assignee: (was: Daniel Halperin) > Streaming BigQueryIO should support user-provided IDs >

[jira] [Created] (BEAM-450) Modules are shaded to the same path

2016-07-14 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-450: Summary: Modules are shaded to the same path Key: BEAM-450 URL: https://issues.apache.org/jira/browse/BEAM-450 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-434) When examples write output to file it creates many output files instead of one

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371662#comment-15371662 ] Daniel Halperin commented on BEAM-434: -- Proposals: 1. Modify examples to use

[jira] [Updated] (BEAM-440) Create.values() returns a type-unsafe Coder

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-440: - Labels: newbie starter (was: ) > Create.values() returns a type-unsafe Coder >

[jira] [Commented] (BEAM-440) Create.values() returns a type-unsafe Coder

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371738#comment-15371738 ] Daniel Halperin commented on BEAM-440: -- This is a good starter issue. > Create.values() returns a

[jira] [Commented] (BEAM-434) When examples write output to file it creates many output files instead of one

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371665#comment-15371665 ] Daniel Halperin commented on BEAM-434: -- cc [~bchambers]] > When examples write output to file it

[jira] [Commented] (BEAM-434) When examples write output to file it creates many output files instead of one

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371666#comment-15371666 ] Daniel Halperin commented on BEAM-434: -- [~bchambers] confirmed that the Direct Runner is producing a

[jira] [Created] (BEAM-440) Create.values() returns a type-unsafe Coder

2016-07-11 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-440: Summary: Create.values() returns a type-unsafe Coder Key: BEAM-440 URL: https://issues.apache.org/jira/browse/BEAM-440 Project: Beam Issue Type: Bug

[jira] [Closed] (BEAM-394) AvroCoder is Serializable with non-serializable fields

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-394. Resolution: Fixed Fix Version/s: 0.2.0-incubating > AvroCoder is Serializable with

[jira] [Commented] (BEAM-404) PubsubIO should have a mode that supports maintaining message attributes.

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372044#comment-15372044 ] Daniel Halperin commented on BEAM-404: -- Of course instead of {{KV}} this could be something else like a

[jira] [Closed] (BEAM-69) TextIO/AvroIO numShards may not work in different runners

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-69?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-69. --- Resolution: Fixed Assignee: Daniel Halperin Fix Version/s: Not applicable >

[jira] [Commented] (BEAM-310) Exercise splitIntoBundles/generateInitialSplits in the Direct Runner

2016-06-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15353334#comment-15353334 ] Daniel Halperin commented on BEAM-310: -- Note that we should also exercise splitAtFraction. > Exercise

[jira] [Created] (BEAM-383) BigQueryIO: update sink to shard into multiple write jobs

2016-06-28 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-383: Summary: BigQueryIO: update sink to shard into multiple write jobs Key: BEAM-383 URL: https://issues.apache.org/jira/browse/BEAM-383 Project: Beam Issue

[jira] [Commented] (BEAM-365) TextIO withoutSharding causes Flink to throw IllegalStateException

2016-06-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15353970#comment-15353970 ] Daniel Halperin commented on BEAM-365: -- This is fixed now "the right way" -- by adding sharding support

[jira] [Closed] (BEAM-365) TextIO withoutSharding causes Flink to throw IllegalStateException

2016-06-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-365. Resolution: Fixed Fix Version/s: 0.2.0-incubating > TextIO withoutSharding causes Flink to

[jira] [Resolved] (BEAM-159) Support fixed number of shards in sinks

2016-06-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-159. -- Resolution: Fixed Fix Version/s: 0.2.0-incubating > Support fixed number of shards in

[jira] [Resolved] (BEAM-363) CompressedSource splits when it shouldn't

2016-06-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-363. -- Resolution: Fixed Fix Version/s: 0.2.0-incubating > CompressedSource splits when it

[jira] [Created] (BEAM-432) BigQueryIO javadoc is incorrect

2016-07-08 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-432: Summary: BigQueryIO javadoc is incorrect Key: BEAM-432 URL: https://issues.apache.org/jira/browse/BEAM-432 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-432) BigQueryIO javadoc is incorrect

2016-07-08 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15367909#comment-15367909 ] Daniel Halperin commented on BEAM-432: -- This is a good starter issue. > BigQueryIO javadoc is

[jira] [Updated] (BEAM-432) BigQueryIO javadoc is incorrect

2016-07-08 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-432: - Labels: newbie starter (was: ) > BigQueryIO javadoc is incorrect > ---

[jira] [Commented] (BEAM-378) Integrate Python SDK in the Maven build

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364505#comment-15364505 ] Daniel Halperin commented on BEAM-378: -- Hi JB, I think that the Python team needs to be in charge of

[jira] [Commented] (BEAM-378) Integrate Python SDK in the Maven build

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364507#comment-15364507 ] Daniel Halperin commented on BEAM-378: -- Also, thanks Sergio -- this looks great! > Integrate Python

[jira] [Assigned] (BEAM-378) Integrate Python SDK in the Maven build

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-378: Assignee: Daniel Halperin (was: Jean-Baptiste Onofré) > Integrate Python SDK in the Maven

[jira] [Updated] (BEAM-400) Direct/InProcess runner should use Pubsub publish time timestamp if timestampLabel is not set

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-400: - Assignee: (was: Daniel Halperin) > Direct/InProcess runner should use Pubsub publish time

[jira] [Commented] (BEAM-400) Direct/InProcess runner should use Pubsub publish time timestamp if timestampLabel is not set

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365541#comment-15365541 ] Daniel Halperin commented on BEAM-400: -- Runner names are not helpful here. I'm going to assume you

[jira] [Updated] (BEAM-361) Batch Pub/Sub sink does not set idLabel

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-361: - Labels: newbie starter (was: ) > Batch Pub/Sub sink does not set idLabel >

[jira] [Updated] (BEAM-361) Batch Pub/Sub sink does not set idLabel

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-361: - Assignee: (was: Daniel Halperin) > Batch Pub/Sub sink does not set idLabel >

[jira] [Comment Edited] (BEAM-361) Batch Pub/Sub sink does not set idLabel

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365649#comment-15365649 ] Daniel Halperin edited comment on BEAM-361 at 7/7/16 5:47 AM: -- This probably

[jira] [Commented] (BEAM-361) Batch Pub/Sub sink does not set idLabel

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365649#comment-15365649 ] Daniel Halperin commented on BEAM-361: -- This probably requires copying some logic from

[jira] [Commented] (BEAM-400) Direct/InProcess runner should use Pubsub publish time timestamp if timestampLabel is not set

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365545#comment-15365545 ] Daniel Halperin commented on BEAM-400: -- This is a good starter issue. > Direct/InProcess runner should

[jira] [Comment Edited] (BEAM-400) Direct/InProcess runner should use Pubsub publish time timestamp if timestampLabel is not set

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365541#comment-15365541 ] Daniel Halperin edited comment on BEAM-400 at 7/7/16 3:31 AM: -- Runner names are

[jira] [Comment Edited] (BEAM-400) Direct/InProcess runner should use Pubsub publish time timestamp if timestampLabel is not set

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365541#comment-15365541 ] Daniel Halperin edited comment on BEAM-400 at 7/7/16 3:32 AM: -- Runner names are

[jira] [Updated] (BEAM-400) Direct/InProcess runner should use Pubsub publish time timestamp if timestampLabel is not set

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-400: - Labels: newbie starter (was: ) > Direct/InProcess runner should use Pubsub publish time timestamp

[jira] [Commented] (BEAM-372) CoderProperties: Test that the coder doesn't consume more bytes than it produces

2016-07-08 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368716#comment-15368716 ] Daniel Halperin commented on BEAM-372: -- Another idea: put elements in a list and use a list coder to

[jira] [Commented] (BEAM-372) CoderProperties: Test that the coder doesn't consume more bytes than it produces

2016-07-08 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368718#comment-15368718 ] Daniel Halperin commented on BEAM-372: -- [~csingh] have you had any progress or blockers? Should I

[jira] [Commented] (BEAM-434) When examples write output to file it creates many output files instead of one

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370274#comment-15370274 ] Daniel Halperin commented on BEAM-434: -- There can be a very large performance impact from forcing a

[jira] [Updated] (BEAM-381) OffsetBasedReader should construct sources before updating the range tracker

2016-07-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-381: - Fix Version/s: 0.2.0-incubating > OffsetBasedReader should construct sources before updating the

[jira] [Resolved] (BEAM-381) OffsetBasedReader should construct sources before updating the range tracker

2016-07-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-381. -- Resolution: Fixed > OffsetBasedReader should construct sources before updating the range tracker

[jira] [Closed] (BEAM-381) OffsetBasedReader should construct sources before updating the range tracker

2016-07-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-381. > OffsetBasedReader should construct sources before updating the range tracker >

[jira] [Created] (BEAM-435) DirectRunner GBK -- task per key?

2016-07-11 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-435: Summary: DirectRunner GBK -- task per key? Key: BEAM-435 URL: https://issues.apache.org/jira/browse/BEAM-435 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-434) When examples write output to file it creates many output files instead of one

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371052#comment-15371052 ] Daniel Halperin commented on BEAM-434: -- It does seem very bad if the DirectRunner produces a bundle per

[jira] [Commented] (BEAM-467) Spark flaky tests?

2016-08-09 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413803#comment-15413803 ] Daniel Halperin commented on BEAM-467: -- Thanks! Sorry I blocked you -- next time, feel free to close

[jira] [Closed] (BEAM-467) Spark flaky tests?

2016-08-09 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-467. Resolution: Fixed Fix Version/s: Not applicable > Spark flaky tests? > -- > >

[jira] [Closed] (BEAM-510) releases: link to source release should use Apache mirror script

2016-08-02 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-510. Resolution: Fixed Fix Version/s: Not applicable > releases: link to source release should use

[jira] [Closed] (BEAM-513) Broken link on programming-guide page

2016-08-02 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-513. Resolution: Fixed Fix Version/s: Not applicable > Broken link on programming-guide page >

[jira] [Closed] (BEAM-212) SparkPipelineRunner should support the Read Primitive

2016-07-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-212. Resolution: Fixed Fix Version/s: Not applicable > SparkPipelineRunner should support the Read

[jira] [Updated] (BEAM-212) SparkPipelineRunner should support the Read Primitive

2016-07-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-212: - Fix Version/s: (was: 0.1.0-incubating) > SparkPipelineRunner should support the Read Primitive

[jira] [Reopened] (BEAM-212) SparkPipelineRunner should support the Read Primitive

2016-07-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reopened BEAM-212: -- > SparkPipelineRunner should support the Read Primitive >

[jira] [Resolved] (BEAM-212) SparkPipelineRunner should support the Read Primitive

2016-07-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-212. -- Resolution: Duplicate > SparkPipelineRunner should support the Read Primitive >

[jira] [Reopened] (BEAM-212) SparkPipelineRunner should support the Read Primitive

2016-07-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reopened BEAM-212: -- > SparkPipelineRunner should support the Read Primitive >

[jira] [Updated] (BEAM-394) AvroCoder is Serializable with non-serializable fields

2016-06-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-394: - Labels: findbugs newbie starter (was: findbugs starter) > AvroCoder is Serializable with

[jira] [Closed] (BEAM-355) Update to Bigtable version 0.3.0

2016-06-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-355. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Update to Bigtable version 0.3.0 >

[jira] [Created] (BEAM-404) PubsubIO should have a mode that supports maintaining message attributes.

2016-06-30 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-404: Summary: PubsubIO should have a mode that supports maintaining message attributes. Key: BEAM-404 URL: https://issues.apache.org/jira/browse/BEAM-404 Project: Beam

[jira] [Closed] (BEAM-395) KafkaIO tests should be marked 'NeedsRunner'

2016-06-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-395. Resolution: Fixed Fix Version/s: Not applicable > KafkaIO tests should be marked 'NeedsRunner'

<    1   2   3   4   5   6   7   8   9   >