Eugene Kirpichov created BEAM-1197:
--
Summary: Slowly-changing external data as a side input
Key: BEAM-1197
URL: https://issues.apache.org/jira/browse/BEAM-1197
Project: Beam
Issue Type:
[
https://issues.apache.org/jira/browse/BEAM-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15767871#comment-15767871
]
Eugene Kirpichov commented on BEAM-1190:
My proposal is to add a mandatory stat at glob-expand time
[
https://issues.apache.org/jira/browse/BEAM-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15766004#comment-15766004
]
Eugene Kirpichov commented on BEAM-1190:
Dan - please note I'm suggesting not to ignore
[
https://issues.apache.org/jira/browse/BEAM-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15765658#comment-15765658
]
Eugene Kirpichov commented on BEAM-1190:
CC: [~dhalp...@google.com] [~pei...@gmail.com]
>
Eugene Kirpichov created BEAM-1190:
--
Summary: FileBasedSource should ignore files that matched the glob
but don't exist
Key: BEAM-1190
URL: https://issues.apache.org/jira/browse/BEAM-1190
Project:
Eugene Kirpichov created BEAM-1182:
--
Summary: Direct runner should enforce encodability of unbounded
source checkpoints
Key: BEAM-1182
URL: https://issues.apache.org/jira/browse/BEAM-1182
Project:
Eugene Kirpichov created BEAM-1159:
--
Summary: DoFnSignature should have info on the fn's side inputs
and outputs
Key: BEAM-1159
URL: https://issues.apache.org/jira/browse/BEAM-1159
Project: Beam
[
https://issues.apache.org/jira/browse/BEAM-1149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Kirpichov resolved BEAM-1149.
Resolution: Fixed
Fix Version/s: 0.4.0-incubating
> Side input access fails in direct
[
https://issues.apache.org/jira/browse/BEAM-1149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746424#comment-15746424
]
Eugene Kirpichov commented on BEAM-1149:
Test works with
Eugene Kirpichov created BEAM-1149:
--
Summary: Side input access fails in direct runner (possibly others
too) when input element in multiple windows
Key: BEAM-1149
URL:
[
https://issues.apache.org/jira/browse/BEAM-863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Kirpichov updated BEAM-863:
--
Description:
Running basic, unchanged WordCount on Windows with local files results in an
Eugene Kirpichov created BEAM-1140:
--
Summary: Apex
ParDoBoundTranslatorTest.testMultiOutputParDoWithSideInputs is flaky
Key: BEAM-1140
URL: https://issues.apache.org/jira/browse/BEAM-1140
Project:
[
https://issues.apache.org/jira/browse/BEAM-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15742991#comment-15742991
]
Eugene Kirpichov commented on BEAM-1134:
I agree that wasting like 10 lines writing an anonymous
[
https://issues.apache.org/jira/browse/BEAM-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15742598#comment-15742598
]
Eugene Kirpichov commented on BEAM-1134:
Can this be done by simply composing the MongoDbIO with a
[
https://issues.apache.org/jira/browse/BEAM-801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713305#comment-15713305
]
Eugene Kirpichov commented on BEAM-801:
---
This can be closed.
> SplittableParDo must be a
Eugene Kirpichov created BEAM-1060:
--
Summary: Make DoFnTester use new DoFn
Key: BEAM-1060
URL: https://issues.apache.org/jira/browse/BEAM-1060
Project: Beam
Issue Type: Improvement
Eugene Kirpichov created BEAM-988:
-
Summary: Support for testing how soon output is emitted
Key: BEAM-988
URL: https://issues.apache.org/jira/browse/BEAM-988
Project: Beam
Issue Type: Bug
Eugene Kirpichov created BEAM-987:
-
Summary: TestStream.advanceWatermarkToInfinity should perhaps also
advance processing time
Key: BEAM-987
URL: https://issues.apache.org/jira/browse/BEAM-987
[
https://issues.apache.org/jira/browse/BEAM-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15634347#comment-15634347
]
Eugene Kirpichov commented on BEAM-896:
---
Note that this is only a problem with local files, not GCS
[
https://issues.apache.org/jira/browse/BEAM-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15634330#comment-15634330
]
Eugene Kirpichov commented on BEAM-896:
---
The code is wrong because it doesn't delete the temp
[
https://issues.apache.org/jira/browse/BEAM-854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Kirpichov closed BEAM-854.
-
Resolution: Fixed
Fix Version/s: 0.4.0-incubating
ReifyTimestampsAndWindows no longer
Eugene Kirpichov created BEAM-876:
-
Summary: Support schemaUpdateOption in BigQueryIO
Key: BEAM-876
URL: https://issues.apache.org/jira/browse/BEAM-876
Project: Beam
Issue Type: Improvement
Eugene Kirpichov created BEAM-854:
-
Summary: ReifyTimestampAndWindows explodes windows
Key: BEAM-854
URL: https://issues.apache.org/jira/browse/BEAM-854
Project: Beam
Issue Type: Bug
[
https://issues.apache.org/jira/browse/BEAM-787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593582#comment-15593582
]
Eugene Kirpichov commented on BEAM-787:
---
I think I found the bug:
[
https://issues.apache.org/jira/browse/BEAM-787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593044#comment-15593044
]
Eugene Kirpichov commented on BEAM-787:
---
I'm able to reproduce this locally in a few seconds when
[
https://issues.apache.org/jira/browse/BEAM-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575679#comment-15575679
]
Eugene Kirpichov commented on BEAM-638:
---
More discussion currently happening on
[
https://issues.apache.org/jira/browse/BEAM-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570357#comment-15570357
]
Eugene Kirpichov commented on BEAM-714:
---
Should be closed.
> Migrate DatastoreV1 to use AutoValue to
[
https://issues.apache.org/jira/browse/BEAM-714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Kirpichov reassigned BEAM-714:
-
Assignee: Eugene Kirpichov (was: Daniel Halperin)
> Migrate DatastoreV1 to use AutoValue
Eugene Kirpichov created BEAM-730:
-
Summary: Remove Reshuffle transform in favor of
Redistribute.byKey()
Key: BEAM-730
URL: https://issues.apache.org/jira/browse/BEAM-730
Project: Beam
Eugene Kirpichov created BEAM-729:
-
Summary: Does sdks/java/io/google-cloud-platform/pom.xml need
javadoc plugin?
Key: BEAM-729
URL: https://issues.apache.org/jira/browse/BEAM-729
Project: Beam
[
https://issues.apache.org/jira/browse/BEAM-717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552714#comment-15552714
]
Eugene Kirpichov commented on BEAM-717:
---
https://github.com/apache/incubator-beam/pull/1048
> Migrate
[
https://issues.apache.org/jira/browse/BEAM-717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Kirpichov reassigned BEAM-717:
-
Assignee: Eugene Kirpichov (was: James Malone)
> Migrate KafkaIO to use AutoValue to
[
https://issues.apache.org/jira/browse/BEAM-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15549629#comment-15549629
]
Eugene Kirpichov commented on BEAM-714:
---
This is being done in
[
https://issues.apache.org/jira/browse/BEAM-702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546300#comment-15546300
]
Eugene Kirpichov commented on BEAM-702:
---
Hmm, I didn't realize that we don't call finishBundle and
[
https://issues.apache.org/jira/browse/BEAM-702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543109#comment-15543109
]
Eugene Kirpichov commented on BEAM-702:
---
CC: [~tgroh]
> Simple pattern for per-bundle and per-DoFn
Eugene Kirpichov created BEAM-702:
-
Summary: Simple pattern for per-bundle and per-DoFn Closeable
resources
Key: BEAM-702
URL: https://issues.apache.org/jira/browse/BEAM-702
Project: Beam
Eugene Kirpichov created BEAM-694:
-
Summary: TriggerTester doesn't test timer firings
Key: BEAM-694
URL: https://issues.apache.org/jira/browse/BEAM-694
Project: Beam
Issue Type: Bug
[
https://issues.apache.org/jira/browse/BEAM-559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527667#comment-15527667
]
Eugene Kirpichov commented on BEAM-559:
---
This issue should be closed now.
> DoFnTester should handle
[
https://issues.apache.org/jira/browse/BEAM-559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524677#comment-15524677
]
Eugene Kirpichov commented on BEAM-559:
---
PR https://github.com/apache/incubator-beam/pull/1011
>
[
https://issues.apache.org/jira/browse/BEAM-630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488969#comment-15488969
]
Eugene Kirpichov commented on BEAM-630:
---
Hmm, looks like I don't have the rights to close this issue.
[
https://issues.apache.org/jira/browse/BEAM-630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488439#comment-15488439
]
Eugene Kirpichov commented on BEAM-630:
---
WELL, ACTUALLY it might be our bug. Almost narrowed down.
>
[
https://issues.apache.org/jira/browse/BEAM-630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488397#comment-15488397
]
Eugene Kirpichov edited comment on BEAM-630 at 9/13/16 9:01 PM:
Wonderful.
[
https://issues.apache.org/jira/browse/BEAM-630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488397#comment-15488397
]
Eugene Kirpichov edited comment on BEAM-630 at 9/13/16 8:57 PM:
Wonderful.
[
https://issues.apache.org/jira/browse/BEAM-630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488397#comment-15488397
]
Eugene Kirpichov commented on BEAM-630:
---
Wonderful. This seems like a bug in ByteBuddy - it
[
https://issues.apache.org/jira/browse/BEAM-630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488356#comment-15488356
]
Eugene Kirpichov commented on BEAM-630:
---
Some investigation:
- The issue can be narrowed down to
Eugene Kirpichov created BEAM-521:
-
Summary: Execute some file-based reads via composite transform
instead of custom source
Key: BEAM-521
URL: https://issues.apache.org/jira/browse/BEAM-521
Project:
[
https://issues.apache.org/jira/browse/BEAM-521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Kirpichov updated BEAM-521:
--
Summary: Execute some bounded source reads via composite transform (was:
Execute some file-based
[
https://issues.apache.org/jira/browse/BEAM-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15257180#comment-15257180
]
Eugene Kirpichov commented on BEAM-217:
---
I'm overwhelmed and don't have time to do it right now
[
https://issues.apache.org/jira/browse/BEAM-215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252038#comment-15252038
]
Eugene Kirpichov commented on BEAM-215:
---
Note that for this to interact well with Dataflow's dynamic
[
https://issues.apache.org/jira/browse/BEAM-217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Kirpichov updated BEAM-217:
--
Priority: Minor (was: Major)
> BoundedSource.splitAtFraction should be splitAfterFraction
>
Eugene Kirpichov created BEAM-217:
-
Summary: BoundedSource.splitAtFraction should be splitAfterFraction
Key: BEAM-217
URL: https://issues.apache.org/jira/browse/BEAM-217
Project: Beam
Issue
[
https://issues.apache.org/jira/browse/BEAM-182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Kirpichov resolved BEAM-182.
---
Resolution: Fixed
> SourceTestUtils.assertSplitAtFractionExhaustive should do a bounded number
[
https://issues.apache.org/jira/browse/BEAM-182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230963#comment-15230963
]
Eugene Kirpichov commented on BEAM-182:
---
https://github.com/apache/incubator-beam/pull/144
>
[
https://issues.apache.org/jira/browse/BEAM-167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Kirpichov updated BEAM-167:
--
Component/s: sdk-java-core
> TextIO can't read concatenated gzip files
>
[
https://issues.apache.org/jira/browse/BEAM-167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15224834#comment-15224834
]
Eugene Kirpichov commented on BEAM-167:
---
Here's a test and a patch
Eugene Kirpichov created BEAM-167:
-
Summary: TextIO can't read concatenated gzip files
Key: BEAM-167
URL: https://issues.apache.org/jira/browse/BEAM-167
Project: Beam
Issue Type: Bug
[
https://issues.apache.org/jira/browse/BEAM-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15221972#comment-15221972
]
Eugene Kirpichov commented on BEAM-47:
--
Is this a dupe of BEAM-65?
> UnboundedSource should support
[
https://issues.apache.org/jira/browse/BEAM-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220089#comment-15220089
]
Eugene Kirpichov commented on BEAM-68:
--
I re-duped BEAM-169 against BEAM-92.
- I agree that it won't
[
https://issues.apache.org/jira/browse/BEAM-159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Kirpichov reopened BEAM-159:
---
Reopening to dupe against BEAM-92 instead, per discussion in BEAM-68.
> Support fixed number of
[
https://issues.apache.org/jira/browse/BEAM-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219126#comment-15219126
]
Eugene Kirpichov commented on BEAM-68:
--
I think the two use cases are quite different and need different
Eugene Kirpichov created BEAM-159:
-
Summary: Support fixed number of shards in custom sinks
Key: BEAM-159
URL: https://issues.apache.org/jira/browse/BEAM-159
Project: Beam
Issue Type:
[
https://issues.apache.org/jira/browse/BEAM-92?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15178147#comment-15178147
]
Eugene Kirpichov commented on BEAM-92:
--
Note: it's not obvious how this API generalizes to streaming
Eugene Kirpichov created BEAM-92:
Summary: Data-dependent sinks
Key: BEAM-92
URL: https://issues.apache.org/jira/browse/BEAM-92
Project: Beam
Issue Type: New Feature
Reporter:
Eugene Kirpichov created BEAM-88:
Summary: DataflowPipelineOptions.tempLocation doesn't really
default to stagingLocation
Key: BEAM-88
URL: https://issues.apache.org/jira/browse/BEAM-88
Project: Beam
64 matches
Mail list logo
