David Moravek created BEAM-8850:
---
Summary: Flink: Batch translation context respects provided
PTransform during Input / Output lookups.
Key: BEAM-8850
URL: https://issues.apache.org/jira/browse/BEAM-8850
David Moravek created BEAM-8849:
---
Summary: Flink: Support multiple translation or a single URN in
batch runner.
Key: BEAM-8849
URL: https://issues.apache.org/jira/browse/BEAM-8849
Project: Beam
David Moravek created BEAM-8848:
---
Summary: Flink: Memory efficient GBK implementation for batch
runner
Key: BEAM-8848
URL: https://issues.apache.org/jira/browse/BEAM-8848
Project: Beam
Issue T
[
https://issues.apache.org/jira/browse/BEAM-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek updated BEAM-8577:
Fix Version/s: (was: 2.17.0)
> FileSystems may have not be initialized during ResourceId deseria
[
https://issues.apache.org/jira/browse/BEAM-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976838#comment-16976838
]
David Moravek commented on BEAM-8577:
-
This is broken in previous versions as well. Re
David Moravek created BEAM-8648:
---
Summary: Euphoria: Deprecate OutputHints from public API
Key: BEAM-8648
URL: https://issues.apache.org/jira/browse/BEAM-8648
Project: Beam
Issue Type: Improvem
[
https://issues.apache.org/jira/browse/BEAM-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971687#comment-16971687
]
David Moravek commented on BEAM-8608:
-
Needed for optimal finishBundle implementation.
[
https://issues.apache.org/jira/browse/BEAM-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek updated BEAM-8608:
Description:
Right now, in Batch runner, DoFn is executed using MapPartition operator
(_FlinkDoFnFu
[
https://issues.apache.org/jira/browse/BEAM-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek updated BEAM-8608:
Attachment: Screen Shot 2019-11-07 at 10.35.22.png
> Chain DoFns in Flink batch runner when possible
[
https://issues.apache.org/jira/browse/BEAM-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek updated BEAM-8608:
Attachment: Screen Shot 2019-11-07 at 10.35.07.png
> Chain DoFns in Flink batch runner when possible
David Moravek created BEAM-8608:
---
Summary: Chain DoFns in Flink batch runner when possible.
Key: BEAM-8608
URL: https://issues.apache.org/jira/browse/BEAM-8608
Project: Beam
Issue Type: Improve
[
https://issues.apache.org/jira/browse/BEAM-8568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek updated BEAM-8568:
Status: Open (was: Triage Needed)
> Local file system does not match relative path with wildcards
>
David Moravek created BEAM-8577:
---
Summary: FileSystems may have not be initialized during ResourceId
deserialization
Key: BEAM-8577
URL: https://issues.apache.org/jira/browse/BEAM-8577
Project: Beam
[
https://issues.apache.org/jira/browse/BEAM-8568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek updated BEAM-8568:
Fix Version/s: 2.17.0
Affects Version/s: 2.16.0
Description:
CWD structure:
{code}
[
https://issues.apache.org/jira/browse/BEAM-8568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16969012#comment-16969012
]
David Moravek edited comment on BEAM-8568 at 11/7/19 7:52 AM:
--
[
https://issues.apache.org/jira/browse/BEAM-8568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16969012#comment-16969012
]
David Moravek commented on BEAM-8568:
-
LocalFileSystem no longer support wildcard rela
[
https://issues.apache.org/jira/browse/BEAM-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek reassigned BEAM-7962:
---
Assignee: Maximilian Michels (was: David Moravek)
> Drop support for Flink 1.5 and 1.6
> ---
[
https://issues.apache.org/jira/browse/BEAM-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926428#comment-16926428
]
David Moravek commented on BEAM-7962:
-
[~mxm] awesome, if you already have the PR read
[
https://issues.apache.org/jira/browse/BEAM-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek reassigned BEAM-7962:
---
Assignee: David Moravek (was: Maximilian Michels)
> Drop support for Flink 1.5 and 1.6
> ---
[
https://issues.apache.org/jira/browse/BEAM-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek updated BEAM-8025:
Affects Version/s: 2.16.0
Priority: Blocker (was: Major)
> Cassandra IO classMethod te
[
https://issues.apache.org/jira/browse/BEAM-7730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900109#comment-16900109
]
David Moravek commented on BEAM-7730:
-
I've managed to solve the serialization issues.
[
https://issues.apache.org/jira/browse/BEAM-7730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16897895#comment-16897895
]
David Moravek commented on BEAM-7730:
-
Successfully tested 1.9 runner with an internal
[
https://issues.apache.org/jira/browse/BEAM-6883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek resolved BEAM-6883.
-
Resolution: Fixed
Fix Version/s: 2.15.0
> StreamingSourceMetricsTest takes too long to fini
[
https://issues.apache.org/jira/browse/BEAM-7730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890219#comment-16890219
]
David Moravek commented on BEAM-7730:
-
Current progress: https://github.com/dmvk/beam/
[
https://issues.apache.org/jira/browse/BEAM-7730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890181#comment-16890181
]
David Moravek commented on BEAM-7730:
-
Already did some work on this as we need to sta
[
https://issues.apache.org/jira/browse/BEAM-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek updated BEAM-7613:
Summary: HadoopFileSystem can be only used with fs.defaultFS (was:
HdfsFileSystem can be only used
David Moravek created BEAM-7613:
---
Summary: HdfsFileSystem can be only used with fs.defaultFS
Key: BEAM-7613
URL: https://issues.apache.org/jira/browse/BEAM-7613
Project: Beam
Issue Type: Bug
[
https://issues.apache.org/jira/browse/BEAM-7543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek resolved BEAM-7543.
-
Resolution: Fixed
Fix Version/s: 2.14.0
> ReduceByKey.combineBy must accept BinaryFunction
David Moravek created BEAM-7591:
---
Summary: Unify FileSystems tests across implementation
Key: BEAM-7591
URL: https://issues.apache.org/jira/browse/BEAM-7591
Project: Beam
Issue Type: Improvemen
[
https://issues.apache.org/jira/browse/BEAM-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866353#comment-16866353
]
David Moravek commented on BEAM-7561:
-
at the conference, but I’ll do my best to finis
David Moravek created BEAM-7561:
---
Summary: HdfsFileSystem is unable to match a directory
Key: BEAM-7561
URL: https://issues.apache.org/jira/browse/BEAM-7561
Project: Beam
Issue Type: Bug
David Moravek created BEAM-6895:
---
Summary: Upgrade joda-time to 2.10.1
Key: BEAM-6895
URL: https://issues.apache.org/jira/browse/BEAM-6895
Project: Beam
Issue Type: Improvement
Compon
[
https://issues.apache.org/jira/browse/BEAM-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek resolved BEAM-6812.
-
Resolution: Fixed
Fix Version/s: 2.12.0
> Convert keys to ByteArray in Combine.perKey for S
[
https://issues.apache.org/jira/browse/BEAM-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek resolved BEAM-6774.
-
Resolution: Fixed
Fix Version/s: 2.12.0
> Euphoria - replace Distinct.mapped with Distinct.
[
https://issues.apache.org/jira/browse/BEAM-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek reassigned BEAM-6774:
---
Assignee: Jan Lukavsky (was: Vaclav Plajt)
> Euphoria - replace Distinct.mapped with Distinc
[
https://issues.apache.org/jira/browse/BEAM-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek updated BEAM-6589:
Affects Version/s: 2.10.0
> SDKs::Java::Extensions::Kryo is incorrectly shaded
> ---
[
https://issues.apache.org/jira/browse/BEAM-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek resolved BEAM-6589.
-
Resolution: Fixed
> SDKs::Java::Extensions::Kryo is incorrectly shaded
> -
[
https://issues.apache.org/jira/browse/BEAM-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769083#comment-16769083
]
David Moravek commented on BEAM-6589:
-
yes, closing
> SDKs::Java::Extensions::Kryo is
[
https://issues.apache.org/jira/browse/BEAM-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek resolved BEAM-3900.
-
Resolution: Fixed
Fix Version/s: 2.9.0
> Introduce Euphoria Java 8 DSL
> --
David Moravek created BEAM-6214:
---
Summary: Spark: CombineByKey performance
Key: BEAM-6214
URL: https://issues.apache.org/jira/browse/BEAM-6214
Project: Beam
Issue Type: Improvement
Co
[
https://issues.apache.org/jira/browse/BEAM-6174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek resolved BEAM-6174.
-
Resolution: Fixed
> Remove unnecesarry Kryo dependecny from euphoria
> ---
[
https://issues.apache.org/jira/browse/BEAM-6174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek updated BEAM-6174:
Fix Version/s: 2.10.0
> Remove unnecesarry Kryo dependecny from euphoria
> -
[
https://issues.apache.org/jira/browse/BEAM-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek updated BEAM-6062:
Affects Version/s: 2.8.0
Fix Version/s: 2.9.0
> Spark runner do not show Beam metrics in Spa
[
https://issues.apache.org/jira/browse/BEAM-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek updated BEAM-6062:
Summary: Spark runner does not show Beam metrics in web UI (was: Spark
runner do not show Beam metr
[
https://issues.apache.org/jira/browse/BEAM-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek resolved BEAM-6062.
-
Resolution: Fixed
> Spark runner do not show Beam metrics in Spark Web Interface
> ---
[
https://issues.apache.org/jira/browse/BEAM-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek updated BEAM-5857:
Affects Version/s: 2.8.0
> Unnecessary submission of a new job in Combine.globally
> ---
[
https://issues.apache.org/jira/browse/BEAM-5987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek updated BEAM-5987:
Description:
We did some profiling of a spark job and 90% of the application time was spent
on side
[
https://issues.apache.org/jira/browse/BEAM-5987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek updated BEAM-5987:
Description:
We did some profiling of a spark job and 90% of the application time was spent
on side
[
https://issues.apache.org/jira/browse/BEAM-5987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Moravek updated BEAM-5987:
Attachment: Screen Shot 2018-11-06 at 13.05.36.png
> Spark SideInputReader performance
> ---
David Moravek created BEAM-5987:
---
Summary: Spark SideInputReader performance
Key: BEAM-5987
URL: https://issues.apache.org/jira/browse/BEAM-5987
Project: Beam
Issue Type: Bug
Componen
David Moravek created BEAM-5790:
---
Summary: Euphoria: Remove Dataset abstraction
Key: BEAM-5790
URL: https://issues.apache.org/jira/browse/BEAM-5790
Project: Beam
Issue Type: Sub-task
51 matches
Mail list logo