Siyuan Hua created APEXMALHAR-2363:
--
Summary: Kafka input operator needs a force exit in case it can't
recover from application offsets
Key: APEXMALHAR-2363
URL:
[
https://issues.apache.org/jira/browse/APEXMALHAR-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15682657#comment-15682657
]
Siyuan Hua commented on APEXMALHAR-2301:
Ok, there are couple things here, the current
[
https://issues.apache.org/jira/browse/APEXMALHAR-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2203:
---
Summary: Control tuple port and watermark support in high-level API
(version 1) (was:
[
https://issues.apache.org/jira/browse/APEXMALHAR-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592494#comment-15592494
]
Siyuan Hua commented on APEXMALHAR-2203:
Support _single_ control tuple port
Support both
Siyuan Hua created APEXMALHAR-2301:
--
Summary: Implement another TimeBucketAssigner to work with any time
Key: APEXMALHAR-2301
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2301
Project:
[
https://issues.apache.org/jira/browse/APEXMALHAR-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573091#comment-15573091
]
Siyuan Hua commented on APEXMALHAR-2220:
[~d9liang] The malhar-library should be depends on
[
https://issues.apache.org/jira/browse/APEXMALHAR-2283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569248#comment-15569248
]
Siyuan Hua commented on APEXMALHAR-2283:
There are couple of solutions to "exactly-once". To
[
https://issues.apache.org/jira/browse/APEXMALHAR-2283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2283:
---
Assignee: Siyuan Hua
> Refactor kafka output operator
> --
>
[
https://issues.apache.org/jira/browse/APEXMALHAR-2283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2283:
---
Description:
The abstract kafka output operator needs to be refactored
1. Needs to set
[
https://issues.apache.org/jira/browse/APEXMALHAR-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546598#comment-15546598
]
Siyuan Hua commented on APEXMALHAR-2276:
Time will be mapped to a time bucket anyways,
[
https://issues.apache.org/jira/browse/APEXMALHAR-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543057#comment-15543057
]
Siyuan Hua commented on APEXMALHAR-2220:
Sorry, I mean org.apache.apex.malhar.lib.function
[
https://issues.apache.org/jira/browse/APEXMALHAR-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15542972#comment-15542972
]
Siyuan Hua commented on APEXMALHAR-2220:
Maybe call them com.datatorrent.lib.function?
>
Siyuan Hua created APEXMALHAR-2275:
--
Summary: ManagedTimeUnifiedStateImpl doesn't support time events
properly
Key: APEXMALHAR-2275
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2275
Siyuan Hua created APEXMALHAR-2276:
--
Summary: ManagedTimeUnifiedStateImpl doesn't support time events
properly
Key: APEXMALHAR-2276
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2276
[
https://issues.apache.org/jira/browse/APEXMALHAR-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua resolved APEXMALHAR-2267.
Resolution: Fixed
> Remove the word "Byte" in the spillable data structures because
[
https://issues.apache.org/jira/browse/APEXMALHAR-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua resolved APEXMALHAR-2130.
Resolution: Fixed
> Scalable windowed storage
> -
>
>
[
https://issues.apache.org/jira/browse/APEXMALHAR-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua reopened APEXMALHAR-2130:
> Scalable windowed storage
> -
>
> Key:
[
https://issues.apache.org/jira/browse/APEXMALHAR-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2130:
---
Fix Version/s: 3.6.0
> Scalable windowed storage
> -
>
>
[
https://issues.apache.org/jira/browse/APEXMALHAR-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15526808#comment-15526808
]
Siyuan Hua commented on APEXMALHAR-2230:
Another test failure that could be useful to
[
https://issues.apache.org/jira/browse/APEXMALHAR-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua resolved APEXMALHAR-2248.
Resolution: Fixed
> Create SpillableSet and SpillableSetMultimap interfaces and
[
https://issues.apache.org/jira/browse/APEXMALHAR-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2248:
---
Fix Version/s: 3.6.0
> Create SpillableSet and SpillableSetMultimap interfaces and
[
https://issues.apache.org/jira/browse/APEXMALHAR-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513770#comment-15513770
]
Siyuan Hua commented on APEXMALHAR-2244:
Each spillable DS implementation use a
[
https://issues.apache.org/jira/browse/APEXMALHAR-2253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2253:
---
Assignee: David Yan
> Iterator for spillable data structure should throw
>
Siyuan Hua created APEXMALHAR-2253:
--
Summary: Iterator for spillable data structure should throw
ConcurrentModificationException during the iteration
Key: APEXMALHAR-2253
URL:
[
https://issues.apache.org/jira/browse/APEXMALHAR-2241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15496632#comment-15496632
]
Siyuan Hua commented on APEXMALHAR-2241:
Hey [~Venkatesh Kottapalli] Would you like to fix
Siyuan Hua created APEXMALHAR-2241:
--
Summary: The metadata kafka consumer should also pickup the
properties setting on the kafka input operator.
Key: APEXMALHAR-2241
URL:
[
https://issues.apache.org/jira/browse/APEXMALHAR-2241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2241:
---
Assignee: Venkatesh Kottapalli
> The metadata kafka consumer should also pickup the
[
https://issues.apache.org/jira/browse/APEXMALHAR-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491639#comment-15491639
]
Siyuan Hua commented on APEXMALHAR-2230:
Good news is this time we can be sure this is the
[
https://issues.apache.org/jira/browse/APEXMALHAR-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491628#comment-15491628
]
Siyuan Hua commented on APEXMALHAR-2230:
The code looks impossible to receive extra END_TUPLE
Siyuan Hua created APEXCORE-529:
---
Summary: Support annotation to automate lifecycle callbacks like
setup() teardown() etc
Key: APEXCORE-529
URL: https://issues.apache.org/jira/browse/APEXCORE-529
[
https://issues.apache.org/jira/browse/APEXMALHAR-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15474990#comment-15474990
]
Siyuan Hua commented on APEXMALHAR-2230:
Not necessarily related to Kafka. This is caused by
[
https://issues.apache.org/jira/browse/APEXMALHAR-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua reassigned APEXMALHAR-2230:
--
Assignee: Siyuan Hua
> Intermittent test failure in Kafka module
>
[
https://issues.apache.org/jira/browse/APEXMALHAR-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468074#comment-15468074
]
Siyuan Hua commented on APEXMALHAR-2220:
[~d9liang]
The function operators are all under
[
https://issues.apache.org/jira/browse/APEXMALHAR-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2220:
---
Assignee: Dongming Liang (was: Siyuan Hua)
> Move the FunctionOperator to Malhar
Siyuan Hua created APEXMALHAR-2220:
--
Summary: Move the FunctionOperator to Malhar library
Key: APEXMALHAR-2220
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2220
Project: Apache Apex Malhar
[
https://issues.apache.org/jira/browse/APEXMALHAR-2142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2142:
---
Attachment: Java-High-level-API-Siyuan.pdf
Apache Beam AutoComplete
[
https://issues.apache.org/jira/browse/APEXMALHAR-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-1939:
---
Attachment: Java-High-level-API-Siyuan.pdf
Apache Beam AutoComplete
Siyuan Hua created APEXMALHAR-2217:
--
Summary: Remove some redundant code in WindowedStorage and
WindowedKeyedStorage
Key: APEXMALHAR-2217
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2217
[
https://issues.apache.org/jira/browse/APEXMALHAR-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2214:
---
Assignee: Siyuan Hua
> Use tuple internally so it can carry over the window semantics
>
Siyuan Hua created APEXMALHAR-2214:
--
Summary: Use tuple internally so it can carry over the window
semantics
Key: APEXMALHAR-2214
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2214
Project:
Siyuan Hua created APEXMALHAR-2213:
--
Summary: Refactor Stream API to make it easier to specify keys for
keyed transformation
Key: APEXMALHAR-2213
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2213
Siyuan Hua created APEXMALHAR-2212:
--
Summary: Tuple codec to make application build by High-level api
more efficient
Key: APEXMALHAR-2212
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2212
[
https://issues.apache.org/jira/browse/APEXMALHAR-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua closed APEXMALHAR-2134.
--
Resolution: Fixed
> Catch NullPointerException if some Kafka partition has no leader
Siyuan Hua created APEXMALHAR-2208:
--
Summary: High-level API beam examples
Key: APEXMALHAR-2208
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2208
Project: Apache Apex Malhar
Issue
[
https://issues.apache.org/jira/browse/APEXMALHAR-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua closed APEXMALHAR-2208.
--
Resolution: Fixed
> High-level API beam examples
>
>
>
[
https://issues.apache.org/jira/browse/APEXMALHAR-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2199:
---
Affects Version/s: (was: 3.4.0)
> 0.8 kafka input operator doesn't support chroot
[
https://issues.apache.org/jira/browse/APEXMALHAR-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2199:
---
Assignee: Siyuan Hua (was: Chaitanya)
> 0.8 kafka input operator doesn't support chroot
[
https://issues.apache.org/jira/browse/APEXMALHAR-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15437102#comment-15437102
]
Siyuan Hua commented on APEXMALHAR-2154:
I don't think so
> Update kafka 0.9 input
[
https://issues.apache.org/jira/browse/APEXMALHAR-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435402#comment-15435402
]
Siyuan Hua commented on APEXMALHAR-2199:
0.9 operator should not have this problem
> 0.8
[
https://issues.apache.org/jira/browse/APEXMALHAR-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435399#comment-15435399
]
Siyuan Hua commented on APEXMALHAR-2199:
[~chaithu] Can you please take a look? The bug is in
[
https://issues.apache.org/jira/browse/APEXMALHAR-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2199:
---
Affects Version/s: 3.5.0
3.4.0
> 0.8 kafka input operator doesn't
Siyuan Hua created APEXMALHAR-2199:
--
Summary: 0.8 kafka input operator doesn't support chroot zookeeper
path (multitenant kafka support)
Key: APEXMALHAR-2199
URL:
[
https://issues.apache.org/jira/browse/APEXMALHAR-2180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2180:
---
Fix Version/s: 3.5.0
> KafkaInput Operator partitions has to be unchanged in case of
[
https://issues.apache.org/jira/browse/APEXMALHAR-2180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua resolved APEXMALHAR-2180.
Resolution: Fixed
> KafkaInput Operator partitions has to be unchanged in case of
[
https://issues.apache.org/jira/browse/APEXMALHAR-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua resolved APEXMALHAR-2169.
Resolution: Fixed
> KafkaInputoperator: Remove the stuff related to Partition Based on
[
https://issues.apache.org/jira/browse/APEXMALHAR-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2169:
---
Fix Version/s: 3.5.0
> KafkaInputoperator: Remove the stuff related to Partition Based
[
https://issues.apache.org/jira/browse/APEXMALHAR-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2154:
---
Fix Version/s: 3.5.0
> Update kafka 0.9 input operator to use new
[
https://issues.apache.org/jira/browse/APEXMALHAR-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua resolved APEXMALHAR-2154.
Resolution: Fixed
> Update kafka 0.9 input operator to use new
[
https://issues.apache.org/jira/browse/APEXMALHAR-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2168:
---
Summary: The setter method for double field is not generated correctly in
[
https://issues.apache.org/jira/browse/APEXMALHAR-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2168:
---
Summary: The in JdbcPOJOInputOperator. (was: Bug Found in
JdbcPOJOInputOperator.)
>
[
https://issues.apache.org/jira/browse/APEXMALHAR-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2154:
---
Fix Version/s: (was: 3.5.0)
> Update kafka 0.9 input operator to use new
[
https://issues.apache.org/jira/browse/APEXMALHAR-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2154:
---
Assignee: Chaitanya (was: Siyuan Hua)
> Update kafka 0.9 input operator to use new
Siyuan Hua created APEXMALHAR-2186:
--
Summary: Configurable start offset for kafka input operator (0.9)
Key: APEXMALHAR-2186
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2186
Project: Apache
[
https://issues.apache.org/jira/browse/APEXMALHAR-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2186:
---
Issue Type: Improvement (was: Bug)
> Configurable start offset for kafka input operator
[
https://issues.apache.org/jira/browse/APEXMALHAR-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2168:
---
Fix Version/s: 3.5.0
> Bug Found in JdbcPOJOInputOperator.
>
[
https://issues.apache.org/jira/browse/APEXMALHAR-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415943#comment-15415943
]
Siyuan Hua commented on APEXMALHAR-2028:
For high-level API as well
> Add System.err to
[
https://issues.apache.org/jira/browse/APEXMALHAR-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411388#comment-15411388
]
Siyuan Hua commented on APEXMALHAR-2169:
[~chaithu]
Then I think the problem is in
[
https://issues.apache.org/jira/browse/APEXMALHAR-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1546#comment-1546
]
Siyuan Hua commented on APEXMALHAR-2169:
[~chaithu]
I'm still not convinced. In your setup
[
https://issues.apache.org/jira/browse/APEXMALHAR-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396353#comment-15396353
]
Siyuan Hua commented on APEXMALHAR-2169:
[~chaithu]
Can you elaborate more on this ticket?
[
https://issues.apache.org/jira/browse/APEXMALHAR-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15394635#comment-15394635
]
Siyuan Hua commented on APEXMALHAR-2168:
Hey [~shubhamp],
[~lushun...@gmail.com] found a bug
Siyuan Hua created APEXMALHAR-2165:
--
Summary: Implement a useful default Partitioner and/or Unifier for
Keyed Windowed Operator
Key: APEXMALHAR-2165
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2165
[
https://issues.apache.org/jira/browse/APEXMALHAR-2135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2135:
---
Fix Version/s: 3.5.0
> Upgrade Kafka 0.8 input operator to support 0.8.2 client
>
Siyuan Hua created APEXCORE-492:
---
Summary: The exception from ExitCondition should not be swallowed
Key: APEXCORE-492
URL: https://issues.apache.org/jira/browse/APEXCORE-492
Project: Apache Apex Core
Siyuan Hua created APEXMALHAR-2154:
--
Summary: Update kafka 0.9 input operator to use new
CheckpointNotificationListener
Key: APEXMALHAR-2154
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2154
Siyuan Hua created APEXMALHAR-2155:
--
Summary: Make high-level api support multiple ports
Key: APEXMALHAR-2155
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2155
Project: Apache Apex Malhar
[
https://issues.apache.org/jira/browse/APEXMALHAR-2149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2149:
---
Assignee: Shunxin Lu
> ApexStream.filter() not working properly.
>
Siyuan Hua created APEXMALHAR-2148:
--
Summary: Reduce the noise of kafka input operator
Key: APEXMALHAR-2148
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2148
Project: Apache Apex Malhar
[
https://issues.apache.org/jira/browse/APEXMALHAR-2142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373783#comment-15373783
]
Siyuan Hua commented on APEXMALHAR-2142:
https://github.com/apache/apex-malhar/pull/339
>
[
https://issues.apache.org/jira/browse/APEXMALHAR-2142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373760#comment-15373760
]
Siyuan Hua commented on APEXMALHAR-2142:
Basically use windowed operator to do windowed
Siyuan Hua created APEXMALHAR-2142:
--
Summary: High-level API window support
Key: APEXMALHAR-2142
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2142
Project: Apache Apex Malhar
Issue
[
https://issues.apache.org/jira/browse/APEXMALHAR-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373694#comment-15373694
]
Siyuan Hua commented on APEXMALHAR-2141:
A stateless accumulation vs stateful accumulation.
Siyuan Hua created APEXMALHAR-2141:
--
Summary: An efficient Accumulation interface for primitive type
Key: APEXMALHAR-2141
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2141
Project: Apache
Siyuan Hua created APEXMALHAR-2135:
--
Summary: Upgrade Kafka 0.8 input operator to support both 0.8.1
and 0.8.2
Key: APEXMALHAR-2135
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2135
Siyuan Hua created APEXMALHAR-2132:
--
Summary: Rename Manifest attributes from DT-App- to
Apex-App-
Key: APEXMALHAR-2132
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2132
Project:
[
https://issues.apache.org/jira/browse/APEXMALHAR-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua closed APEXMALHAR-2131.
--
Resolution: Won't Fix
Sorry wrong project name
> Change the default container log name
Siyuan Hua created APEXMALHAR-2131:
--
Summary: Change the default container log name from dt.log to
apex.log
Key: APEXMALHAR-2131
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2131
Project:
[
https://issues.apache.org/jira/browse/APEXMALHAR-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15359194#comment-15359194
]
Siyuan Hua commented on APEXMALHAR-2086:
[~thomas.we...@googlemail.com]
API difference
There
[
https://issues.apache.org/jira/browse/APEXMALHAR-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312609#comment-15312609
]
Siyuan Hua commented on APEXMALHAR-2099:
[~ilganeli] Thanks for bring this up, I should have
88 matches
Mail list logo
