[jira] [Assigned] (STORM-1871) Storm Alluxio integrate
[ https://issues.apache.org/jira/browse/STORM-1871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet reassigned STORM-1871: Assignee: darion yaphet > Storm Alluxio integrate > --- > > Key: STORM-1871 > URL: https://issues.apache.org/jira/browse/STORM-1871 > Project: Apache Storm > Issue Type: New Feature >Affects Versions: 1.0.0, 1.0.1 >Reporter: darion yaphet >Assignee: darion yaphet > > [alluxio|http://alluxio.org/] is a memory speed virtual distributed storage > system.Alluxio’s memory-centric architecture enables data access orders of > magnitude faster than existing solutions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-2013) Upgrade Netty to 3.10.6
darion yaphet created STORM-2013: Summary: Upgrade Netty to 3.10.6 Key: STORM-2013 URL: https://issues.apache.org/jira/browse/STORM-2013 Project: Apache Storm Issue Type: Improvement Reporter: darion yaphet Assignee: darion yaphet Since Netty 3.9 , it have fix some bugs and improve performance . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (STORM-2003) Make sure config contains TOPIC before get it
[ https://issues.apache.org/jira/browse/STORM-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated STORM-2003: - Description: When topic selector is not specified, KafkaBolt will get topic name from storm config . We should make sure the topic name is not null . (was: When topic selector is not specified, KafkaSpout will get topic name from storm config . We should make sure the topic name is not null .) > Make sure config contains TOPIC before get it > - > > Key: STORM-2003 > URL: https://issues.apache.org/jira/browse/STORM-2003 > Project: Apache Storm > Issue Type: Improvement > Components: storm-kafka >Affects Versions: 0.10.0, 1.0.0 >Reporter: darion yaphet >Assignee: darion yaphet > > When topic selector is not specified, KafkaBolt will get topic name from > storm config . We should make sure the topic name is not null . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-2003) Make sure config contains TOPIC before get it
darion yaphet created STORM-2003: Summary: Make sure config contains TOPIC before get it Key: STORM-2003 URL: https://issues.apache.org/jira/browse/STORM-2003 Project: Apache Storm Issue Type: Improvement Components: storm-kafka Affects Versions: 0.10.0, 1.0.0 Reporter: darion yaphet Assignee: darion yaphet When topic selector is not specified, KafkaSpout will get topic name from storm config . We should make sure the topic name is not null . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (STORM-2002) KafkaSpout data type error
[ https://issues.apache.org/jira/browse/STORM-2002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet closed STORM-2002. Resolution: Won't Fix > KafkaSpout data type error > --- > > Key: STORM-2002 > URL: https://issues.apache.org/jira/browse/STORM-2002 > Project: Apache Storm > Issue Type: Bug > Components: storm-kafka >Reporter: darion yaphet >Assignee: darion yaphet > > fix data type error in KafkaSpout doSeek -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-2002) KafkaSpout data type error
darion yaphet created STORM-2002: Summary: KafkaSpout data type error Key: STORM-2002 URL: https://issues.apache.org/jira/browse/STORM-2002 Project: Apache Storm Issue Type: Bug Components: storm-kafka Reporter: darion yaphet Assignee: darion yaphet fix data type error in KafkaSpout doSeek -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (STORM-1991) Support auto.commit.interval in Kafka Client
[ https://issues.apache.org/jira/browse/STORM-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated STORM-1991: - Description: Support auto.commit.interval in Kafka Client > Support auto.commit.interval in Kafka Client > > > Key: STORM-1991 > URL: https://issues.apache.org/jira/browse/STORM-1991 > Project: Apache Storm > Issue Type: Improvement > Components: storm-kafka >Affects Versions: 1.0.0 >Reporter: darion yaphet >Assignee: darion yaphet > > Support auto.commit.interval in Kafka Client -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-2001) New Kafka Spout Consume Max Records
darion yaphet created STORM-2001: Summary: New Kafka Spout Consume Max Records Key: STORM-2001 URL: https://issues.apache.org/jira/browse/STORM-2001 Project: Apache Storm Issue Type: New Feature Components: storm-kafka Affects Versions: 1.0.0, 1.0.1 Reporter: darion yaphet Assignee: darion yaphet Kafka 0.10 have add a new parameter (max.poll.records) that use to control the number of messages returned in a single call to poll(). It's useful to control topology QPS . [Implement max.poll.records for new consumer (KIP-41)|https://issues.apache.org/jira/browse/KAFKA-3007] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1997) Support Kafka Bolt in Storm Kafka Client
darion yaphet created STORM-1997: Summary: Support Kafka Bolt in Storm Kafka Client Key: STORM-1997 URL: https://issues.apache.org/jira/browse/STORM-1997 Project: Apache Storm Issue Type: Bug Components: storm-kafka Affects Versions: 1.0.0 Reporter: darion yaphet Assignee: darion yaphet Support KafkaBolt in storm-kafka-client -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1996) Supplement Kafka Test Case
darion yaphet created STORM-1996: Summary: Supplement Kafka Test Case Key: STORM-1996 URL: https://issues.apache.org/jira/browse/STORM-1996 Project: Apache Storm Issue Type: Bug Components: storm-kafka Affects Versions: 1.0.0, 1.0.1 Reporter: darion yaphet Assignee: darion yaphet Storm Kafka Client's test package seems not a test case . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1991) Support auto.commit.interval in Kafka Client
darion yaphet created STORM-1991: Summary: Support auto.commit.interval in Kafka Client Key: STORM-1991 URL: https://issues.apache.org/jira/browse/STORM-1991 Project: Apache Storm Issue Type: Improvement Components: storm-kafka Affects Versions: 1.0.0 Reporter: darion yaphet Assignee: darion yaphet -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1990) Make some constant unvisible
darion yaphet created STORM-1990: Summary: Make some constant unvisible Key: STORM-1990 URL: https://issues.apache.org/jira/browse/STORM-1990 Project: Apache Storm Issue Type: Improvement Components: storm-kafka Affects Versions: 0.10.0, 1.0.0 Reporter: darion yaphet Assignee: darion yaphet Priority: Minor Some constant used as default config , make them private and unvisible . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1975) Support default value for KafkaBolt
darion yaphet created STORM-1975: Summary: Support default value for KafkaBolt Key: STORM-1975 URL: https://issues.apache.org/jira/browse/STORM-1975 Project: Apache Storm Issue Type: Improvement Components: storm-kafka Affects Versions: 0.10.0, 1.0.0 Reporter: darion yaphet Assignee: darion yaphet Support acks , key and value serializer for kafka bolt -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1974) Using System.lineSeparator to replacement write a new line
darion yaphet created STORM-1974: Summary: Using System.lineSeparator to replacement write a new line Key: STORM-1974 URL: https://issues.apache.org/jira/browse/STORM-1974 Project: Apache Storm Issue Type: Improvement Components: storm-core Affects Versions: 0.10.0, 1.0.0, 1.0.1 Reporter: darion yaphet Assignee: darion yaphet Using System.lineSeparator to replacement write a new line . It will write message in once and reduce writer synchroniz . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (STORM-1971) HDFS Timed Synchronous Policy
[ https://issues.apache.org/jira/browse/STORM-1971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377109#comment-15377109 ] darion yaphet commented on STORM-1971: -- Hi , I checked default.yaml and found topology.tick.tuple.freq.secs is null . So if I don't specify this item in config the tick tuple will not send to bolts . > HDFS Timed Synchronous Policy > - > > Key: STORM-1971 > URL: https://issues.apache.org/jira/browse/STORM-1971 > Project: Apache Storm > Issue Type: Bug > Components: storm-hdfs >Affects Versions: 0.10.0, 1.0.0 >Reporter: darion yaphet >Assignee: darion yaphet > > When the data need to be wrote to HDFS is not very large in quantity . We > need a timed synchronous policy to flush cached date into HDFS periodically. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (STORM-1973) Using DefaultTopicSelector to replace StaticTopicSelector
[ https://issues.apache.org/jira/browse/STORM-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated STORM-1973: - Summary: Using DefaultTopicSelector to replace StaticTopicSelector (was: Replace StaticTopicSelector using DefaultTopicSelector) > Using DefaultTopicSelector to replace StaticTopicSelector > - > > Key: STORM-1973 > URL: https://issues.apache.org/jira/browse/STORM-1973 > Project: Apache Storm > Issue Type: Bug > Components: storm-sql >Reporter: darion yaphet >Assignee: darion yaphet > > Replace StaticTopicSelector using DefaultTopicSelector , they are the same . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1973) Replace StaticTopicSelector using DefaultTopicSelector
darion yaphet created STORM-1973: Summary: Replace StaticTopicSelector using DefaultTopicSelector Key: STORM-1973 URL: https://issues.apache.org/jira/browse/STORM-1973 Project: Apache Storm Issue Type: Bug Components: storm-sql Reporter: darion yaphet Assignee: darion yaphet Replace StaticTopicSelector using DefaultTopicSelector , they are the same . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1971) HDFS Timed Synchronous Policy
darion yaphet created STORM-1971: Summary: HDFS Timed Synchronous Policy Key: STORM-1971 URL: https://issues.apache.org/jira/browse/STORM-1971 Project: Apache Storm Issue Type: Bug Components: storm-hdfs Affects Versions: 0.10.0, 1.0.0 Reporter: darion yaphet Assignee: darion yaphet When the data need to be wrote to HDFS is not very large in quantity . We need a timed synchronous policy to flush cached date into HDFS periodically. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1963) Replace Put add with addColumn
darion yaphet created STORM-1963: Summary: Replace Put add with addColumn Key: STORM-1963 URL: https://issues.apache.org/jira/browse/STORM-1963 Project: Apache Storm Issue Type: Improvement Components: storm-hbase Affects Versions: 0.10.0, 1.0.0, 1.0.1 Reporter: darion yaphet Assignee: darion yaphet HBase Put add() have deprecated , replace add() with addColumn() -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (STORM-1943) Support loading properties from a file
[ https://issues.apache.org/jira/browse/STORM-1943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet closed STORM-1943. Resolution: Not A Problem > Support loading properties from a file > -- > > Key: STORM-1943 > URL: https://issues.apache.org/jira/browse/STORM-1943 > Project: Apache Storm > Issue Type: New Feature > Components: Flux >Affects Versions: 1.0.0, 1.0.1 >Reporter: darion yaphet >Assignee: darion yaphet > > Support load properties from a file include config's argument . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (STORM-1957) Support Storm JDBC batch insert
[ https://issues.apache.org/jira/browse/STORM-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet reopened STORM-1957: -- > Support Storm JDBC batch insert > --- > > Key: STORM-1957 > URL: https://issues.apache.org/jira/browse/STORM-1957 > Project: Apache Storm > Issue Type: New Feature > Components: storm-jdbc >Affects Versions: 0.10.0, 1.0.0, 1.0.1 >Reporter: darion yaphet >Assignee: darion yaphet > > Batch insert support execute grouped SQL a batch and submit into one call . > It can reduce the amount of communication , improving performance. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (STORM-1957) Support Storm JDBC batch insert
[ https://issues.apache.org/jira/browse/STORM-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet closed STORM-1957. Resolution: Not A Problem > Support Storm JDBC batch insert > --- > > Key: STORM-1957 > URL: https://issues.apache.org/jira/browse/STORM-1957 > Project: Apache Storm > Issue Type: New Feature > Components: storm-jdbc >Affects Versions: 0.10.0, 1.0.0, 1.0.1 >Reporter: darion yaphet >Assignee: darion yaphet > > Batch insert support execute grouped SQL a batch and submit into one call . > It can reduce the amount of communication , improving performance. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1957) Support Storm JDBC batch insert
darion yaphet created STORM-1957: Summary: Support Storm JDBC batch insert Key: STORM-1957 URL: https://issues.apache.org/jira/browse/STORM-1957 Project: Apache Storm Issue Type: New Feature Components: storm-jdbc Affects Versions: 0.10.0, 1.0.0, 1.0.1 Reporter: darion yaphet Assignee: darion yaphet Batch insert support execute grouped SQL a batch and submit into one call . It can reduce the amount of communication , improving performance. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1943) Support loading properties from a file
darion yaphet created STORM-1943: Summary: Support loading properties from a file Key: STORM-1943 URL: https://issues.apache.org/jira/browse/STORM-1943 Project: Apache Storm Issue Type: New Feature Components: Flux Affects Versions: 1.0.0, 1.0.1 Reporter: darion yaphet Assignee: darion yaphet Support load properties from a file include config's argument . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1936) Support default value for WindowedBolt
darion yaphet created STORM-1936: Summary: Support default value for WindowedBolt Key: STORM-1936 URL: https://issues.apache.org/jira/browse/STORM-1936 Project: Apache Storm Issue Type: New Feature Components: storm-core Reporter: darion yaphet Assignee: darion yaphet -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (STORM-973) Netty-Client Connection Failed
[ https://issues.apache.org/jira/browse/STORM-973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15354500#comment-15354500 ] darion yaphet commented on STORM-973: - Thanks ~~ > Netty-Client Connection Failed > -- > > Key: STORM-973 > URL: https://issues.apache.org/jira/browse/STORM-973 > Project: Apache Storm > Issue Type: Bug > Components: storm-core >Affects Versions: 0.9.4 > Environment: apache-storm-0.9.4 JDK 1.7.0_75 >Reporter: darion yaphet > > When Storm Topology startup in a distribution cluster I found netty > connection will failed and messages will be droped by client itself. > worker log info as following : > ``` > 2015-08-07T11:43:18.903+0800 b.s.m.n.StormClientErrorHandler [INFO] > Connection failed Netty-Client-storm-01 > java.io.IOException: Connection reset by peer > at sun.nio.ch.FileDispatcherImpl.read0(Native Method) ~[na:1.7.0_75] > at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) > ~[na:1.7.0_75] > at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) > ~[na:1.7.0_75] > at sun.nio.ch.IOUtil.read(IOUtil.java:192) ~[na:1.7.0_75] > at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379) > ~[na:1.7.0_75] > at > org.apache.storm.netty.channel.socket.nio.NioWorker.read(NioWorker.java:64) > [storm-core-0.9.4.jar:0.9.4] > at > org.apache.storm.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) > [storm-core-0.9.4.jar:0.9.4] > at > org.apache.storm.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318) > [storm-core-0.9.4.jar:0.9.4] > at > org.apache.storm.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) > [storm-core-0.9.4.jar:0.9.4] > at > org.apache.storm.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > [storm-core-0.9.4.jar:0.9.4] > at > org.apache.storm.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > [storm-core-0.9.4.jar:0.9.4] > at > org.apache.storm.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) > [storm-core-0.9.4.jar:0.9.4] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > [na:1.7.0_75] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > [na:1.7.0_75] > at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75] > 2015-08-07T11:43:19.426+0800 b.s.m.n.Client [INFO] connection attempt 1 to > Netty-Client-syq-storm-01.meilishuo.com/172.16.7.25:8711 scheduled to run in > 0 ms > 2015-08-07T11:43:19.427+0800 b.s.m.n.Client [ERROR] connection to > Netty-Client-storm-01 is unavailable > 2015-08-07T11:43:19.427+0800 b.s.m.n.Client [ERROR] dropping 1 message(s) > destined for Netty-Client-storm-01 > 2015-08-07T11:43:19.428+0800 b.s.m.n.Client [ERROR] connection to > Netty-Client-storm-01 is unavailable > 2015-08-07T11:43:19.428+0800 b.s.m.n.Client [ERROR] dropping 103 message(s) > destined for Netty-Client-storm-01 > 2015-08-07T11:43:19.428+0800 b.s.m.n.Client [ERROR] connection to > Netty-Client-storm-01 is unavailable > 2015-08-07T11:43:19.428+0800 b.s.m.n.Client [ERROR] dropping 35 message(s) > destined for Netty-Client-storm-01 > ``` -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (STORM-973) Netty-Client Connection Failed
[ https://issues.apache.org/jira/browse/STORM-973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet resolved STORM-973. - Resolution: Fixed > Netty-Client Connection Failed > -- > > Key: STORM-973 > URL: https://issues.apache.org/jira/browse/STORM-973 > Project: Apache Storm > Issue Type: Bug > Components: storm-core >Affects Versions: 0.9.4 > Environment: apache-storm-0.9.4 JDK 1.7.0_75 >Reporter: darion yaphet > > When Storm Topology startup in a distribution cluster I found netty > connection will failed and messages will be droped by client itself. > worker log info as following : > ``` > 2015-08-07T11:43:18.903+0800 b.s.m.n.StormClientErrorHandler [INFO] > Connection failed Netty-Client-storm-01 > java.io.IOException: Connection reset by peer > at sun.nio.ch.FileDispatcherImpl.read0(Native Method) ~[na:1.7.0_75] > at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) > ~[na:1.7.0_75] > at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) > ~[na:1.7.0_75] > at sun.nio.ch.IOUtil.read(IOUtil.java:192) ~[na:1.7.0_75] > at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379) > ~[na:1.7.0_75] > at > org.apache.storm.netty.channel.socket.nio.NioWorker.read(NioWorker.java:64) > [storm-core-0.9.4.jar:0.9.4] > at > org.apache.storm.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) > [storm-core-0.9.4.jar:0.9.4] > at > org.apache.storm.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318) > [storm-core-0.9.4.jar:0.9.4] > at > org.apache.storm.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) > [storm-core-0.9.4.jar:0.9.4] > at > org.apache.storm.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > [storm-core-0.9.4.jar:0.9.4] > at > org.apache.storm.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > [storm-core-0.9.4.jar:0.9.4] > at > org.apache.storm.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) > [storm-core-0.9.4.jar:0.9.4] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > [na:1.7.0_75] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > [na:1.7.0_75] > at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75] > 2015-08-07T11:43:19.426+0800 b.s.m.n.Client [INFO] connection attempt 1 to > Netty-Client-syq-storm-01.meilishuo.com/172.16.7.25:8711 scheduled to run in > 0 ms > 2015-08-07T11:43:19.427+0800 b.s.m.n.Client [ERROR] connection to > Netty-Client-storm-01 is unavailable > 2015-08-07T11:43:19.427+0800 b.s.m.n.Client [ERROR] dropping 1 message(s) > destined for Netty-Client-storm-01 > 2015-08-07T11:43:19.428+0800 b.s.m.n.Client [ERROR] connection to > Netty-Client-storm-01 is unavailable > 2015-08-07T11:43:19.428+0800 b.s.m.n.Client [ERROR] dropping 103 message(s) > destined for Netty-Client-storm-01 > 2015-08-07T11:43:19.428+0800 b.s.m.n.Client [ERROR] connection to > Netty-Client-storm-01 is unavailable > 2015-08-07T11:43:19.428+0800 b.s.m.n.Client [ERROR] dropping 35 message(s) > destined for Netty-Client-storm-01 > ``` -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (STORM-1932) Change Duration's value data type
[ https://issues.apache.org/jira/browse/STORM-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated STORM-1932: - Description: BaseWindowedBolt Duration value is integer now . Use long to express time interval maybe better (was: BaseWindowedBolt Duration value is integer . Use long to express time interval maybe better) > Change Duration's value data type > -- > > Key: STORM-1932 > URL: https://issues.apache.org/jira/browse/STORM-1932 > Project: Apache Storm > Issue Type: Improvement > Components: storm-core >Reporter: darion yaphet >Assignee: darion yaphet > > BaseWindowedBolt Duration value is integer now . Use long to express time > interval maybe better -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (STORM-1932) Change Duration's value data type
[ https://issues.apache.org/jira/browse/STORM-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated STORM-1932: - Description: BaseWindowedBolt Duration value is integer . Use long to express time interval maybe better (was: BaseWindowedBolt ) > Change Duration's value data type > -- > > Key: STORM-1932 > URL: https://issues.apache.org/jira/browse/STORM-1932 > Project: Apache Storm > Issue Type: Improvement > Components: storm-core >Reporter: darion yaphet >Assignee: darion yaphet > > BaseWindowedBolt Duration value is integer . Use long to express time > interval maybe better -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (STORM-1932) Change Duration's value data type
[ https://issues.apache.org/jira/browse/STORM-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated STORM-1932: - Description: BaseWindowedBolt > Change Duration's value data type > -- > > Key: STORM-1932 > URL: https://issues.apache.org/jira/browse/STORM-1932 > Project: Apache Storm > Issue Type: Improvement > Components: storm-core >Reporter: darion yaphet >Assignee: darion yaphet > > BaseWindowedBolt -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1932) Change Duration's value data type
darion yaphet created STORM-1932: Summary: Change Duration's value data type Key: STORM-1932 URL: https://issues.apache.org/jira/browse/STORM-1932 Project: Apache Storm Issue Type: Improvement Components: storm-core Reporter: darion yaphet Assignee: darion yaphet -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1931) Share mapper and selector in Storm-Kafka
darion yaphet created STORM-1931: Summary: Share mapper and selector in Storm-Kafka Key: STORM-1931 URL: https://issues.apache.org/jira/browse/STORM-1931 Project: Apache Storm Issue Type: Improvement Components: storm-kafka Affects Versions: 1.0.0, 1.0.1 Reporter: darion yaphet Assignee: darion yaphet Storm Kafka's mapper and selector and Storm Kafka trident's mapper and selector are the same . I try to merge them into one . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (STORM-1311) port backtype.storm.ui.core to java
[ https://issues.apache.org/jira/browse/STORM-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350081#comment-15350081 ] darion yaphet commented on STORM-1311: -- HI [~jark] Do you have plan to port Jetty Server and RESTful Interface into java ? > port backtype.storm.ui.core to java > --- > > Key: STORM-1311 > URL: https://issues.apache.org/jira/browse/STORM-1311 > Project: Apache Storm > Issue Type: New Feature > Components: storm-core >Reporter: Robert Joseph Evans >Assignee: Jark Wu > Labels: java-migration, jstorm-merger > > User Interface + REST -> java -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Comment Edited] (STORM-1770) Pluggable status storage in storm-Kafka
[ https://issues.apache.org/jira/browse/STORM-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15348121#comment-15348121 ] darion yaphet edited comment on STORM-1770 at 6/24/16 10:42 AM: I found HdfsSpout how to keep it's position . BTW maybe all kinds of spout need offset manager to store it status . was (Author: darion): Current HdfsSpout seems couldn't keep the position . BTW maybe all kinds of spout need offset manager to store it status . > Pluggable status storage in storm-Kafka > --- > > Key: STORM-1770 > URL: https://issues.apache.org/jira/browse/STORM-1770 > Project: Apache Storm > Issue Type: Improvement > Components: storm-kafka >Affects Versions: 0.10.0, 1.0.0, 0.9.6 >Reporter: darion yaphet >Assignee: darion yaphet > > Storm-Kafka spout store consumer offset in zookeeper . When a lot topology > running in cluster , zookeeper snapshot frequently . This ticket is to make > status storage pluggable , support store in zookeeper (default) and Redis . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Comment Edited] (STORM-1770) Pluggable status storage in storm-Kafka
[ https://issues.apache.org/jira/browse/STORM-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15348121#comment-15348121 ] darion yaphet edited comment on STORM-1770 at 6/24/16 10:41 AM: Current HdfsSpout seems couldn't keep the position . BTW maybe all kinds of spout need offset manager to store it status . was (Author: darion): CUrrent HdfsSpout seems couldn't keep the position . BTW maybe all kinds of spout need offset manager to store it status . > Pluggable status storage in storm-Kafka > --- > > Key: STORM-1770 > URL: https://issues.apache.org/jira/browse/STORM-1770 > Project: Apache Storm > Issue Type: Improvement > Components: storm-kafka >Affects Versions: 0.10.0, 1.0.0, 0.9.6 >Reporter: darion yaphet >Assignee: darion yaphet > > Storm-Kafka spout store consumer offset in zookeeper . When a lot topology > running in cluster , zookeeper snapshot frequently . This ticket is to make > status storage pluggable , support store in zookeeper (default) and Redis . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (STORM-1770) Pluggable status storage in storm-Kafka
[ https://issues.apache.org/jira/browse/STORM-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15348121#comment-15348121 ] darion yaphet commented on STORM-1770: -- CUrrent HdfsSpout seems couldn't keep the position . BTW maybe all kinds of spout need offset manager to store it status . > Pluggable status storage in storm-Kafka > --- > > Key: STORM-1770 > URL: https://issues.apache.org/jira/browse/STORM-1770 > Project: Apache Storm > Issue Type: Improvement > Components: storm-kafka >Affects Versions: 0.10.0, 1.0.0, 0.9.6 >Reporter: darion yaphet >Assignee: darion yaphet > > Storm-Kafka spout store consumer offset in zookeeper . When a lot topology > running in cluster , zookeeper snapshot frequently . This ticket is to make > status storage pluggable , support store in zookeeper (default) and Redis . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1929) Check when create topology
darion yaphet created STORM-1929: Summary: Check when create topology Key: STORM-1929 URL: https://issues.apache.org/jira/browse/STORM-1929 Project: Apache Storm Issue Type: Improvement Components: storm-core Affects Versions: 1.0.0, 1.0.1 Reporter: darion yaphet Assignee: darion yaphet Add some check when create topology . 1. Spout and Bolt id shouldn't conflict 2. createTopology's spout and bolt set shouldn't empty . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (STORM-1770) Pluggable status storage in storm-Kafka
[ https://issues.apache.org/jira/browse/STORM-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15346553#comment-15346553 ] darion yaphet commented on STORM-1770: -- HI [~abhishek.agarwal] I found a lot Spout (not only KafkaSpout) should using OffsetManager to save reading point . So I put OffsetManager in storm-core's package org.apache.storm.spout. It's a good idea ? > Pluggable status storage in storm-Kafka > --- > > Key: STORM-1770 > URL: https://issues.apache.org/jira/browse/STORM-1770 > Project: Apache Storm > Issue Type: Improvement > Components: storm-kafka >Affects Versions: 0.10.0, 1.0.0, 0.9.6 >Reporter: darion yaphet >Assignee: darion yaphet > > Storm-Kafka spout store consumer offset in zookeeper . When a lot topology > running in cluster , zookeeper snapshot frequently . This ticket is to make > status storage pluggable , support store in zookeeper (default) and Redis . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (STORM-1926) Upgrade Jetty and Ring
[ https://issues.apache.org/jira/browse/STORM-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet closed STORM-1926. Resolution: Won't Fix > Upgrade Jetty and Ring > -- > > Key: STORM-1926 > URL: https://issues.apache.org/jira/browse/STORM-1926 > Project: Apache Storm > Issue Type: Bug > Components: storm-ui >Affects Versions: 1.0.0, 1.0.1 >Reporter: darion yaphet >Assignee: darion yaphet > > Jetty 7 is EOL so we should upgrade to Jetty 9 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1927) Upgrade Jetty and Ring
darion yaphet created STORM-1927: Summary: Upgrade Jetty and Ring Key: STORM-1927 URL: https://issues.apache.org/jira/browse/STORM-1927 Project: Apache Storm Issue Type: Improvement Components: storm-ui Affects Versions: 1.0.0, 1.0.1 Reporter: darion yaphet Assignee: darion yaphet Jetty 7 is EOL , upgrade to Jetty 9 & Ring could also support it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1926) Upgrade Jetty and Ring
darion yaphet created STORM-1926: Summary: Upgrade Jetty and Ring Key: STORM-1926 URL: https://issues.apache.org/jira/browse/STORM-1926 Project: Apache Storm Issue Type: Bug Components: storm-ui Affects Versions: 1.0.0, 1.0.1 Reporter: darion yaphet Assignee: darion yaphet Jetty 7 is EOL so we should upgrade to Jetty 9 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1923) Storm site page not found
darion yaphet created STORM-1923: Summary: Storm site page not found Key: STORM-1923 URL: https://issues.apache.org/jira/browse/STORM-1923 Project: Apache Storm Issue Type: Bug Components: documentation Affects Versions: 1.0.0, 1.0.1 Reporter: darion yaphet [ Daemon Metrics/Monitoring | http://storm.apache.org/releases/1.0.1/storm-metrics-profiling-internal-actions.html] Not found -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (STORM-1923) Storm site page not found
[ https://issues.apache.org/jira/browse/STORM-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated STORM-1923: - Description: [DaemonMetrics/Monitoring|http://storm.apache.org/releases/1.0.1/storm-metrics-profiling-internal-actions.html] Not found (was: [ Daemon Metrics/Monitoring | http://storm.apache.org/releases/1.0.1/storm-metrics-profiling-internal-actions.html] Not found ) > Storm site page not found > -- > > Key: STORM-1923 > URL: https://issues.apache.org/jira/browse/STORM-1923 > Project: Apache Storm > Issue Type: Bug > Components: documentation >Affects Versions: 1.0.0, 1.0.1 >Reporter: darion yaphet > > [DaemonMetrics/Monitoring|http://storm.apache.org/releases/1.0.1/storm-metrics-profiling-internal-actions.html] > Not found -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1921) Update parallelism_hint date type to integer
darion yaphet created STORM-1921: Summary: Update parallelism_hint date type to integer Key: STORM-1921 URL: https://issues.apache.org/jira/browse/STORM-1921 Project: Apache Storm Issue Type: Bug Components: storm-core Affects Versions: 1.0.0, 1.0.1 Reporter: darion yaphet Assignee: darion yaphet update TopologyBuilder's parallelism_hint date type from Number to int -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (STORM-1908) Support Storm HBase ZooKeeper Config
[ https://issues.apache.org/jira/browse/STORM-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet closed STORM-1908. Resolution: Invalid > Support Storm HBase ZooKeeper Config > - > > Key: STORM-1908 > URL: https://issues.apache.org/jira/browse/STORM-1908 > Project: Apache Storm > Issue Type: Improvement > Components: storm-hbase >Affects Versions: 1.0.0 >Reporter: darion yaphet >Assignee: darion yaphet > > Support Storm HBase ZooKeeper Config . About zk host , port and parent . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (STORM-1908) Support Storm HBase ZooKeeper Config
[ https://issues.apache.org/jira/browse/STORM-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet reopened STORM-1908: -- > Support Storm HBase ZooKeeper Config > - > > Key: STORM-1908 > URL: https://issues.apache.org/jira/browse/STORM-1908 > Project: Apache Storm > Issue Type: Improvement > Components: storm-hbase >Affects Versions: 1.0.0 >Reporter: darion yaphet >Assignee: darion yaphet > > Support Storm HBase ZooKeeper Config . About zk host , port and parent . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (STORM-1908) Support Storm HBase ZooKeeper Config
[ https://issues.apache.org/jira/browse/STORM-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet closed STORM-1908. Resolution: Fixed > Support Storm HBase ZooKeeper Config > - > > Key: STORM-1908 > URL: https://issues.apache.org/jira/browse/STORM-1908 > Project: Apache Storm > Issue Type: Improvement > Components: storm-hbase >Affects Versions: 1.0.0 >Reporter: darion yaphet >Assignee: darion yaphet > > Support Storm HBase ZooKeeper Config . About zk host , port and parent . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1917) Storm Redis TTL Control
darion yaphet created STORM-1917: Summary: Storm Redis TTL Control Key: STORM-1917 URL: https://issues.apache.org/jira/browse/STORM-1917 Project: Apache Storm Issue Type: New Feature Reporter: darion yaphet Assignee: darion yaphet add a new interface to control key ttl . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1914) Storm Kafka Field Topic Selector
darion yaphet created STORM-1914: Summary: Storm Kafka Field Topic Selector Key: STORM-1914 URL: https://issues.apache.org/jira/browse/STORM-1914 Project: Apache Storm Issue Type: New Feature Components: storm-kafka Affects Versions: 1.0.0, 1.0.1, 1.0.2 Reporter: darion yaphet Assignee: darion yaphet Support field name and field index to select which kafka topic will used as a downstream . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1908) Support Storm HBase ZooKeeper Config
darion yaphet created STORM-1908: Summary: Support Storm HBase ZooKeeper Config Key: STORM-1908 URL: https://issues.apache.org/jira/browse/STORM-1908 Project: Apache Storm Issue Type: Improvement Components: storm-hbase Affects Versions: 1.0.0 Reporter: darion yaphet Assignee: darion yaphet Support Storm HBase ZooKeeper Config . About zk host , port and parent . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1904) Storm shell display summary info
darion yaphet created STORM-1904: Summary: Storm shell display summary info Key: STORM-1904 URL: https://issues.apache.org/jira/browse/STORM-1904 Project: Apache Storm Issue Type: New Feature Components: storm-core Affects Versions: 1.0.0, 1.0.1, 1.0.2 Reporter: darion yaphet Assignee: darion yaphet display storm cluster summary info about cluster , nimbus ,supervisor and history . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1899) Release HBase connection when topology shutdown
darion yaphet created STORM-1899: Summary: Release HBase connection when topology shutdown Key: STORM-1899 URL: https://issues.apache.org/jira/browse/STORM-1899 Project: Apache Storm Issue Type: Improvement Components: storm-hbase Affects Versions: 1.0.0, 1.0.1 Reporter: darion yaphet Assignee: darion yaphet Priority: Minor Storm HBase Client release connection when topology shutdown. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (STORM-1896) HdfsSpout remove duplicated code
[ https://issues.apache.org/jira/browse/STORM-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet reassigned STORM-1896: Assignee: darion yaphet > HdfsSpout remove duplicated code > > > Key: STORM-1896 > URL: https://issues.apache.org/jira/browse/STORM-1896 > Project: Apache Storm > Issue Type: Improvement > Components: storm-hdfs >Reporter: darion yaphet >Assignee: darion yaphet >Priority: Minor > > remove duplicated code in HdfsSpout open() -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (STORM-1875) Separate Jedis/JedisCluster Config
[ https://issues.apache.org/jira/browse/STORM-1875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet reassigned STORM-1875: Assignee: darion yaphet > Separate Jedis/JedisCluster Config > -- > > Key: STORM-1875 > URL: https://issues.apache.org/jira/browse/STORM-1875 > Project: Apache Storm > Issue Type: Improvement > Components: storm-redis >Affects Versions: 1.0.0, 1.0.1, 1.0.2 >Reporter: darion yaphet >Assignee: darion yaphet > > Separate Jedis / JedisCluster to provide full operations for each environment > to users . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (STORM-1895) blobstore replication-factor argument
[ https://issues.apache.org/jira/browse/STORM-1895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet reassigned STORM-1895: Assignee: darion yaphet > blobstore replication-factor argument > - > > Key: STORM-1895 > URL: https://issues.apache.org/jira/browse/STORM-1895 > Project: Apache Storm > Issue Type: Documentation > Components: documentation >Affects Versions: 1.0.0, 1.0.1 >Reporter: darion yaphet >Assignee: darion yaphet >Priority: Minor > > storm command line argument --repl-fctr have update to replication-factor > and update the document . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1896) HdfsSpout remove duplicated code
darion yaphet created STORM-1896: Summary: HdfsSpout remove duplicated code Key: STORM-1896 URL: https://issues.apache.org/jira/browse/STORM-1896 Project: Apache Storm Issue Type: Improvement Components: storm-hdfs Reporter: darion yaphet Priority: Minor remove duplicated code in HdfsSpout open() -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (STORM-1717) Support Redis INRC , INRCBY and INRCBYFLOAT
[ https://issues.apache.org/jira/browse/STORM-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet closed STORM-1717. Resolution: Won't Fix > Support Redis INRC , INRCBY and INRCBYFLOAT > --- > > Key: STORM-1717 > URL: https://issues.apache.org/jira/browse/STORM-1717 > Project: Apache Storm > Issue Type: Improvement > Components: storm-redis >Affects Versions: 1.0.0, 2.0.0 >Reporter: darion yaphet >Assignee: darion yaphet >Priority: Minor > > to support redis incr incrby and incrbyfloat -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1895) blobstore replication-factor argument
darion yaphet created STORM-1895: Summary: blobstore replication-factor argument Key: STORM-1895 URL: https://issues.apache.org/jira/browse/STORM-1895 Project: Apache Storm Issue Type: Bug Components: documentation Affects Versions: 1.0.0, 1.0.1 Reporter: darion yaphet Priority: Minor storm command line argument --repl-fctr have update to replication-factor and update the document . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1883) FileReader extends Closeable Interface
darion yaphet created STORM-1883: Summary: FileReader extends Closeable Interface Key: STORM-1883 URL: https://issues.apache.org/jira/browse/STORM-1883 Project: Apache Storm Issue Type: Improvement Components: storm-hdfs Affects Versions: 1.0.0, 1.0.1 Reporter: darion yaphet Priority: Minor use Closeable Interface to decorate FileReader to support close() -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1882) Expose TextFileReader public
darion yaphet created STORM-1882: Summary: Expose TextFileReader public Key: STORM-1882 URL: https://issues.apache.org/jira/browse/STORM-1882 Project: Apache Storm Issue Type: Bug Components: storm-hdfs Affects Versions: 1.0.0, 1.0.1 Reporter: darion yaphet [Storm HDFS Using|https://github.com/apache/storm/tree/master/external/storm-hdfs#usage-1] TextFileReader is package-private . Should make TextFileReader a public class to expose it to user and hdfs spout. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (STORM-1880) Support EXISTS Command Storm-Redis
[ https://issues.apache.org/jira/browse/STORM-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated STORM-1880: - Issue Type: New Feature (was: Bug) > Support EXISTS Command Storm-Redis > --- > > Key: STORM-1880 > URL: https://issues.apache.org/jira/browse/STORM-1880 > Project: Apache Storm > Issue Type: New Feature > Components: storm-redis >Affects Versions: 1.0.0, 1.0.1, 1.0.2 >Reporter: darion yaphet > > add exists command in storm-redis LookupBolt -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1880) Support EXISTS Command Storm-Redis
darion yaphet created STORM-1880: Summary: Support EXISTS Command Storm-Redis Key: STORM-1880 URL: https://issues.apache.org/jira/browse/STORM-1880 Project: Apache Storm Issue Type: Bug Components: storm-redis Affects Versions: 1.0.0, 1.0.1, 1.0.2 Reporter: darion yaphet add exists command in storm-redis LookupBolt -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (STORM-1875) Separate Jedis/JedisCluster Config
[ https://issues.apache.org/jira/browse/STORM-1875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15310128#comment-15310128 ] darion yaphet commented on STORM-1875: -- have you update this issues priority ? It's Major now ~ > Separate Jedis/JedisCluster Config > -- > > Key: STORM-1875 > URL: https://issues.apache.org/jira/browse/STORM-1875 > Project: Apache Storm > Issue Type: Improvement > Components: storm-redis >Affects Versions: 1.0.0, 1.0.1, 1.0.2 >Reporter: darion yaphet > > Separate Jedis / JedisCluster to provide full operations for each environment > to users . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1875) Separate Jedis/JedisCluster Config
darion yaphet created STORM-1875: Summary: Separate Jedis/JedisCluster Config Key: STORM-1875 URL: https://issues.apache.org/jira/browse/STORM-1875 Project: Apache Storm Issue Type: Improvement Components: storm-redis Affects Versions: 1.0.0, 1.0.1, 1.0.2 Reporter: darion yaphet Priority: Critical Separate Jedis / JedisCluster to provide full operations for each environment to users . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1874) Update Logger access permissions
darion yaphet created STORM-1874: Summary: Update Logger access permissions Key: STORM-1874 URL: https://issues.apache.org/jira/browse/STORM-1874 Project: Apache Storm Issue Type: Improvement Components: storm-kafka Affects Versions: 1.0.0, 1.0.1, 1.0.2 Reporter: darion yaphet Priority: Minor Update Log access permissions from public to private . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1872) Storm Redis connection release
darion yaphet created STORM-1872: Summary: Storm Redis connection release Key: STORM-1872 URL: https://issues.apache.org/jira/browse/STORM-1872 Project: Apache Storm Issue Type: Bug Components: storm-redis Affects Versions: 1.0.0, 1.0.1, 0.10.2 Reporter: darion yaphet Strom Redis connect should be release when topology shutdown . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (STORM-1871) Storm Alluxio integrate
[ https://issues.apache.org/jira/browse/STORM-1871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated STORM-1871: - Affects Version/s: 1.0.1 1.0.0 > Storm Alluxio integrate > --- > > Key: STORM-1871 > URL: https://issues.apache.org/jira/browse/STORM-1871 > Project: Apache Storm > Issue Type: New Feature >Affects Versions: 1.0.0, 1.0.1 >Reporter: darion yaphet > > [alluxio|http://alluxio.org/] is a memory speed virtual distributed storage > system.Alluxio’s memory-centric architecture enables data access orders of > magnitude faster than existing solutions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1871) Storm Alluxio integrate
darion yaphet created STORM-1871: Summary: Storm Alluxio integrate Key: STORM-1871 URL: https://issues.apache.org/jira/browse/STORM-1871 Project: Apache Storm Issue Type: New Feature Reporter: darion yaphet [alluxio|http://alluxio.org/] is a memory speed virtual distributed storage system.Alluxio’s memory-centric architecture enables data access orders of magnitude faster than existing solutions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (STORM-1770) Pluggable status storage in storm-Kafka
[ https://issues.apache.org/jira/browse/STORM-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet reassigned STORM-1770: Assignee: darion yaphet > Pluggable status storage in storm-Kafka > --- > > Key: STORM-1770 > URL: https://issues.apache.org/jira/browse/STORM-1770 > Project: Apache Storm > Issue Type: Improvement > Components: storm-kafka >Affects Versions: 0.10.0, 1.0.0, 0.9.6 >Reporter: darion yaphet >Assignee: darion yaphet > > Storm-Kafka spout store consumer offset in zookeeper . When a lot topology > running in cluster , zookeeper snapshot frequently . This ticket is to make > status storage pluggable , support store in zookeeper (default) and Redis . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1770) Pluggable status storage in storm-Kafka
darion yaphet created STORM-1770: Summary: Pluggable status storage in storm-Kafka Key: STORM-1770 URL: https://issues.apache.org/jira/browse/STORM-1770 Project: Apache Storm Issue Type: Improvement Components: storm-kafka Affects Versions: 0.10.0, 1.0.0, 0.9.6 Reporter: darion yaphet Storm-Kafka spout store consumer offset in zookeeper . When a lot topology running in cluster , zookeeper snapshot frequently . This ticket is to make status storage pluggable , support store in zookeeper (default) and Redis . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (STORM-1715) Jedis Default Host
[ https://issues.apache.org/jira/browse/STORM-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated STORM-1715: - Description: Using Jedis Protocol.DEFAULT_HOST to replace DEFAULT_HOST (was: Useing Jedis Protocol.DEFAULT_HOST to replace DEFAULT_HOST) > Jedis Default Host > -- > > Key: STORM-1715 > URL: https://issues.apache.org/jira/browse/STORM-1715 > Project: Apache Storm > Issue Type: Improvement > Components: storm-redis >Affects Versions: 1.0.0, 2.0.0 >Reporter: darion yaphet >Assignee: darion yaphet >Priority: Minor > > Using Jedis Protocol.DEFAULT_HOST to replace DEFAULT_HOST -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1720) Support GEO in storm-redis
darion yaphet created STORM-1720: Summary: Support GEO in storm-redis Key: STORM-1720 URL: https://issues.apache.org/jira/browse/STORM-1720 Project: Apache Storm Issue Type: New Feature Components: storm-redis Affects Versions: 1.0.0, 2.0.0 Reporter: darion yaphet Assignee: darion yaphet Priority: Minor GEO is a new feature in redis 3.2 . It's useful in Geography calculate. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1717) Support Redis INRC , INRCBY and INRCBYFLOAT
darion yaphet created STORM-1717: Summary: Support Redis INRC , INRCBY and INRCBYFLOAT Key: STORM-1717 URL: https://issues.apache.org/jira/browse/STORM-1717 Project: Apache Storm Issue Type: Improvement Components: storm-redis Affects Versions: 1.0.0, 2.0.0 Reporter: darion yaphet Assignee: darion yaphet Priority: Minor to support redis incr incrby and incrbyfloat -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1716) Add some external Jedis pool config
darion yaphet created STORM-1716: Summary: Add some external Jedis pool config Key: STORM-1716 URL: https://issues.apache.org/jira/browse/STORM-1716 Project: Apache Storm Issue Type: Improvement Components: storm-redis Affects Versions: 1.0.0, 0.9.6, 2.0.0 Reporter: darion yaphet Assignee: darion yaphet Priority: Minor add some jedis pool config -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1715) Jedis Default Host
darion yaphet created STORM-1715: Summary: Jedis Default Host Key: STORM-1715 URL: https://issues.apache.org/jira/browse/STORM-1715 Project: Apache Storm Issue Type: Improvement Components: storm-redis Affects Versions: 1.0.0, 2.0.0 Reporter: darion yaphet Assignee: darion yaphet Priority: Minor Fix For: 2.0.0 Useing Jedis Protocol.DEFAULT_HOST to replace DEFAULT_HOST -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (STORM-1571) Improvment Kafka Spout Time Metric
[ https://issues.apache.org/jira/browse/STORM-1571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated STORM-1571: - Attachment: 0002-Update-time-interval-counting-on-TridentKafkaEmitter.patch > Improvment Kafka Spout Time Metric > -- > > Key: STORM-1571 > URL: https://issues.apache.org/jira/browse/STORM-1571 > Project: Apache Storm > Issue Type: Improvement > Components: storm-kafka >Affects Versions: 0.9.3, 0.9.4, 0.9.5, 0.9.6 > Environment: Mac 10.11.1 JDK 1.8.0_40 >Reporter: darion yaphet >Assignee: darion yaphet >Priority: Minor > Attachments: 0001-Improvment-Kafka-Spout-Time-Metric.patch, > 0002-Update-time-interval-counting-on-TridentKafkaEmitter.patch > > > Use System.currentTimeMillis() to calculation time interval is better than > System.nanoTime() -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (STORM-1571) Improvment Kafka Spout Time Metric
[ https://issues.apache.org/jira/browse/STORM-1571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated STORM-1571: - Attachment: 0001-Improvment-Kafka-Spout-Time-Metric.patch > Improvment Kafka Spout Time Metric > -- > > Key: STORM-1571 > URL: https://issues.apache.org/jira/browse/STORM-1571 > Project: Apache Storm > Issue Type: Improvement > Components: storm-kafka >Affects Versions: 0.9.3, 0.9.4, 0.9.5, 0.9.6 > Environment: Mac 10.11.1 JDK 1.8.0_40 >Reporter: darion yaphet >Assignee: darion yaphet >Priority: Minor > Attachments: 0001-Improvment-Kafka-Spout-Time-Metric.patch > > > Use System.currentTimeMillis() to calculation time interval is better than > System.nanoTime() -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (STORM-1571) Improvment Kafka Spout Time Metric
[ https://issues.apache.org/jira/browse/STORM-1571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated STORM-1571: - Attachment: (was: 0001-Improvment-Kafka-Spout-Time-Metric.patch) > Improvment Kafka Spout Time Metric > -- > > Key: STORM-1571 > URL: https://issues.apache.org/jira/browse/STORM-1571 > Project: Apache Storm > Issue Type: Improvement > Components: storm-kafka >Affects Versions: 0.9.3, 0.9.4, 0.9.5, 0.9.6 > Environment: Mac 10.11.1 JDK 1.8.0_40 >Reporter: darion yaphet >Assignee: darion yaphet >Priority: Minor > > Use System.currentTimeMillis() to calculation time interval is better than > System.nanoTime() -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (STORM-1571) Improvment Kafka Spout Time Metric
[ https://issues.apache.org/jira/browse/STORM-1571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated STORM-1571: - Description: Use System.currentTimeMillis() to calculation time interval is better than System.nanoTime() > Improvment Kafka Spout Time Metric > -- > > Key: STORM-1571 > URL: https://issues.apache.org/jira/browse/STORM-1571 > Project: Apache Storm > Issue Type: Improvement > Components: storm-kafka >Affects Versions: 0.9.3, 0.9.4, 0.9.5, 0.9.6 > Environment: Mac 10.11.1 JDK 1.8.0_40 >Reporter: darion yaphet >Assignee: darion yaphet >Priority: Minor > Attachments: 0001-Improvment-Kafka-Spout-Time-Metric.patch > > > Use System.currentTimeMillis() to calculation time interval is better than > System.nanoTime() -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (STORM-1571) Improvment Kafka Spout Time Metric
[ https://issues.apache.org/jira/browse/STORM-1571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated STORM-1571: - Attachment: 0001-Improvment-Kafka-Spout-Time-Metric.patch > Improvment Kafka Spout Time Metric > -- > > Key: STORM-1571 > URL: https://issues.apache.org/jira/browse/STORM-1571 > Project: Apache Storm > Issue Type: Improvement > Components: storm-kafka >Affects Versions: 0.9.3, 0.9.4, 0.9.5, 0.9.6 > Environment: Mac 10.11.1 JDK 1.8.0_40 >Reporter: darion yaphet >Assignee: darion yaphet >Priority: Minor > Attachments: 0001-Improvment-Kafka-Spout-Time-Metric.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (STORM-1571) Improvment Kafka Spout Time Metric
darion yaphet created STORM-1571: Summary: Improvment Kafka Spout Time Metric Key: STORM-1571 URL: https://issues.apache.org/jira/browse/STORM-1571 Project: Apache Storm Issue Type: Improvement Components: storm-kafka Affects Versions: 0.9.3, 0.9.4, 0.9.5, 0.9.6 Environment: Mac 10.11.1 JDK 1.8.0_40 Reporter: darion yaphet Assignee: darion yaphet Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (STORM-1379) Removed Redundant Structure
[ https://issues.apache.org/jira/browse/STORM-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15117415#comment-15117415 ] darion yaphet commented on STORM-1379: -- Hi Rebert Actually I have create a pull request at github https://github.com/apache/storm/pull/932 but maybe not very successfully . Thank you for you great work :) > Removed Redundant Structure > --- > > Key: STORM-1379 > URL: https://issues.apache.org/jira/browse/STORM-1379 > Project: Apache Storm > Issue Type: Improvement > Components: storm-kafka >Affects Versions: 0.10.0, 0.9.4, 0.9.5, 0.9.6 > Environment: CentOS 6 JDK1.7.0_75 >Reporter: darion yaphet >Assignee: darion yaphet >Priority: Minor > Fix For: 1.0.0 > > Attachments: STORM-1379.patch > > > Storm KafkaSpout have a static class MessageAndRealOffset which is same with > Kafka API 's kafka.message.MessageAndOffset . So I have remove > MessageAndRealOffset and replace with MessageAndOffset :) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (STORM-1379) Removed Redundant Structure
[ https://issues.apache.org/jira/browse/STORM-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated STORM-1379: - Description: Storm KafkaSpout have a static class MessageAndRealOffset which is same with Kafka API 's kafka.message.MessageAndOffset . So I have remove MessageAndRealOffset and replace with MessageAndOffset :) (was: Storm KafkaSpout have a static class MessageAndRealOffset which is same with Kafka API 's kafka.message.MessageAndOffset . So I hava remove MessageAndRealOffset and replace with MessageAndOffset :)) > Removed Redundant Structure > --- > > Key: STORM-1379 > URL: https://issues.apache.org/jira/browse/STORM-1379 > Project: Apache Storm > Issue Type: Improvement > Components: storm-kafka >Affects Versions: 0.10.0, 0.9.4, 0.9.5, 0.9.6 > Environment: CentOS 6 JDK1.7.0_75 >Reporter: darion yaphet >Assignee: darion yaphet >Priority: Minor > Fix For: 1.0.0 > > Attachments: STORM-1379.patch > > > Storm KafkaSpout have a static class MessageAndRealOffset which is same with > Kafka API 's kafka.message.MessageAndOffset . So I have remove > MessageAndRealOffset and replace with MessageAndOffset :) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
