[jira] [Commented] (HBASE-20515) Cleanup ProcedureExecutor#stop and #join interaction/dependency
[ https://issues.apache.org/jira/browse/HBASE-20515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245092#comment-17245092 ] Shroff Amrith Nayak commented on HBASE-20515: - Additionally, I have observed that there is one shutdown hook spawned from `HFileArchiver#getArchiveExecutor` that is tied to the PEWorkerGroup ThreadGroup which can throw an `IllegalStateException` on JVM shutdown if the minicluster is stopped in a different lifecycle, say when test case execution is completed. This can cause `ApplicationShutdownHooks` (openJDK) to prematurely terminate potentially causing cascading errors. Interested to discuss alternative solutions. > Cleanup ProcedureExecutor#stop and #join interaction/dependency > --- > > Key: HBASE-20515 > URL: https://issues.apache.org/jira/browse/HBASE-20515 > Project: HBase > Issue Type: Task > Components: amv2 >Reporter: Michael Stack >Priority: Major > > See HBASE-20169 discussion toward the end. What the discussion makes clear is > that there is an ordering expected around the shutdown of > PerformanceExecutor; first #stop must be called and then #join. In > multi-threaded context, this may not always happen. > Also look at #join. It is doing harvesting and cleanup which is not what a > #join usually does; #join is usually more an observer than a final tidying of > resources. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-15320) HBase connector for Kafka Connect
[ https://issues.apache.org/jira/browse/HBASE-15320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928288#comment-15928288 ] Shroff Amrith Nayak commented on HBASE-15320: - I'd love to give this a shot (Hbase as a source) > HBase connector for Kafka Connect > - > > Key: HBASE-15320 > URL: https://issues.apache.org/jira/browse/HBASE-15320 > Project: HBase > Issue Type: New Feature > Components: Replication >Reporter: Andrew Purtell > Labels: beginner > Fix For: 2.0.0 > > > Implement an HBase connector with source and sink tasks for the Connect > framework (http://docs.confluent.io/2.0.0/connect/index.html) available in > Kafka 0.9 and later. > See also: > http://www.confluent.io/blog/announcing-kafka-connect-building-large-scale-low-latency-data-pipelines > An HBase source > (http://docs.confluent.io/2.0.0/connect/devguide.html#task-example-source-task) > could be implemented as a replication endpoint or WALObserver, publishing > cluster wide change streams from the WAL to one or more topics, with > configurable mapping and partitioning of table changes to topics. > An HBase sink task > (http://docs.confluent.io/2.0.0/connect/devguide.html#sink-tasks) would > persist, with optional transformation (JSON? Avro?, map fields to native > schema?), Kafka SinkRecords into HBase tables. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
