Re: [DISCUSS] KIP-328: Ability to suppress updates for KTables

2018-06-27 Thread Ted Yu
hods I listed. > > For example: > > windowCounts > .suppress( > Suppression > .suppressLateEvents(Duration.ofMinutes(10)) > .suppressIntermediateEvents( > IntermediateSuppression.emitAfter(Duration.ofMinutes(10)) > )

Re: [DISCUSS] KIP-328: Ability to suppress updates for KTables

2018-06-27 Thread Ted Yu
hods I listed. > > For example: > > windowCounts > .suppress( > Suppression > .suppressLateEvents(Duration.ofMinutes(10)) > .suppressIntermediateEvents( > IntermediateSuppression.emitAfter(Duration.ofMinutes(10)) > )

[jira] [Commented] (HBASE-20798) Duplicated threads name of StoreFileOpenerThread

2018-06-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524969#comment-16524969 ] Ted Yu commented on HBASE-20798: {code} 560 + this.region.getRegionInfo().getEncodedName

[jira] [Created] (FLINK-9675) Avoid FileInputStream/FileOutputStream

2018-06-27 Thread Ted Yu (JIRA)
Ted Yu created FLINK-9675: - Summary: Avoid FileInputStream/FileOutputStream Key: FLINK-9675 URL: https://issues.apache.org/jira/browse/FLINK-9675 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-9675) Avoid FileInputStream/FileOutputStream

2018-06-27 Thread Ted Yu (JIRA)
Ted Yu created FLINK-9675: - Summary: Avoid FileInputStream/FileOutputStream Key: FLINK-9675 URL: https://issues.apache.org/jira/browse/FLINK-9675 Project: Flink Issue Type: Improvement

[jira] [Created] (KYLIN-3431) Avoid FileInputStream/FileOutputStream

2018-06-27 Thread Ted Yu (JIRA)
Ted Yu created KYLIN-3431: - Summary: Avoid FileInputStream/FileOutputStream Key: KYLIN-3431 URL: https://issues.apache.org/jira/browse/KYLIN-3431 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-3431) Avoid FileInputStream/FileOutputStream

2018-06-27 Thread Ted Yu (JIRA)
Ted Yu created KYLIN-3431: - Summary: Avoid FileInputStream/FileOutputStream Key: KYLIN-3431 URL: https://issues.apache.org/jira/browse/KYLIN-3431 Project: Kylin Issue Type: Improvement

Re: [DISCUSS] KIP-322: Return new error code for DeleteTopics API when topic deletion disabled.

2018-06-27 Thread Ted Yu
bq. set the serialVersionUID = 1L in Kafka exception classes Indeed. Should have checked earlier. On Wed, Jun 27, 2018 at 1:38 AM, Manikumar wrote: > Hi, > > Thanks for the review. > > > > nit: you are going to fill in an actual value below in your PR, right ? > > private static final

[jira] [Comment Edited] (KAFKA-7108) "Exactly-once" stream breaks production exception handler contract

2018-06-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524716#comment-16524716 ] Ted Yu edited comment on KAFKA-7108 at 6/27/18 7:43 AM: In StreamTask

[jira] [Commented] (KAFKA-7108) "Exactly-once" stream breaks production exception handler contract

2018-06-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524716#comment-16524716 ] Ted Yu commented on KAFKA-7108: --- {code} if (eosEnabled

Re: [DISCUSS] KIP-328: Ability to suppress updates for KTables

2018-06-26 Thread Ted Yu
I started to read this KIP which contains a lot of materials. One suggestion: .suppress( new Suppression() Do you think it would be more consistent with the rest of Streams data structures by supporting `of` ? Suppression.of(Duration.ofMinutes(10)) Cheers On Tue, Jun 26, 2018

[jira] [Commented] (HBASE-20791) RSGroupBasedLoadBalancer#setClusterMetrics should pass ClusterMetrics to it’s internalBalancer

2018-06-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524592#comment-16524592 ] Ted Yu commented on HBASE-20791: [~reidchan]: Do you have other comments w.r.t. patch v2

[jira] [Updated] (HBASE-20791) RSGroupBasedLoadBalancer#setClusterMetrics should pass ClusterMetrics to it’s internalBalancer

2018-06-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-20791: --- Attachment: 20791-master-v2.patch > RSGroupBasedLoadBalancer#setClusterMetrics should pass ClusterMetr

[jira] [Commented] (HBASE-6028) Implement a cancel for in-progress compactions

2018-06-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524446#comment-16524446 ] Ted Yu commented on HBASE-6028: --- {code} 2018-06-26 13:37:22,042 ERROR [RpcServer.default.FPBQ.Fifo.handler

Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-06-26 Thread Ted Yu
nit: bq. leaving this empty for compacted topics Some user(s) may be confused by empty partition size. How about emitting 'compacted' for compacted topics ? Cheers On Tue, Jun 26, 2018 at 4:42 PM, Gwen Shapira wrote: > It will be. In my experience most topics aren't compacted, so it will

[jira] [Updated] (HBASE-20789) TestBucketCache#testCacheBlockNextBlockMetadataMissing is flaky

2018-06-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-20789: --- Attachment: bucket-33718.out > TestBucketCache#testCacheBlockNextBlockMetadataMissing is fl

[jira] [Commented] (HBASE-20789) TestBucketCache#testCacheBlockNextBlockMetadataMissing is flaky

2018-06-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524277#comment-16524277 ] Ted Yu commented on HBASE-20789: https://builds.apache.org/job/HBASE-Flaky-Tests/33718/testReport/junit

[jira] [Commented] (HBASE-20789) TestBucketCache#testCacheBlockNextBlockMetadataMissing is flaky

2018-06-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524186#comment-16524186 ] Ted Yu commented on HBASE-20789: Zack: You can get test failure from: https://builds.apache.org/job

Re: [DISCUSS] KIP-322: Return new error code for DeleteTopics API when topic deletion disabled.

2018-06-26 Thread Ted Yu
Looks good overall. nit: you are going to fill in an actual value below in your PR, right ? private static final long serialVersionUID = 1L; In Motivation, please mention the IllegalStateException scenario. On Tue, Jun 26, 2018 at 9:34 AM, Manikumar wrote: > Hi all, > > I have created a

Re: [DISCUSS] KIP-326: Schedulable KTable as Graph source

2018-06-26 Thread Ted Yu
What's the relationship between this KIP and KIP-323 ? Thanks On Tue, Jun 26, 2018 at 11:22 AM, Flávio Stutz wrote: > Hey, guys, I've just created a new KIP about creating a new DSL graph > source for realtime partitioned consolidations. > > We have faced the following scenario/problem in a

[jira] [Commented] (HBASE-20791) RSGroupBasedLoadBalancer#setClusterMetrics should pass ClusterMetrics to it’s internalBalancer

2018-06-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523950#comment-16523950 ] Ted Yu commented on HBASE-20791: Can you put the patch on review board after fixing failing tests

[jira] [Updated] (KYLIN-3317) Replace UUID.randomUUID with deterministic PRNG

2018-06-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated KYLIN-3317: -- Description: Currently UUID.randomUUID is called in various places in the code base. * It is non-deterministic

Re: [Discuss] KIP-321: Add method to get TopicNameExtractor in TopologyDescription

2018-06-25 Thread Ted Yu
gt; > -Matthias > > On 6/25/18 5:19 PM, Ted Yu wrote: > > If there are different TopicNameExtractor classes from multiple sink > nodes, > > the new method should throw exception alerting user of such scenario. > > > > > > On Mon, Jun 25, 2018 at

Re: [ANNOUNCE] New HBase committer Reid Chan

2018-06-25 Thread Ted Yu
Congratulations, Reid ! On Mon, Jun 25, 2018 at 6:59 PM, Chia-Ping Tsai wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Reid Chan > has accepted the PMC's invitation to become a committer on the project. We > appreciate all of Reid’s generous contributions thus far and

Re: SASL Unit test failing

2018-06-25 Thread Ted Yu
", arch: "amd64", family: "unix" On Mon, Jun 25, 2018 at 5:42 PM, Ted Yu wrote: > Here was the command I used: > > ./gradlew -Dtest.single=SaslAuthenticatorTest clients:test > > On Mon, Jun 25, 2018 at 5:39 PM, Ahmed A wrote: > >> I ran test

Re: SASL Unit test failing

2018-06-25 Thread Ted Yu
ahmed 3.10.0-514.36.5.el7.x86_64 #1 SMP Thu Dec 28 21:42:18 EST > 2017 x86_64 x86_64 x86_64 GNU/Linux > > > Can you please let me know how I can run an individual unit test, what > options do I provide? > > > Thank you, > Ahmed. > > > > On Mon, Jun 25, 2

Re: [Discuss] KIP-321: Add method to get TopicNameExtractor in TopologyDescription

2018-06-25 Thread Ted Yu
If there are different TopicNameExtractor classes from multiple sink nodes, the new method should throw exception alerting user of such scenario. On Mon, Jun 25, 2018 at 2:23 PM, Bill Bejeck wrote: > Thanks for the KIP! > > Overall I'm +1 on the KIP. I have one question. > > The KIP states

Re: [DISCUSS] KIP-323: Schedulable KTable as Graph source

2018-06-25 Thread Ted Yu
This would be useful feature. In the Public Interfaces section, the new method lacks a closing parenthesis. In the Proposed Changes section, if the order of the 3 bullets can match the order of the parameters of the new method, it would be easier to read. For Rejected Alternatives #2, can you

Re: [VOTE] KIP-319: Replace numSegments to segmentInterval in Streams window configurations

2018-06-25 Thread Ted Yu
+1 On Mon, Jun 25, 2018 at 2:56 PM, John Roesler wrote: > Hello All, > > Thanks for the discussion on KIP-319. I'd now like to start the voting. > > As a reminder, KIP-319 proposes a fix to an issue I identified in > KAFKA-7080. Specifically, the issue is that we're creating >

Re: SASL Unit test failing

2018-06-25 Thread Ted Yu
I ran the test alone which passed. Can you include -i on the command line to see if there is some clue from the output ? Here is my environment: Java version: 1.8.0_151, vendor: Oracle Corporation Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_151.jdk/Contents/Home/jre Default locale:

Re: [VOTE] KIP-312: Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties

2018-06-25 Thread Ted Yu
+1 On Mon, Jun 25, 2018 at 9:45 AM, Guozhang Wang wrote: > +1. > > On Mon, Jun 25, 2018 at 8:12 AM, Matthias J. Sax > wrote: > > > +1 (binding) > > > > On 6/25/18 6:11 AM, Bill Bejeck wrote: > > > All, > > > I'd like to start a vote for this KIP now. > > > > > > Thanks, > > > Bill > > > > > >

[jira] [Commented] (HBASE-20769) getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl

2018-06-25 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16522195#comment-16522195 ] Ted Yu commented on HBASE-20769: [~openinx]: Can you take a look as well ? If this is good by you, can

[jira] [Commented] (HBASE-20357) AccessControlClient API Enhancement

2018-06-25 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16522157#comment-16522157 ] Ted Yu commented on HBASE-20357: Please fill out release note. > AccessControlClient API Enhancem

[jira] [Commented] (HBASE-20357) AccessControlClient API Enhancement

2018-06-25 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16522152#comment-16522152 ] Ted Yu commented on HBASE-20357: +1 > AccessControlClient API Enhancem

[jira] [Commented] (KAFKA-7088) Kafka streams thread waits infinitely on transaction init

2018-06-25 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16522031#comment-16522031 ] Ted Yu commented on KAFKA-7088: --- Maybe set log level to DEBUG when you have a chance. Thanks > Ka

[jira] [Commented] (HBASE-20769) getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl

2018-06-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521806#comment-16521806 ] Ted Yu commented on HBASE-20769: lgtm Please wrap the long line. > getSplits() has a out of bou

Re: [VOTE] 0.11.0.3 RC0

2018-06-23 Thread Ted Yu
+1 Checked signatures. Ran unit test suite. On Fri, Jun 22, 2018 at 4:56 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > +1 (non-binding) > > Built from source and ran quickstart successfully on Ubuntu (with Java 8). > > Thanks Matthias! > --Vahid > > > > > From: "Matthias J.

Re: [Flink-9407] Question about proposed ORC Sink !

2018-06-22 Thread Ted Yu
For #1, the word exist should be exit, right ?Thanks Original message From: zhangminglei <18717838...@163.com> Date: 6/23/18 10:12 AM (GMT+08:00) To: sagar loke Cc: dev , user Subject: Re: [Flink-9407] Question about proposed ORC Sink ! Hi, Sagar. 1. It solves the issue

Re: [Flink-9407] Question about proposed ORC Sink !

2018-06-22 Thread Ted Yu
For #1, the word exist should be exit, right ?Thanks Original message From: zhangminglei <18717838...@163.com> Date: 6/23/18 10:12 AM (GMT+08:00) To: sagar loke Cc: dev , user Subject: Re: [Flink-9407] Question about proposed ORC Sink ! Hi, Sagar. 1. It solves the issue

[jira] [Commented] (KAFKA-7088) Kafka streams thread waits infinitely on transaction init

2018-06-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520844#comment-16520844 ] Ted Yu commented on KAFKA-7088: --- Lukasz: I was looking at code related to how queued TxnRequestHandler's

[jira] [Commented] (HBASE-20403) Prefetch sometimes doesn't work with encrypted file system

2018-06-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520778#comment-16520778 ] Ted Yu commented on HBASE-20403: +1 > Prefetch sometimes doesn't work with encrypted file sys

Re: [VOTE] 1.0.2 RC0

2018-06-22 Thread Ted Yu
+1 Ran test suite. Checked signatures. On Fri, Jun 22, 2018 at 11:42 AM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > +1 (non-binding) > > Built from source and ran quickstart successfully on Ubuntu (with Java 8). > > Thanks for running the release Matthias! > --Vahid > > > > >

[jira] [Commented] (HBASE-20357) AccessControlClient API Enhancement

2018-06-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520764#comment-16520764 ] Ted Yu commented on HBASE-20357: There are 3 pairs of bq. result.getParams().addExtraParam("filte

Re: Eclipse and hbase-server version 2.0.1- bad imports

2018-06-22 Thread Ted Yu
I already explained which jars contain the other two classes. Better approach is to let 'mvn eclipse:eclipse' generate the dependencies for you. bq. I don't have in .m2 directory Have you looked under ~/.m2/repository ? Cheers On Fri, Jun 22, 2018 at 10:27 AM, Andrzej wrote: > W dniu 22.06.2018 o

Re: [VOTE] 1.1.1 RC1

2018-06-22 Thread Ted Yu
+1 Ran test suite. Checked signatures. On Fri, Jun 22, 2018 at 12:14 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > +1 (non-binding) > > Built from source and ran quickstart successfully on Ubuntu (with Java 8). > > Thanks Dong! > --Vahid > > > > From: Dong Lin > To:

Re: [ANNOUNCE] New committer Piotr Nowojski

2018-06-22 Thread Ted Yu
Congratulations, Piotr! On Fri, Jun 22, 2018 at 12:26 PM, Till Rohrmann wrote: > Hi everybody, > > On behalf of the PMC I am delighted to announce Piotr Nowojski as a new > Flink > committer! > > Piotr has been an active member of our community for more than a year. > Among other things, he

Re: [VOTE] KIP-313: Add KStream.flatTransform and KStream.flatTransformValues

2018-06-22 Thread Ted Yu
+1 On Fri, Jun 22, 2018 at 2:50 AM, Bruno Cadonna wrote: > Hi list, > > I would like to voting on this KIP. > > I created a first PR[1] that adds flatTransform. Once I get some > feedback, I will start work on flatTransformValues. > > Best regards, > Bruno > > [1]

Re: [ANNOUNCE] New committer: Sihua Zhou

2018-06-22 Thread Ted Yu
Congratulations Sihua! On Fri, Jun 22, 2018 at 6:42 AM, zhangminglei <18717838...@163.com> wrote: > Congrats! Sihua > > Cheers > Minglei. > > > 在 2018年6月22日,下午9:17,Till Rohrmann 写道: > > > > Hi everybody, > > > > On behalf of the PMC I am delighted to announce Sihua Zhou as a new Flink > >

Re: Eclipse and hbase-server version 2.0.1- bad imports

2018-06-22 Thread Ted Yu
$ jar tvf ~/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/3.0.0/hadoop-mapreduce-client-jobclient-3.0.0-tests.jar | grep MiniMRCluster 1863 Fri Dec 08 11:31:44 PST 2017 org/apache/hadoop/mapred/ClusterMapReduceTestCase$ConfigurableMiniMRCluster.class 9947 Fri Dec 08

[jira] [Commented] (KAFKA-7088) Kafka streams thread waits infinitely on transaction init

2018-06-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520094#comment-16520094 ] Ted Yu commented on KAFKA-7088: --- What's the value for "processing.guarantee&quo

[jira] [Updated] (HBASE-20740) StochasticLoadBalancer should consider CoprocessorService request factor when computing cost

2018-06-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-20740: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved

[jira] [Updated] (HBASE-20740) StochasticLoadBalancer should consider CoprocessorService request factor when computing cost

2018-06-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-20740: --- Release Note: Introduce CPRequestCostFunction for StochasticLoadBalancer, which will consider

Re: Bulk Load is pulling files locally with same FS and validation disabled.

2018-06-21 Thread Ted Yu
Since S3FileSystem is not taken into account in FSHDFSUtils#isSameHdfs, we need to add more code to avoid the overhead. Can you log a JIRA with what you discovered ? Thanks On Thu, Jun 21, 2018 at 2:08 PM, Austin Heyne wrote: > Hi again, > > I've been doing more digging into this and I've

Re: I am searching Java examples for HBase 2.0.0

2018-06-21 Thread Ted Yu
See code HBaseTestingUtility : public Connection getConnection() throws IOException { if (this.connection == null) { this.connection = ConnectionFactory.createConnection(this.conf); Once you have the connection, you can call: this.hbaseAdmin = (HBaseAdmin)

Re: Alternative to native client c++

2018-06-21 Thread Ted Yu
I executed the following commands: mvn clean mvn compile There was no error. Andrzej: Can you tell us which mvn / Java versions you use ? I use the following: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=812M; support was removed in 8.0 Apache Maven 3.5.2

[jira] [Commented] (HBASE-20740) StochasticLoadBalancer should consider CoprocessorService request factor when computing cost

2018-06-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519759#comment-16519759 ] Ted Yu commented on HBASE-20740: Please fill out release note. > StochasticLoadBalancer should consi

[jira] [Commented] (HBASE-20740) StochasticLoadBalancer should consider CoprocessorService request factor when computing cost

2018-06-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519749#comment-16519749 ] Ted Yu commented on HBASE-20740: Test failure doesn't seem to be related. Can you address checkstyle

Re: Template problem native client c++ with new folly

2018-06-21 Thread Ted Yu
Can you take a look at : HBASE-18901 [C++] Provide CMAKE infrastructure There hasn't been effort to support newer folly. FYI On Wed, Jun 20, 2018 at 1:42 PM, Andrzej wrote: > I have installed new (17 days ago) folly and wangle from sources. > I try compile sources of native client from

[jira] [Commented] (HBASE-20769) getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl

2018-06-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519720#comment-16519720 ] Ted Yu commented on HBASE-20769: When I ran the new test without fix: {code

Re: [DISCUSS] KIP-319: Replace segments with segmentSize in WindowBytesStoreSupplier

2018-06-21 Thread Ted Yu
> > opposed > > > to "segments". Now it makes sense that you meant as opposed to > > > "segmentSize". > > > > > > I named it that way to match the peer method "windowSize", which is > also > > a > > > quan

[jira] [Updated] (HBASE-20740) StochasticLoadBalancer should consider CoprocessorService request factor when computing cost

2018-06-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-20740: --- Attachment: 20740-master-v2.patch > StochasticLoadBalancer should consider CoprocessorService requ

[jira] [Updated] (HBASE-20748) HBaseContext bulkLoad: being able to use custom versions

2018-06-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-20748: --- Status: Open (was: Patch Available) > HBaseContext bulkLoad: being able to use custom versi

[jira] [Updated] (HBASE-20532) Use try-with-resources in BackupSystemTable

2018-06-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-20532: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Thanks

[jira] [Updated] (HBASE-20532) Use try-with-resources in BackupSystemTable

2018-06-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-20532: --- Summary: Use try-with-resources in BackupSystemTable (was: Use try -with-resources in BackupSystemTable

[jira] [Comment Edited] (HBASE-20734) Colocate recovered edits directory with hbase.wal.dir

2018-06-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519544#comment-16519544 ] Ted Yu edited comment on HBASE-20734 at 6/21/18 4:07 PM: - In WALSplitter

[jira] [Commented] (HBASE-20734) Colocate recovered edits directory with hbase.wal.dir

2018-06-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519544#comment-16519544 ] Ted Yu commented on HBASE-20734: In WALSplitter#finishSplitLogFile : Path rootdir

[jira] [Commented] (KAFKA-7088) Kafka streams thread waits infinitely on transaction init

2018-06-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519542#comment-16519542 ] Ted Yu commented on KAFKA-7088: --- Is it possible to reproduce this behavior using 1.1.1 RC ? There have been

[jira] [Commented] (HBASE-20532) Use try -with-resources in BackupSystemTable

2018-06-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519274#comment-16519274 ] Ted Yu commented on HBASE-20532: lgtm Please fix checkstyle warnings > Use try -with-resour

[jira] [Commented] (HBASE-20631) B: Merge command enhancements

2018-06-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519088#comment-16519088 ] Ted Yu commented on HBASE-20631: Please fix checkstyle warnings. > B: Merge command enhanceme

Re: [DISCUSS] KIP-319: Replace segments with segmentSize in WindowBytesStoreSupplier

2018-06-21 Thread Ted Yu
h is also a > quantity of milliseconds. > > I agree that "interval" is more intuitive, but I think I favor consistency > in this case. Does that seem reasonable? > > Thanks, > -John > > On Wed, Jun 20, 2018 at 1:06 PM Ted Yu wrote: > > > Norm

Re: [DISCUSS] KIP-319: Replace segments with segmentSize in WindowBytesStoreSupplier

2018-06-20 Thread Ted Yu
Normally size is not measured in time unit, such as milliseconds.  How about naming the new method segmentInterval ? Thanks Original message From: John Roesler Date: 6/20/18 10:45 AM (GMT-08:00) To: dev@kafka.apache.org Subject: [DISCUSS] KIP-319: Replace segments with

[jira] [Updated] (AMBARI-21822) Implement CodeCache related configuration change for HBase master

2018-06-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-21822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated AMBARI-21822: Description: AMBARI-21326 applied the code cache directive to region server daemons. This issue

[jira] [Updated] (AMBARI-24032) Ambari should be selective about which HBase components that need to be restarted

2018-06-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-24032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated AMBARI-24032: Description: For hbase config changes that only involve hbase master, Ambari should explicitly say so

[jira] [Updated] (AMBARI-22943) Wrong condition in FixCapacitySchedulerOrderingPolicy#execute()

2018-06-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-22943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated AMBARI-22943: Description: {code} } else if (!orderingPolicyValue.equals(UTILIZATION

[jira] [Commented] (HBASE-15320) HBase connector for Kafka Connect

2018-06-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517749#comment-16517749 ] Ted Yu commented on HBASE-15320: Unit test encountered: {code} [ERROR] Caused

Re: [VOTE] 1.1.1 RC0

2018-06-19 Thread Ted Yu
+1 Ran unit test suite which passed. Checked signatures. On Tue, Jun 19, 2018 at 4:47 PM, Dong Lin wrote: > Re-send to kafka-clie...@googlegroups.com > > On Tue, Jun 19, 2018 at 4:29 PM, Dong Lin wrote: > > > Hello Kafka users, developers and client-developers, > > > > This is the first

Re: [VOTE] 1.1.1 RC0

2018-06-19 Thread Ted Yu
+1 Ran unit test suite which passed. Checked signatures. On Tue, Jun 19, 2018 at 4:47 PM, Dong Lin wrote: > Re-send to kafka-clie...@googlegroups.com > > On Tue, Jun 19, 2018 at 4:29 PM, Dong Lin wrote: > > > Hello Kafka users, developers and client-developers, > > > > This is the first

Re: Native client c++

2018-06-19 Thread Ted Yu
Please use HBASE-14850 branch which works with hbase 2.0 Cheers On Tue, Jun 19, 2018 at 7:30 AM, Andrzej wrote: > I have written previous my library based on native_client sources in any > branch. Those worked with HBase 1.3 but now not works with HBase 2.0 > I again want compile my library

Re: Exception while submitting jobs through Yarn

2018-06-19 Thread Ted Yu
Since you're using a vendor's distro, I would suggest asking on their user forum. Cheers Original message From: Garvit Sharma Date: 6/19/18 3:34 AM (GMT-08:00) To: trohrm...@apache.org Cc: Amit Jain , Chesnay Schepler , Ted Yu , user@flink.apache.org Subject: Re: Exception

Re: Please review FLINK-9610 Add Kafka partitioner that uses the key to partition by

2018-06-19 Thread Ted Yu
Interesting enhancement. I left a minor comment on the PR. Cheers On Tue, Jun 19, 2018 at 12:26 AM, Niels Basjes wrote: > Hi, > > Yesterday we ran into problems regarding the distribution of records across > Kafka where Flink was used as the producer. So we fixed this and realized > that the

[jira] [Created] (KYLIN-3417) Consider replacing ReentrantReadWriteLock with StampedLock

2018-06-19 Thread Ted Yu (JIRA)
Ted Yu created KYLIN-3417: - Summary: Consider replacing ReentrantReadWriteLock with StampedLock Key: KYLIN-3417 URL: https://issues.apache.org/jira/browse/KYLIN-3417 Project: Kylin Issue Type

[jira] [Created] (KYLIN-3417) Consider replacing ReentrantReadWriteLock with StampedLock

2018-06-19 Thread Ted Yu (JIRA)
Ted Yu created KYLIN-3417: - Summary: Consider replacing ReentrantReadWriteLock with StampedLock Key: KYLIN-3417 URL: https://issues.apache.org/jira/browse/KYLIN-3417 Project: Kylin Issue Type

[jira] [Commented] (HBASE-20743) ASF License warnings for branch-1

2018-06-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516642#comment-16516642 ] Ted Yu commented on HBASE-20743: Yes. Here is excerpt from target/rat.txt : {code} hbase-error-prone

[jira] [Commented] (HBASE-20542) Better heap utilization for IMC with MSLABs

2018-06-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516625#comment-16516625 ] Ted Yu commented on HBASE-20542: When I ran the test locally with patch, I saw the following in test

[jira] [Updated] (KYLIN-3321) Set MALLOC_ARENA_MAX in script

2018-06-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated KYLIN-3321: -- Description: conf/setenv.sh would be good place to set MALLOC_ARENA_MAX which prevents native memory OOM

[jira] [Updated] (KYLIN-3394) Prepare for Kafka 2.0

2018-06-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated KYLIN-3394: -- Description: Kafka 2.0 is around the corner. I got the following when compiling against Kafka 2.0.0-SNAPSHOT

[jira] [Updated] (KYLIN-3399) Leaked lookup table in DictionaryGeneratorCLI#processSegment

2018-06-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated KYLIN-3399: -- Component/s: Client - CLI > Leaked lookup table in DictionaryGeneratorCLI#processSegm

Re: [VOTE] KIP-291: Have separate queues for control requests and data requests

2018-06-18 Thread Ted Yu
+1 On Mon, Jun 18, 2018 at 1:04 PM, Lucas Wang wrote: > Hi All, > > I've addressed a couple of comments in the discussion thread for KIP-291, > and > got no objections after making the changes. Therefore I would like to start > the voting thread. > > KIP: >

[jira] [Commented] (HBASE-20542) Better heap utilization for IMC with MSLABs

2018-06-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516172#comment-16516172 ] Ted Yu commented on HBASE-20542: {code} + public void waitForUpdates

[jira] [Commented] (HBASE-20542) Better heap utilization for IMC with MSLABs

2018-06-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516158#comment-16516158 ] Ted Yu commented on HBASE-20542: Took a quick look. {code} +while(!succ) { + currentActive

[jira] [Commented] (HBASE-20734) Colocate recovered edits directory with hbase.wal.dir

2018-06-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16515979#comment-16515979 ] Ted Yu commented on HBASE-20734: WALSplitter is annotated @InterfaceAudience.Private It has information

[jira] [Updated] (HBASE-20734) Colocate recovered edits directory with hbase.wal.dir

2018-06-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-20734: --- Fix Version/s: 3.0.0 > Colocate recovered edits directory with hbase.wal.

[jira] [Commented] (HBASE-20208) Review of SequenceIdAccounting.java

2018-06-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16515908#comment-16515908 ] Ted Yu commented on HBASE-20208: {code} [ERROR] /testptch/hbase/hbase-server/src/main/java/org/apache

[jira] [Updated] (HBASE-20208) Review of SequenceIdAccounting.java

2018-06-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-20208: --- Status: Open (was: Patch Available) > Review of SequenceIdAccounting.j

[jira] [Commented] (HBASE-20748) HBaseContext bulkLoad: being able to use custom versions

2018-06-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16515898#comment-16515898 ] Ted Yu commented on HBASE-20748: As Chia-ping commented on the PR, PR is not integrated with QA bot

Re: NPE in low level Kafka topology

2018-06-18 Thread Ted Yu
Can you show the related code from OneToManyGroupedProcessor ? Thanks On Mon, Jun 18, 2018 at 4:29 AM, Frank Lyaruu wrote: > Hi, I've upgraded our 0.11 based stream application to the trunk version, > and I get an intermittent NPE. It's is quite a big topology, and I haven't > succeeded in

[jira] [Commented] (HBASE-20748) HBaseContext bulkLoad: being able to use custom versions

2018-06-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16515728#comment-16515728 ] Ted Yu commented on HBASE-20748: Please also add a unit test utilizing the enhancement. > HBaseCont

[jira] [Commented] (HBASE-20748) HBaseContext bulkLoad: being able to use custom versions

2018-06-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16515727#comment-16515727 ] Ted Yu commented on HBASE-20748: bq. method would throw back to I think you meant 'fall back' Your

Re: [VOTE] KIP-280: Enhanced log compaction

2018-06-17 Thread Ted Yu
er A. > > Also, if existing topics might have data with record header key > "offset", the change would not be backward compatible either. > > > -Matthias > > On 6/16/18 6:59 PM, Ted Yu wrote: > > Pardon the brevity in my previous reply. > > I was talk

[jira] [Updated] (HBASE-20723) Custom hbase.wal.dir results in data loss because we write recovered edits into a different place than where the recovering region server looks for them

2018-06-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-20723: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 1.4.6 2.1.0

<    15   16   17   18   19   20   21   22   23   24   >