[jira] [Updated] (AMBARI-24032) Ambari should be selective about which HBase components that need to be restarted

2018-08-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-24032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated AMBARI-24032: Description: For hbase config changes that only involve hbase master, Ambari should explicitly say so

[jira] [Comment Edited] (FLINK-6105) Properly handle InterruptedException in HadoopInputFormatBase

2018-08-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307281#comment-16307281 ] Ted Yu edited comment on FLINK-6105 at 8/31/18 9:45 AM: In flink-connectors

[jira] [Comment Edited] (FLINK-9340) ScheduleOrUpdateConsumersTest may fail with Address already in use

2018-08-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507191#comment-16507191 ] Ted Yu edited comment on FLINK-9340 at 8/31/18 9:45 AM: I wonder if it is easier

[jira] [Comment Edited] (FLINK-9825) Upgrade checkstyle version to 8.6

2018-08-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575017#comment-16575017 ] Ted Yu edited comment on FLINK-9825 at 8/31/18 9:44 AM: Thanks, Dalong

[jira] [Commented] (HBASE-21129) Clean up duplicate codes in #equals and #hashCode methods of Filter

2018-08-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598498#comment-16598498 ] Ted Yu commented on HBASE-21129: Test failures were not related. After addressing FindBugs warning

Re: SPIP: Executor Plugin (SPARK-24918)

2018-08-31 Thread Ted Yu
+1 Original message From: Reynold Xin Date: 8/30/18 11:11 PM (GMT-08:00) To: Felix Cheung Cc: dev Subject: Re: SPIP: Executor Plugin (SPARK-24918) I actually had a similar use case a while ago, but not entirely the same. In my use case, Spark is already up, but I want to

[jira] [Commented] (HBASE-21052) After restoring a snapshot, table.jsp page for the table gets stuck

2018-08-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598455#comment-16598455 ] Ted Yu commented on HBASE-21052: For the new test, can you add assertion for how quickly

[jira] [Updated] (YARN-5579) Resourcemanager should surface failed state store operation prominently

2018-08-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated YARN-5579: - Description: I found the following in Resourcemanager log when I tried to figure out why application got stuck

[jira] [Updated] (FLINK-9363) Bump up the Jackson version

2018-08-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-9363: -- Description: CVE's for Jackson : CVE-2017-17485 CVE-2018-5968 CVE-2018-7489 We can upgrade to 2.9.5

[jira] [Updated] (FLINK-9924) Upgrade zookeeper to 3.4.13

2018-08-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-9924: -- Description: zookeeper 3.4.13 is being released. ZOOKEEPER-2959 fixes data loss when observer is used

[jira] [Commented] (HBASE-21129) Clean up duplicate codes in #equals and #hashCode methods of Filter

2018-08-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598152#comment-16598152 ] Ted Yu commented on HBASE-21129: QA is back. Triggered a QA run. > Clean up duplicate codes in #equ

[jira] [Commented] (HBASE-21132) return wrong result in rest multiget

2018-08-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597464#comment-16597464 ] Ted Yu commented on HBASE-21132: lgtm > return wrong result in rest multi

[jira] [Updated] (KYLIN-3447) Upgrade zookeeper to 3.4.13

2018-08-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated KYLIN-3447: -- Description: zookeeper 3.4.13 is being released with the following fixes: ZOOKEEPER-2959 fixes data loss when

[jira] [Updated] (KYLIN-3484) Update Hadoop version to 2.7.7

2018-08-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated KYLIN-3484: -- Description: We should upgrade the Hadoop 2.7 dependency to 2.7.7, to pick up bug and security fixes

[jira] [Updated] (KAFKA-7334) Suggest changing config for state.dir in case of FileNotFoundException

2018-08-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated KAFKA-7334: -- Description: Quoting stack trace from KAFKA-5998 : {code} WARN [2018-08-22 03:17:03,745

Re: a table is neither disable or enable

2018-08-29 Thread Ted Yu
ly? > > From the "Procedure" tab of the hbase ui, I see the "disable" is still > > running. > > > > Thanks. > > > > Antonio. > > > > On Wed, Aug 29, 2018 at 3:31 PM Ted Yu wrote: > > > >> The 'missing table descript

Re: a table is neither disable or enable

2018-08-29 Thread Ted Yu
> > [AM.ZK.Worker-pool2-t6552] master.RegionStates: Failed to open/close > ba912582f295f7ac0b83e7e419351602 set to FAILED_OPEN" > > > The version of hbase is 1.3.1 > > > Thanks. > > > Antonio. > > On Wed, Aug 29, 2018 at 2:28 PM Ted Yu wrote: >

Re: a table is neither disable or enable

2018-08-29 Thread Ted Yu
Do you have access to master / region logs for when FAILED_OPEN state was noticed ? There should be some hint there as to why some region couldn't open. The length of table DDL is related to number of regions the table has. But the length should be less related to data amount. Which version of

[jira] [Updated] (KAFKA-7345) Potentially unclosed FileChannel in StateDirectory#unlock

2018-08-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated KAFKA-7345: -- Description: {code} locks.remove(taskId); lockAndOwner.lock.release

[jira] [Commented] (HBASE-21129) Clean up duplicate codes in #equals and #hashCode methods of Filter

2018-08-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596634#comment-16596634 ] Ted Yu commented on HBASE-21129: Thanks for the quick turn around. lgtm, pending QA. > Clean

[jira] [Commented] (HBASE-21129) Clean up duplicate codes in #equals and #hashCode methods of Filter

2018-08-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596620#comment-16596620 ] Ted Yu commented on HBASE-21129: For FirstKeyOnlyFilter, can you use foundKV ? I don't have suggestion

[jira] [Commented] (HBASE-21129) Clean up duplicate codes in #equals and #hashCode methods of Filter

2018-08-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596463#comment-16596463 ] Ted Yu commented on HBASE-21129: For FamilyFilter.java, hashCode is dropped. This is because we

[jira] [Resolved] (HBASE-14783) Proc-V2: Master aborts when downgrading from 1.3 to 1.1

2018-08-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-14783. Resolution: Later > Proc-V2: Master aborts when downgrading from 1.3 to

[jira] [Resolved] (HBASE-14783) Proc-V2: Master aborts when downgrading from 1.3 to 1.1

2018-08-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-14783. Resolution: Later > Proc-V2: Master aborts when downgrading from 1.3 to

[jira] [Resolved] (HBASE-14716) Detection of orphaned table znode should cover table in Enabled state

2018-08-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-14716. Resolution: Later > Detection of orphaned table znode should cover table in Enabled st

[jira] [Resolved] (HBASE-14716) Detection of orphaned table znode should cover table in Enabled state

2018-08-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-14716. Resolution: Later > Detection of orphaned table znode should cover table in Enabled st

[jira] [Comment Edited] (HBASE-21122) bulkload multi-version Cell supported in hbase-spark module

2018-08-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595329#comment-16595329 ] Ted Yu edited comment on HBASE-21122 at 8/28/18 5:19 PM: - I tried to run

[jira] [Commented] (HBASE-21122) bulkload multi-version Cell supported in hbase-spark module

2018-08-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595329#comment-16595329 ] Ted Yu commented on HBASE-21122: I tried to run the added test alone: {code} [ERROR] /mnt/disk2/a/hbase

[jira] [Commented] (KAFKA-7304) memory leakage in org.apache.kafka.common.network.Selector

2018-08-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595315#comment-16595315 ] Ted Yu commented on KAFKA-7304: --- [~yuyang08]: Please confirm that the gap between the following two metrics

[jira] [Created] (KYLIN-3519) Upgrade Jacoco version to 0.8.2

2018-08-28 Thread Ted Yu (JIRA)
Ted Yu created KYLIN-3519: - Summary: Upgrade Jacoco version to 0.8.2 Key: KYLIN-3519 URL: https://issues.apache.org/jira/browse/KYLIN-3519 Project: Kylin Issue Type: Improvement Reporter

[jira] [Created] (KYLIN-3519) Upgrade Jacoco version to 0.8.2

2018-08-28 Thread Ted Yu (JIRA)
Ted Yu created KYLIN-3519: - Summary: Upgrade Jacoco version to 0.8.2 Key: KYLIN-3519 URL: https://issues.apache.org/jira/browse/KYLIN-3519 Project: Kylin Issue Type: Improvement Reporter

[jira] [Commented] (KYLIN-3482) Unclosed SetAndUnsetThreadLocalConfig in SparkCubingByLayer

2018-08-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595265#comment-16595265 ] Ted Yu commented on KYLIN-3482: --- Some more occurrences of calling KylinConfig.setAndUnsetThreadLocalConfig

[jira] [Commented] (KAFKA-7304) memory leakage in org.apache.kafka.common.network.Selector

2018-08-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595251#comment-16595251 ] Ted Yu commented on KAFKA-7304: --- One potential cause for the delayed closing of idle connections

[jira] [Comment Edited] (FLINK-9150) Prepare for Java 10

2018-08-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473198#comment-16473198 ] Ted Yu edited comment on FLINK-9150 at 8/28/18 3:29 AM: Similar error

[jira] [Commented] (HBASE-21122) bulkload multi-version Cell supported in hbase-spark module

2018-08-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594453#comment-16594453 ] Ted Yu commented on HBASE-21122: Can you take a look at other tests under the same directory

[jira] [Commented] (HBASE-21088) HStoreFile should be closed in HStore#hasReferences

2018-08-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594377#comment-16594377 ] Ted Yu commented on HBASE-21088: I would think those two branches should have this fix. > HStoreF

Re: 答复: [VOTE] KIP-347: Enable batching in FindCoordinatorRequest

2018-08-27 Thread Ted Yu
Looking at the code for solution #1: } else if (builder.build(version) instanceof List){ wouldn't AbstractRequest be gone due to type erasure ? Which solution do you favor ? Cheers On Mon, Aug 27, 2018 at 4:20 PM

[jira] [Commented] (HBASE-20734) Colocate recovered edits directory with hbase.wal.dir

2018-08-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594333#comment-16594333 ] Ted Yu commented on HBASE-20734: Took a quick look at patch v6. {code} + public HRegionFileSystem

Re: [VOTE] KIP-365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde

2018-08-27 Thread Ted Yu
+1 On Mon, Aug 27, 2018 at 12:18 PM John Roesler wrote: > +1 (non-binding) > > On Sat, Aug 25, 2018 at 1:16 PM Joan Goyeau wrote: > > > Hi, > > > > We want to make sure that we always have a serde for all Materialized, > > Serialized, Joined, Consumed and Produced. > > For that we can make use

Re: [VOTE] KIP-357: Add support to list ACLs per principal

2018-08-27 Thread Ted Yu
+1 On Mon, Aug 27, 2018 at 11:42 AM Priyank Shah wrote: > +1 (Non-binding) > > On 8/27/18, 9:24 AM, "Manikumar" wrote: > > Hi All, > > I would like to start voting on KIP-357 which allows to list ACLs per > principal using AclCommand (kafka-acls.sh) > > KIP: > >

[jira] [Created] (FLINK-10228) Add metrics for netty direct memory consumption

2018-08-27 Thread Ted Yu (JIRA)
Ted Yu created FLINK-10228: -- Summary: Add metrics for netty direct memory consumption Key: FLINK-10228 URL: https://issues.apache.org/jira/browse/FLINK-10228 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-10228) Add metrics for netty direct memory consumption

2018-08-27 Thread Ted Yu (JIRA)
Ted Yu created FLINK-10228: -- Summary: Add metrics for netty direct memory consumption Key: FLINK-10228 URL: https://issues.apache.org/jira/browse/FLINK-10228 Project: Flink Issue Type: Improvement

[jira] [Updated] (HBASE-21088) HStoreFile should be closed in HStore#hasReferences

2018-08-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21088: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 3.0.0

[jira] [Commented] (KAFKA-7345) Potentially unclosed FileChannel in StateDirectory#unlock

2018-08-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593820#comment-16593820 ] Ted Yu commented on KAFKA-7345: --- Replied on PR, copied below. >From the javadoc of FileLock: {c

[jira] [Commented] (HBASE-21122) bulkload multi-version Cell supported in hbase-spark module

2018-08-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593740#comment-16593740 ] Ted Yu commented on HBASE-21122: Is it possible to add a test that verifies the added support

Re: question on reducing number of versions

2018-08-26 Thread Ted Yu
This depends on how far down you revise the max versions for table t2. If your data normally only reaches 15000 versions and you lower max versions to ~15000, there wouldn't be much saving. FYI On Sun, Aug 26, 2018 at 3:52 PM Antonio Si wrote: > Thanks Anil. > > We are using hbase on s3. Yes,

[jira] [Created] (KAFKA-7345) Potentially unclosed FileChannel in StateDirectory#unlock

2018-08-26 Thread Ted Yu (JIRA)
Ted Yu created KAFKA-7345: - Summary: Potentially unclosed FileChannel in StateDirectory#unlock Key: KAFKA-7345 URL: https://issues.apache.org/jira/browse/KAFKA-7345 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-7345) Potentially unclosed FileChannel in StateDirectory#unlock

2018-08-26 Thread Ted Yu (JIRA)
Ted Yu created KAFKA-7345: - Summary: Potentially unclosed FileChannel in StateDirectory#unlock Key: KAFKA-7345 URL: https://issues.apache.org/jira/browse/KAFKA-7345 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-7304) memory leakage in org.apache.kafka.common.network.Selector

2018-08-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592857#comment-16592857 ] Ted Yu commented on KAFKA-7304: --- I am looking at SaslSslAdminClientIntegrationTest . It seems some getter

[jira] [Commented] (KAFKA-7304) memory leakage in org.apache.kafka.common.network.Selector

2018-08-25 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592765#comment-16592765 ] Ted Yu commented on KAFKA-7304: --- Thanks for the feedback, Yu. There are a few {{log.error()}} calls

[jira] [Commented] (HBASE-15410) Utilize the max seek value when all Filters in MUST_PASS_ALL FilterList return SEEK_NEXT_USING_HINT

2018-08-25 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592759#comment-16592759 ] Ted Yu commented on HBASE-15410: It seems the following two fields of FilterListBase: {code} protected

[jira] [Commented] (HBASE-15410) Utilize the max seek value when all Filters in MUST_PASS_ALL FilterList return SEEK_NEXT_USING_HINT

2018-08-25 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592754#comment-16592754 ] Ted Yu commented on HBASE-15410: Now that HBASE-19008 has been integrated, I wonder whether we can

[jira] [Commented] (KAFKA-7304) memory leakage in org.apache.kafka.common.network.Selector

2018-08-25 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592752#comment-16592752 ] Ted Yu commented on KAFKA-7304: --- In patch v7, I added some assertion to SslTransportLayerTest#teardown

[jira] [Updated] (KAFKA-7304) memory leakage in org.apache.kafka.common.network.Selector

2018-08-25 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated KAFKA-7304: -- Attachment: 7304.v7.txt > memory leakage in org.apache.kafka.common.network.Selec

Re: time out when running CellCounter

2018-08-25 Thread Ted Yu
, Aug 25, 2018 at 2:49 PM Antonio Si wrote: > Thanks Ted. > > I try passing "-Dhbase.client.scanner.timeout.period=180" when I invoke > CellCounter, but it is still saying timeout after 600 sec. > > Thanks. > > Antonio. > > On Sat, Aug 25, 2018 at 2:09 PM T

[jira] [Created] (KAFKA-7344) Return early when all tasks are assigned in StickyTaskAssignor#assignActive

2018-08-25 Thread Ted Yu (JIRA)
Ted Yu created KAFKA-7344: - Summary: Return early when all tasks are assigned in StickyTaskAssignor#assignActive Key: KAFKA-7344 URL: https://issues.apache.org/jira/browse/KAFKA-7344 Project: Kafka

[jira] [Created] (KAFKA-7344) Return early when all tasks are assigned in StickyTaskAssignor#assignActive

2018-08-25 Thread Ted Yu (JIRA)
Ted Yu created KAFKA-7344: - Summary: Return early when all tasks are assigned in StickyTaskAssignor#assignActive Key: KAFKA-7344 URL: https://issues.apache.org/jira/browse/KAFKA-7344 Project: Kafka

Re: time out when running CellCounter

2018-08-25 Thread Ted Yu
It seems CellCounter doesn't have such (commandline) option. You can specify, e.g. scan timerange, scan max versions, start row, stop row, etc. so that individual run has shorter runtime. Cheers On Sat, Aug 25, 2018 at 9:35 AM Antonio Si wrote: > Hi, > > When I run

Re: unable to build schema registry

2018-08-24 Thread Ted Yu
The first error was complaining about this class from Kafka clients: clients/src/main/java/org/apache/kafka/common/utils/Timer.java It seems you haven't installed kafka clients jar into local maven repo. You can run the following command under kafka working dir: ./gradlew installAll I just

Re: [VOTE] KIP-363: Make FunctionConversions private

2018-08-24 Thread Ted Yu
gt; > > > On Fri, 24 Aug 2018 at 19:14 John Roesler wrote: > > > > > > > I'm also in favor of this. I don't think it's controversial either. > > > Should > > > > we just move to a vote? > > > > > > > > On Thu, Aug 23, 2018 at

[jira] [Updated] (HBASE-21098) Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3

2018-08-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21098: --- Release Note: It is recommended to place the working directory on-cluster on HDFS as doing so has shown

[jira] [Commented] (HBASE-21097) Flush pressure assertion may fail in testFlushThroughputTuning

2018-08-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591726#comment-16591726 ] Ted Yu commented on HBASE-21097: Ran the test with different memory settings: {code} 1979 mt -Dtest

[jira] [Commented] (HBASE-21097) Flush pressure assertion may fail in testFlushThroughputTuning

2018-08-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591720#comment-16591720 ] Ted Yu commented on HBASE-21097: Looks like using epsilon to judge how close the flush pressure would

[jira] [Updated] (HBASE-21097) Flush pressure assertion may fail in testFlushThroughputTuning

2018-08-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21097: --- Attachment: 21097.v2.txt > Flush pressure assertion may fail in testFlushThroughputTun

[jira] [Commented] (HBASE-21097) Flush pressure assertion may fail in testFlushThroughputTuning

2018-08-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591426#comment-16591426 ] Ted Yu commented on HBASE-21097: Interesting. >From >https://builds.apache.org/job/HBase%20Night

[jira] [Commented] (HBASE-20993) [Auth] IPC client fallback to simple auth allowed doesn't work

2018-08-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591156#comment-16591156 ] Ted Yu commented on HBASE-20993: I tried running TestInsecureIPC in master branch but got compilation

[jira] [Commented] (HBASE-20993) [Auth] IPC client fallback to simple auth allowed doesn't work

2018-08-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591152#comment-16591152 ] Ted Yu commented on HBASE-20993: Looks good overall. For BlockingRpcConnection : {code

[jira] [Commented] (HBASE-21098) Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3

2018-08-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591047#comment-16591047 ] Ted Yu commented on HBASE-21098: Can you put the above response in release note ? Please also look

[jira] [Commented] (HBASE-21098) Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3

2018-08-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590904#comment-16590904 ] Ted Yu commented on HBASE-21098: {code} public static final String SNAPSHOT_WORKING_DIR

Re: Build failed in Jenkins: kafka-trunk-jdk10 #429

2018-08-23 Thread Ted Yu
I ran streams unit tests as of commit 4156ea0a9bcca67d209fd3b43d2268c9abd5a0b5 . All tests passed locally. FYI On Thu, Aug 23, 2018 at 12:23 PM Joan Goyeau wrote: > I'm looking into this one. > > On Thu, 23 Aug 2018 at 20:19 Apache Jenkins Server < > jenk...@builds.apache.org> wrote: > > >

[jira] [Commented] (HBASE-21097) Flush pressure assertion may fail in testFlushThroughputTuning

2018-08-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590747#comment-16590747 ] Ted Yu commented on HBASE-21097: Thanks for checking. > Flush pressure assertion may f

Re: [DISCUSS] KIP-363: Make FunctionConversions private

2018-08-23 Thread Ted Yu
+1 In the Motivation section, you can quote the comment from pull request so that reader doesn't have to click through. Cheers On Thu, Aug 23, 2018 at 12:13 PM Joan Goyeau wrote: > Hi, > > As pointed out in this comment #5539 (comment) >

[jira] [Commented] (KAFKA-5998) /.checkpoint.tmp Not found exception

2018-08-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590729#comment-16590729 ] Ted Yu commented on KAFKA-5998: --- Logged KAFKA-7334 for improving exception message. The stack trace

[jira] [Created] (KAFKA-7334) Suggest changing config for state.dir in case of FileNotFoundException

2018-08-23 Thread Ted Yu (JIRA)
Ted Yu created KAFKA-7334: - Summary: Suggest changing config for state.dir in case of FileNotFoundException Key: KAFKA-7334 URL: https://issues.apache.org/jira/browse/KAFKA-7334 Project: Kafka

[jira] [Created] (KAFKA-7334) Suggest changing config for state.dir in case of FileNotFoundException

2018-08-23 Thread Ted Yu (JIRA)
Ted Yu created KAFKA-7334: - Summary: Suggest changing config for state.dir in case of FileNotFoundException Key: KAFKA-7334 URL: https://issues.apache.org/jira/browse/KAFKA-7334 Project: Kafka

[jira] [Updated] (HBASE-21097) Flush pressure assertion may fail in testFlushThroughputTuning

2018-08-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21097: --- Resolution: Fixed Assignee: Ted Yu Hadoop Flags: Reviewed Fix Version/s: 2.2.0

[jira] [Commented] (KAFKA-5998) /.checkpoint.tmp Not found exception

2018-08-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590547#comment-16590547 ] Ted Yu commented on KAFKA-5998: --- bq. java.nio.file.NoSuchFileException: /tmp/kafka-streams//0_45

[jira] [Comment Edited] (HBASE-19008) Add missing equals or hashCode method(s) to stock Filter implementations

2018-08-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590475#comment-16590475 ] Ted Yu edited comment on HBASE-19008 at 8/23/18 4:32 PM: - Reid: You can drop

[jira] [Commented] (HBASE-19008) Add missing equals or hashCode method(s) to stock Filter implementations

2018-08-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590475#comment-16590475 ] Ted Yu commented on HBASE-19008: Reid: You can drop the changes to 19008-21.patch in patch v21 and apply

[jira] [Commented] (KAFKA-7316) Use of filter method in KTable.scala may result in StackOverflowError

2018-08-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590450#comment-16590450 ] Ted Yu commented on KAFKA-7316: --- When would PR #5539 be merged ? > Use of filter method in KTable.sc

[jira] [Updated] (HBASE-21097) Flush pressure assertion may fail in testFlushThroughputTuning

2018-08-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21097: --- Priority: Major (was: Minor) > Flush pressure assertion may fail in testFlushThroughputTun

[jira] [Commented] (HBASE-19008) Add missing equals or hashCode method(s) to stock Filter implementations

2018-08-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590414#comment-16590414 ] Ted Yu commented on HBASE-19008: TestFlushWithThroughputController is being handled in HBASE-21097

[jira] [Updated] (HBASE-21097) Flush pressure assertion may fail in testFlushThroughputTuning

2018-08-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21097: --- Status: Patch Available (was: Open) > Flush pressure assertion may fail in testFlushThroughputTun

[jira] [Updated] (HBASE-21097) Flush pressure assertion may fail in testFlushThroughputTuning

2018-08-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21097: --- Attachment: 21097.v1.txt > Flush pressure assertion may fail in testFlushThroughputTun

[jira] [Commented] (HBASE-19008) Add missing equals or hashCode method(s) to stock Filter implementations

2018-08-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589630#comment-16589630 ] Ted Yu commented on HBASE-19008: See: http://hbase.apache.org/book.html

[jira] [Commented] (KAFKA-7327) kafak主节点cpu 内存持续飙高,不回收,最后服务挂掉问题?

2018-08-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589609#comment-16589609 ] Ted Yu commented on KAFKA-7327: --- Have you seen KAFKA-7304 ? BTW my patch over KAFKA-7304 may not fix

[jira] [Commented] (KAFKA-7327) kafak主节点cpu 内存持续飙高,不回收,最后服务挂掉问题?

2018-08-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589606#comment-16589606 ] Ted Yu commented on KAFKA-7327: --- Please use English when reporting bug. How about the following as subject

[jira] [Commented] (HBASE-20942) Make RpcServer trace log length configurable

2018-08-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589592#comment-16589592 ] Ted Yu commented on HBASE-20942: Krish: You can upload patch now. > Make RpcServer trace log len

[jira] [Assigned] (HBASE-20942) Make RpcServer trace log length configurable

2018-08-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reassigned HBASE-20942: -- Assignee: Krish Dey > Make RpcServer trace log length configura

Re: [DISCUSS] KIP-361: Add Consumer Configuration to Disable Auto Topic Creation

2018-08-22 Thread Ted Yu
We may also consider : "suppress.auto.topic.creation" or "allow.auto.topic.creation" w.r.t. suppress or allow, I don't have strong opinion either. It's just a matter of choosing the proper default value. Cheers On Wed, Aug 22, 2018 at 6:00 PM Dhruvil Shah wrote: > Hi Matthias, > > Do you

[jira] [Commented] (HBASE-19008) Add missing equals or hashCode method(s) to stock Filter implementations

2018-08-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589400#comment-16589400 ] Ted Yu commented on HBASE-19008: Reid: Please go ahead with merge. > Add missing equals or hashC

[jira] [Created] (HBASE-21097) Flush pressure assertion may fail in testFlushThroughputTuning

2018-08-22 Thread Ted Yu (JIRA)
Ted Yu created HBASE-21097: -- Summary: Flush pressure assertion may fail in testFlushThroughputTuning Key: HBASE-21097 URL: https://issues.apache.org/jira/browse/HBASE-21097 Project: HBase Issue

[jira] [Created] (HBASE-21097) Flush pressure assertion may fail in testFlushThroughputTuning

2018-08-22 Thread Ted Yu (JIRA)
Ted Yu created HBASE-21097: -- Summary: Flush pressure assertion may fail in testFlushThroughputTuning Key: HBASE-21097 URL: https://issues.apache.org/jira/browse/HBASE-21097 Project: HBase Issue

Re: how to get rowkey with largest number of versions

2018-08-22 Thread Ted Yu
Antonio: Please take a look at CellCounter under hbase-mapreduce module which may be of use to you: * 6. Total number of versions of each qualifier. Please note that the max versions may fluctuate depending on when major compaction kicks in. FYI On Wed, Aug 22, 2018 at 11:53 AM Ankit

[jira] [Created] (SPARK-25201) Synchronization performed on AtomicReference in LevelDB class

2018-08-22 Thread Ted Yu (JIRA)
Ted Yu created SPARK-25201: -- Summary: Synchronization performed on AtomicReference in LevelDB class Key: SPARK-25201 URL: https://issues.apache.org/jira/browse/SPARK-25201 Project: Spark Issue

[jira] [Updated] (HBASE-21088) HStoreFile should be closed in HStore#hasReferences

2018-08-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21088: --- Attachment: 21088.v4.txt > HStoreFile should be closed in HStore#hasReferen

Re: [DISCUSS] Minimum Maven Version

2018-08-22 Thread Ted Yu
I would choose #1 bq. if we ever try to backport the hbase-spark module. I doubt this would ever happen for the 2.x releases. Cheers On Wed, Aug 22, 2018 at 9:26 AM Mike Drob wrote: > Hi Devs, > > Our current minimum maven version is 3.0.4, this is both enforced by the > enforcer plugin and

[jira] [Commented] (HBASE-21084) When cloning a snapshot including a split parent region, the split parent region of the cloned table will be online

2018-08-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589092#comment-16589092 ] Ted Yu commented on HBASE-21084: lgtm > When cloning a snapshot including a split parent reg

[jira] [Updated] (HBASE-21088) HStoreFile should be closed in HStore#hasReferences

2018-08-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21088: --- Attachment: 21088.v3.txt > HStoreFile should be closed in HStore#hasReferen

[jira] [Commented] (HBASE-19008) Add missing equals or hashCode method(s) to stock Filter implementations

2018-08-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588891#comment-16588891 ] Ted Yu commented on HBASE-19008: Test failures were not related to the patch. > Add missing equ

<    7   8   9   10   11   12   13   14   15   16   >