Re: May report draft

2018-05-02 Thread Ted Yu
+1 On Wed, May 2, 2018 at 8:27 AM, Billie Rinaldi wrote: > Hi all, here is a draft of our report due today. If there are no objections > / suggestions, I'll post this by the end of the day. > > Slider > > Slider is a collection of tools and technologies to package,

Re: Welcoming a new committer

2018-02-26 Thread Ted Yu
Welcome, Kyungwan ! On Mon, Feb 26, 2018 at 9:16 AM, Billie Rinaldi wrote: > I'd like to welcome Kyungwan Nam, a new committer and PPMC member for > Apache Slider! >

Re: Podling Report Reminder - February 2017

2017-02-02 Thread Ted Yu
+1 On Thu, Feb 2, 2017 at 8:47 AM, Gour Saha wrote: > Billie, thank you for the draft. > > +1. It looks good to me. > > -Gour > > On 2/2/17, 6:31 AM, "Billie Rinaldi" wrote: > > >Here's a draft of the board report which is due today. Let me know

[jira] [Commented] (SLIDER-1055) hbase-daemon executed by slider is excepted from nodemanager container monitoring

2016-01-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15094310#comment-15094310 ] Ted Yu commented on SLIDER-1055: Would this situation be observed in Slider Accumulo, etc as well

Re: [VOTE] Apache Slider (incubating) release 0.90.2-incubating-RC1

2015-12-29 Thread Ted Yu
I ran test suite (against hadoop 2.7.0) on Linux and got: Tests in error: TestAgentClientProvider2.initializationError » Verify Bad method call f... TestSliderClientMethods.initializationError » Verify Bad method call fr...

Re: [VOTE] Apache Slider (incubating) release 0.90.2-incubating-RC1

2015-12-29 Thread Ted Yu
etup (so > probably lots of my tests just no-op'ed themselves). > > Out of curiosity, were you running OpenJDK or Oracle? > > Ted Yu wrote: > >> I ran test suite (against hadoop 2.7.0) on Linux and got: >> >> Tests in error: >>TestAgentClien

Re: [VOTE] Apache Slider (incubating) release 0.90.2-incubating-RC1

2015-12-29 Thread Ted Yu
M, Jon Maron <jma...@hortonworks.com> wrote: > Does looks like this issue: > https://bugs.openjdk.java.net/browse/JDK-8051012. I can find instances > on the web referencing the version you use with this issue (groovy > compatibility issue) > > > On Dec 29, 2015, at 12:3

[jira] [Resolved] (SLIDER-1011) Slider-hbase-app should export zk-path to user

2015-12-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-1011. Resolution: Fixed Thanks for the patch, Yongshe. > Slider-hbase-app should export zk-path to u

[jira] [Assigned] (SLIDER-1011) Slider-hbase-app should export zk-path to user

2015-12-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reassigned SLIDER-1011: -- Assignee: fengyongshe > Slider-hbase-app should export zk-path to u

[jira] [Resolved] (SLIDER-1015) hbase.bulkload.staging.dir should take user name into account

2015-12-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-1015. Resolution: Fixed > hbase.bulkload.staging.dir should take user name into acco

[jira] [Created] (SLIDER-1015) hbase.bulkload.staging.dir should take user name into account

2015-12-09 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-1015: -- Summary: hbase.bulkload.staging.dir should take user name into account Key: SLIDER-1015 URL: https://issues.apache.org/jira/browse/SLIDER-1015 Project: Slider Issue

[jira] [Updated] (SLIDER-1011) Slider-hbase-app should export zk-path to user

2015-12-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SLIDER-1011: --- Description: when developers adopt java client API to perform CRUD operations on HBase tables.Here

[jira] [Commented] (SLIDER-1011) Slider-hbase-app should export zk-path to user

2015-12-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045361#comment-15045361 ] Ted Yu commented on SLIDER-1011: lgtm > Slider-hbase-app should export zk-path to u

[jira] [Created] (SLIDER-941) Add JAAS config templates

2015-09-23 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-941: - Summary: Add JAAS config templates Key: SLIDER-941 URL: https://issues.apache.org/jira/browse/SLIDER-941 Project: Slider Issue Type: Bug Reporter: Ted Yu

[jira] [Resolved] (SLIDER-914) Make hbase.bulkload.staging.dir config unique per Slider instance

2015-07-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-914. --- Resolution: Fixed Make hbase.bulkload.staging.dir config unique per Slider instance

[jira] [Created] (SLIDER-914) Make hbase.bulkload.staging.dir config unique per Slider instance

2015-07-13 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-914: - Summary: Make hbase.bulkload.staging.dir config unique per Slider instance Key: SLIDER-914 URL: https://issues.apache.org/jira/browse/SLIDER-914 Project: Slider Issue

Re: new committer

2015-07-07 Thread Ted Yu
Welcome, Thomas. On Tue, Jul 7, 2015 at 9:49 AM, Billie Rinaldi billie.rina...@gmail.com wrote: Welcome Thomas Liu, a new committer and PPMC member for Apache Slider!

[jira] [Created] (SLIDER-909) Add missing config for hadoop.security.authentication in HBase app package

2015-07-02 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-909: - Summary: Add missing config for hadoop.security.authentication in HBase app package Key: SLIDER-909 URL: https://issues.apache.org/jira/browse/SLIDER-909 Project: Slider

[jira] [Resolved] (SLIDER-909) Add missing config for hadoop.security.authentication in HBase app package

2015-07-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-909. --- Resolution: Fixed Add missing config for hadoop.security.authentication in HBase app package

[jira] [Created] (SLIDER-899) Phoenix UDF should be enabled by default in appConfig-phoenix-default.json

2015-06-06 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-899: - Summary: Phoenix UDF should be enabled by default in appConfig-phoenix-default.json Key: SLIDER-899 URL: https://issues.apache.org/jira/browse/SLIDER-899 Project: Slider

[jira] [Created] (SLIDER-893) Add SecureBulkLoadEndpoint to hbase.coprocessor.region.classes

2015-06-01 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-893: - Summary: Add SecureBulkLoadEndpoint to hbase.coprocessor.region.classes Key: SLIDER-893 URL: https://issues.apache.org/jira/browse/SLIDER-893 Project: Slider Issue Type

[jira] [Resolved] (SLIDER-893) Add SecureBulkLoadEndpoint to hbase.coprocessor.region.classes

2015-06-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-893. --- Resolution: Fixed Resolved through commit 38d5d908b294bae703a76af90fa711e41b36082f Add

Re: Building Slider with Hadoop 2.7 (trying to use updateBlackList method in AMRMClientAsync)

2015-05-29 Thread Ted Yu
There is a release-2.7 profile you can use without modifying hadoop.version in pom.xml Can you pastebin the stack trace you got w.r.t. updateBlackList ? Cheers On Fri, May 29, 2015 at 8:38 PM, Rajesh Kartha karth...@gmail.com wrote: Hello all, I am using the mvn clean site:site site:stage

Re: Interest in including a package for Solr in Slider?

2015-05-27 Thread Ted Yu
Please open a JIRA. Thanks On Wed, May 27, 2015 at 6:24 AM, Timothy Potter thelabd...@gmail.com wrote: Hi, I'm a committer on the Lucene/Solr project and have developed a basic solution for deploying Solr to YARN using Slider, see: https://github.com/LucidWorks/solr-slider I'm reaching

Re: Re: slider registry --name cl1 --conf hbase --format xml cannot work with java 1.8

2015-05-16 Thread Ted Yu
Looks like you were reading out of date Slider doc. amwebfilter is no longer used in current develop branch. I searched *.md files and didn't find amwebfilter mentioned. Cheers On Sat, May 16, 2015 at 6:01 AM, xqfly...@163.com wrote: hello guys: i want fix this problem,so i read a

Re: [VOTE] Apache Slider Incubating Release 0.80.0-incubating

2015-05-12 Thread Ted Yu
+1 downloaded .ZIP file built on Linux and ran test suite checked Apache license On Mon, May 11, 2015 at 2:43 PM, Steve Loughran ste...@hortonworks.com wrote: On 8 May 2015, at 16:14, Gour Saha gs...@hortonworks.com wrote: Hello, This is a call for a vote on Apache Slider

Re: Question on the Slider-HBase application (0.80 build)

2015-05-10 Thread Ted Yu
Thanks for trying out 0.80.0 release. The error you saw was due to hbase.tmp.dir pointing to path which was valid on the node where container was running but invalid on the client. In the retrieved hbase-site.xml, you can replace with the following:

Re: slider may report

2015-05-06 Thread Ted Yu
+1 On Wed, May 6, 2015 at 6:05 AM, Jon Maron jma...@hortonworks.com wrote: +1 On May 6, 2015, at 8:58 AM, Billie Rinaldi billie.rina...@gmail.com wrote: How does this draft look? Slider Slider is a collection of tools and technologies to package, deploy, and manage long

Re: storm-slider-client availability

2015-05-04 Thread Ted Yu
Slider 0.80.0 release is coming by May 15, 2015 - according to Gour. storm-slider would be in that release. To keep up with latest development, please use develop branch. Cheers On Mon, May 4, 2015 at 8:59 AM, Jean-Baptiste Note jbn...@gmail.com wrote: Thanks a huge lot, storm-slider is

[jira] [Comment Edited] (SLIDER-819) Create addon package of Ranger for Hbase

2015-04-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520841#comment-14520841 ] Ted Yu edited comment on SLIDER-819 at 4/30/15 4:36 AM: I think

[jira] [Commented] (SLIDER-819) Create addon package of Phoenix and Ranger for Hbase

2015-04-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520784#comment-14520784 ] Ted Yu commented on SLIDER-819: --- Starting with DAL, Apache Phoenix is embedded in HBase app

[jira] [Commented] (SLIDER-819) Create addon package of Phoenix and Ranger for Hbase

2015-04-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520841#comment-14520841 ] Ted Yu commented on SLIDER-819: --- I think it is not advisable for the user to go the above

[jira] [Updated] (SLIDER-819) Create addon package of Ranger for Hbase

2015-04-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SLIDER-819: -- Summary: Create addon package of Ranger for Hbase (was: Create addon package of Phoenix and Ranger for Hbase

[jira] [Commented] (SLIDER-773) Add co-processor support for app packages

2015-04-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492312#comment-14492312 ] Ted Yu commented on SLIDER-773: --- Went through the above attachment - looks fine to me. Add

[jira] [Commented] (SLIDER-773) Add co-processor support for app packages

2015-04-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14491899#comment-14491899 ] Ted Yu commented on SLIDER-773: --- Fine with most of the responses above. bq. shall we use

[jira] [Updated] (SLIDER-773) Add co-processor support for app packages

2015-04-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SLIDER-773: -- Attachment: 773-suggest.txt Suggested change which folds two loops in ComponentInstanceState#getNextCommand

[jira] [Commented] (SLIDER-773) Add co-processor support for app packages

2015-04-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14491261#comment-14491261 ] Ted Yu commented on SLIDER-773: --- Some minor comments: {code} +log.debug(metainfo

Re: Redundant container request from slider causing high load on busy cluster

2015-03-23 Thread Ted Yu
The JIRAs you mentioned are somewhat dormant. You can open a Slider JIRA to track this issue. Thanks On Mon, Mar 23, 2015 at 10:44 AM, Shrijeet Paliwal shrijeet.pali...@gmail.com wrote: More evidence: Spark is also affected: https://issues.apache.org/jira/browse/SPARK-2687 One more

Re: [VOTE] Apache Slider Incubating Release 0.70.1-incubating

2015-03-19 Thread Ted Yu
+1 as well. Verified signatures. Ran test suite. On Thu, Mar 19, 2015 at 7:36 AM, Josh Elser els...@apache.org wrote: +1 Verified 814 and 815 were fixed. Ensured build passed sigs+xsums pass Gour Saha wrote: Hello, This is a call for a vote on Apache Slider 0.70.1-incubating

Re: Anti-affinity

2015-03-17 Thread Ted Yu
Support from YARN is needed. Please see https://issues.apache.org/jira/browse/YARN-1042 Cheers On Tue, Mar 17, 2015 at 1:56 AM, Krishna Kishore Bonagiri write2kish...@gmail.com wrote: Hi, Is there any plan to implement anti-affinity? I know it would obviously depend on the support for

Re: Apache Slider stop function not working

2015-03-14 Thread Ted Yu
Kishore: Looks like logging was at INFO level. Do you mind turning on DEBUG logging ? Thanks On Sat, Mar 14, 2015 at 7:39 AM, Krishna Kishore Bonagiri write2kish...@gmail.com wrote: Hi Steve, This is what I see in the AM's log since the STOP command is issued. Even though it indicates

Re: [VOTE] Release Apache Slider 0.70.0-incubating

2015-03-13 Thread Ted Yu
Checked signature Ran test suite. +1 On Fri, Mar 13, 2015 at 5:37 AM, 杨浩 yangha...@gmail.com wrote: +1 2015-03-13 0:48 GMT+08:00 Steve Loughran ste...@hortonworks.com: On 11 Mar 2015, at 13:43, Gour Saha gs...@hortonworks.com wrote: Hello, This is a call for a vote for

Re: [VOTE] Apache Slider Incubating Release 0.70.0-incubating

2015-03-09 Thread Ted Yu
+1 Checked hash/sigs Built from tag Ran test suite On Mon, Mar 9, 2015 at 6:06 PM, Josh Elser els...@apache.org wrote: +1 * Checked hash/sigs * Fetched Gour's key * Built from tag (a8919c84) * Ran rat check on source release * Verified issues from IPMC vote on 0.61.0 were resolved One

[jira] [Resolved] (SLIDER-734) Create wrapper script for hbase which retrieves hbase-site.xml from running cluster

2015-03-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-734. --- Resolution: Fixed Create wrapper script for hbase which retrieves hbase-site.xml from running cluster

[jira] [Resolved] (SLIDER-732) Allow more parameters to be passed to HBase thrift2 gateway

2015-03-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-732. --- Resolution: Fixed Allow more parameters to be passed to HBase thrift2 gateway

[jira] [Resolved] (SLIDER-731) Allow more parameters to be passed to HBase REST gateway

2015-02-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-731. --- Resolution: Fixed Allow more parameters to be passed to HBase REST gateway

Re: [VOTE] Move Slider to JDK7+

2015-02-20 Thread Ted Yu
+1 On Fri, Feb 20, 2015 at 2:00 PM, Sumit Mohanty sumit.moha...@gmail.com wrote: Given that Java 6 is no longer supported (even Java 7 will not be supported after Spring 2015) and Hadoop 2.7+ is JDK7+, we should have Slider move to JDK7+. This is a call to vote to have Slider move to JDK7+

[jira] [Created] (SLIDER-790) Enforce JDK7 javac for builds

2015-02-19 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-790: - Summary: Enforce JDK7 javac for builds Key: SLIDER-790 URL: https://issues.apache.org/jira/browse/SLIDER-790 Project: Slider Issue Type: Task Reporter: Ted Yu

[jira] [Resolved] (SLIDER-790) Enforce JDK7 javac for builds

2015-02-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-790. --- Resolution: Fixed Enforce JDK7 javac for builds - Key: SLIDER

[jira] [Updated] (SLIDER-734) Create wrapper script for hbase which retrieves hbase-site.xml from running cluster

2015-02-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SLIDER-734: -- Description: The wrapper, app-packages/hbase/hbase-slider.py, accepts slider-instance-name as parameter

Re: How do HBase and Accumulo handle failures during client RPC operations

2015-02-04 Thread Ted Yu
What Josh described w.r.t. client failing over to new server is mostly applicable to HBase as well. Cheers On Wed, Feb 4, 2015 at 8:12 AM, Josh Elser josh.el...@gmail.com wrote: For Accumulo, like you said, information is published in ZK for clients to find. Thinking about just the Accumulo

Re: Slider 0.50.2 requests container from decommissioned node.

2015-01-31 Thread Ted Yu
Tim: We have been improving role history in develop branch. Take a look at the recent JIRAs: SLIDER-743. Include node failure history when choosing placement hints SLIDER-647 allocation requests not being satisfied when a cluster goes to labels SLIDER-81. Support placement of containers on

Re: Slider 0.50.2 requests container from decommissioned node.

2015-01-31 Thread Ted Yu
The two JIRAs you mentioned were in 0.60 release (HDP 2.2) Please consider upgrading. Cheers On Sat, Jan 31, 2015 at 4:05 PM, Tim Israel t...@timisrael.com wrote: Thanks Ted, SLIDER-647 and SLIDER-439 were exactly what I was looking for. Tim On Sat, Jan 31, 2015 at 6:34 PM, Ted Yu yuzhih

[jira] [Commented] (SLIDER-764) Provide proper response when number of good nodes is lower than requested number of components

2015-01-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299358#comment-14299358 ] Ted Yu commented on SLIDER-764: --- bq. start with some criteria for the minimum number of each

[jira] [Updated] (SLIDER-764) Allow specification of minimum number of live containers for each component type

2015-01-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SLIDER-764: -- Summary: Allow specification of minimum number of live containers for each component type (was: Provide proper

[jira] [Commented] (SLIDER-757) Add Additional Resources

2015-01-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299383#comment-14299383 ] Ted Yu commented on SLIDER-757: --- {code} + * If the ADDTIONAL_RESOUERCE_DIR set, + * add

Re: [VOTE] Apache Slider Incubating Release 0.61.0-incubating

2015-01-29 Thread Ted Yu
+1 * Checked signatures * Built from source * Ran test suite On Thu, Jan 29, 2015 at 3:00 PM, Josh Elser els...@apache.org wrote: +1 (binding) * Filenames have -incubating * Xsums+sigs check out * KEYS has signing key * Built from source * Tarballs have LICENSE/NOTICE/DISCLAIMER *

[jira] [Created] (SLIDER-764) Provide proper response when number of good nodes is lower than requested number of components

2015-01-22 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-764: - Summary: Provide proper response when number of good nodes is lower than requested number of components Key: SLIDER-764 URL: https://issues.apache.org/jira/browse/SLIDER-764

Re: ApacheCon NA CFP

2015-01-21 Thread Ted Yu
I submitted a talk on Slider. Fyi On Jan 21, 2015, at 2:45 AM, Steve Loughran ste...@hortonworks.com wrote: If anyone wants to submit a talk to ApacheCon North America on Slider or using it, they have until Feb 1 http://events.linuxfoundation.org/events/apachecon-north-america

[jira] [Commented] (SLIDER-737) add LANG=en_US when executing shell command

2015-01-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14277792#comment-14277792 ] Ted Yu commented on SLIDER-737: --- lgtm add LANG=en_US when executing shell command

Re: The utility exported by resource management of slider agent

2015-01-10 Thread Ted Yu
We have wiki but it is very out of date: https://cwiki.apache.org/confluence/collector/pages.action?key=SLIDER Cheers On Sat, Jan 10, 2015 at 9:00 PM, Yong Feng fengyong...@gmail.com wrote: Hi Ted and Team I have written a slider package for a HPC cluster by taking hbase slider package as

[jira] [Commented] (SLIDER-742) Slider AM secure configuration

2015-01-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268804#comment-14268804 ] Ted Yu commented on SLIDER-742: --- What do you mean by MapReduceAM ? I don't see such class

[jira] [Updated] (SLIDER-742) Slider AM secure configuration

2015-01-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SLIDER-742: -- Summary: Slider AM secure configuration (was: Slider AM securied configuration) Slider AM secure

Re: Locality results in instance shut-down due to single bad instance

2015-01-06 Thread Ted Yu
Here is the meaning of 2 (see PlacementPolicy): * No data locality; do not bother trying to ask for any location */ public static final int NO_DATA_LOCALITY = 2; On Tue, Jan 6, 2015 at 4:15 PM, Gour Saha gs...@hortonworks.com wrote: Try setting property

Re: the component ha

2015-01-06 Thread Ted Yu
w.r.t. region ha, did you mean read replica ? bq. how config the backhmaster Did you mean secondary master ? You can specify 2 instances of HBASE_MASTER in resources.json Cheers On Tue, Jan 6, 2015 at 6:39 PM, liujs3 liu...@asiainfo.com wrote: hi, i see the least news about hbase ,it will

Re: 答复: the component ha

2015-01-06 Thread Ted Yu
Phase 2 of read replica hasn't been fully integrated to Apache HBase yet. Once that is done, you can produce hbase app package and utilize this feature. FYI On Tue, Jan 6, 2015 at 7:52 PM, liujs3 liu...@asiainfo.com wrote: Yes ,I mean that read replica -邮件原件- 发件人: Ted Yu

Re: How to set jvm option for HMaster

2015-01-05 Thread Ted Yu
杨浩: See the following example appConfig.json snippet: components: { HBASE_MASTER: { }, slider-appmaster: { *jvm.heapsize*: 256M, Cheers On Mon, Jan 5, 2015 at 7:27 AM, Steve Loughran ste...@hortonworks.com wrote: can you post your appconfig.json file, under your

[jira] [Resolved] (SLIDER-668) slider package CLI command to offer package management operations

2015-01-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-668. --- Resolution: Fixed Thanks for the patch, Vasanth slider package CLI command to offer package management

[jira] [Assigned] (SLIDER-668) slider package CLI command to offer package management operations

2015-01-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reassigned SLIDER-668: - Assignee: Vasanth kumar RJ slider package CLI command to offer package management operations

Re: [jira] [Created] (SLIDER-736) build hbase

2015-01-04 Thread Ted Yu
See app-packages/hbase/appConfig-default.json in source code where you can find example for hbase-site. core-site and hdfs-site can be plugged in the same manner. e.g.: site.hdfs-site.dfs.namenode.kerberos.principal: ${TODO-NN-PRINCIPAL},

Re: How Sliders configure configuration file of regionserver of HBase

2014-12-30 Thread Ted Yu
bq. host list of all the instances of a component Are you using node labels feature of YARN ? If not, the list would comprise of all the nodes in your YARN cluster. Cheers On Tue, Dec 30, 2014 at 4:43 PM, Yong Feng fengyong...@gmail.com wrote: Hi Team, The template of regionserver of HBase

Re: How Sliders configure configuration file of regionserver of HBase

2014-12-30 Thread Ted Yu
membership of master need restart whole cluster so we will not support flex up/down role of master. How can I know the host list of master role in Slider script or template? Thanks, Yong On Tue, Dec 30, 2014 at 9:08 PM, Ted Yu yuzhih...@gmail.com wrote: bq. host list of all the instances

[jira] [Commented] (SLIDER-668) slider package CLI command to offer package management operations

2014-12-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260286#comment-14260286 ] Ted Yu commented on SLIDER-668: --- {code} - * @param installPkgInfo the arguments needed

[jira] [Commented] (SLIDER-668) slider package CLI command to offer package management operations

2014-12-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260296#comment-14260296 ] Ted Yu commented on SLIDER-668: --- Patch v3 doesn't apply cleanly. After the above comments

Re: flex a different resource component . so i can use the all memory

2014-12-25 Thread Ted Yu
Currently memory for one component (region server in your case) has to have same amount of memory. Cheers On Dec 25, 2014, at 7:45 PM, liujs3 liu...@asiainfo.com wrote: When I run the slider , I want to flex a specified memory regionserver which is different in other running regionservers

Re: when i run slider0.40+hadoop2.4 i found the error log in slider-error.log

2014-12-25 Thread Ted Yu
bq. WARN security.SecurityUtils: Command openssl pkcs12 Are you deploying in a secure cluster ? Can you try with 0.60.0 and hadoop 2.6.0 ? Cheers On Thu, Dec 25, 2014 at 7:17 PM, liujs3 liu...@asiainfo.com wrote: 14/12/24 03:15:35 WARN util.NativeCodeLoader: Unable to load native-hadoop

Re: 答复: flex a different resource component . so i can use the all memory

2014-12-25 Thread Ted Yu
? For example :lastused is 4g all components, and this time I used 3g for all regionservers ? Best Regards! ocean floyd 亚信科技(中 国)有限公司 www.asiainfo.com BDX Mp:18513780630 E-mail:liu...@asiainfo.com -邮件原件- 发件人: Ted Yu [mailto:yuzhih...@gmail.com] 发送时间: 2014年12月26日 11:50 收件人: dev

[jira] [Commented] (SLIDER-668) slider package CLI command to offer package management operations

2014-12-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14258588#comment-14258588 ] Ted Yu commented on SLIDER-668: --- There're lines longer than 100 characters - please shorten

Re: Fail to build Slider 0.60.0

2014-12-22 Thread Ted Yu
On my Mac, ~/.m2/repository/net/java/jvnet-parent/1/jvnet-parent-1.pom lines 5 and 6 are in license header. ls -l ~/.m2/repository/net/java/jvnet-parent/1/jvnet-parent-1.pom -rw-r--r-- 1 tyu staff 4711 Jun 30 2013 /Users/tyu/.m2/repository/net/java/jvnet-parent/1/jvnet-parent-1.pom Can you

[jira] [Commented] (SLIDER-668) slider package CLI command to offer package management operations

2014-12-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255945#comment-14255945 ] Ted Yu commented on SLIDER-668: --- {code} -if (ACTION_INSTALL_PACKAGE.equals(action

[jira] [Created] (SLIDER-734) Create wrapper script for hbase which retrieves hbase-site.xml from running cluster

2014-12-22 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-734: - Summary: Create wrapper script for hbase which retrieves hbase-site.xml from running cluster Key: SLIDER-734 URL: https://issues.apache.org/jira/browse/SLIDER-734 Project: Slider

[jira] [Commented] (SLIDER-734) Create wrapper script for hbase which retrieves hbase-site.xml from running cluster

2014-12-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255980#comment-14255980 ] Ted Yu commented on SLIDER-734: --- Here is one sample run: {code} python hbase-wrapper.py

review board

2014-12-21 Thread Ted Yu
Hi, Who should I contact so that patch for Slider can be added to https://reviews.apache.org/r/new/ ? Cheers

Re: review board

2014-12-21 Thread Ted Yu
be a reference. On Monday, December 22, 2014, Jon Maron jma...@hortonworks.com wrote: I’ve wondered about that myself. I’m wondering if anything is really required administratively, or can we simply install RBTools and start posting reviews? On Dec 21, 2014, at 4:28 PM, Ted Yu yuzhih

[jira] [Created] (SLIDER-731) Allow more parameters to be passed to HBase REST gateway

2014-12-19 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-731: - Summary: Allow more parameters to be passed to HBase REST gateway Key: SLIDER-731 URL: https://issues.apache.org/jira/browse/SLIDER-731 Project: Slider Issue Type: Task

[jira] [Created] (SLIDER-730) Lack of synchronization in RoleStatus#serialize()

2014-12-18 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-730: - Summary: Lack of synchronization in RoleStatus#serialize() Key: SLIDER-730 URL: https://issues.apache.org/jira/browse/SLIDER-730 Project: Slider Issue Type: Bug

[jira] [Resolved] (SLIDER-730) Lack of synchronization in RoleStatus#serialize()

2014-12-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-730. --- Resolution: Fixed Lack of synchronization in RoleStatus#serialize

[jira] [Created] (SLIDER-728) Placement policy for thrift / REST / thrift2 should be strict

2014-12-17 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-728: - Summary: Placement policy for thrift / REST / thrift2 should be strict Key: SLIDER-728 URL: https://issues.apache.org/jira/browse/SLIDER-728 Project: Slider Issue Type

[jira] [Resolved] (SLIDER-728) Placement policy for thrift / REST / thrift2 should be strict

2014-12-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-728. --- Resolution: Fixed Placement policy for thrift / REST / thrift2 should be strict

Re: Is it able to specify the percentage of memory instead of # of MB

2014-12-02 Thread Ted Yu
I created SLIDER-691 for this feature. Cheers On Tue, Dec 2, 2014 at 7:09 AM, Steve Loughran ste...@hortonworks.com wrote: I don't even think we can ask yarn for the percentage of memory I do understand what you are trying to do: ask for 51%. We could do something where we can query YARN

[jira] [Created] (SLIDER-690) Add appConfig template for HBase Phoenix deployment

2014-12-01 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-690: - Summary: Add appConfig template for HBase Phoenix deployment Key: SLIDER-690 URL: https://issues.apache.org/jira/browse/SLIDER-690 Project: Slider Issue Type: Task

[jira] [Resolved] (SLIDER-690) Add appConfig template for HBase Phoenix deployment

2014-12-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-690. --- Resolution: Fixed Add appConfig template for HBase Phoenix deployment

Re: Current Status of HOYA

2014-11-19 Thread Ted Yu
Yes. HOYA is now Apache Slider. Release 0.60 was announced yesterday. See http://slider.incubator.apache.org/ (Download link will be pointing to 0.60 soon) Also added dev@slider.incubator to CC. Cheers On Wed, Nov 19, 2014 at 3:43 AM, Kevin O'dell kevin.od...@cloudera.com wrote: I think it

Re: slider stop bug?

2014-11-18 Thread Ted Yu
Did you specify --force ? You can find explanation for this flag here: http://slider.incubator.apache.org/docs/manpage.html On Tue, Nov 18, 2014 at 12:00 PM, hsy...@gmail.com hsy...@gmail.com wrote: If the application is stuck in ACCEPT status, slider stop command doesn't stop the yarn

Re: [VOTE] Apache Slider Incubating Release 0.60.0-incubating RC1

2014-11-17 Thread Ted Yu
+1 verified licenses ran test suite. On Mon, Nov 17, 2014 at 10:24 AM, Billie Rinaldi billie.rina...@gmail.com wrote: +1 verified licenses, checksums, and signatures checked that the tarball, zip, and tag have the same contents ran basic tests On Fri, Nov 14, 2014 at 11:26 AM, Steve

[jira] [Commented] (SLIDER-633) Slider should support invocation via Oozie

2014-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14208809#comment-14208809 ] Ted Yu commented on SLIDER-633: --- For #2 above, the config name is used in hadoop: {code

[jira] [Created] (SLIDER-635) Duration should be closed upon return from LaunchedApplication#monitorAppToState()

2014-11-10 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-635: - Summary: Duration should be closed upon return from LaunchedApplication#monitorAppToState() Key: SLIDER-635 URL: https://issues.apache.org/jira/browse/SLIDER-635 Project: Slider

[jira] [Resolved] (SLIDER-635) Duration should be closed upon return from LaunchedApplication#monitorAppToState()

2014-11-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-635. --- Resolution: Fixed Test suite run was green. Duration should be closed upon return from

Re: Q: How to define component configuration?

2014-11-10 Thread Ted Yu
To my knowledge, there is no direct support for this. You can create different components, each with corresponding properties. Cheers On Mon, Nov 10, 2014 at 4:13 PM, hsy...@gmail.com hsy...@gmail.com wrote: If I want to have several instances of some component. But I want to set some of the

Re: slider report

2014-11-05 Thread Ted Yu
bq. We have added one committer / PMC member. I think we should mention Gour's name in the above sentence. lgtm On Wed, Nov 5, 2014 at 12:12 PM, Billie Rinaldi billie.rina...@gmail.com wrote: I drafted the following Slider report. If anyone wants to edit or add anything, please do so on the

  1   2   3   4   >