Re: May report draft

2018-05-02 Thread Ted Yu
+1 On Wed, May 2, 2018 at 8:27 AM, Billie Rinaldi wrote: > Hi all, here is a draft of our report due today. If there are no objections > / suggestions, I'll post this by the end of the day. > > Slider > > Slider is a collection of tools and technologies to package, deploy, and > manage long runn

Re: Welcoming a new committer

2018-02-26 Thread Ted Yu
Welcome, Kyungwan ! On Mon, Feb 26, 2018 at 9:16 AM, Billie Rinaldi wrote: > I'd like to welcome Kyungwan Nam, a new committer and PPMC member for > Apache Slider! >

Re: Podling Report Reminder - February 2017

2017-02-02 Thread Ted Yu
+1 On Thu, Feb 2, 2017 at 8:47 AM, Gour Saha wrote: > Billie, thank you for the draft. > > +1. It looks good to me. > > -Gour > > On 2/2/17, 6:31 AM, "Billie Rinaldi" wrote: > > >Here's a draft of the board report which is due today. Let me know if you > >have any additions. > > > >--- > >S

[jira] [Commented] (SLIDER-1055) hbase-daemon executed by slider is excepted from nodemanager container monitoring

2016-01-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15094310#comment-15094310 ] Ted Yu commented on SLIDER-1055: Would this situation be observed in Slider Accu

Re: [VOTE] Apache Slider (incubating) release 0.90.2-incubating-RC1

2015-12-29 Thread Ted Yu
M, Jon Maron wrote: > Does looks like this issue: > https://bugs.openjdk.java.net/browse/JDK-8051012. I can find instances > on the web referencing the version you use with this issue (groovy > compatibility issue) > > > On Dec 29, 2015, at 12:31 PM, Ted Yu wrote: > > >

Re: [VOTE] Apache Slider (incubating) release 0.90.2-incubating-RC1

2015-12-29 Thread Ted Yu
ably lots of my tests just no-op'ed themselves). > > Out of curiosity, were you running OpenJDK or Oracle? > > Ted Yu wrote: > >> I ran test suite (against hadoop 2.7.0) on Linux and got: >> >> Tests in error: >>TestA

Re: [VOTE] Apache Slider (incubating) release 0.90.2-incubating-RC1

2015-12-29 Thread Ted Yu
I ran test suite (against hadoop 2.7.0) on Linux and got: Tests in error: TestAgentClientProvider2.initializationError » Verify Bad method call f... TestSliderClientMethods.initializationError » Verify Bad method call fr... initializationError(org.apache.slider.providers.agent.TestAgentClie

[jira] [Resolved] (SLIDER-1011) Slider-hbase-app should export zk-path to user

2015-12-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-1011. Resolution: Fixed Thanks for the patch, Yongshe. > Slider-hbase-app should export zk-path to u

[jira] [Assigned] (SLIDER-1011) Slider-hbase-app should export zk-path to user

2015-12-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reassigned SLIDER-1011: -- Assignee: fengyongshe > Slider-hbase-app should export zk-path to u

[jira] [Resolved] (SLIDER-1015) hbase.bulkload.staging.dir should take user name into account

2015-12-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-1015. Resolution: Fixed > hbase.bulkload.staging.dir should take user name into acco

[jira] [Created] (SLIDER-1015) hbase.bulkload.staging.dir should take user name into account

2015-12-09 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-1015: -- Summary: hbase.bulkload.staging.dir should take user name into account Key: SLIDER-1015 URL: https://issues.apache.org/jira/browse/SLIDER-1015 Project: Slider Issue

[jira] [Commented] (SLIDER-1011) Slider-hbase-app should export zk-path to user

2015-12-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045361#comment-15045361 ] Ted Yu commented on SLIDER-1011: lgtm > Slider-hbase-app should export zk-path

[jira] [Updated] (SLIDER-1011) Slider-hbase-app should export zk-path to user

2015-12-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SLIDER-1011: --- Description: when developers adopt java client API to perform CRUD operations on HBase tables.Here is a

Re: [VOTE] Apache Slider Incubating Release 0.81.1-incubating

2015-10-24 Thread Ted Yu
I used the following command on Linux: ~/apache-maven-3.3.3/bin/mvn clean -Dslider.conf.dir=src/test/clusters/offline/slider/ package Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.49 sec <<< FAILURE! - in org.apache.slider.providers.agent.TestAgentClientProvider2 initializatio

[jira] [Created] (SLIDER-941) Add JAAS config templates

2015-09-23 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-941: - Summary: Add JAAS config templates Key: SLIDER-941 URL: https://issues.apache.org/jira/browse/SLIDER-941 Project: Slider Issue Type: Bug Reporter: Ted Yu

[jira] [Updated] (SLIDER-941) Add JAAS config templates for HBase

2015-09-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SLIDER-941: -- Summary: Add JAAS config templates for HBase (was: Add JAAS config templates) > Add JAAS config templates

[jira] [Resolved] (SLIDER-914) Make hbase.bulkload.staging.dir config unique per Slider instance

2015-07-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-914. --- Resolution: Fixed > Make hbase.bulkload.staging.dir config unique per Slider insta

[jira] [Created] (SLIDER-914) Make hbase.bulkload.staging.dir config unique per Slider instance

2015-07-13 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-914: - Summary: Make hbase.bulkload.staging.dir config unique per Slider instance Key: SLIDER-914 URL: https://issues.apache.org/jira/browse/SLIDER-914 Project: Slider Issue

Re: new committer

2015-07-07 Thread Ted Yu
Welcome, Thomas. On Tue, Jul 7, 2015 at 9:49 AM, Billie Rinaldi wrote: > Welcome Thomas Liu, a new committer and PPMC member for Apache Slider! >

[jira] [Resolved] (SLIDER-909) Add missing config for hadoop.security.authentication in HBase app package

2015-07-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-909. --- Resolution: Fixed > Add missing config for hadoop.security.authentication in HBase app pack

[jira] [Updated] (SLIDER-909) Add missing config for hadoop.security.authentication in HBase app package

2015-07-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SLIDER-909: -- Attachment: slider-909.patch > Add missing config for hadoop.security.authentication in HBase app pack

[jira] [Created] (SLIDER-909) Add missing config for hadoop.security.authentication in HBase app package

2015-07-02 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-909: - Summary: Add missing config for hadoop.security.authentication in HBase app package Key: SLIDER-909 URL: https://issues.apache.org/jira/browse/SLIDER-909 Project: Slider

[jira] [Resolved] (SLIDER-900) Add hbase.bulkload.staging.dir config for unsecure appConfig.json

2015-06-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-900. --- Resolution: Fixed > Add hbase.bulkload.staging.dir config for unsecure appConfig.j

[jira] [Updated] (SLIDER-900) Add hbase.bulkload.staging.dir config for unsecure appConfig.json

2015-06-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SLIDER-900: -- Description: SecureBulkLoadEndpoint is loaded by default. In unsecure deployment, it would access directory

[jira] [Created] (SLIDER-900) Add hbase.bulkload.staging.dir config for unsecure appConfig.json

2015-06-08 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-900: - Summary: Add hbase.bulkload.staging.dir config for unsecure appConfig.json Key: SLIDER-900 URL: https://issues.apache.org/jira/browse/SLIDER-900 Project: Slider Issue

[jira] [Resolved] (SLIDER-899) Phoenix UDF should be enabled by default in appConfig-phoenix-default.json

2015-06-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-899. --- Resolution: Fixed > Phoenix UDF should be enabled by default in appConfig-phoenix-default.j

[jira] [Created] (SLIDER-899) Phoenix UDF should be enabled by default in appConfig-phoenix-default.json

2015-06-06 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-899: - Summary: Phoenix UDF should be enabled by default in appConfig-phoenix-default.json Key: SLIDER-899 URL: https://issues.apache.org/jira/browse/SLIDER-899 Project: Slider

[jira] [Resolved] (SLIDER-893) Add SecureBulkLoadEndpoint to hbase.coprocessor.region.classes

2015-06-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-893. --- Resolution: Fixed Resolved through commit 38d5d908b294bae703a76af90fa711e41b36082f >

[jira] [Created] (SLIDER-893) Add SecureBulkLoadEndpoint to hbase.coprocessor.region.classes

2015-06-01 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-893: - Summary: Add SecureBulkLoadEndpoint to hbase.coprocessor.region.classes Key: SLIDER-893 URL: https://issues.apache.org/jira/browse/SLIDER-893 Project: Slider Issue Type

Re: Building Slider with Hadoop 2.7 (trying to use updateBlackList method in AMRMClientAsync)

2015-05-29 Thread Ted Yu
There is a release-2.7 profile you can use without modifying hadoop.version in pom.xml Can you pastebin the stack trace you got w.r.t. updateBlackList ? Cheers On Fri, May 29, 2015 at 8:38 PM, Rajesh Kartha wrote: > Hello all, > > I am using the > mvn clean site:site site:stage package -Dskip

Re: Interest in including a package for Solr in Slider?

2015-05-27 Thread Ted Yu
Please open a JIRA. Thanks On Wed, May 27, 2015 at 6:24 AM, Timothy Potter wrote: > Hi, > > I'm a committer on the Lucene/Solr project and have developed a basic > solution for deploying Solr to YARN using Slider, see: > https://github.com/LucidWorks/solr-slider > > I'm reaching out to see if t

Re: Re: slider registry --name cl1 --conf hbase --format xml cannot work with java 1.8

2015-05-16 Thread Ted Yu
Looks like you were reading out of date Slider doc. amwebfilter is no longer used in current develop branch. I searched *.md files and didn't find amwebfilter mentioned. Cheers On Sat, May 16, 2015 at 6:01 AM, wrote: > hello guys: > i want fix this problem,so i read a lot slider docs,

Re: [VOTE] Apache Slider Incubating Release 0.80.0-incubating

2015-05-12 Thread Ted Yu
+1 downloaded .ZIP file built on Linux and ran test suite checked Apache license On Mon, May 11, 2015 at 2:43 PM, Steve Loughran wrote: > > > On 8 May 2015, at 16:14, Gour Saha wrote: > > > > Hello, > > > > This is a call for a vote on Apache Slider 0.80.0-incubating release. > > > > This is a

Re: Question on the Slider-HBase application (0.80 build)

2015-05-10 Thread Ted Yu
Thanks for trying out 0.80.0 release. The error you saw was due to hbase.tmp.dir pointing to path which was valid on the node where container was running but invalid on the client. In the retrieved hbase-site.xml, you can replace with the following: hbase.tmp.dir/tmp/hbase-tmp This step is done

Re: slider may report

2015-05-06 Thread Ted Yu
+1 On Wed, May 6, 2015 at 6:05 AM, Jon Maron wrote: > +1 > > > On May 6, 2015, at 8:58 AM, Billie Rinaldi > wrote: > > > > How does this draft look? > > > > Slider > > > > Slider is a collection of tools and technologies to package, deploy, and > > manage long running applications on Apache Had

Re: storm-slider-client availability

2015-05-04 Thread Ted Yu
Slider 0.80.0 release is coming by May 15, 2015 - according to Gour. storm-slider would be in that release. To keep up with latest development, please use develop branch. Cheers On Mon, May 4, 2015 at 8:59 AM, Jean-Baptiste Note wrote: > Thanks a huge lot, storm-slider is indeed in develop. >

Re: storm-slider-client availability

2015-05-04 Thread Ted Yu
Have you looked at https://git-wip-us.apache.org/repos/asf/incubator-slider.git ? Branch: develop Cheers On Mon, May 4, 2015 at 8:50 AM, Jean-Baptiste Note wrote: > Hi folks, > > First, thanks a lot for making slider available. This is awesome for > consolidating YARN as a generic-purpose resou

[jira] [Comment Edited] (SLIDER-819) Create addon package of Ranger for Hbase

2015-04-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520841#comment-14520841 ] Ted Yu edited comment on SLIDER-819 at 4/30/15 4:36 AM: I t

[jira] [Updated] (SLIDER-819) Create addon package of Ranger for Hbase

2015-04-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SLIDER-819: -- Summary: Create addon package of Ranger for Hbase (was: Create addon package of Phoenix and Ranger for Hbase

[jira] [Commented] (SLIDER-819) Create addon package of Phoenix and Ranger for Hbase

2015-04-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520841#comment-14520841 ] Ted Yu commented on SLIDER-819: --- I think it is not advisable for the user to go the a

[jira] [Commented] (SLIDER-819) Create addon package of Phoenix and Ranger for Hbase

2015-04-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520784#comment-14520784 ] Ted Yu commented on SLIDER-819: --- Starting with DAL, Apache Phoenix is embedded in HBase

[jira] [Created] (SLIDER-861) Failure counts should be clarified on AppMaster UI

2015-04-22 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-861: - Summary: Failure counts should be clarified on AppMaster UI Key: SLIDER-861 URL: https://issues.apache.org/jira/browse/SLIDER-861 Project: Slider Issue Type: Bug

[jira] [Commented] (SLIDER-773) Add co-processor support for app packages

2015-04-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14492312#comment-14492312 ] Ted Yu commented on SLIDER-773: --- Went through the above attachment - looks fine t

[jira] [Commented] (SLIDER-773) Add co-processor support for app packages

2015-04-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14491899#comment-14491899 ] Ted Yu commented on SLIDER-773: --- Fine with most of the responses above. bq. shall we

[jira] [Updated] (SLIDER-773) Add co-processor support for app packages

2015-04-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SLIDER-773: -- Attachment: 773-suggest.txt Suggested change which folds two loops in ComponentInstanceState#getNextCommand

[jira] [Commented] (SLIDER-773) Add co-processor support for app packages

2015-04-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14491261#comment-14491261 ] Ted Yu commented on SLIDER-773: --- Some minor comments: {code} +log.d

Re: Redundant container request from slider causing high load on busy cluster

2015-03-23 Thread Ted Yu
The JIRAs you mentioned are somewhat dormant. You can open a Slider JIRA to track this issue. Thanks On Mon, Mar 23, 2015 at 10:44 AM, Shrijeet Paliwal < shrijeet.pali...@gmail.com> wrote: > More evidence: > > Spark is also affected: https://issues.apache.org/jira/browse/SPARK-2687 > One more r

Re: [VOTE] Apache Slider Incubating Release 0.70.1-incubating

2015-03-19 Thread Ted Yu
+1 as well. Verified signatures. Ran test suite. On Thu, Mar 19, 2015 at 7:36 AM, Josh Elser wrote: > +1 > > Verified 814 and 815 were fixed. > Ensured build passed > sigs+xsums pass > > > Gour Saha wrote: > >> Hello, >> >> This is a call for a vote on Apache Slider 0.70.1-incubating release. >

Re: Anti-affinity

2015-03-17 Thread Ted Yu
Support from YARN is needed. Please see https://issues.apache.org/jira/browse/YARN-1042 Cheers On Tue, Mar 17, 2015 at 1:56 AM, Krishna Kishore Bonagiri < write2kish...@gmail.com> wrote: > Hi, > > Is there any plan to implement anti-affinity? I know it would obviously > depend on the support

Re: Apache Slider stop function not working

2015-03-14 Thread Ted Yu
Kishore: Looks like logging was at INFO level. Do you mind turning on DEBUG logging ? Thanks On Sat, Mar 14, 2015 at 7:39 AM, Krishna Kishore Bonagiri < write2kish...@gmail.com> wrote: > Hi Steve, > > This is what I see in the AM's log since the STOP command is issued. Even > though it indicat

Re: [VOTE] Release Apache Slider 0.70.0-incubating

2015-03-13 Thread Ted Yu
Checked signature Ran test suite. +1 On Fri, Mar 13, 2015 at 5:37 AM, 杨浩 wrote: > +1 > > 2015-03-13 0:48 GMT+08:00 Steve Loughran : > > > > > > On 11 Mar 2015, at 13:43, Gour Saha wrote: > > > > > > Hello, > > > > > > This is a call for a vote for releasing Apache Slider > 0.70.0-incubating. >

Re: [VOTE] Apache Slider Incubating Release 0.70.0-incubating

2015-03-09 Thread Ted Yu
+1 Checked hash/sigs Built from tag Ran test suite On Mon, Mar 9, 2015 at 6:06 PM, Josh Elser wrote: > +1 > > * Checked hash/sigs > * Fetched Gour's key > * Built from tag (a8919c84) > * Ran rat check on source release > * Verified issues from IPMC vote on 0.61.0 were resolved > > One note, mak

[jira] [Resolved] (SLIDER-287) Allow more parameters to be passed to HBase thrift gateway

2015-03-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-287. --- Resolution: Fixed Fix Version/s: (was: Slider 2.0.0) Slider 0.70 > Allow m

[jira] [Resolved] (SLIDER-734) Create wrapper script for hbase which retrieves hbase-site.xml from running cluster

2015-03-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-734. --- Resolution: Fixed > Create wrapper script for hbase which retrieves hbase-site.xml from running > c

[jira] [Resolved] (SLIDER-732) Allow more parameters to be passed to HBase thrift2 gateway

2015-03-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-732. --- Resolution: Fixed > Allow more parameters to be passed to HBase thrift2 gate

[jira] [Resolved] (SLIDER-731) Allow more parameters to be passed to HBase REST gateway

2015-02-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-731. --- Resolution: Fixed > Allow more parameters to be passed to HBase REST gate

Re: [VOTE] Move Slider to JDK7+

2015-02-20 Thread Ted Yu
+1 On Fri, Feb 20, 2015 at 2:00 PM, Sumit Mohanty wrote: > Given that Java 6 is no longer supported (even Java 7 will not be supported > after Spring 2015) and Hadoop 2.7+ is JDK7+, we should have Slider move to > JDK7+. > > This is a call to vote to have Slider move to JDK7+ after the upcoming

Re: start service as another user

2015-02-20 Thread Ted Yu
Discussed with Sumit. The ability to start as a different user is better implemented by YARN, instead of Slider. Cheers On Fri, Feb 20, 2015 at 9:42 AM, Sumit Mohanty wrote: > As the agent does not run as root (either as YARN user on non-secured or > the principal that started on secured), Sli

[jira] [Resolved] (SLIDER-790) Enforce JDK7 javac for builds

2015-02-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-790. --- Resolution: Fixed > Enforce JDK7 javac for builds > - > >

[jira] [Created] (SLIDER-790) Enforce JDK7 javac for builds

2015-02-19 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-790: - Summary: Enforce JDK7 javac for builds Key: SLIDER-790 URL: https://issues.apache.org/jira/browse/SLIDER-790 Project: Slider Issue Type: Task Reporter: Ted Yu

[jira] [Updated] (SLIDER-734) Create wrapper script for hbase which retrieves hbase-site.xml from running cluster

2015-02-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SLIDER-734: -- Description: The wrapper, app-packages/hbase/hbase-slider.py, accepts slider-instance-name as parameter and

Re: How do HBase and Accumulo handle failures during client RPC operations

2015-02-04 Thread Ted Yu
What Josh described w.r.t. client failing over to new server is mostly applicable to HBase as well. Cheers On Wed, Feb 4, 2015 at 8:12 AM, Josh Elser wrote: > For Accumulo, like you said, information is published in ZK for clients to > find. Thinking about just the Accumulo master process (tabl

Re: Slider 0.50.2 requests container from decommissioned node.

2015-01-31 Thread Ted Yu
The two JIRAs you mentioned were in 0.60 release (HDP 2.2) Please consider upgrading. Cheers On Sat, Jan 31, 2015 at 4:05 PM, Tim Israel wrote: > Thanks Ted, SLIDER-647 and SLIDER-439 were exactly what I was looking for. > > Tim > > On Sat, Jan 31, 2015 at 6:34 PM, Ted Yu w

Re: Slider 0.50.2 requests container from decommissioned node.

2015-01-31 Thread Ted Yu
Tim: We have been improving role history in develop branch. Take a look at the recent JIRAs: SLIDER-743. Include node failure history when choosing placement hints SLIDER-647 allocation requests not being satisfied when a cluster goes to labels SLIDER-81. Support placement of containers on labeled

[jira] [Commented] (SLIDER-757) Add Additional Resources

2015-01-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299383#comment-14299383 ] Ted Yu commented on SLIDER-757: --- {code} + * If the ADDTIONAL_RESOUERCE_DIR set, + *

[jira] [Updated] (SLIDER-764) Allow specification of minimum number of live containers for each component type

2015-01-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SLIDER-764: -- Summary: Allow specification of minimum number of live containers for each component type (was: Provide proper

[jira] [Commented] (SLIDER-764) Provide proper response when number of good nodes is lower than requested number of components

2015-01-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299358#comment-14299358 ] Ted Yu commented on SLIDER-764: --- bq. start with some criteria for the minimum numbe

Re: review board

2015-01-30 Thread Ted Yu
r than one large one (if portions can be broken > into commits that do not break the overall functionality). > > — Jon > > On Jan 30, 2015, at 9:18 AM, Ted Yu wrote: > > > The INFRA JIRA has been resolved. > > > > We should be able to use reviewboard now. > >

Re: review board

2015-01-30 Thread Ted Yu
: >> >>> It might help (a little) if the component were listed as ReviewBoard. I >>> think only Ted can change this. >>> >>>> On Mon, Jan 5, 2015 at 7:06 AM, Jon Maron >>> wrote: >>> >>>> Is there a way to poke one of

Re: [VOTE] Apache Slider Incubating Release 0.61.0-incubating

2015-01-29 Thread Ted Yu
+1 * Checked signatures * Built from source * Ran test suite On Thu, Jan 29, 2015 at 3:00 PM, Josh Elser wrote: > +1 (binding) > > * Filenames have -incubating > * Xsums+sigs check out > * KEYS has signing key > * Built from source > * Tarballs have LICENSE/NOTICE/DISCLAIMER > * Looked over th

[jira] [Created] (SLIDER-764) Provide proper response when number of good nodes is lower than requested number of components

2015-01-22 Thread Ted Yu (JIRA)
Ted Yu created SLIDER-764: - Summary: Provide proper response when number of good nodes is lower than requested number of components Key: SLIDER-764 URL: https://issues.apache.org/jira/browse/SLIDER-764

Re: ApacheCon NA CFP

2015-01-21 Thread Ted Yu
I submitted a talk on Slider. Fyi > On Jan 21, 2015, at 2:45 AM, Steve Loughran wrote: > > If anyone wants to submit a talk to ApacheCon North America on Slider or > using it, they have until Feb 1 > > http://events.linuxfoundation.org/events/apachecon-north-america > > -Steve > > -- >

Re: defeated by maven automated release process

2015-01-20 Thread Ted Yu
I browsed the staging repo - looks good. On Tue, Jan 20, 2015 at 6:05 AM, Steve Loughran wrote: > We have our first repository! > > > https://repository.apache.org/content/repositories/orgapacheslider-1002/org/apache/slider/ > > big zip file is in > > > https://repository.apache.org/content/repo

[jira] [Commented] (SLIDER-737) add LANG=en_US when executing shell command

2015-01-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14277792#comment-14277792 ] Ted Yu commented on SLIDER-737: --- lgtm > add LANG=en_US when executing shell

Re: The utility exported by resource management of slider agent

2015-01-10 Thread Ted Yu
We have wiki but it is very out of date: https://cwiki.apache.org/confluence/collector/pages.action?key=SLIDER Cheers On Sat, Jan 10, 2015 at 9:00 PM, Yong Feng wrote: > Hi Ted and Team > > I have written a slider package for a HPC cluster by taking hbase > slider package as example. It runs we

[jira] [Updated] (SLIDER-742) Slider AM secure configuration

2015-01-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SLIDER-742: -- Summary: Slider AM secure configuration (was: Slider AM securied configuration) > Slider AM sec

[jira] [Commented] (SLIDER-742) Slider AM secure configuration

2015-01-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268804#comment-14268804 ] Ted Yu commented on SLIDER-742: --- What do you mean by MapReduceAM ? I don't see s

Re: 答复: the component ha

2015-01-06 Thread Ted Yu
Phase 2 of read replica hasn't been fully integrated to Apache HBase yet. Once that is done, you can produce hbase app package and utilize this feature. FYI On Tue, Jan 6, 2015 at 7:52 PM, liujs3 wrote: > Yes ,I mean that read replica > > > > > -----邮件原件- >

Re: the component ha

2015-01-06 Thread Ted Yu
w.r.t. region ha, did you mean read replica ? bq. how config the backhmaster Did you mean secondary master ? You can specify 2 instances of HBASE_MASTER in resources.json Cheers On Tue, Jan 6, 2015 at 6:39 PM, liujs3 wrote: > hi, i see the least news about hbase ,it will support region ha,whe

Re: Locality results in instance shut-down due to single bad instance

2015-01-06 Thread Ted Yu
Anti-affinity has not been implemented yet. Cheers On Tue, Jan 6, 2015 at 5:26 PM, 杨浩 wrote: > I have read the PlacementPolicy.java, but it seems there is no call to > ANTI_AFFINITY_REQUIRED > > 2015-01-07 8:52 GMT+08:00 Ted Yu : > > > Here is the meaning of 2

Re: Locality results in instance shut-down due to single bad instance

2015-01-06 Thread Ted Yu
Here is the meaning of 2 (see PlacementPolicy): * No data locality; do not bother trying to ask for any location */ public static final int NO_DATA_LOCALITY = 2; On Tue, Jan 6, 2015 at 4:15 PM, Gour Saha wrote: > Try setting property *yarn.component.placement.policy* to 2 for the > co

Re: How to set jvm option for HMaster

2015-01-05 Thread Ted Yu
杨浩: See the following example appConfig.json snippet: "components": { "HBASE_MASTER": { }, "slider-appmaster": { "*jvm.heapsize*": "256M", Cheers On Mon, Jan 5, 2015 at 7:27 AM, Steve Loughran wrote: > can you post your appconfig.json file, under your .slider/CLUSTERNAME di

Re: [jira] [Created] (SLIDER-736) build hbase

2015-01-04 Thread Ted Yu
See app-packages/hbase/appConfig-default.json in source code where you can find example for hbase-site. core-site and hdfs-site can be plugged in the same manner. e.g.: "site.hdfs-site.dfs.namenode.kerberos.principal": "${TODO-NN-PRINCIPAL}", "site.hdfs-site.dfs.namenode.kerberos.internal.

[jira] [Assigned] (SLIDER-668) "slider package" CLI command to offer package management operations

2015-01-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reassigned SLIDER-668: - Assignee: Vasanth kumar RJ > "slider package" CLI command to offer package manageme

[jira] [Resolved] (SLIDER-668) "slider package" CLI command to offer package management operations

2015-01-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SLIDER-668. --- Resolution: Fixed Thanks for the patch, Vasanth > "slider package" CLI command to offer packa

Re: How Sliders configure configuration file of regionserver of HBase

2015-01-03 Thread Ted Yu
od to do that, but you can get a > label-to-nodes mapping using YarnClient.getNodeToLabels(). > > We can consider to add a method label-to-nodes mapping in future release > if necessary. > > Thanks, > Wangda > > On Fri, Jan 2, 2015 at 9:11 AM, Ted Yu wrote: > &g

Re: How Sliders configure configuration file of regionserver of HBase

2015-01-02 Thread Ted Yu
er to > manage both HPC wlm and BigData wlm. Mesos/Marathon is another choice > however I prefer Yarn/Slider due to its BigData DNA. > > Looking forward to getting more support from Slider and Yarn team. > > Thanks, > > Yong > > > On Thu, Jan 1, 2015 at 10:31 PM, Ted

Re: How Sliders configure configuration file of regionserver of HBase

2015-01-01 Thread Ted Yu
orted by either Slider or YARN. > >> > [Yong] If there is only one instance of master role, at least I could > >> know > >> > its host name by COMPONENT_HOST in slave hosts, right? If so, I could > >> work > >> > it around to just configure one

Re: How Sliders configure configuration file of regionserver of HBase

2014-12-30 Thread Ted Yu
t; in the conf file of slave. Changing membership of master need restart whole > cluster so we will not support flex up/down role of master. > > How can I know the host list of master role in Slider script or template? > > Thanks, > > Yong > > On Tue, Dec 30, 2014 at

Re: How Sliders configure configuration file of regionserver of HBase

2014-12-30 Thread Ted Yu
bq. host list of all the instances of a component Are you using node labels feature of YARN ? If not, the list would comprise of all the nodes in your YARN cluster. Cheers On Tue, Dec 30, 2014 at 4:43 PM, Yong Feng wrote: > Hi Team, > > The template of regionserver of HBase application uses fo

[jira] [Commented] (SLIDER-668) "slider package" CLI command to offer package management operations

2014-12-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14260296#comment-14260296 ] Ted Yu commented on SLIDER-668: --- Patch v3 doesn't apply cleanly. After the above

[jira] [Commented] (SLIDER-668) "slider package" CLI command to offer package management operations

2014-12-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14260286#comment-14260286 ] Ted Yu commented on SLIDER-668: --- {code} - * @param installPkgInfo the arguments neede

Re: how to get get the port of memcached

2014-12-27 Thread Ted Yu
When you go to AppMaster UI (slider 0.60), you should see an entry for org.apache.slider.registry e.g. http://hor15n22.gq1.ygridcore.net:44221/ws/v1/slider/registry which has two nodes: services and users. You can navigate to: http://hor11n14.gq1.ygridcore.net:8088/proxy/application_1419019592694_

Re: 答复: when i run slider0.40+hadoop2.4 i found the error log in slider-error.log

2014-12-26 Thread Ted Yu
.4.x86_64.rpm , then slider work. > > In my cluster ,I doesn’t config the secure . how can confirm it used > secure cluster? > > -邮件原件- > 发件人: Ted Yu [mailto:yuzhih...@gmail.com] > 发送时间: 2014年12月26日 12:33 > 收件人: dev@slider.incubator.apache.org > 主题: Re:

Re: 答复: 答复: flex a different resource component . so i can use the all memory

2014-12-25 Thread Ted Yu
> BDX > Mp:18513780630 > E-mail:liu...@asiainfo.com > > > > -邮件原件- > 发件人: Ted Yu [mailto:yuzhih...@gmail.com] > 发送时间: 2014年12月26日 13:17 > 收件人: dev@slider.incubator.apache.org > 主题: Re: 答复: flex a different resource component . so i can use the all > memory > &g

Re: 答复: flex a different resource component . so i can use the all memory

2014-12-25 Thread Ted Yu
sed is 4g all components, and this time I used 3g for all > regionservers ? > > > Best Regards! > ocean floyd > 亚信科技(中 国)有限公司 > www.asiainfo.com > BDX > Mp:18513780630 > E-mail:liu...@asiainfo.com > > > > > -邮件原件- > 发件人: Ted Yu [mailto:yuz

Re: when i run slider0.40+hadoop2.4 i found the error log in slider-error.log

2014-12-25 Thread Ted Yu
bq. WARN security.SecurityUtils: Command openssl pkcs12 Are you deploying in a secure cluster ? Can you try with 0.60.0 and hadoop 2.6.0 ? Cheers On Thu, Dec 25, 2014 at 7:17 PM, liujs3 wrote: > 14/12/24 03:15:35 WARN util.NativeCodeLoader: Unable to load native-hadoop > library for your platf

Re: flex a different resource component . so i can use the all memory

2014-12-25 Thread Ted Yu
Currently memory for one component (region server in your case) has to have same amount of memory. Cheers On Dec 25, 2014, at 7:45 PM, "liujs3" wrote: > When I run the slider , I want to flex a specified memory regionserver which > is different in other running regionservers that memory. >

[jira] [Commented] (SLIDER-668) "slider package" CLI command to offer package management operations

2014-12-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258588#comment-14258588 ] Ted Yu commented on SLIDER-668: --- There're lines longer than 100 characters - pleas

[jira] [Commented] (SLIDER-735) Support specification of user for list command

2014-12-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14256139#comment-14256139 ] Ted Yu commented on SLIDER-735: --- When there is no user parameter specified, we ca

  1   2   3   4   5   >