[jira] [Work started] (KNOX-1153) Dynamic HaProvider Configuration for Generated Topologies
[
https://issues.apache.org/jira/browse/KNOX-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on KNOX-1153 started by Phil Zampino.
--
> Dynamic HaProvider Configuration for Generated Topologies
> -
>
> Key: KNOX-1153
> URL: https://issues.apache.org/jira/browse/KNOX-1153
> Project: Apache Knox
> Issue Type: Improvement
> Components: Server
>Affects Versions: 0.14.0
>Reporter: Phil Zampino
>Assignee: Phil Zampino
>Priority: Major
> Fix For: 0.15.0
>
>
> With the ability to share provider configuration across multiple topologies,
> it would be good if the service-specific HA Provider configuration could be
> pushed down into the service elements themselves, possibly with more generic
> (i.e., global) configuration specified at the provider level.
> For instance, rather than
> {code:java}
>
> ha
> HaProvider
> true
>value="maxFailoverAttempts=3;failoverSleep=1000;enabled=true;zookeeperEnsemble=c6801.ambari.apache.org:2181,c6802.ambari.apache.org:2181,c6803.ambari.apache.org:2181;zookeeperNamespace=hiveserver2"
> />
>
>
> ...
>
> HIVE
>
> {code}
> The HIVE param value would become discrete service-level params:
> {code:java}
>
> HIVE
>
> "
> "
>value="machine1:2181,machine2:2181,machine3:2181"/>
>
>
> {code}
> This has the potential to increase the share-ability of provider
> configurations. It also makes more sense for the service-specific details to
> be co-located with the services themselves. An additional benefit is that the
> cluster discovery information includes the ZooKeeper details for most
> services, so those details can optionally be provided automatically in
> generated topologies.
> Furthermore, it should be possible to determine whether or not HA is
> configured for a service, in which case, topology generation could use the
> cluster discovery information to automatically enable Knox to interact with
> the service in an HA manner.
> [https://cwiki.apache.org/confluence/display/KNOX/Dynamic+HA+Provider+Configuration]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Work started] (KNOX-1040) Knox Admin UI for Simple Descriptors and Provider Configurations
[ https://issues.apache.org/jira/browse/KNOX-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KNOX-1040 started by Phil Zampino. -- > Knox Admin UI for Simple Descriptors and Provider Configurations > > > Key: KNOX-1040 > URL: https://issues.apache.org/jira/browse/KNOX-1040 > Project: Apache Knox > Issue Type: Sub-task > Components: AdminUI >Reporter: Phil Zampino >Assignee: Phil Zampino >Priority: Major > Labels: kip-8 > Fix For: 0.15.0 > > > The Knox Admin UI needs to support management of simple descriptors and > externalized provider configurations used for topology generation. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (KNOX-1040) Knox Admin UI for Simple Descriptors and Provider Configurations
[ https://issues.apache.org/jira/browse/KNOX-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Zampino reassigned KNOX-1040: -- Assignee: Phil Zampino > Knox Admin UI for Simple Descriptors and Provider Configurations > > > Key: KNOX-1040 > URL: https://issues.apache.org/jira/browse/KNOX-1040 > Project: Apache Knox > Issue Type: Sub-task > Components: AdminUI >Reporter: Phil Zampino >Assignee: Phil Zampino >Priority: Major > Labels: kip-8 > Fix For: 0.15.0 > > > The Knox Admin UI needs to support management of simple descriptors and > externalized provider configurations used for topology generation. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KNOX-1040) Knox Admin UI for Simple Descriptors and Provider Configurations
[ https://issues.apache.org/jira/browse/KNOX-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349636#comment-16349636 ] ASF subversion and git services commented on KNOX-1040: --- Commit e8ba712c8b5a102c95aa2e70d27b2fe32f9d620c in knox's branch refs/heads/master from [~pzampino] [ https://git-wip-us.apache.org/repos/asf?p=knox.git;h=e8ba712 ] KNOX-1040 - Initial changes to support simple descriptors and provider configurations in the Admin UI. > Knox Admin UI for Simple Descriptors and Provider Configurations > > > Key: KNOX-1040 > URL: https://issues.apache.org/jira/browse/KNOX-1040 > Project: Apache Knox > Issue Type: Sub-task > Components: AdminUI >Reporter: Phil Zampino >Priority: Major > Labels: kip-8 > Fix For: 0.15.0 > > > The Knox Admin UI needs to support management of simple descriptors and > externalized provider configurations used for topology generation. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KNOX-1153) Dynamic HaProvider Configuration for Generated Topologies
[
https://issues.apache.org/jira/browse/KNOX-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349515#comment-16349515
]
ASF subversion and git services commented on KNOX-1153:
---
Commit 7025086a8a0ab757cb24486b27515f8f5331bfa0 in knox's branch
refs/heads/master from [~pzampino]
[ https://git-wip-us.apache.org/repos/asf?p=knox.git;h=7025086 ]
KNOX-1153 - Service-level overrides for HA provider configuration in generated
topologies, and alternate provide config formats.
> Dynamic HaProvider Configuration for Generated Topologies
> -
>
> Key: KNOX-1153
> URL: https://issues.apache.org/jira/browse/KNOX-1153
> Project: Apache Knox
> Issue Type: Improvement
> Components: Server
>Affects Versions: 0.14.0
>Reporter: Phil Zampino
>Assignee: Phil Zampino
>Priority: Major
> Fix For: 0.15.0
>
>
> With the ability to share provider configuration across multiple topologies,
> it would be good if the service-specific HA Provider configuration could be
> pushed down into the service elements themselves, possibly with more generic
> (i.e., global) configuration specified at the provider level.
> For instance, rather than
> {code:java}
>
> ha
> HaProvider
> true
>value="maxFailoverAttempts=3;failoverSleep=1000;enabled=true;zookeeperEnsemble=c6801.ambari.apache.org:2181,c6802.ambari.apache.org:2181,c6803.ambari.apache.org:2181;zookeeperNamespace=hiveserver2"
> />
>
>
> ...
>
> HIVE
>
> {code}
> The HIVE param value would become discrete service-level params:
> {code:java}
>
> HIVE
>
> "
> "
>value="machine1:2181,machine2:2181,machine3:2181"/>
>
>
> {code}
> This has the potential to increase the share-ability of provider
> configurations. It also makes more sense for the service-specific details to
> be co-located with the services themselves. An additional benefit is that the
> cluster discovery information includes the ZooKeeper details for most
> services, so those details can optionally be provided automatically in
> generated topologies.
> Furthermore, it should be possible to determine whether or not HA is
> configured for a service, in which case, topology generation could use the
> cluster discovery information to automatically enable Knox to interact with
> the service in an HA manner.
> [https://cwiki.apache.org/confluence/display/KNOX/Dynamic+HA+Provider+Configuration]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
Re: [VOTE] Release Apache Knox 1.0.0 RC-2
Thanks for the quick turnaround. RC2 looks good to me. +1 * Downloaded and built from source (with Java 1.8.0_144) * Checked LICENSE and NOTICE files * Verified GPG signature for Knox source * Checked CHANGES file * Ran Knox tests * Verified remote configuration management via ZooKeeper * Verified knoxcli for listing provider configurations and descriptors in ZooKeeper (KNOX-1137) * Verified that the relationship changes effected among descriptors and provider configs when Knox is NOT running are correctly established at Knox start-up (KNOX-1144) On Thu, Feb 1, 2018 at 12:34 AM, larry mccay wrote: > A candidate for the Apache Knox 1.0.0 release is available at: > > https://dist.apache.org/repos/dist/dev/knox/knox-1.0.0/ > > The release candidate is a zip archive of the sources in: > > https://git-wip-us.apache.org/repos/asf/knox.git > Branch v1.0.0 (git checkout -b v1.0.0) > Git Tag: v1.0.0-rc2 > > The KEYS file for signature validation is available at: > https://dist.apache.org/repos/dist/release/knox/KEYS > > Please vote on releasing this package as Apache Knox 1.0.0. > > This release is nearly identical to 0.14.0 with the exception of: > > * repackaging of the classes to remove "hadoop" from the package > names > * handful of patches for rounding out service discovery > and topology generation > * moved the Apache Hadoop dependency to Hadoop 3.0 > > The vote is open for the next 72 hours and passes if a majority of at > least three +1 Apache Knox PMC votes are cast. > > [ ] +1 Release this package as Apache Knox 1.0.0 > [ ] -1 Do not release this package because... >
Re: [VOTE] Release Apache Knox 1.0.0 RC-2
Thanks for a quick Knox 1.0.0 RC2 +1 Regards, Jeffrey Rodriguez On Thu, Feb 1, 2018 at 7:52 AM, Sandeep More wrote: > Thanks Larry for quickly spinning up RC2. > > +1 > > * Downloaded and built from source (with Java 1.8.0_101) > * Checked LICENSE and NOTICE files > * Verified GPG/MD5/SHA signatures for Knox source, Knox and Knoxshell > release packages (zip files) > * Installed pseudo-distributed instance (Mac OS X ) > * Ran through knox tests > * Checked websocket functionality > * Checked Topology Port Mapping feature > * Checked KnoxShell samples > * Checked KnoxSSO > * Checked the UI (read only for generated topologies) > > Best, > Sandeep > > On Thu, Feb 1, 2018 at 12:34 AM, larry mccay wrote: > > > A candidate for the Apache Knox 1.0.0 release is available at: > > > > https://dist.apache.org/repos/dist/dev/knox/knox-1.0.0/ > > > > The release candidate is a zip archive of the sources in: > > > > https://git-wip-us.apache.org/repos/asf/knox.git > > Branch v1.0.0 (git checkout -b v1.0.0) > > Git Tag: v1.0.0-rc2 > > > > The KEYS file for signature validation is available at: > > https://dist.apache.org/repos/dist/release/knox/KEYS > > > > Please vote on releasing this package as Apache Knox 1.0.0. > > > > This release is nearly identical to 0.14.0 with the exception of: > > > > * repackaging of the classes to remove "hadoop" from the package > > names > > * handful of patches for rounding out service discovery > > and topology generation > > * moved the Apache Hadoop dependency to Hadoop 3.0 > > > > The vote is open for the next 72 hours and passes if a majority of at > > least three +1 Apache Knox PMC votes are cast. > > > > [ ] +1 Release this package as Apache Knox 1.0.0 > > [ ] -1 Do not release this package because... > > >
Re: [VOTE] Release Apache Knox 1.0.0 RC-2
Thanks Larry for quickly spinning up RC2. +1 * Downloaded and built from source (with Java 1.8.0_101) * Checked LICENSE and NOTICE files * Verified GPG/MD5/SHA signatures for Knox source, Knox and Knoxshell release packages (zip files) * Installed pseudo-distributed instance (Mac OS X ) * Ran through knox tests * Checked websocket functionality * Checked Topology Port Mapping feature * Checked KnoxShell samples * Checked KnoxSSO * Checked the UI (read only for generated topologies) Best, Sandeep On Thu, Feb 1, 2018 at 12:34 AM, larry mccay wrote: > A candidate for the Apache Knox 1.0.0 release is available at: > > https://dist.apache.org/repos/dist/dev/knox/knox-1.0.0/ > > The release candidate is a zip archive of the sources in: > > https://git-wip-us.apache.org/repos/asf/knox.git > Branch v1.0.0 (git checkout -b v1.0.0) > Git Tag: v1.0.0-rc2 > > The KEYS file for signature validation is available at: > https://dist.apache.org/repos/dist/release/knox/KEYS > > Please vote on releasing this package as Apache Knox 1.0.0. > > This release is nearly identical to 0.14.0 with the exception of: > > * repackaging of the classes to remove "hadoop" from the package > names > * handful of patches for rounding out service discovery > and topology generation > * moved the Apache Hadoop dependency to Hadoop 3.0 > > The vote is open for the next 72 hours and passes if a majority of at > least three +1 Apache Knox PMC votes are cast. > > [ ] +1 Release this package as Apache Knox 1.0.0 > [ ] -1 Do not release this package because... >
