Re: [Openstack] [Sahara] Jobs get marked as "failed" immediately on Spark cluster
Hello. I haven't saw issues like that. Can you explain more precisely how you are running job, what configs and arguments are passed, job binaries, and so on. Minimal example for reproducing this issue should be a best option. Moreover, this looks like a absolutely strange issue (if job was executed successfully). It means that launching command was successful (see [0]). But there is no copy operations after launching command. [0] https://github.com/openstack/sahara/blob/stable/liberty/sahara/service/edp/spark/engine.py#L339 On Mon, Aug 8, 2016 at 11:02 PM, Jeremy Freudberg wrote: > Hi all, I am experiencing a strange bug running jobs on Sahara (Red > Hat Liberty). > > When submitting a job to a Spark 1.3.1 cluster, I get the following > error immediately: > > 2016-08-08 15:56:09.546 20949 WARNING sahara.service.edp.job_manager > [req-fb5b47 > 22-861a-4063-bc22-5e96b417376c ] [instance: none, job_execution: > ee747ffb-9be5-4 > 5b0-aa0b-c719668a43aa] Can't run job execution (reason: '__deepcopy__') > > However, even though the job is marked as failed in Sahara API and > dashboard, the job still runs and succeeds on the cluster. (i.e. I see > the results in Swift/HDFS). > > I only experience this behavior on Spark clusters (no other plugins) > but it does affect all job types. (Even simple ones like Shell). > > Any help is greatly appreciated. > > Thanks, > Jeremy Freudberg > > ___ > Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/ > openstack > Post to : openstack@lists.openstack.org > Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/ > openstack > -- Best Regards, Vitaly Gridnev, Project Technical Lead of OpenStack DataProcessing Program (Sahara) Mirantis, Inc ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
[Openstack] [Sahara] Jobs get marked as "failed" immediately on Spark cluster
Hi all, I am experiencing a strange bug running jobs on Sahara (Red Hat Liberty). When submitting a job to a Spark 1.3.1 cluster, I get the following error immediately: 2016-08-08 15:56:09.546 20949 WARNING sahara.service.edp.job_manager [req-fb5b47 22-861a-4063-bc22-5e96b417376c ] [instance: none, job_execution: ee747ffb-9be5-4 5b0-aa0b-c719668a43aa] Can't run job execution (reason: '__deepcopy__') However, even though the job is marked as failed in Sahara API and dashboard, the job still runs and succeeds on the cluster. (i.e. I see the results in Swift/HDFS). I only experience this behavior on Spark clusters (no other plugins) but it does affect all job types. (Even simple ones like Shell). Any help is greatly appreciated. Thanks, Jeremy Freudberg ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
[Openstack] new here - quick question on Horizon/Mitaka
I am new to the thread... so I apologize if this has already been discussed. Can anyone point me to how to properly apply boostrap/bootswatch themes to Horizon Portal? For example, which directory to store the files, how to enable boostrap themes versus the defaults, etc. This is just to skin/theme the overall portal and has nothing to do with creating dashboard/panels such as Project/Admin/Identity.. Lastly it is using Mirantis Openstack - Mitaka release. I recently purchase theme from WrapBootstrap.com and thought I should check here for any tips. (I purchased INSPINIA theme which has SCSS, AngularJS, etc. files https://wrapbootstrap.com/theme/inspinia-responsive-admin-theme-WB0R5L90S) Thanks! ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] Swift new starter questions (PoC)
Great to hear that you're looking at Swift. Answers inline... --John On 8 Aug 2016, at 7:56, Chris wrote: > Hello, > > We are currently playing with swift and try to find out if it would be useful > for our needs. We would use the latest mitaka release. It would be a > multi-region deployment in around 4-5 different countries/DCs with a total > size of 5 TB and millions of small files. Worst case RTT between two > locations would be 400ms. I came across some questions I want to ask. > > 1) As far as I understood Swift returns a 200 OK if the majority of replicas > are written. Is it possible to change this ratio? For replicas, "quorum" is defined as ((R DIV 2) + 1) when R is odd and (R DIV 2) when R is even, where "R" is the replica count. For example, for 3 replicas, the quorum is 2. For 4 replicas, the quorum is 2. It's not possible to change the quorum size, but it is possible to change the replica count. > 2) Does the write affinity now includes containers and accounts? Saw a > presentation from the Symantic guys on the Openstack summit where this topic > came up. And the acces time spikes if this information are transferred from > the WAN. This sounds accurate and is the current state of the system. It's also one of the known ways the community would like to improve the global cluster story. > 2a) If not does it make sense to do some kind of warm up and get the > container and account information saved in memcache for faster access? > Anybody experience at this approach? That sounds like a fantastic idea. Note that it's a very good idea to have a separate memcache pool for each region instead of one pool across all regions. > 3) Lets say we have 5 regions and a replication factor of 3. When we use > write affinity 12 copies would be written in a local cluster and then in the > background replicated to the other regions? Isn't there a better way and > avoid unnecessary local writes if they would be transferred away anyway? With 5 regions and 3 replicas, on write the data would be written to 3 locations in the region that received the request. Later (asynchronously) the replicas would be written to the correct "primary" locations. With 5 regions and 3 replicas, it could mean that the "local" region will not have any of the primary locations. > 4) What will happen if the WAN connection to a DC fails is there an option to > not create a another replication in other DCs just because the WAN is of fore > some minutes? You are describing Swift's normal behavior. A WAN (or even LAN) failure will not trigger automatic replication (a drive failing, however, will trigger it). Basically, Swift treats the inability to connect to another server as an availability issue instead of a durability issue. Replication is only automatically triggered for durability issues. > 5) In a Swift multi region deployment is it possible to have local Keystone > services in every region/DC or does all authentication need to come from the > same keytone machine? I think this would be possible, but I'm not sure if it's advisable. Because any Swift endpoint in the cluster can handle any request to the cluster, this means that you'd be responsible for "locking" a client to a particular endpoint. That is, you don't want UserA in Region1 to try to do requests to Region2, because Region2 will have different auth set up and therefore the request would likely fail. For simplicity, I'd recommend starting with one global auth endpoint and local memcache pools in each Swift region. I'll leave it up to you to determine if you want one global VIP for every region or if you want to expose different endpoints for each region in the cluster. FWIW, I don't think either way is "right". In my opinion, it sounds easier to manage local caching instead of managing the client locking to a region. > > Any help and ideas appreciated! > > Cheers > Chris > > ___ > Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack > Post to : openstack@lists.openstack.org > Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack signature.asc Description: OpenPGP digital signature ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
[Openstack] Customize app for Murano
Hi,
I'm going to write a Murano app for MariaDB Server.
Unfortunately, I'm receiving the following log error from Murano engine,
although MariaDB is actually installed on the server.
*{"packages": [{"class_definitions": ["io.murano.apps.databases.MariaDB"],
"description": "MariaDB is a community-developed fork of the MySQL
relational \r\ndatabase management system intended to remain free under the
GNU GPL.\r\nIt is notable for being led by the original developers of
MySQL, who\r\nforked it due to concerns over its acquisition by Oracle.
Contributors\r\nare required to share their copyright with the MariaDB
Foundation.\r\n", "tags": ["HTTP", "Server", "WebServer", "HTML",
"MariaDB"], "updated": "2016-08-08T13:34:10", "is_public": true,
"categories": ["Databases"], "name": "Maria Database Server", "author":
"Zaeim, Ind", "created": "2016-08-08T13:34:04", "enabled": true, "id":
"02907dab1bad4b2a8bebb59978fb7907", "supplier": {}, "fully_qualified_name":
"io.murano.apps.databases.MariaDB", "type": "Application", "owner_id":
"1d08396d7697497a80f6ea40029530f3"}]} log_http_response
/usr/lib/python2.7/site-packages/muranoclient/common/http.py:1242016-08-08
18:06:49.905 10935 DEBUG murano.dsl.executor [-]
2d9de20d2542444b80c2af5fa803aaf4: Begin execution:
io.murano.system.Resources.yaml (-24369133454107209) called from File
"/tmp/murano-packages-cache/b60832a4-197e-4269-9b02-53945f672416/io.murano/Classes/Environment.yaml",
line 70:9 in method deploy of class io.murano.Environment
$.applications.pselect($.deploy()) _invoke_method_implementation
/usr/lib/python2.7/site-packages/murano/dsl/executor.py:1422016-08-08
18:06:49.909 10935 DEBUG murano.dsl.executor [-]
2d9de20d2542444b80c2af5fa803aaf4: End execution:
io.murano.system.Resources.yaml (-24369133454107209)
_invoke_method_implementation
/usr/lib/python2.7/site-packages/murano/dsl/executor.py:1612016-08-08
18:06:49.913 10935 DEBUG murano.dsl.executor [-]
2d9de20d2542444b80c2af5fa803aaf4: Begin execution:
io.murano.system.StatusReporter.report (-5881409530865345445) called from
File
"/tmp/murano-packages-cache/b60832a4-197e-4269-9b02-53945f672416/io.murano/Classes/Environment.yaml",
line 70:9 in method deploy of class io.murano.Environment
$.applications.pselect($.deploy()) _invoke_method_implementation
/usr/lib/python2.7/site-packages/murano/dsl/executor.py:1422016-08-08
18:06:49.915 10935 DEBUG oslo_messaging._drivers.amqp [-] UNIQUE_ID is
77e7e9f926c84649a9ee059b528ef137. _add_unique_id
/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqp.py:2582016-08-08
18:06:49.930 10935 DEBUG murano.dsl.executor [-]
2d9de20d2542444b80c2af5fa803aaf4: End execution:
io.murano.system.StatusReporter.report (-5881409530865345445)
_invoke_method_implementation
/usr/lib/python2.7/site-packages/murano/dsl/executor.py:1612016-08-08
18:06:49.935 10935 DEBUG murano.dsl.executor [-]
2d9de20d2542444b80c2af5fa803aaf4: Begin execution:
io.murano.system.Agent.call (6292510272563704764) called from File
"/tmp/murano-packages-cache/b60832a4-197e-4269-9b02-53945f672416/io.murano/Classes/Environment.yaml",
line 70:9 in method deploy of class io.murano.Environment
$.applications.pselect($.deploy()) _invoke_method_implementation
/usr/lib/python2.7/site-packages/murano/dsl/executor.py:1422016-08-08
18:09:17.701 10935 DEBUG murano.engine.system.agent_listener [-] Got
execution result: id 'bd82719ede0a4fb989fdd4d2ddb4ef02' body '{u'Body':
{u'AdditionalInfo': None, u'Message': u"'utf8' codec can't decode byte 0xda
in position 7456: invalid continuation byte"}, u'SourceID':
u'bd82719ede0a4fb989fdd4d2ddb4ef02', u'ErrorCode': 1, u'FormatVersion':
u'2.0.0', u'Time': u'2016-08-08 13:39:16.982738', u'Action':
u'Execution:Result', u'ID': u'f4608828cb524e4fbe34eacab6b2a9d8'}' _receive
/usr/lib/python2.7/site-packages/murano/engine/system/agent_listener.py:1082016-08-08
18:09:17.708 10935 DEBUG murano.dsl.executor [-]
2d9de20d2542444b80c2af5fa803aaf4: End execution:
io.murano.system.Agent.call (6292510272563704764) with exception
[murano.engine.system.agent.AgentException]: {'errorCode': 1, 'message':
u"'utf8' codec can't decode byte 0xda in position 7456: invalid
continuation byte", 'extra': None, 'details': None, 'time': u'2016-08-08
13:39:16.982738'} _invoke_method_implementation
/usr/lib/python2.7/site-packages/murano/dsl/executor.py:1562016-08-08
18:09:17.709 10935 DEBUG murano.dsl.executor [-]
2d9de20d2542444b80c2af5fa803aaf4: End execution:
io.murano.apps.databases.MariaDB.deploy (-6973977050694221440) with
exception [murano.engine.system.agent.AgentException]: {'errorCode': 1,
'message': u"'utf8' codec can't decode byte 0xda in position 7456: invalid
continuation byte", 'extra': None, 'details': None, 'time': u'2016-08-08
13:39:16.982738'} _invoke_method_implementation
/usr/lib/python2.7/site-packages/murano/dsl/executor.py:1562016-08-08
18:09:17.709 10935 DEBUG murano.dsl.executor [-]
e5f8e765d4d14501a53d4b05769758ef: End execution:
io.murano.Environment.dep
Re: [Openstack] Which component's API services support Apache + mod_wsgi in Mitaka?
AFAIK, there is no official documentation for Heat, but Heat supports mod_wsgi. You can use these Apache templates: https://github.com/openstack/heat/tree/master/devstack/files and these scripts: https://github.com/openstack/heat/tree/master/heat/httpd to run Heat under mod_wsgi. Also we have gate job for running tempest test on Heat+modwsgi (gate-tempest-dsvm-heat-apache). -Alexey On Mon, Aug 8, 2016 at 5:25 PM, Drew Fisher wrote: > I wasn't able to find any documentation that explicitly lists which > component's API services are officially supported in Mitaka. > > * Keystone (http://docs.openstack.org/developer/keystone/apache-httpd.html > ) > * Cinder (http://docs.openstack.org/developer/cinder/devref/api. > apache.html) > * Swift > (http://docs.openstack.org/developer/swift/apache_deployment_guide.html) > > all appear to be fully supported > > > * Nova > (https://github.com/openstack/nova/blob/stable/mitaka/nova/ > wsgi/nova-api.py) > appears to have some support but it's marked as experimental. > > > I wasn't able to find anything official about Glance, Heat, Neutron, or > Ironic (I stopped here). Are there any official docs about what runs > under Apache + mod_wsgi and what doesn't? > > Thanks! > > -Drew > > ___ > Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/ > openstack > Post to : openstack@lists.openstack.org > Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/ > openstack > ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
[Openstack] Swift new starter questions (PoC)
Hello, We are currently playing with swift and try to find out if it would be useful for our needs. We would use the latest mitaka release. It would be a multi-region deployment in around 4-5 different countries/DCs with a total size of 5 TB and millions of small files. Worst case RTT between two locations would be 400ms. I came across some questions I want to ask. 1) As far as I understood Swift returns a 200 OK if the majority of replicas are written. Is it possible to change this ratio? 2) Does the write affinity now includes containers and accounts? Saw a presentation from the Symantic guys on the Openstack summit where this topic came up. And the acces time spikes if this information are transferred from the WAN. 2a) If not does it make sense to do some kind of warm up and get the container and account information saved in memcache for faster access? Anybody experience at this approach? 3) Lets say we have 5 regions and a replication factor of 3. When we use write affinity 12 copies would be written in a local cluster and then in the background replicated to the other regions? Isn't there a better way and avoid unnecessary local writes if they would be transferred away anyway? 4) What will happen if the WAN connection to a DC fails is there an option to not create a another replication in other DCs just because the WAN is of fore some minutes? 5) In a Swift multi region deployment is it possible to have local Keystone services in every region/DC or does all authentication need to come from the same keytone machine? Any help and ideas appreciated! Cheers Chris ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
[Openstack] Which component's API services support Apache + mod_wsgi in Mitaka?
I wasn't able to find any documentation that explicitly lists which component's API services are officially supported in Mitaka. * Keystone (http://docs.openstack.org/developer/keystone/apache-httpd.html) * Cinder (http://docs.openstack.org/developer/cinder/devref/api.apache.html) * Swift (http://docs.openstack.org/developer/swift/apache_deployment_guide.html) all appear to be fully supported * Nova (https://github.com/openstack/nova/blob/stable/mitaka/nova/wsgi/nova-api.py) appears to have some support but it's marked as experimental. I wasn't able to find anything official about Glance, Heat, Neutron, or Ironic (I stopped here). Are there any official docs about what runs under Apache + mod_wsgi and what doesn't? Thanks! -Drew ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] /usr/bin/keystone-wsgi-admin file not found
Hi Mathi! Can you please specify a link to the instructions you've followed? Thoughts: keystone-wsgi-* scripts are generated by PBR, which is required, but it must be run in order to make these files. If you follow DevStack installation procedure, all magic is done for you. Hint: simplest way to make DevStack working is runnig all DevStack related actions as 'stack' user. On 08.08.2016 13:41, Selvamani Gandhimathi wrote: Dear Team, I am installing openstack mitaka on my debian machine. I followed the steps mentioned in the user manual, while I am trying to register the keystone service, I am getting 404 error and the error log shows /usr/bin/keystone-wsgi-admin file not found I don't see the file anywhere in my machine Please help Thanks Mathi ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] /usr/bin/keystone-wsgi-admin file not found
On Mon, Aug 08, 2016 at 04:11:12PM +0530, Selvamani Gandhimathi wrote: > Dear Team, > > I am installing openstack mitaka on my debian machine. > I followed the steps mentioned in the user manual, > > while I am trying to register the keystone service, I am getting 404 error > and the error log shows > /usr/bin/keystone-wsgi-admin file not found > > I don't see the file anywhere in my machine which repos are you using? whic debian release? I have this $ dpkg -L keystone |grep bin /usr/bin /usr/bin/keystone-all /usr/bin/keystone-manage /usr/bin/keystone-wsgi-admin /usr/bin/keystone-wsgi-public $ dpkg -l keystone Desired=Unknown/Install/Remove/Purge/Hold | Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend |/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad) ||/ Name Version Architecture Description +++-==---= ii keystone 2:9.0.0-2~bpo8+1 all OpenStack identity service -- 1AE0 322E B8F7 4717 BDEA BF1D 44BB 1BA7 9F6C 6333 keybase: http://keybase.io/gfa ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] /usr/bin/keystone-wsgi-admin file not found
Hi, keystone-wsgi-admin usually is in */usr/local/bin* directory (not /usr/bin) Check if you have it there. Then check your apache configuration (/etc/apache2/sites-available/wsgi-keystone.conf) There is a line: WSGIScriptAlias / /usr/local/bin/keystone-wsgi-admin Check that path is correct and you do have a file at that location. Example of apache config you can find here: https://github.com/openstack/keystone/blob/master/httpd/wsgi-keystone.conf So I guess all you need to do is: correct an error in apache config and restart the apache. Kind regards, Kseniya On Mon, Aug 8, 2016 at 1:41 PM, Selvamani Gandhimathi wrote: > Dear Team, > > I am installing openstack mitaka on my debian machine. > I followed the steps mentioned in the user manual, > > while I am trying to register the keystone service, I am getting 404 error > and the error log shows > /usr/bin/keystone-wsgi-admin file not found > > I don't see the file anywhere in my machine > > Please help > > > Thanks > Mathi > > > > > ___ > Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/ > openstack > Post to : openstack@lists.openstack.org > Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/ > openstack > > ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] /usr/bin/keystone-wsgi-admin file not found
I could not find the file in the /usr/local/bin/ also, What should I do On Aug 8, 2016 4:43 PM, "Kseniya Tychkova" wrote: > Hi, > keystone-wsgi-admin usually is in */usr/local/bin* directory (not > /usr/bin) > Check if you have it there. > Then check your apache configuration (/etc/apache2/sites-available/ > wsgi-keystone.conf) > There is a line: WSGIScriptAlias / /usr/local/bin/keystone-wsgi-admin > Check that path is correct and you do have a file at that location. > Example of apache config you can find here: https://github.com/openstack/ > keystone/blob/master/httpd/wsgi-keystone.conf > So I guess all you need to do is: correct an error in apache config and > restart the apache. > > Kind regards, Kseniya > > On Mon, Aug 8, 2016 at 1:41 PM, Selvamani Gandhimathi > wrote: > >> Dear Team, >> >> I am installing openstack mitaka on my debian machine. >> I followed the steps mentioned in the user manual, >> >> while I am trying to register the keystone service, I am getting 404 >> error and the error log shows >> /usr/bin/keystone-wsgi-admin file not found >> >> I don't see the file anywhere in my machine >> >> Please help >> >> >> Thanks >> Mathi >> >> >> >> >> ___ >> Mailing list: http://lists.openstack.org/cgi >> -bin/mailman/listinfo/openstack >> Post to : openstack@lists.openstack.org >> Unsubscribe : http://lists.openstack.org/cgi >> -bin/mailman/listinfo/openstack >> >> > ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] /usr/bin/keystone-wsgi-admin file not found
Try to run "sudo which keystone-wsgi-admin" On Mon, Aug 8, 2016 at 2:16 PM, Selvamani Gandhimathi wrote: > I could not find the file in the /usr/local/bin/ also, > > What should I do > On Aug 8, 2016 4:43 PM, "Kseniya Tychkova" wrote: > >> Hi, >> keystone-wsgi-admin usually is in */usr/local/bin* directory (not >> /usr/bin) >> Check if you have it there. >> Then check your apache configuration (/etc/apache2/sites-available/ >> wsgi-keystone.conf) >> There is a line: WSGIScriptAlias / /usr/local/bin/keystone-wsgi-admin >> Check that path is correct and you do have a file at that location. >> Example of apache config you can find here: >> https://github.com/openstack/keystone/blob/master/httpd/wsg >> i-keystone.conf >> So I guess all you need to do is: correct an error in apache config and >> restart the apache. >> >> Kind regards, Kseniya >> >> On Mon, Aug 8, 2016 at 1:41 PM, Selvamani Gandhimathi > > wrote: >> >>> Dear Team, >>> >>> I am installing openstack mitaka on my debian machine. >>> I followed the steps mentioned in the user manual, >>> >>> while I am trying to register the keystone service, I am getting 404 >>> error and the error log shows >>> /usr/bin/keystone-wsgi-admin file not found >>> >>> I don't see the file anywhere in my machine >>> >>> Please help >>> >>> >>> Thanks >>> Mathi >>> >>> >>> >>> >>> ___ >>> Mailing list: http://lists.openstack.org/cgi >>> -bin/mailman/listinfo/openstack >>> Post to : openstack@lists.openstack.org >>> Unsubscribe : http://lists.openstack.org/cgi >>> -bin/mailman/listinfo/openstack >>> >>> >> ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] [Sahara]Cloudera-Manager generate empty Hadoop/HDFS configration
Hello. Seems like an issue around Cloudera (not sure). I faced with something like that when cluster was deployed without Oozie. Could please try to deploy cluster with Oozie server? On Mon, Aug 8, 2016 at 11:56 AM, fuguangping wrote: > Hi all, > > I installed sahara on Openstack liberty version, and I succeed to deploy > CDH-5.4 without any error. But When I login to the Cloudera-manager VM, I > found some wrong Hadoop/HDFS configurations: > > *[root@int32bit-hadoop-1-cdh-master-001 hdfs]# hdfs dfs -df* > *Filesystem SizeUsedAvailable Use%* > *file:///20061442048 5187198976 14874243072 26%* > > I checked the hadoop config file in /etc/hadoop/conf, it seemed that the > Cloudera-manager fail to update config: > > *[root@int32bit-hadoop-1-cdh-master-001 hdfs]# cat > /etc/hadoop/conf/core-site.xml* > * * > > ** > ** > > As showed above, the core-site.xml is empty. > > Then I checked other config files, it showed the same result with empty > configuration. > > Here's my master role processes: > > CLOUDERA_MANAGER > YARN_JOBHISTORY > YARN_RESOURCEMANAGER > HDFS_SECONDARYNAMENODE > HDFS_NAMENODE > > and slave role processes: > > HBASE_REGIONSERVER > HDFS_DATANODE > YARN_NODEMANAGER > > *sahara.conf:* > > [DEFAULT] > debug=true > verbose = true > log_dir = /var/log/sahara > use_syslog = false > use_stderr = true > rpc_backend = rabbit > use_floating_ips= True > use_neutron = true > use_namespaces = true > use_rootwrap = true > rootwrap_command="sudo sahara-rootwrap /etc/sahara/rootwrap.conf" > > plugins = vanilla,hdp,spark,cdh,ambari,fake,mapr,storm > infrastructure_engine = heat > > ... > > Any help is greatly appreciated. > > Regards, > > Guangping Fu > > ___ > Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/ > openstack > Post to : openstack@lists.openstack.org > Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/ > openstack > > -- Best Regards, Vitaly Gridnev, Project Technical Lead of OpenStack DataProcessing Program (Sahara) Mirantis, Inc ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
[Openstack] /usr/bin/keystone-wsgi-admin file not found
Dear Team, I am installing openstack mitaka on my debian machine. I followed the steps mentioned in the user manual, while I am trying to register the keystone service, I am getting 404 error and the error log shows /usr/bin/keystone-wsgi-admin file not found I don't see the file anywhere in my machine Please help Thanks Mathi ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] The possible ways of high availability for non-cloud-ready apps running on openstack
Hi Hossein, hossein zabolzadeh wrote: > Hi there. > I am dealing with large amount of legacy application(MediaWiki, Joomla, > ...) running on openstack. I am looking for the best way to improve high > availability of my instances. All applications are not designed for > fail(Non-Cloud-Ready Apps). So, what is the best way of improving HA on my > non-clustered instances(Stateful Instances)? > Thanks in advance. Sorry for the slow reply - I only just noticed this. Please see this talk I gave in Austin with Dawid Deja: https://www.openstack.org/videos/video/high-availability-for-pets-and-hypervisors-state-of-the-nation I believe it should answer your question in a lot of detail, but please let me know if you have follow-up questions. Regards, Adam ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
[Openstack] [Sahara]Cloudera-Manager generate empty Hadoop/HDFS configration
Hi all, I installed sahara on Openstack liberty version, and I succeed to deploy CDH-5.4 without any error. But When I login to the Cloudera-manager VM, I found some wrong Hadoop/HDFS configurations: [root@int32bit-hadoop-1-cdh-master-001 hdfs]# hdfs dfs -df Filesystem SizeUsedAvailable Use% file:///20061442048 5187198976 14874243072 26% I checked the hadoop config file in /etc/hadoop/conf, it seemed that the Cloudera-manager fail to update config: [root@int32bit-hadoop-1-cdh-master-001 hdfs]# cat /etc/hadoop/conf/core-site.xml As showed above, the core-site.xml is empty. Then I checked other config files, it showed the same result with empty configuration. Here's my master role processes: CLOUDERA_MANAGER YARN_JOBHISTORY YARN_RESOURCEMANAGER HDFS_SECONDARYNAMENODE HDFS_NAMENODE and slave role processes: HBASE_REGIONSERVER HDFS_DATANODE YARN_NODEMANAGER sahara.conf: [DEFAULT] debug=true verbose = true log_dir = /var/log/sahara use_syslog = false use_stderr = true rpc_backend = rabbit use_floating_ips= True use_neutron = true use_namespaces = true use_rootwrap = true rootwrap_command="sudo sahara-rootwrap /etc/sahara/rootwrap.conf" plugins = vanilla,hdp,spark,cdh,ambari,fake,mapr,storm infrastructure_engine = heat ... Any help is greatly appreciated. Regards, Guangping Fu___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] [Keystone] List group members with policy.v3cloudsample.json
Hi all, I found this issue was fixed by https://bugs.launchpad.net/keystone/+bug/1433402. Thanks. John Eugen Block 於 2016年8月4日 週四 下午9:20寫道： > I just tried to reproduce that with a test domain, but I didn't get > any errors. Did you make sure that your environment script uses the > right credentials for (user)domain scope? I had my share with them a > couple of times... > > > Zitat von 林自均 : > > > Hi Eugen, > > > > I have no problem with the cloud admin, so I guess your workaround > doesn't > > work for me. What disturbing me is the unexpected behavior of the domain > > admin. > > > > John > > > > Eugen Block 於 2016年8月4日 週四 下午3:34寫道： > > > >> Hi, > >> > >> I had a similar issue recently [1], I had to adjust my policy file > >> because for some reason "domain_id:default" was not applied, instead I > >> use "user_domain_id:default" which works fine now. > >> > >> ---cut here--- > >> control1:~ # grep "\"cloud_admin\":" /etc/keystone/policy.json > >> "cloud_admin": "rule:admin_required and (domain_id:default or > >> user_domain_id:default)", > >> ---cut here--- > >> > >> And I added it as an OR statement as a workaround to keep the original > >> statement. Hope this helps! > >> > >> Regards, > >> Eugen > >> > >> [1] > http://lists.openstack.org/pipermail/openstack/2016-June/016454.html > >> > >> > >> Zitat von 林自均 : > >> > >> > Hi all, > >> > > >> > My OpenStack version is Mitaka. I updated my > /etc/keystone/policy.json to > >> > policy.v3cloudsample.json > >> > < > >> > https://github.com/openstack/keystone/blob/master/etc/policy.v3cloudsample.json > >> >. > >> > Most functions works as expected. > >> > > >> > However, when I wanted to list members in a group as a domain admin, > an > >> > error occurred: “You are not authorized to perform the requested > action: > >> > identity:list_users_in_group (HTTP 403)”. > >> > > >> > The reproduce steps are: > >> > > >> >- As cloud admin: > >> > - openstack domain create taiwan > >> > - openstack user create --domain taiwan --password 5ecret > >> > taiwan-president > >> > - openstack role add --user taiwan-president --domain taiwan > admin > >> >- As taiwan-president: > >> > - openstack group create --domain taiwan indigenous > >> > - openstack user create --domain taiwan margaret > >> > - openstack group add user --group-domain taiwan indigenous > >> margaret > >> > - openstack user list --group indigenous --domain taiwan > >> > > >> > The last command will generate the 403 error. > >> > > >> > The rule for identity:list_users_in_group is rule:cloud_admin or > >> > rule:admin_and_matching_target_group_domain_id. I can successfully > list > >> > group members if I changed it to rule:admin_required. > >> > > >> > Am I doing anything wrong? Or did I run into some kind of bug? Thanks > for > >> > the help. > >> > > >> > John > >> > > >> > >> > >> > >> -- > >> Eugen Block voice : +49-40-559 51 75 > >> NDE Netzdesign und -entwicklung AG fax : +49-40-559 51 77 > >> Postfach 61 03 15 > >> D-22423 Hamburg e-mail : ebl...@nde.ag > >> > >> Vorsitzende des Aufsichtsrates: Angelika Mozdzen > >>Sitz und Registergericht: Hamburg, HRB 90934 > >>Vorstand: Jens-U. Mozdzen > >> USt-IdNr. DE 814 013 983 > >> > >> > >> ___ > >> Mailing list: > >> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack > >> Post to : openstack@lists.openstack.org > >> Unsubscribe : > >> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack > >> > > > > -- > Eugen Block voice : +49-40-559 51 75 > NDE Netzdesign und -entwicklung AG fax : +49-40-559 51 77 > Postfach 61 03 15 > D-22423 Hamburg e-mail : ebl...@nde.ag > > Vorsitzende des Aufsichtsrates: Angelika Mozdzen >Sitz und Registergericht: Hamburg, HRB 90934 >Vorstand: Jens-U. Mozdzen > USt-IdNr. DE 814 013 983 > > ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
