2015-09-30 17:47 GMT+02:00 Dwayne Bailey <[email protected]>:
> On 30 September 2015 at 15:12, Bernardo Gonzalez Kriegel <
> [email protected]> wrote:
>
>> On Wed, Sep 30, 2015 at 7:58 AM, Dwayne Bailey <[email protected]>
>> wrote:
>>
>>>
>>> If you are getting a traceback from a file that doesn't exist in 2.7.2
>>> then the env is still dirty somehow.  The only way to get that is stray
>>> .pyc files.  It would be important to pyclean in the actual venv
>>> installation.  It would help if you could confirm that the .py and indeed
>>> the .pyc files are not present in your venv.
>>>
>>> If you still get it then Pootle is pulling those in from some other
>>> installation somewhere.
>>>
>>>
>>>>
>>>> I did a clean install of 2.7.2 on a new virtualenv.
>>>> With that filetree I managed to get Pootle running again,
>>>> so perhaps the upgrade process does not remove some files !!
>>>>
>>>
>>> The .pyc's are usually the issue.
>>>
>>
>> I checked that pyclean removes all 'pyc' files, but what I found is that
>> there is no
>> models.py file, only a 'pyo' one
>>
>> ./env/lib/python2.7/site-packages/pootle/apps/pootle_profile/models.pyo
>>
>
> Then be the bad ones.  Weird pyclean is meant to remove .pyc and .pyo files.
>
> rm $(find /env/lib/python2.7/site-packages/pootle -name "*.pyo")
>
>
>>
>> Pootle is only installed on the virtualenvs.
>> For testing I will keep for now the clean install, I'll try the update
>> procedure again
>> when a new version of 2.6.x is released

2.6.2 has been released this last Monday:
http://docs.translatehouse.org/projects/pootle/en/latest/releases/2.6.2.html


>>>> I'm now struggling with elasticsearch and other issues :(
>>>>
>>>
>>> Feel free to post them here.  Note that ES isn't critical, but you want
>>> it for local TM.  Leandro has just setup ES for some work we want to do on
>>> improving local TM.  So its a good time to ask.
>>>
>>>
>>
>> Issues I found:
>>
>> 1) Core dump when running calculate_checks  or   refresh_stats
>> Last time I tried my server crashed, it need a harware reset.
>> I did those jobs using something like
>>
>> for project in $( pootle list_projects ); do pootle calculate_checks
>> --no-rq -v 3 --traceback --project $project; done
>>
>> and something similar to refresh_stats.
>> Perhaps I have too many projects
>>
>
> Your server must be massive.  I hit that with calculate_checks and thought
> also that it was my projects that where too big.  I've never hit that with
> refresh_stats, in fact not sure how you did as those should just spawn jobs
> in RQ.
>
>
>>
>> 2) Local TM seems a nice feature, I have elasticsearch running
>> ( default install, I'm new to this and redis and RQ... )
>>
>> curl http://localhost:9200
>> {
>>   "status" : 200,
>>   "name" : "Lorelei II",
>>   "cluster_name" : "elasticsearch",
>>   "version" : {
>>     "number" : "1.7.2",
>>     "build_hash" : "e43676b1385b8125d647f593f7202acbd816e8ec",
>>     "build_timestamp" : "2015-09-14T09:49:53Z",
>>     "build_snapshot" : false,
>>     "lucene_version" : "4.10.4"
>>   },
>>   "tagline" : "You Know, for Search"
>> }
>>
>> but when trying update_tmserver I got
>>
>> $ pootle update_tmserver -v 3 --dry-run
>>
>
> Can you try by adding --rebuild which will rebuild the TM resources from
> scratch.  The current command line will simply update an existing LocalTM
> and clearly you haven't got one yet.  The command needs to be more robust
> and clearer.  Will push your traceback into an issue to track this see
> https://github.com/translate/pootle/issues/4120


We don't support elasticsearch 1.7.2. It can be 1.6.0 at most. See
http://docs.translatehouse.org/projects/pootle/en/latest/releases/2.7.2.html#details-of-changes

Please tell us if all these recommendations solve this issue.


Bye

>> 2015-09-30 10:55:33,485 INFO Loading custom settings from
>> '/root/.pootle/pootle.conf'...
>> 2015-09-30 13:55:33,704 INFO Using Python PO
>> System check identified some issues:
>>
>> WARNINGS:
>> ?: (pootle.W017) There are user accounts with duplicate emails. This will
>> not be allowed in Pootle 2.8.
>>         HINT: Try using 'pootle find_duplicate_emails', and then update
>> user emails with 'pootle update_user_email username email'. You might also
>> want to consider using pootle merge_user or purge_user commands
>> Traceback (most recent call last):
>>   File "/var/www/pootle/env/bin/pootle", line 11, in <module>
>>     sys.exit(main())
>>   File
>> "/var/www/pootle/env/local/lib/python2.7/site-packages/pootle/runner.py",
>> line 309, in main
>>     django_settings_module='pootle.settings')
>>   File
>> "/var/www/pootle/env/local/lib/python2.7/site-packages/pootle/runner.py",
>> line 289, in run_app
>>     management.execute_from_command_line(command)
>>   File
>> "/var/www/pootle/env/local/lib/python2.7/site-packages/django/core/management/__init__.py",
>> line 385, in execute_from_command_line
>>     utility.execute()
>>   File
>> "/var/www/pootle/env/local/lib/python2.7/site-packages/django/core/management/__init__.py",
>> line 377, in execute
>>     self.fetch_command(subcommand).run_from_argv(self.argv)
>>   File
>> "/var/www/pootle/env/local/lib/python2.7/site-packages/django/core/management/base.py",
>> line 288, in run_from_argv
>>     self.execute(*args, **options.__dict__)
>>   File
>> "/var/www/pootle/env/local/lib/python2.7/site-packages/django/core/management/base.py",
>> line 338, in execute
>>     output = self.handle(*args, **options)
>>   File
>> "/var/www/pootle/env/local/lib/python2.7/site-packages/pootle/apps/pootle_app/management/commands/update_tmserver.py",
>> line 152, in handle
>>     'field': 'revision'
>>   File
>> "/var/www/pootle/env/local/lib/python2.7/site-packages/elasticsearch/client/utils.py",
>> line 69, in _wrapped
>>     return func(*args, params=params, **kwargs)
>>   File
>> "/var/www/pootle/env/local/lib/python2.7/site-packages/elasticsearch/client/__init__.py",
>> line 506, in search
>>     params=params, body=body)
>>   File
>> "/var/www/pootle/env/local/lib/python2.7/site-packages/elasticsearch/transport.py",
>> line 307, in perform_request
>>     status, headers, data = connection.perform_request(method, url,
>> params, body, ignore=ignore, timeout=timeout)
>>   File
>> "/var/www/pootle/env/local/lib/python2.7/site-packages/elasticsearch/connection/http_urllib3.py",
>> line 89, in perform_request
>>     self._raise_error(response.status, raw_data)
>>   File
>> "/var/www/pootle/env/local/lib/python2.7/site-packages/elasticsearch/connection/base.py",
>> line 105, in _raise_error
>>     raise HTTP_EXCEPTIONS.get(status_code, TransportError)(status_code,
>> error_message, additional_info)
>> elasticsearch.exceptions.RequestError: TransportError(400,
>> u'SearchPhaseExecutionException[Failed to execute phase [query], all shards
>> failed; shardFailures {[aQHk0CPtT1K_ZZ2YJG8rjQ][translations][0]:
>> SearchParseException[[translations][0]:
>> query[ConstantScore(*:*)],from[-1],size[-1]: Parse Failure [Failed to parse
>> source [{"query": {"match_all": {}}, "facets": {"stat1": {"statistical":
>> {"field": "revision"}}}}]]]; nested: FacetPhaseExecutionException[Facet
>> [stat1]: No mapping found for field [revision]];
>> }{[aQHk0CPtT1K_ZZ2YJG8rjQ][translations][1]:
>> SearchParseException[[translations][1]:
>> query[ConstantScore(*:*)],from[-1],size[-1]: Parse Failure [Failed to parse
>> source [{"query": {"match_all": {}}, "facets": {"stat1": {"statistical":
>> {"field": "revision"}}}}]]]; nested: FacetPhaseExecutionException[Facet
>> [stat1]: No mapping found for field [revision]];
>> }{[aQHk0CPtT1K_ZZ2YJG8rjQ][translations][2]:
>> SearchParseException[[translations][2]:
>> query[ConstantScore(*:*)],from[-1],size[-1]: Parse Failure [Failed to parse
>> source [{"query": {"match_all": {}}, "facets": {"stat1": {"statistical":
>> {"field": "revision"}}}}]]]; nested: FacetPhaseExecutionException[Facet
>> [stat1]: No mapping found for field [revision]];
>> }{[aQHk0CPtT1K_ZZ2YJG8rjQ][translations][3]:
>> SearchParseException[[translations][3]:
>> query[ConstantScore(*:*)],from[-1],size[-1]: Parse Failure [Failed to parse
>> source [{"query": {"match_all": {}}, "facets": {"stat1": {"statistical":
>> {"field": "revision"}}}}]]]; nested: FacetPhaseExecutionException[Facet
>> [stat1]: No mapping found for field [revision]];
>> }{[aQHk0CPtT1K_ZZ2YJG8rjQ][translations][4]:
>> SearchParseException[[translations][4]:
>> query[ConstantScore(*:*)],from[-1],size[-1]: Parse Failure [Failed to parse
>> source [{"query": {"match_all": {}}, "facets": {"stat1": {"statistical":
>> {"field": "revision"}}}}]]]; nested: FacetPhaseExecutionException[Facet
>> [stat1]: No mapping found for field [revision]]; }]')
>>
>> Don't know if I need to setup or run another thing
>>
>> Bernardo
>>
>>
>>
>
>
> --
> Dwayne
>
> *Translate*
> +27 12 460 1095 (work)
> ------------------------------------------------------------------------------
> _______________________________________________
> Translate-pootle mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/translate-pootle

------------------------------------------------------------------------------
_______________________________________________
Translate-pootle mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/translate-pootle

Reply via email to