Re: [galaxy-dev] error and question from using galaxy kickstart

2018-10-12 Thread Rui Wang
Never mind folks, it was that I had an older version of nginx running with
a different config file. After I added the upload module and restarted it,
now I could simply go to the UI by just specifying the host name.

But...how do I stop/start this still remains unclear. please help if you
could. :-)

I see that I have so many python processes and postgresql processes:

bioinfo+ 101567 101415  0 19:41 ?00:00:04
/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/bin/python2
/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/bin/uwsgi --virtualenv
/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv --ini-paste
/media/libraryfiles/bioinfoadmin/bioinfoadmin/config/galaxy.ini --logdate
--thunder-lock --master --processes 2 --threads 2 --logto
/media/libraryfiles/bioinfoadmin/bioinfoadmin/uwsgi.log --socket
127.0.0.1:4001 --pythonpath lib --stats 127.0.0.1:9191 -b 16384
bioinfo+ 101568 101415  1 19:41 ?00:01:38
/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/bin/python
./lib/galaxy/main.py -c
/media/libraryfiles/bioinfoadmin/bioinfoadmin/config/galaxy.ini
--server-name=handler0
--log-file=/media/libraryfiles/bioinfoadmin/bioinfoadmin/handler0.log
bioinfo+ 101569 101415  1 19:41 ?00:01:37
/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/bin/python
./lib/galaxy/main.py -c
/media/libraryfiles/bioinfoadmin/bioinfoadmin/config/galaxy.ini
--server-name=handler1
--log-file=/media/libraryfiles/bioinfoadmin/bioinfoadmin/handler1.log
bioinfo+ 101570 101415  1 19:41 ?00:01:38
/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/bin/python
./lib/galaxy/main.py -c
/media/libraryfiles/bioinfoadmin/bioinfoadmin/config/galaxy.ini
--server-name=handler2
--log-file=/media/libraryfiles/bioinfoadmin/bioinfoadmin/handler2.log
bioinfo+ 101571 101415  1 19:41 ?00:01:38
/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/bin/python
./lib/galaxy/main.py -c
/media/libraryfiles/bioinfoadmin/bioinfoadmin/config/galaxy.ini
--server-name=handler3
--log-file=/media/libraryfiles/bioinfoadmin/bioinfoadmin/handler3.log
bioinfo+ 102477 101567  1 19:41 ?00:01:39
/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/bin/python2
/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/bin/uwsgi --virtualenv
/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv --ini-paste
/media/libraryfiles/bioinfoadmin/bioinfoadmin/config/galaxy.ini --logdate
--thunder-lock --master --processes 2 --threads 2 --logto
/media/libraryfiles/bioinfoadmin/bioinfoadmin/uwsgi.log --socket
127.0.0.1:4001 --pythonpath lib --stats 127.0.0.1:9191 -b 16384
bioinfo+ 102478 101567  1 19:41 ?00:01:39
/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/bin/python2
/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/bin/uwsgi --virtualenv
/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv --ini-paste
/media/libraryfiles/bioinfoadmin/bioinfoadmin/config/galaxy.ini --logdate
--thunder-lock --master --processes 2 --threads 2 --logto
/media/libraryfiles/bioinfoadmin/bioinfoadmin/uwsgi.log --socket
127.0.0.1:4001 --pythonpath lib --stats 127.0.0.1:9191 -b 16384

$ ps -ef | grep -i post
postgres 102744  1  0 19:41 ?00:00:00
/usr/lib/postgresql/10/bin/postgres -D /var/lib/postgresql/10/main -c
config_file=/etc/postgresql/10/main/postgresql.conf
postgres 102747 102744  0 19:41 ?00:00:00 postgres: 10/main:
checkpointer process
postgres 102748 102744  0 19:41 ?00:00:00 postgres: 10/main: writer
process
postgres 102749 102744  0 19:41 ?00:00:00 postgres: 10/main: wal
writer process
postgres 102750 102744  0 19:41 ?00:00:00 postgres: 10/main:
autovacuum launcher process
postgres 102751 102744  0 19:41 ?00:00:00 postgres: 10/main: stats
collector process
postgres 102752 102744  0 19:41 ?00:00:00 postgres: 10/main:
bgworker: logical replication launcher
postgres 103679 101415  0 19:42 ?00:00:00
/usr/lib/postgresql/9.5/bin/postmaster -D /var/lib/postgresql/9.5/main -c
config_file=/etc/postgresql/9.5/main/postgresql.conf
postgres 103689 103679  0 19:42 ?00:00:00 postgres: checkpointer
process
postgres 103690 103679  0 19:42 ?00:00:00 postgres: writer process
postgres 103691 103679  0 19:42 ?00:00:00 postgres: wal writer
process
postgres 103692 103679  0 19:42 ?00:00:00 postgres: autovacuum
launcher process
postgres 103693 103679  0 19:42 ?00:00:01 postgres: stats collector
process
postgres 103694 103679  0 19:42 ?00:00:04 postgres: bioinfoadmin
galaxy 127.0.0.1(36144) idle
postgres 103695 103679  0 19:42 ?00:00:04 postgres: bioinfoadmin
galaxy 127.0.0.1(36146) idle
postgres 103696 103679  0 19:42 ?00:00:04 postgres: bioinfoadmin
galaxy 127.0.0.1(36148) idle
postgres 103697 103679  0 19:42 ?00:00:04 postgres: bioinfoadmin
galaxy 127.0.0.1(36150) idle
postgres 103698 103679  0 19:42 ?00:00:11 postgres: bioinfoadmin
galaxy 127.0.0.1(36152) idle
postgres 103699 103679  0 19:42 ?00:00:11 postgres

[galaxy-dev] error and question from using galaxy kickstart

2018-10-12 Thread Rui Wang
Hi Folks,

So I managed to ran through the ansible. What I did was to remove certain
steps. For example, I don't need slurm-drmaa and docker, then I skipped the
update cache. After these minor changes, it finished successfully(?) with
an error message it ignored. Then I tried to access the UI, but nothing
worked. I pasted it below for your reference. If anyone has seen this
before, please help. :-)

Sorry for the beginner question, so once the ansible playbook ran
through...seems the galaxy and the postgresql etc were started. How do I
start/stop them manually? Do I have to run the playbook every time I want
to run galaxy or only after I modify the playbook? Also, if I don't look at
the log, I don't even know that the UI is at 127.0.0.1:4001.  Is there any
documentation for this?

Thanks,
Rui


error message:

galaxy.web.stack INFO 2018-10-12 19:41:53,874 [p:102477,w:1,m:0]
[MainThread] Galaxy server instance 'main.web.1' is running
Starting server in PID 101567.
serving on uwsgi://127.0.0.1:4001
galaxy.jobs.handler ERROR 2018-10-12 19:42:48,487 [p:102477,w:1,m:0]
[JobHandlerQueue.monitor_thread] Exception in monitor_step
Traceback (most recent call last):
  File "lib/galaxy/jobs/handler.py", line 213, in __monitor
self.__monitor_step()
  File "lib/galaxy/jobs/handler.py", line 272, in __monitor_step
.order_by(model.Job.id).all()
  File
"/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py",
line 2737, in all
return list(self)
  File
"/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py",
line 2889, in __iter__
return self._execute_and_instances(context)
  File
"/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py",
line 2912, in _execute_and_instances
result = conn.execute(querycontext.statement, self._params)
  File
"/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 948, in execute
return meth(self, multiparams, params)
  File
"/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/local/lib/python2.7/site-packages/sqlalchemy/sql/elements.py",
line 269, in _execute_on_connection
return connection._execute_clauseelement(self, multiparams, params)
  File
"/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1060, in _execute_clauseelement
compiled_sql, distilled_params
  File
"/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1200, in _execute_context
context)
  File
"/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1413, in _handle_dbapi_exception
exc_info
  File
"/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/local/lib/python2.7/site-packages/sqlalchemy/util/compat.py",
line 203, in raise_from_cause
reraise(type(exception), exception, tb=exc_tb, cause=cause)
  File
"/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1193, in _execute_context
context)
  File
"/media/libraryfiles/bioinfoadmin/bioinfoadmin/.venv/local/lib/python2.7/site-packages/sqlalchemy/engine/default.py",
line 507, in do_execute
cursor.execute(statement, parameters)
OperationalError: (psycopg2.OperationalError) server closed the connection
unexpectedly
This probably means the server terminated abnormally
before or while processing the request.
 [SQL: 'SELECT EXISTS (SELECT history_dataset_association.id,
history_dataset_association.history_id,
history_dataset_association.dataset_id,
history_dataset_association.create_time,
history_dataset_association.update_time, history_dataset_association.state,
history_dataset_association.copied_from_history_dataset_association_id,
history_dataset_association.copied_from_library_dataset_dataset_association_id,
history_dataset_association.name, history_dataset_association.info,
history_dataset_association.blurb, history_dataset_association.peek,
history_dataset_association.tool_version,
history_dataset_association.extension,
history_dataset_association.metadata,
history_dataset_association.parent_id,
history_dataset_association.designation,
history_dataset_association.deleted, history_dataset_association.visible,
history_dataset_association.extended_metadata_id,
history_dataset_association.version, history_dataset_association.hid,
history_dataset_association.purged,
history_dataset_association.hidden_beneath_collection_instance_id \nFROM
history_dataset_association, job_to_output_dataset \nWHERE job.id =
job_to_output_dataset.job_id AND history_dataset_association.id =
job_to_output_dataset.dataset_id AND history_dataset_association.deleted =
true) AS anon_1, EXISTS (SELECT history_dataset_collection_association.id
\nFROM history