This is an automated email from the ASF dual-hosted git repository.
lfrolov pushed a change to branch develop
in repository https://gitbox.apache.org/repos/asf/incubator-datalab.git.
from 2e4da21 Merge pull request #1156 from apache/DATALAB-2395
add 35ac2d5 [DATALAB-2269] - updated third-party software to new stable
versions
add d8106cf [DATALAB-2091]: made some py3 related changes
add 90dbacd [DATALAB-2091]: changed shebang in py scripts for py3
add e3ac23f [DATALAB-2091]: made some py3 related changes
add 910772f [DATALAB-2091]: replaced fabric with fab-classic
add 932734a [DATALAB-2091]: changed some libs
add 1739079 [DATALAB-2091]: changed shebang in all .py scripts
add defe1db [DATALAB-2091]: replaced python2.7 with python 3.6 in
Dockerfiles
add be0ec0a [DATALAB-2091]: changed prefix to Oo
add 8d56672 [DATALAB-2091]: changed import of meta_lib in actions_lib
add 2fb0d15 [DATALAB-2091]: changed urllib2 to urllib3 in gcp actions_lib
add e640df2 [DATALAB-2091]: replaced meta_lib with datalab.meta_lib
add fd3aff9 [DATALAB-2091]: changed check if subnet is predefined during
ssn_prepare
add 0999188 [DATALAB-2091]: fixed subnet creation error
add 35dea49 [DATALAB-2091]: added cryptography python lib in base
dockerfile
add 83ddd9d [DATALAB-2091]: fixed unable to connect to newly created
instance
add 87d815a [DATALAB-2091]: changed manage_pkg behavior in case of
frontend lock, changed pip to pip3
add b0cb003 [DATALAB-2091]: replaced fabric with fab-classic
add 3323184 [DATALAB-2091]: added --ignore-installed in ensure_pip
add a60593b [DATALAB-2091]: fixed error when creating subnet with
preexisting VPC
add d496aad [DATALAB-2091]: made additional changes in manage_pkg function
add 466202f [DATALAB-2091]: added locale change
add 1cbe473 [DATALAB-2091]: fixed UnicodeDecodeError during python lib
installation
add 1079d0f [DATALAB-2091]: changed back except in ensure_pip function
add 33f96fc [DATALAB-2091]: changed usage of python to python3 in some
scripts
add aa73054 [DATALAB-2091]: changed usage of python to python3 in some
scripts
add 54f971e [DATALAB-2091]: changed import of configparser
add c582d80 [DATALAB-2091]: added static ip removal in case of ssn config
failure
add 4ccd5da [DATALAB-2091]: removed option duplication in datalab.ini
add ba37433 [DATALAB-2091]: changed python version fron 2.7 to 3.6
add f9f89f3 [DATALAB-2091]: changed pip2 to pip3 in configure_ui
add 8682866 [DATALAB-2091]: removed fab-classic version from
install_prerequisites.py
add 6bcf772 [DATALAB-2091]: removed installation of python2 modules
during notebook creation
add 78eb56b [DATALAB-2091]: removed installation of python2 modules
during notebook creation
add 82ad373 [DATALAB-2091]: changed six install from six>= to six==
add 45f237e [DATALAB-2091]: removed python2 libs installation
add c4f32a7 [DATALAB-2091]: added keyrings.alt installation
add 95249bc [DATALAB-2091]: fixed configure_docker during jupyterlab
deployment
add 204f271 [DATALAB-2091]: removed installation by pip2 during
additional libs installation
add e3aa1c5 [DATALAB-2091]: removed decode during dataproc cluster json
opening
add 7be3cff [DATALAB-2091]: changed format of additional tags
add 373be47 [DATALAB-2091]: replaced "with file(" by "with open("
add 5f1e7f5 [DATALAB-2091]: fixed scp of datalab python libs
add ea3c701 [DATALAB-2091]: added update of keyrings.alt
add c737f9e [DATALAB-2091]: changed how tensoeflow-gpu is installed
add ce3b55b [DATALAB-2091]: added backoff python3 lib install
add 43d3e2d [DATALAB-2091]: replaced python-dev with python3-pip
add ecbbcbd [DATALAB-2091]: replaced xmlrpclib with xmlrpclib
add bf53502 [DATALAB-2091]: fixed usage of xmlrpclib
add bcbe8fb [DATALAB-2091]: fixed usage of xmlrpclib
add 1c5b99f [DATALAB-2091]: changed mode when opening list of r packages
add b8e8a47 [DATALAB-2091]: replaced install of python-matplotlib with
python3-mathplotlib
add 7138898 [DATALAB-2091]: changed debian_image_names in datalab.ini
according to ubuntu 20.04
add b110aef [DATALAB-2261]: changed jupyter version
add fe4c398 [DATALAB-2262]: changed tensorflow version
add c8a23f5 [DATALAB-2263]: changed rstudio version
add a02af5c [DATALAB-2264]: changed zeppelin version
add 1624e7b [DATALAB-2091]: fixed gcp ubuntu 2004 version
add c97e587 [DATALAB-2091]: fixed docker-ce version
add 7c3cd3b [DATALAB-2233]: Added GPU parameters for Dataproc (#1049)
add a65d78d Merge branch 'DATALAB-2091' of
https://github.com/apache/incubator-dlab into DATALAB-2091
add d5c8a76 [DATALAB-2270]: updated ungit
add 4a899ea [DATALAB-2091]: replaced python3.6 with python 3.8
add a6601bd [DATALAB-2091]: replaced ubuntu 18.04 with 20.04 in base
dockerfile
add 1d853da [DATALAB-2091]: added noninteractive to base dockerfile
add 4069559 [DATALAB-2091]: removed decode of the ssh_key during instance
create
add f9e263a [DATALAB-2091]: added check of crypto version
add e4fedb5 [DATALAB-2091]: replaced pycrypto with pycryptodome
add 7fca713 [DATALAB-2091]: added creation of /usr/lib64/python3.8 dir
add 7ce11c3 [DATALAB-2091]: added creation of /usr/lib64/python3.8 dir
add 0385af1 [DATALAB-2091]: changed mongodb version
add 41c4f93 [DATALAB-2233]: Mock GPU parameters for Dataproc on cluster
details
add 2d03289 [DATALAB-2233]: Show GPU Dataproc parameters on cluster
details dialog
add a34480f Merge branch 'DATALAB-2232' of
github.com:apache/incubator-dlab into DATALAB-2258
add 56edde9 Merge branch 'DATALAB-2091' into DATALAB-2258
add b3cfd1c Merge pull request #1050 from apache/DATALAB-2258
add fba592c Merge branch 'DATALAB-2091' of
https://github.com/apache/incubator-dlab into DATALAB-2091
add 2c11e53 [DATALAB-2091]: changed openresty version according to ubuntu
20.04
add f57dd57 [DATALAB-2091]: updated tensorflow zeppelin jupyter versions
add ef4db96 [DATALAB-2091]: changed how R repository is added
add c3c20ce [DATALAB-2091]: fixed zeppelin creation error when
/tmp/notebook_spark-defaults_local.conf permission denied
add 34d6a3f [DATALAB-2091]: fixed rstudio server version
add 7a27077 [DATALAB-2091]: fixed rstudio server download link
add 5c5770a [DATALAB-2091]: added creation of
/opt/zeppelin/lib/interpreter/ directory
add 6daa0df [DATALAB-2091]: fixed path to rstudio-server.service
add 51d68fc [DATALAB-2091]: fixed path to python3
add 9dcb48d [DATALAB-2091]: added uninstall of fabric
add e4a4b98 [DATALAB-2091]: added install of fab-classic
add bc1eb2b [DATALAB-2091]: added install of python3-virtualenv
add d9b75c3 [DATALAB-2091]: added import of fabric in meta_lib
add bd41a75 [DATALAB-2091]: removed decode in common create subnet
add a866107 [DATALAB-2091]: added missing whitespace
add 04010db [DATALAB-2091]: fixed pip uninstall
add 92556d4 [DATALAB-2091]: fixed zeppelin versions in json
add e11e655 [DATALAB-2091]: fixed venv_command
add 460728f [DATALAB-2091]: removed gpu_shapes from
jupyter_description.json
add 0b20fa9 [DATALAB-2091]: remade connection for new fabric
add b4ea1a4 [DATALAB-2091]: replaced fab-classic with fabric
add 7030b9c [DATALAB-2235]: Added GPU for compute creating, Changed
checkboxes
add be49dc7 Merge branch 'DATALAB-2232' of
github.com:apache/incubator-dlab into DATALAB-2233
add 9d3c40d [DATALAB-2233]: Add service layer
add 13985e9 [DATALAB-2233]: added GPU count
add 4e349f0 Merge branch 'DATALAB-2232' of
github.com:apache/incubator-dlab into DATALAB-2233
add 84ae771 Merge branch 'DATALAB-2232' of
github.com:apache/incubator-dlab into DATALAB-2233
add dfe19b4 [DATALAB-2233]: upd gpu for dataproc
add 255fa64 Merge branch 'DATALAB-2232' of
github.com:apache/incubator-dlab into DATALAB-2233
add 3193d91 [DATALAB-2233]: Add validation
add 818a0dc small fix
add 1e746d2 Merge branch 'DATALAB-2232' of
github.com:apache/incubator-dlab into DATALAB-2233
add 24cf73d [DATALAB-2233]: Added GPU parameters for Dataproc
add a34252b Merge branch 'DATALAB-2233' of
github.com:apache/incubator-dlab into DATALAB-2246
add 8a97e5f Merge branch 'DATALAB-2232' of
github.com:apache/incubator-dlab into DATALAB-2246
add 4313d3f [DATALAB-2233]: Fixed visibility of action menu on small
screen
add 47ef2be [DATALAB-2233]: Add possibility to create jupiter with GPU
add 63accf4 Merge branch 'DATALAB-2232' of
github.com:apache/incubator-dlab into DATALAB-2246
add 2387e4c add gpu tag
add a9d8089 Merge branch 'DATALAB-2232' of
github.com:apache/incubator-dlab into DATALAB-2246
add fc9a452 [DATALAB-2246]: Added GPU for jupyter on GCP
add f7f6f39 Merge branch 'DATALAB-2091' into DATALAB-2246
add bd802e5 Merge pull request #1053 from apache/DATALAB-2246
add d72db0a Merge branch 'DATALAB-2091' of
https://github.com/apache/incubator-dlab into DATALAB-2091
add 71bc158 [DATALAB-2091]: replaced sudo() run() put() with conn.sudo()
conn.run() conn.put()
add 559f7f6 [DATALAB-2091]: replaced import of fabric.api with import
fabric
add 9c36811 [DATALAB-2091]: replaced cd( and run( with conn.cd( and
conn.run(
add 165142d [DATALAB-2091]: removed lcd(
add 9688bf0 [DATALAB-2091]: added invoke import in deploy datalab
add cb4ff55 [DATALAB-2091]: changed local in deploy datalab
add 2de1e15 [DATALAB-2091]: changed local in deploy datalab
add eb61ff2 Merge branch 'DATALAB-2232' of
github.com:apache/incubator-dlab into DATALAB-2246
add 9e5e37f [DATALAB-2246]: Show notebooks with GPU on Env. managment
page. Added GPU count
add 1de557a Merge pull request #1055 from apache/DATALAB-2246
add c92ea94 [DATALAB-2271]: Removed pip2 package from groups list
add d439799 small fix
add 8bad24b small fix
add 8f538f7 Merge pull request #1057 from apache/DATALAB-2271
add 4946220 Merge branch 'DATALAB-2091' into DATALAB-2269
add ad0f9b4 Merge pull request #1061 from apache/DATALAB-2269
add cb302b6 [DATALAB-2091]: updated pip version
add 34cf9c2 [DATALAB-2091]: partially replaced local with subprocess.run(
add f78fb55 [DATALAB-2091]: partially replaced local with subprocess.run(
add 97f89cf [DATALAB-2091]: partially replaced local with subprocess.run(
add 1553dc1 [DATALAB-2091]: partially replaced local with subprocess.run(
add eb38891 [DATALAB-2091]: partially replaced local with subprocess.run(
add 3d93bf7 [DATALAB-2091]: partially replaced local with subprocess.run(
add 876d6bd [DATALAB-2091]: partially replaced local with subprocess.run(
add 722045a [DATALAB-2091]: partially replaced local with subprocess.run(
add 0f42c4c [DATALAB-2091]: partially replaced local with subprocess.run(
add 675f183 [DATALAB-2091]: partially replaced local with subprocess.run(
add 2b65f72 [DATALAB-2091]: partially replaced local with subprocess.run(
add a92b4a1 [DATALAB-2091]: partially replaced local with subprocess.run(
add 5d8eb01 [DATALAB-2091]: partially replaced local with subprocess.run(
add 7549087 Merge branch 'DATALAB-2091-fab2' into DATALAB-2091
add 3f27f2b [DATALAB-2091]: changed SafeConfigParser to ConfigParser
add 7e40d30 [DATALAB-2091]: changed how hide is called
add 01a6a29 [DATALAB-2091]: changed pip version in dockerfile
add 9789d90 [DATALAB-2091]: changed fabric import in entrypoint.py
add 77da794 [DATALAB-2091]: removed with hide(
add 2bdd28f [DATALAB-2091]: changed exists import
add d721583 [DATALAB-2091]: added patchwork install
add ec74681 [DATALAB-2091]: added @task decorator
add 1e46c26 [DATALAB-2091]: added context
add 7fb8b17 [DATALAB-2091]: added missing import
add 0f54889 [DATALAB-2091]: added sys.exit to init_datalab_connection
add b8285d0 [DATALAB-2091]: reduced amount of connection attempts
add 1910c05 [DATALAB-2091]: added for testing
add 161d8a6 [DATALAB-2091]: added for testing
add d76818e [DATALAB-2091]: added for testing
add db503a0 [DATALAB-2091]: changed fabric ssh connection
add 18ce88c [DATALAB-2091]: lowered amount of connection attempts
add 32ac9c8 [DATALAB-2091]: changed connection key
add a3fb81a [DATALAB-2091]: changed connection in create_ssh_user.py
add f3bc48c [DATALAB-2091]: changed connection in create_ssh_user.py
add b6bdd2f [DATALAB-2091]: increased amount of attempts
add 593fe27 [DATALAB-2091]: remade init_datalab_connection
add 1cd7156 [DATALAB-2091]: added additional fabric command for testing
add 4801f54 [DATALAB-2091]: corrected usage of the connection
add f1aa0b2 [DATALAB-2091]: added for testing
add 38d300f [DATALAB-2091]: fixed exists usage
add c363cd7 [DATALAB-2091]: removed unnecessary lines, changed from where
init_datalab_connection is called
add 15b9246 [DATALAB-2091]: added exit code check
add a13df0e [DATALAB-2091]: added for testing
add 930eb87 [DATALAB-2091]: changed how subprocess exitcode is obtained
add 94636ef [DATALAB-2091]: changed how connection is defined
add 0023984 [DATALAB-2091]: added additional command to check instance
hostname
add dd732a4 [DATALAB-2091]: moved connect to datalab.fab
add 5a253c6 [DATALAB-2091]: made connect print traceback only after last
attempt
add fc92e43 [DATALAB-2091]: added conn variable assignment
add c839b2c [DATALAB-2091]: commented check of subprocess exitcode
add dfaa48a [DATALAB-2091]: changed how sudoers file is changed
add bb64257 [DATALAB-2091]: added check of subprocess.run output
add 3dcfc4e [DATALAB-2091]: removed unnecessary check
add ba7b6e1 [DATALAB-2091]: removed test commands
add 0346745 [DATALAB-2091]: changed how connection is established
add 5779f09 [DATALAB-2091]: changed arguments order
add 3cde4cb [DATALAB-2091]: added some lines for testing
add 38ef258 [DATALAB-2091]: fixed exists() usage for fabric2
add bfa4874 [DATALAB-2091]: removed test line
add dcb49d5 [DATALAB-2091]: made connection global
add 6f0f6d9 [DATALAB-2091]: made connection global
add 11cf623 [DATALAB-2091]: reduced amount of attempts from 61 to 6
add 1f4e30e [DATALAB-2091]: changed how conn is defined
add 1571401 [DATALAB-2091]: changed how conn is defined
add 5791713 [DATALAB-2091]: changed how conn is defined
add 2aaaf98 [DATALAB-2091]: changed how conn is defined
add 113c200 [DATALAB-2091]: changed connection close
add aa93ce1 [DATALAB-2091]: changed connection close
add 098e6a6 [DATALAB-2091]: changed connection declaration
add 3653b2b [DATALAB-2091]: changed connection declaration
add b6b704d [DATALAB-2091]: changed connection declaration
add 01c8676 [DATALAB-2091]: changed function placement
add 85f8def [DATALAB-2091]: changed function placement
add 21d72ab [DATALAB-2091]: changed how conn is used by another modules
add 599ced8 [DATALAB-2091]: changed how conn is used by another modules
add 343dd20 [DATALAB-2091]: fixed stdout capture to variable
add 84d85f8 [DATALAB-2091]: fixed some directing echo output to files
owned by root
add 1a3607b [DATALAB-2091]: removed unnecessary list
add be3b013 [DATALAB-2091]: fixed syntax error
add f7fd92e [DATALAB-2091]: fixed syntax error
add 82eb50e [DATALAB-2091]: fixed variable assignment from remote command
output
add 58932d2 [DATALAB-2091]: removed \n from variables assigned from
remote command output
add 490e9ee [DATALAB-2091]: removed \n from variables assigned from
remote command output
add 02370a5 [DATALAB-2091]: removed \n from variable assigned from remote
command output
add 24f3fae [DATALAB-2091]: fixed write with echo to file with restricted
access
add a2014cf [DATALAB-2091]: removed use_sudo from part of fabric put()
add 30c56cb [DATALAB-2091]: removed use_sudo from part of fabric put()
where content of directory has to be put on remote host
add 519b37b [DATALAB-2091]: fixed /etc/nginx/htpasswd: Permission denied
error
add 8ff03fa [DATALAB-2091]: removed with cd(): as it is not supported by
fabric 2.x yet
add e223b53 [DATALAB-2091]: fixed permission denied to
/etc/ssh/ssh_config when writing with echo
add 2724e7f [DATALAB-2091]: fixed undefined variable error
add f784a73 [DATALAB-2091]: removed duplication
add c0bef71 [DATALAB-2091]: added sudo for apt-key
add 0de0472 [DATALAB-2091]: added additional output
add a336047 [DATALAB-2091]: added bash -c as a wrapper
add 946a7aa [DATALAB-2091]: fixed typo
add d08ad31 [DATALAB-2091]: changed some docker build commands
add 5582578 [DATALAB-2091]: added escape character
add 8a65f73 [DATALAB-2091]: added escape character
add 889b845 [DATALAB-2091]: added temporary copy of mysql.sh file
add 589d06e [DATALAB-2091]: removed temporary copy of mysql.sh file,
added escape characters
add b1c3d74 [DATALAB-2091]: split to several lines
add a3791f4 [DATALAB-2091]: changed crontab command
add 59c5578 [DATALAB-2091]: fixed exists usage with fabric 2.x
add 788d6fd [DATALAB-2091]: added wrap in bash -c
add a79b1bf [DATALAB-2091]: changed creation of
/etc/apt/sources.list.d/mongodb-org-4.4.list
add 911da39 [DATALAB-2091]: fixed typo
add 693dd0d [DATALAB-2091]: changed command for mongodb-org installation
add 29a61bc [DATALAB-2091]: changed update
add d716b49 [DATALAB-2091]: removed unnecessary commands, added patchwork
install
add e6e581d [DATALAB-2091]: wrapped into bash -c due to permission denied
add 550bb55 [DATALAB-2091]: changed maven download
add d90ebe5 [DATALAB-2091]: added wrap in bash -c
add 7711002 [DATALAB-2091]: changed npm build
add 4b97403 [DATALAB-2091]: merged develop
add 3e229ed [DATALAB-2091]: removed conn. from .java files
add d38a0b7 [DATALAB-2091]: enabled full logging and trace of errors for
maven
add 4d00df7 [DATALAB-2091]: removed full logging and trace of errors for
maven, added wrap in bash -c
add a556fe6 [DATALAB-2091]: added maven output redirection to tmp file
add 90120e5 [DATALAB-2091]: added decorators in project fabfile
add 56eaed3 [DATALAB-2091]: added decorators and context to all other
fabfiles
add 4f56f72 [DATALAB-2091]: corrected firewall rule names, used to delete
resources in case of edge configuration failure
add 6c1806d [DATALAB-2091]: corrected firewall rule names
add 029a5f7 [DATALAB-2091]: corrected roles` names
add eb507fe [DATALAB-2091]: fixed connection usage
add 4d7b577 [DATALAB-2091]: added traceback
add f7aa795 [DATALAB-2091]: changed docker-build checks
add 80abcf5 [DATALAB-2091]: changed docker images build
add 1d3ee3d [DATALAB-2091]: added datalab.fab import
add 44eb9e9 [DATALAB-2091]: added datalab.fab import
add 3c7743f [DATALAB-2091]: added datalab.fab import
add a1d0e55 [DATALAB-2091]: added datalab.fab import
add 49653be [DATALAB-2091]: fixed variable assignment from subprocess.run
output
add 15f9be8 [DATALAB-2091]: removed unnecessary slash in paths
add a287739 [DATALAB-2091]: added wrap in bash -c
add fdedc3a [DATALAB-2091]: added wrap in bash -c
add 246ce5c [DATALAB-2091]: added import subprocess
add 15cd846 [DATALAB-2091]: fixed redirecting output to /etc/apt/apt.conf
add 5417aa6 [DATALAB-2091]: replaced conn. with datalab.fab.conn.
add abe23b7 [DATALAB-2091]: updated some python libs versions
add a63937f [DATALAB-2091]: changed python version in configure zeppelin
node
add 4d1c4ca [DATALAB-2091]: specified setuptools version
add da919c0 [DATALAB-2091]: fixed output redirection to file with limited
access
add 3c844e4 [DATALAB-2091]: fixed output redirection to file with limited
access
add de52d34 [DATALAB-2091]: added echo of executed command by fabric
add ad3a098 [DATALAB-2091]: added error output
add 93ce4b0 [DATALAB-2091]: fixed usage of linux env variables
add 207f73a [DATALAB-2091]: fixed output redirect to zeppelin conf file
add 1c8d8e5 [DATALAB-2091]: merged develop into 2091
add 70d39a2 [DATALAB-2091]: disabled use of
ensure_python3_specific_version in zeppelin
add b91de93 [DATALAB-2091]: fixed usage of fabric get
add 307f5e8 [DATALAB-2091]: fixed usage of put for fabric 2 with
specified modes of access and specified full destination path in put()
add 617747c [DATALAB-2091]: added wrap in bash -l -c for redirect to file
with limited access
add 88e9eef [DATALAB-2091]: updated matplotlib version
add 3c78f0f [DATALAB-2091]: added missing import
add 33fc5b3 [DATALAB-2091]: fixed missed merge conflict
add 9ed394c [DATALAB-2091]: added maven error print
add e5fd210 [DATALAB-2091]: changed maven error print
add c5cd707 [DataLab-2222] - [GCP] Dataproc updated with GPU
add 644639f [DataLab-2222] - [GCP] Dataproc updated with GPU, Jupyter
notebook deployment fixed, Python version for Dataproc fixed
add 3735e55 Merge branch 'DATALAB-2222' into DATALAB-2091-with-dataproc
add 40ac09e [DataLab-2222] - [GCP] fixes for GPU on dataproc and for R
kernel for Jupyter
add 390f337 [DataLab-2091] - [GCP] Jupyter deployment fixed
add c6b990e [DATALAB-2091]: merged 2091-with-dataproc into 2091
add f033cb9 [DATALAB-2091]: enabled installation of specific version of
python
add 02f462b [DATALAB-2091]: fixed matplot version variable usage error
add cf0e02d [DATALAB-2091]: changed http and https_proxy variables
assignment
add 9865c62 [DATALAB-2091]: changed java_home variables assignment
add 0937dd3 [DATALAB-2091]: added wrap into bash -c for chpasswd
add 0117bac [DATALAB-2091]: added wrap into bash -c for chpasswd
add 0ff933a [DATALAB-2091]: updated cuda and cudnn versions
add 794f11f [DATALAB-2091]: partially removed with setting
add 742b5d5 [DATALAB-2091]: fixed cuda installation directory path
add c265e5d [DATALAB-2091]: fixed operation not permitted
add d5e0252 [DATALAB-2091]: downgraded cuda and cudnn as pytorch doesnt
support cuda 11.2 yet
add c4e1e5c [DATALAB-2091]: fixed cuda dir path
add 110fddf [DATALAB-2091]: fixed cudnn file version
add e601c47 [DATALAB-2091]: updated cmake version
add 025dc21 Merge branch 'develop' into DATALAB-2091
add da9dd19 [DATALAB-2091]: removed manage_pkg as it can not be found
add 3b0abea [DATALAB-2091]: added import
add a8b0e66 [DATALAB-2091]: rolled bask to previous cuda cmake and cudnn
versions
add 78fed37 [DATALAB-2091]: added fix for cuda installation on ubuntu
20.04
add 2ab89ea [DATALAB-2091]: fixed access to inactivity checker file
add cc370d0 [DATALAB-2091]: fixed jupyterlab creation and configuration
add 2f89119 [DATALAB-2091]: fixed fab unable to find tasks with
underscore in name
add a1a549a [DataLab-2091] - [GCP] Dataproc deployment fixed
add eba5683 [DataLab-2091] - [GCP] Dataengine and Dataengine-Srvice
deployment fixed
add bf451dc [DataLab-2091] - [GCP] Jupyter Toree local kernel fixed
add 5977bcb [DATALAB-2091]: merged 2091-with-dataproc
add c042006 [DATALAB-2232] -- fixed GPU for Jupyter
add 2ee0d94 Merge remote-tracking branch 'origin/DATALAB-2232-merged'
into DATALAB-2091
add ce28c05 [DATALAB-2091]: fixed apt list
add e5b78e8 [DATALAB-2091]: fixed apt lib install
add 4740572 [DATALAB-2091]: fixed R and pip lib install
add bb23e3a [DATALAB-2339] increased space for information message
add 4e42505 Merge pull request #1120 from apache/DATALAB-2339
add d176547 Merge branch 'DATALAB-2091' of
https://github.com/apache/incubator-dlab into DATALAB-2091
add 3c41cbb [DATALAB-2091]: changed aws base Dockerfile according to
python3
add 119cae5 [DataLab-2091] - [GCP] Jupyter/Dataengine kernels for Jupyter
fixed
add 6ca8c69 Merge branch 'DATALAB-2091-with-dataproc' into DATALAB-2091
add 1cd69b8 [DATALAB-2091]: changed aws base Dockerfile according to
python3
add d7be416 [DATALAB-2091]: replaced urllib2 with urllib3
add d4fb0ad [DATALAB-2091]: changed metalib usage in action lib
add b982c51 [DATALAB-2091]: changed metalib usage in action lib
add 90f653f [DATALAB-2091]: added lines to check aws creds file
add 401897a [DATALAB-2091]: added lines to check aws creds file
add c77870b [DATALAB-2091]: added lines to check aws creds file
add dc6f61f [DATALAB-2091]: changed create_aws_config_files
add 0ba86ea [DATALAB-2091]: changed create_aws_config_files
add f47f7c9 [DATALAB-2091]: changed aws action create_iam_role
add 535cda7 [DATALAB-2091]: fixed connection usage
add d43aaf1 [DATALAB-2091]: fixed subnet creation error
add c908fb2 [DATALAB-2091]: removed with hide usage
add 6170b7b [DATALAB-2091]: fixed boto Config usage conflict
add 2cb1df8 [DataLab-2248] - [GCP] GPU for Jupyter added
add 74f72c3 Merge pull request #1126 from apache/DATALAB-2248
add f2652b5 Merge branch 'DATALAB-2091' of
https://github.com/apache/incubator-dlab into DATALAB-2091
add 32f1a27 [DATALAB-2091]: fixed function name
add de56164 [DATALAB-2091]: added import of replace_multi_symbols in
common_create_git_certfile
add a621158 [DATALAB-2091]: specified which functions to import
add 61c02eb [DATALAB-2091]: fixed post configuration failure
add 632505c7 [DATALAB-2091]: merged develop into 2091
add d9819c6 [DATALAB-2091]: added ensure dir for remove_unexisting_kernel
add 0dc9173 [DATALAB-2091]: added user argument to
remove_unexisting_kernel
add ec298a6 [DATALAB-2091]: fixed error during notebook creation from
custom ami
add 398ae32 [DATALAB-2091]: added redirect of stderror to stdout
add bd791b2 [DATALAB-2091]: added error handling during back-end build
add 550fe84 [DATALAB-2091]: fixed function usage
add a4eed99 [DATALAB-2091]: fixed dependency list
add d5dfde2 [DATALAB-2091]: corrected invalid name and invalid version
handling
add de076d3 [DATALAB-2091] - fixed conflicts
add 335baaa Merge branch 'DATALAB-2091' of
https://github.com/apache/incubator-dlab into DATALAB-2091
add ed3e758 [DATALAB-2091]: fixed python lib versions list
add 7fdb877 [DATALAB-2091]: fixed R lib versions list
add 86c9c50 [DATALAB-2091]: fixed R lib versions list
add 39b898b [DataLab-2351] - [GCP] Retrieved the list of available GPU
add 6896469 [DataLab-2351] - [GCP] Retrieving the list of available GPU
fixed
add d14bbad [DataLab-2351] - [GCP] Retrieving the list of available GPU
updated
add 2f08ee3 [DataLab-2351] - [GCP] Retrieving the list of available GPU
updated
add 7a8f6c0 Merge pull request #1132 from apache/DATALAB-2351
add a8c5307 Merge branch 'DATALAB-2091' of
https://github.com/apache/incubator-dlab into DATALAB-2091
add 12b93d5 [DATALAB-2091]: fixed java lib install
add 0bbc5ed [DATALAB-2348]: fixed spark reconfiguration on existing
notebook
add 58e7b1a [DATALAB-2091]: fixed some errors during spark configuration
add 2b843e3 [DATALAB-2091]: fixed one of emr creation errors
add ce9fbb4 [DATALAB-2091]: fixed another of emr creation errors
add 1584a92 [DATALAB-2091]: added wrap in bash -c
add abcf565 [DATALAB-2091]: tmp use python2 instead of python3
add f743296 [DATALAB-2091]: fixed some emr deployment errors
add ce9908a [DATALAB-2091]: changed connections to python3
add bb252f1 [DATALAB-2091]: merged develop
add b8d22b2 [DataLab-2364] - [GCP] Added list of available images and
descriptions for Deeplearning
add b49443a Merge pull request #1137 from apache/DATALAB-2364
add ebc58fd Merge branch 'develop' into DATALAB-2091
add 2e235aa [DATALAB-2091] - fixed NPE
add 6b2ada3 Merge branch 'DATALAB-1724' into DATALAB-2091
add f384671 Merge branch 'develop' into DATALAB-2091
add 3394987 [DATALAB-2091]: changed azure base dockerfile according to
python3
add 76cf703 [DATALAB-2091]: changed azure base dockerfile according to
python3
add 7d4cb49 [DATALAB-2091]: changed azure base dockerfile according to
python3
add 418be43 [DATALAB-2091]: fixed public key
add e22e3e6 [DATALAB-2091]: fixed metalib usage
add ed8c2e1 [DATALAB-2091]: fixed image name
add 02dce1a [DATALAB-2091]: changed image name
add 6ccead0 [DATALAB-2091]: changed image name
add 88d50ff [DATALAB-2091]: removed some prints
add 092500b [DATALAB-2091]: fixed path.exists usage
add 19c4149 [DATALAB-2091]: fixed key and ip_addresses format
add f3aaa85 [DATALAB-2091]: fixed key format
add 3b5fa63 [DATALAB-2091]: fixed typo
add e863973 [DATALAB-2091]: fixed connection usage, disk preparation and
changed skala link from http to https
add 69dde98 [DATALAB-2091]: added traceback in ssn lib
add c348849 [DATALAB-2091]: fixed gpg connection error
add 302d33c [DATALAB-2091]: changed zeppelin link from http to https
add 92597d6 [DATALAB-2091]: fixed public key
add a7fb442 [DATALAB-2091]: fixed public key
add db6a53f [DATALAB-2091]: changed link from http to https
add 70c4427 [DATALAB-2091]: changed link from http to https
add 1aea3b0 [DATALAB-2352] - Retrieve the list of available GPU during
endpoint deployment
add 3532f7d Merge branch 'DATALAB-2091' of
https://github.com/apache/incubator-datalab into DATALAB-2091
add 23aac09 Merge branch 'DATALAB-2091' of
https://github.com/apache/incubator-dlab into DATALAB-2091
add e3ab5ad [DATALAB-2352] - refactoring
add a63e356 [DATALAB-2352] - remove gpu_types from desc.json files
add e549c09 [DATALAB-2352] - refactoring
add 7dc8a14 [DATALAB-2091]: fixed scp error during jupyter emr creation
add ac8367e Merge branch 'DATALAB-2091' of
https://github.com/apache/incubator-dlab into DATALAB-2091
add 2fec2c5 Merge remote-tracking branch 'origin/DATALAB-2091' into
DATALAB-2091
add db908c3 [DATALAB-2352] - fixed BUG
add 6511906 [DATALAB-2091]: added import install, corrected patchwork
import, fixed some bugs during notebook configuration afted emr creation
add 668e1e9 Merge branch 'DATALAB-2091' of
https://github.com/apache/incubator-dlab into DATALAB-2091
add ef95448 [DATALAB-2091]: fixed some emr related errors in aws action
lib
add d1d8d53 Merge remote-tracking branch 'origin/DATALAB-2091' into
DATALAB-2091
add 13e0c3d [DATALAB-2352] - fixed BUG
add 257e4ad [DATALAB-2091]: changed where install_sparkamagic_kernels
function is located
add 5c70c93 [DATALAB-2091]: fixed jupyter kernel configuration after emr
creation
add 442bd7e [DATALAB-2091]: fixed log file name
add e80b013 [DATALAB-2352] - fixed NPE
add 9f5c215 Merge remote-tracking branch 'origin/DATALAB-2091' into
DATALAB-2091
add 2d4e48f [DataLab-2372] - [AWS] Create Deeplearning notebook from
cloud AMI added
add 2f48047 [DataLab-2372] - [AWS] Get Deeplearning image id fixed
add 09575d5 [DataLab-2372] - [AWS] Deeplearning description added
add dc9d8c2 [DataLab-2372] - [AWS] Deeplearning notebook updated for
using aws predefined image
add 1d85ccc [DataLab-2372] - [AWS][Azure] Deeplearning notebook updated
for using aws predefined image
add 0a7e037 Merge pull request #1149 from apache/DATALAB-2372
add 2c162b5 Merge branch 'DATALAB-2091' of
https://github.com/apache/incubator-dlab into DATALAB-2091
add 20fb1d0 [DATALAB-2091]: added handling of "/dev/sdc1 is apparently in
use by the system; will not make a filesystem here!"
add fa012c4 [DATALAB-2091]: removed warn True
add ca9ba59 [DATALAB-2391]: added version variable definition in case of
invalid version
add eb69af1 [DATALAB-2386]: added jars download from the repository
instead of build
add 6641361 [DATALAB-2386]: added repository parameters in deploy datalab
add 6c8f627 [DATALAB-2386]: fixed some vars names
add 5769f59 [DATALAB-2091]: fixed bug with nonexistent python lib
installation
add 2671ad6 [DataLab-2372] - Local Apache Toree - Scala kernel dies
during connection fixed
add f35c15d Merge pull request #1152 from apache/DATALAB-2392
add 6533946 [DATALAB-2390] fixed bug with switching between AM and PM on
sсheduler
add acb942a Merge pull request #1153 from apache/DATALAB-2390
add fdc928b [DATALAB-2091]: changed which jars to download for ssn with
python3
add 97e5564 [DATALAB-2091]: merged develop
add 776cf16 [epm-2.5-preview1] - Certbot install fixed
add 63b20f5 [epm-2.5-preview1] - Certbot install fixed
add 85a7ff0 [epm-2.5-preview1] - torre kernel fixed
add b7440b7 [epm-2.5-preview1] - torre kernel fixed
add a397898 Merge pull request #1157 from apache/epm-2.5-preview1
new 579fd47 Merge pull request #1158 from apache/DATALAB-2091-dev
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
README.md | 6 +-
.../scripts/deploy_datalab.py | 19 +-
.../scripts/deploy_keycloak/deploy_keycloak.py | 74 +-
.../scripts/deploy_repository/deploy_repository.py | 445 ++++++-----
.../scripts/deploy_repository/files/Dockerfile | 4 +-
.../scripts/update_amazon_repositories.py | 40 +-
.../scripts/jenkins/sonar.py | 2 +-
.../scripts/post-deployment_configuration.py | 186 ++---
infrastructure-provisioning/src/base/entrypoint.py | 61 +-
.../src/base/scripts/create_ssh_user.py | 43 +-
.../src/base/scripts/install_prerequisites.py | 40 +-
.../src/base/scripts/install_user_key.py | 21 +-
.../src/dataengine-service/fabfile.py | 27 +-
.../src/dataengine/fabfile.py | 42 +-
.../src/dataengine/scripts/configure_dataengine.py | 98 ++-
.../src/deeplearning/fabfile.py | 65 +-
.../scripts/configure_deep_learning_node.py | 149 ++--
infrastructure-provisioning/src/edge/fabfile.py | 21 +-
.../src/edge/scripts/configure_http_proxy.py | 11 +-
.../edge/scripts/configure_nginx_reverse_proxy.py | 12 +-
.../src/edge/scripts/reupload_ssh_key.py | 7 +-
.../src/general/api/check_inactivity.py | 8 +-
.../src/general/api/configure.py | 8 +-
.../src/general/api/create.py | 8 +-
.../src/general/api/create_image.py | 8 +-
.../src/general/api/git_creds.py | 8 +-
.../src/general/api/install_libs.py | 8 +-
.../src/general/api/list_libs.py | 8 +-
.../src/general/api/reconfigure_spark.py | 8 +-
.../src/general/api/recreate.py | 8 +-
.../src/general/api/reupload_key.py | 8 +-
.../src/general/api/start.py | 8 +-
.../src/general/api/status.py | 8 +-
.../src/general/api/stop.py | 8 +-
.../src/general/api/terminate.py | 8 +-
.../src/general/api/terminate_image.py | 8 +-
.../src/general/conf/datalab.ini | 43 +-
.../src/general/files/aws/base_Dockerfile | 27 +-
.../files/aws/dataengine-service_Dockerfile | 4 +-
.../src/general/files/aws/dataengine_Dockerfile | 2 +-
.../src/general/files/aws/deeplearning_Dockerfile | 2 +-
.../files/aws/deeplearning_description.json | 6 +-
.../src/general/files/aws/edge_Dockerfile | 2 +-
.../src/general/files/aws/jupyter_Dockerfile | 2 +-
.../src/general/files/aws/jupyter_description.json | 4 +-
.../src/general/files/aws/jupyterlab_Dockerfile | 2 +-
.../src/general/files/aws/project_Dockerfile | 2 +-
.../src/general/files/aws/rstudio_Dockerfile | 2 +-
.../src/general/files/aws/rstudio_description.json | 4 +-
.../src/general/files/aws/ssn_Dockerfile | 2 +-
.../general/files/aws/tensor-rstudio_Dockerfile | 2 +-
.../src/general/files/aws/tensor_Dockerfile | 2 +-
.../src/general/files/aws/tensor_description.json | 4 +-
.../src/general/files/aws/zeppelin_Dockerfile | 2 +-
.../general/files/aws/zeppelin_description.json | 4 +-
.../src/general/files/azure/base_Dockerfile | 16 +-
.../src/general/files/azure/dataengine_Dockerfile | 2 +-
.../general/files/azure/deeplearning_Dockerfile | 2 +-
.../files/azure/deeplearning_description.json | 6 +-
.../src/general/files/azure/edge_Dockerfile | 2 +-
.../src/general/files/azure/jupyter_Dockerfile | 2 +-
.../general/files/azure/jupyter_description.json | 4 +-
.../src/general/files/azure/jupyterlab_Dockerfile | 2 +-
.../src/general/files/azure/project_Dockerfile | 2 +-
.../src/general/files/azure/rstudio_Dockerfile | 2 +-
.../general/files/azure/rstudio_description.json | 4 +-
.../src/general/files/azure/ssn_Dockerfile | 2 +-
.../src/general/files/azure/tensor_Dockerfile | 2 +-
.../general/files/azure/tensor_description.json | 4 +-
.../src/general/files/azure/zeppelin_Dockerfile | 2 +-
.../general/files/azure/zeppelin_description.json | 4 +-
.../src/general/files/gcp/base_Dockerfile | 27 +-
.../files/gcp/dataengine-service_Dockerfile | 5 +-
.../files/gcp/dataengine-service_description.json | 2 +-
.../src/general/files/gcp/dataengine_Dockerfile | 2 +-
.../src/general/files/gcp/deeplearning_Dockerfile | 2 +-
.../files/gcp/deeplearning_description.json | 19 +-
.../src/general/files/gcp/edge_Dockerfile | 2 +-
.../src/general/files/gcp/jupyter_Dockerfile | 2 +-
.../src/general/files/gcp/jupyter_description.json | 4 +-
.../src/general/files/gcp/jupyterlab_Dockerfile | 2 +-
.../src/general/files/gcp/project_Dockerfile | 2 +-
.../src/general/files/gcp/rstudio_Dockerfile | 2 +-
.../src/general/files/gcp/rstudio_description.json | 4 +-
.../src/general/files/gcp/ssn_Dockerfile | 2 +-
.../src/general/files/gcp/superset_Dockerfile | 2 +-
.../general/files/gcp/tensor-rstudio_Dockerfile | 2 +-
.../src/general/files/gcp/tensor_Dockerfile | 2 +-
.../src/general/files/gcp/zeppelin_Dockerfile | 2 +-
.../general/files/gcp/zeppelin_description.json | 4 +-
.../src/general/lib/aws/actions_lib.py | 531 +++++++------
.../src/general/lib/aws/meta_lib.py | 15 +-
.../src/general/lib/azure/actions_lib.py | 356 ++++-----
.../src/general/lib/gcp/actions_lib.py | 476 ++++++-----
.../src/general/lib/gcp/meta_lib.py | 23 +-
.../src/general/lib/os/debian/common_lib.py | 181 ++---
.../src/general/lib/os/debian/edge_lib.py | 194 ++---
.../src/general/lib/os/debian/notebook_lib.py | 504 ++++++------
.../src/general/lib/os/debian/ssn_lib.py | 245 +++---
.../src/general/lib/os/fab.py | 869 +++++++++++----------
.../src/general/lib/os/redhat/common_lib.py | 98 +--
.../src/general/lib/os/redhat/edge_lib.py | 208 ++---
.../src/general/lib/os/redhat/notebook_lib.py | 435 +++++------
.../src/general/lib/os/redhat/ssn_lib.py | 252 +++---
.../src/general/scripts/aws/common_collect_data.py | 4 +-
.../general/scripts/aws/common_create_bucket.py | 6 +-
.../general/scripts/aws/common_create_instance.py | 2 +-
.../scripts/aws/common_create_notebook_image.py | 2 +-
.../general/scripts/aws/common_create_policy.py | 2 +-
.../scripts/aws/common_create_role_policy.py | 2 +-
.../scripts/aws/common_create_security_group.py | 2 +-
.../general/scripts/aws/common_create_subnet.py | 6 +-
.../scripts/aws/common_download_git_certfile.py | 18 +-
...common_notebook_configure_dataengine-service.py | 9 +-
.../aws/common_notebook_configure_dataengine.py | 9 +-
.../general/scripts/aws/common_prepare_notebook.py | 9 +-
.../general/scripts/aws/common_put_to_bucket.py | 2 +-
.../scripts/aws/common_remove_remote_kernels.py | 19 +-
.../src/general/scripts/aws/common_reupload_key.py | 7 +-
.../general/scripts/aws/common_start_notebook.py | 9 +-
.../general/scripts/aws/common_stop_notebook.py | 4 +-
.../scripts/aws/common_terminate_notebook.py | 2 +-
.../scripts/aws/common_terminate_notebook_image.py | 2 +-
.../scripts/aws/dataengine-service_configure.py | 22 +-
.../scripts/aws/dataengine-service_create.py | 16 +-
.../scripts/aws/dataengine-service_install_libs.py | 7 +-
.../scripts/aws/dataengine-service_jars_parser.py | 2 +-
.../scripts/aws/dataengine-service_key_importer.py | 2 +-
.../scripts/aws/dataengine-service_list_libs.py | 7 +-
.../scripts/aws/dataengine-service_prepare.py | 17 +-
.../scripts/aws/dataengine-service_terminate.py | 2 +-
.../general/scripts/aws/dataengine_configure.py | 32 +-
.../src/general/scripts/aws/dataengine_prepare.py | 9 +-
.../src/general/scripts/aws/dataengine_start.py | 7 +-
.../src/general/scripts/aws/dataengine_stop.py | 2 +-
.../general/scripts/aws/dataengine_terminate.py | 2 +-
.../general/scripts/aws/deeplearning_configure.py | 23 +-
.../scripts/aws/edge_associate_elastic_ip.py | 2 +-
.../src/general/scripts/aws/edge_configure.py | 19 +-
.../scripts/aws/edge_configure_route_table.py | 2 +-
.../src/general/scripts/aws/edge_start.py | 2 +-
.../src/general/scripts/aws/edge_status.py | 7 +-
.../src/general/scripts/aws/edge_stop.py | 2 +-
.../src/general/scripts/aws/jupyter_configure.py | 25 +-
.../jupyter_dataengine-service_create_configs.py | 131 ++--
.../jupyter_install_dataengine-service_kernels.py | 119 +--
.../general/scripts/aws/jupyterlab_configure.py | 29 +-
.../src/general/scripts/aws/odahu_deploy.py | 13 +-
.../src/general/scripts/aws/odahu_prepare.py | 5 +-
.../src/general/scripts/aws/project_prepare.py | 45 +-
.../src/general/scripts/aws/project_terminate.py | 2 +-
.../src/general/scripts/aws/rstudio_configure.py | 23 +-
.../rstudio_dataengine-service_create_configs.py | 43 +-
.../rstudio_install_dataengine-service_kernels.py | 33 +-
.../scripts/aws/ssn_associate_elastic_ip.py | 2 +-
.../src/general/scripts/aws/ssn_configure.py | 19 +-
.../src/general/scripts/aws/ssn_create_endpoint.py | 2 +-
.../src/general/scripts/aws/ssn_create_vpc.py | 2 +-
.../src/general/scripts/aws/ssn_finalize.py | 2 +-
.../src/general/scripts/aws/ssn_prepare.py | 23 +-
.../src/general/scripts/aws/ssn_terminate.py | 7 +-
.../scripts/aws/ssn_terminate_aws_resources.py | 2 +-
.../scripts/aws/tensor-rstudio_configure.py | 23 +-
.../src/general/scripts/aws/tensor_configure.py | 23 +-
.../src/general/scripts/aws/zeppelin_configure.py | 23 +-
.../zeppelin_dataengine-service_create_configs.py | 33 +-
.../zeppelin_install_dataengine-service_kernels.py | 39 +-
.../general/scripts/azure/common_collect_data.py | 4 +-
.../azure/common_create_datalake_directory.py | 2 +-
.../scripts/azure/common_create_instance.py | 2 +-
.../scripts/azure/common_create_notebook_image.py | 9 +-
.../scripts/azure/common_create_security_group.py | 2 +-
.../scripts/azure/common_create_storage_account.py | 2 +-
.../general/scripts/azure/common_create_subnet.py | 6 +-
.../scripts/azure/common_download_git_certfile.py | 17 +-
.../azure/common_notebook_configure_dataengine.py | 9 +-
.../azure/common_notebook_update_refresh_token.py | 8 +-
.../scripts/azure/common_prepare_notebook.py | 9 +-
.../scripts/azure/common_remove_remote_kernels.py | 10 +-
.../general/scripts/azure/common_reupload_key.py | 7 +-
.../general/scripts/azure/common_start_notebook.py | 22 +-
.../general/scripts/azure/common_stop_notebook.py | 2 +-
.../scripts/azure/common_terminate_notebook.py | 2 +-
.../azure/common_terminate_notebook_image.py | 2 +-
.../general/scripts/azure/dataengine_configure.py | 33 +-
.../general/scripts/azure/dataengine_prepare.py | 11 +-
.../src/general/scripts/azure/dataengine_start.py | 7 +-
.../src/general/scripts/azure/dataengine_stop.py | 2 +-
.../general/scripts/azure/dataengine_terminate.py | 2 +-
.../scripts/azure/deeplearning_configure.py | 27 +-
.../src/general/scripts/azure/edge_configure.py | 17 +-
.../src/general/scripts/azure/edge_prepare.py | 19 +-
.../src/general/scripts/azure/edge_start.py | 2 +-
.../src/general/scripts/azure/edge_status.py | 7 +-
.../src/general/scripts/azure/edge_stop.py | 2 +-
.../src/general/scripts/azure/edge_terminate.py | 2 +-
.../src/general/scripts/azure/jupyter_configure.py | 29 +-
.../general/scripts/azure/jupyterlab_configure.py | 29 +-
.../src/general/scripts/azure/project_prepare.py | 32 +-
.../src/general/scripts/azure/project_terminate.py | 2 +-
.../general/scripts/azure/rstudio_change_pass.py | 12 +-
.../src/general/scripts/azure/rstudio_configure.py | 27 +-
.../src/general/scripts/azure/ssn_configure.py | 19 +-
.../general/scripts/azure/ssn_create_datalake.py | 2 +-
.../general/scripts/azure/ssn_create_peering.py | 2 +-
.../scripts/azure/ssn_create_resource_group.py | 2 +-
.../src/general/scripts/azure/ssn_create_vpc.py | 2 +-
.../src/general/scripts/azure/ssn_prepare.py | 26 +-
.../src/general/scripts/azure/ssn_terminate.py | 4 +-
.../src/general/scripts/azure/tensor_configure.py | 27 +-
.../general/scripts/azure/zeppelin_configure.py | 27 +-
.../src/general/scripts/gcp/common_collect_data.py | 4 +-
.../general/scripts/gcp/common_create_bucket.py | 2 +-
.../general/scripts/gcp/common_create_firewall.py | 2 +-
.../general/scripts/gcp/common_create_instance.py | 4 +-
.../general/scripts/gcp/common_create_nat_route.py | 2 +-
.../scripts/gcp/common_create_notebook_image.py | 2 +-
.../scripts/gcp/common_create_service_account.py | 2 +-
.../general/scripts/gcp/common_create_subnet.py | 10 +-
.../scripts/gcp/common_download_git_certfile.py | 17 +-
.../common_install_gpu.py} | 23 +-
...common_notebook_configure_dataengine-service.py | 11 +-
.../gcp/common_notebook_configure_dataengine.py | 9 +-
.../general/scripts/gcp/common_prepare_notebook.py | 12 +-
.../general/scripts/gcp/common_put_to_bucket.py | 2 +-
.../src/general/scripts/gcp/common_reupload_key.py | 7 +-
.../general/scripts/gcp/common_start_notebook.py | 9 +-
.../general/scripts/gcp/common_stop_notebook.py | 2 +-
.../scripts/gcp/common_terminate_notebook.py | 2 +-
.../scripts/gcp/common_terminate_notebook_image.py | 2 +-
.../scripts/gcp/dataengine-service_configure.py | 19 +-
.../scripts/gcp/dataengine-service_create.py | 4 +-
.../scripts/gcp/dataengine-service_install_libs.py | 7 +-
.../scripts/gcp/dataengine-service_jars_parser.py | 6 +-
.../scripts/gcp/dataengine-service_key_importer.py | 2 +-
.../scripts/gcp/dataengine-service_list_libs.py | 7 +-
.../scripts/gcp/dataengine-service_prepare.py | 36 +-
.../scripts/gcp/dataengine-service_terminate.py | 2 +-
.../general/scripts/gcp/dataengine_configure.py | 27 +-
.../src/general/scripts/gcp/dataengine_prepare.py | 11 +-
.../src/general/scripts/gcp/dataengine_start.py | 7 +-
.../src/general/scripts/gcp/dataengine_stop.py | 2 +-
.../general/scripts/gcp/dataengine_terminate.py | 2 +-
.../general/scripts/gcp/deeplearning_configure.py | 21 +-
.../src/general/scripts/gcp/edge_configure.py | 56 +-
.../general/scripts/gcp/edge_create_static_ip.py | 2 +-
.../src/general/scripts/gcp/edge_start.py | 2 +-
.../src/general/scripts/gcp/edge_status.py | 5 +-
.../src/general/scripts/gcp/edge_stop.py | 2 +-
.../src/general/scripts/gcp/edge_terminate.py | 2 +-
.../src/general/scripts/gcp/jupyter_configure.py | 37 +-
.../jupyter_dataengine-service_create_configs.py | 57 +-
.../jupyter_install_dataengine-service_kernels.py | 106 ++-
.../general/scripts/gcp/jupyterlab_configure.py | 25 +-
.../src/general/scripts/gcp/project_prepare.py | 33 +-
.../src/general/scripts/gcp/project_terminate.py | 2 +-
.../src/general/scripts/gcp/rstudio_configure.py | 21 +-
.../rstudio_dataengine-service_create_configs.py | 39 +-
.../rstudio_install_dataengine-service_kernels.py | 38 +-
.../src/general/scripts/gcp/ssn_configure.py | 23 +-
.../general/scripts/gcp/ssn_create_static_ip.py | 2 +-
.../src/general/scripts/gcp/ssn_create_vpc.py | 2 +-
.../src/general/scripts/gcp/ssn_finalize.py | 2 +-
.../src/general/scripts/gcp/ssn_prepare.py | 23 +-
.../src/general/scripts/gcp/ssn_terminate.py | 7 +-
.../scripts/gcp/ssn_terminate_gcp_resources.py | 2 +-
.../src/general/scripts/gcp/superset_configure.py | 23 +-
.../scripts/gcp/tensor-rstudio_configure.py | 21 +-
.../src/general/scripts/gcp/tensor_configure.py | 21 +-
.../src/general/scripts/gcp/zeppelin_configure.py | 21 +-
.../zeppelin_dataengine-service_create_configs.py | 25 +-
.../zeppelin_install_dataengine-service_kernels.py | 41 +-
.../src/general/scripts/os/check_inactivity.py | 15 +-
.../general/scripts/os/common_clean_instance.py | 78 +-
.../general/scripts/os/common_configure_proxy.py | 14 +-
.../scripts/os/common_configure_reverse_proxy.py | 18 +-
.../general/scripts/os/common_configure_spark.py | 27 +-
.../scripts/os/configure_proxy_for_docker.py | 38 +-
.../general/scripts/os/dataengine_install_libs.py | 9 +-
.../src/general/scripts/os/dataengine_list_libs.py | 7 +-
.../scripts/os/dataengine_reconfigure_spark.py | 12 +-
.../os/deeplearning_dataengine_create_configs.py | 81 +-
.../os/deeplearning_install_dataengine_kernels.py | 58 +-
.../general/scripts/os/get_list_available_pkgs.py | 24 +-
.../src/general/scripts/os/git_pre_commit.py | 2 +-
.../general/scripts/os/install_additional_libs.py | 29 +-
.../src/general/scripts/os/ipynb_output_filter.py | 2 +-
.../os/jupyter_dataengine_create_configs.py | 117 ++-
.../os/jupyter_install_dataengine_kernels.py | 108 ++-
.../scripts/os/jupyterlab_container_start.py | 22 +-
.../src/general/scripts/os/manage_git_creds.py | 27 +-
.../src/general/scripts/os/notebook_git_creds.py | 9 +-
.../scripts/os/notebook_inactivity_check.py | 5 +-
.../general/scripts/os/notebook_install_libs.py | 7 +-
.../src/general/scripts/os/notebook_list_libs.py | 7 +-
.../os/notebook_reconfigure_dataengine_spark.py | 4 +-
.../scripts/os/notebook_reconfigure_spark.py | 7 +-
.../src/general/scripts/os/reconfigure_spark.py | 24 +-
.../os/rstudio_dataengine_create_configs.py | 43 +-
.../os/rstudio_install_dataengine_kernels.py | 50 +-
.../src/general/scripts/os/superset_start.py | 25 +-
.../os/tensor-rstudio_dataengine_create_configs.py | 42 +-
.../tensor-rstudio_install_dataengine_kernels.py | 52 +-
.../scripts/os/tensor_dataengine_create_configs.py | 80 +-
.../os/tensor_install_dataengine_kernels.py | 54 +-
.../scripts/os/update_inactivity_on_start.py | 15 +-
.../os/zeppelin_dataengine_create_configs.py | 103 +--
.../os/zeppelin_install_dataengine_kernels.py | 57 +-
.../aws/jenkins_jobs/gitlab_server/config.xml | 2 +-
.../templates/gcp/dataengine-service_cluster.json | 12 +-
...on => dataengine-service_cluster_with_gpu.json} | 23 +-
.../templates/gcp/dataengine-service_livy-env.sh | 5 +
.../dataengine-service_livy.service} | 8 +-
.../gcp/jenkins_jobs/gitlab_server/config.xml | 2 +-
.../src/general/templates/os/livy-env.sh | 3 +-
.../templates/os/py3spark_local_template.json | 4 +-
.../templates/os/pyspark_local_template.json | 6 +-
infrastructure-provisioning/src/jupyter/fabfile.py | 67 +-
.../src/jupyter/scripts/configure_jupyter_node.py | 32 +-
.../src/jupyterlab/fabfile.py | 62 +-
.../scripts/configure_jupyterlab_node.py | 19 +-
infrastructure-provisioning/src/project/fabfile.py | 25 +-
.../src/project/scripts/configure_http_proxy.py | 12 +-
.../src/project/scripts/configure_keycloak.py | 2 +-
.../src/project/scripts/configure_nftables.py | 11 +-
.../scripts/configure_nginx_reverse_proxy.py | 11 +-
.../src/project/scripts/reupload_ssh_key.py | 7 +-
infrastructure-provisioning/src/rstudio/fabfile.py | 67 +-
.../src/rstudio/scripts/configure_rstudio_node.py | 24 +-
infrastructure-provisioning/src/ssn/fabfile.py | 18 +-
.../src/ssn/scripts/backup.py | 57 +-
.../src/ssn/scripts/configure_billing.py | 4 +-
.../src/ssn/scripts/configure_conf_file.py | 8 +-
.../src/ssn/scripts/configure_docker.py | 128 ++-
.../src/ssn/scripts/configure_gitlab.py | 121 ++-
.../src/ssn/scripts/configure_mongo.py | 2 +-
.../src/ssn/scripts/configure_ssn_node.py | 177 ++---
.../src/ssn/scripts/configure_ui.py | 162 ++--
.../src/ssn/scripts/docker_build.py | 37 +-
.../src/ssn/scripts/gitlab_deploy.py | 22 +-
.../src/ssn/scripts/resource_status.py | 2 +-
.../src/ssn/scripts/restore.py | 45 +-
.../src/ssn/scripts/upload_response_file.py | 18 +-
.../src/superset/fabfile.py | 45 +-
.../superset/scripts/configure_superset_node.py | 15 +-
.../src/tensor-rstudio/fabfile.py | 65 +-
.../scripts/configure_tensor-rstudio_node.py | 24 +-
infrastructure-provisioning/src/tensor/fabfile.py | 65 +-
.../src/tensor/scripts/configure_tensor_node.py | 24 +-
.../src/zeppelin/fabfile.py | 66 +-
.../zeppelin/scripts/configure_zeppelin_node.py | 203 ++---
.../aws/ssn-k8s/main/files/masters-user-data.sh | 2 +-
.../aws/ssn-k8s/main/files/workers-user-data.sh | 2 +-
.../terraform/bin/deploy/endpoint_fab.py | 7 +-
.../bin/deploy/mongo_files/configure_mongo.py | 2 +-
.../terraform/bin/terraform-cli.py | 11 +-
.../terraform/gcp/endpoint/provisioning.py | 3 +-
.../terraform/gcp/ssn-gke/README.md | 2 +-
.../zeppelin/zeppelin-notebook.json | 4 +-
integration-tests/examples/copy_files.py | 11 +-
.../ec2_templates/zeppelin/zeppelin-notebook.json | 4 +-
.../gcp_templates/zeppelin/zeppelin-notebook.json | 4 +-
.../scenario_deeplearning/deeplearning_tests.py | 25 +-
.../examples/scenario_jupyter/jupyter_tests.py | 10 +-
.../examples/scenario_rstudio/rstudio_tests.py | 16 +-
.../examples/scenario_tensor/tensor_tests.py | 24 +-
.../examples/scenario_zeppelin/zeppelin_tests.py | 16 +-
pom.xml | 2 +-
services/billing-aws/pom.xml | 4 +-
.../java/com/epam/datalab/dto/UserInstanceDTO.java | 21 +
.../dto/aws/exploratory/ExploratoryCreateAws.java | 12 +-
.../azure/exploratory/ExploratoryCreateAzure.java | 27 +-
.../com/epam/datalab/dto/base/edge/EdgeInfo.java | 5 +
.../datalab/dto/base/project/ProjectResult.java | 3 +-
.../computational/UserComputationalResource.java | 5 +
.../dto/exploratory/ExploratoryBaseDTO.java | 23 +-
.../dto/exploratory/ExploratoryCreateDTO.java | 60 +-
.../gcp/computational/ComputationalCreateGcp.java | 45 ++
.../computational/GcpComputationalResource.java | 28 +-
.../dto/gcp/exploratory/ExploratoryCreateGcp.java | 14 +-
.../imagemetadata/ComputationalMetadataDTO.java | 5 +
.../UploadFile.java => imagemetadata/EdgeGPU.java} | 19 +-
.../dto/imagemetadata/ExploratoryMetadataDTO.java | 6 +
.../datalab/model/exploratory/Exploratory.java | 3 +
.../datalab/backendapi/core/DockerWarmuper.java | 13 +-
.../core/commands/CommandParserMock.java | 14 +-
.../response/handlers/BackupCallbackHandler.java | 1 -
.../datalab/backendapi/dao/EndpointDAOImpl.java | 1 -
.../AuditResourceTypeEnum.java => dao/GpuDAO.java} | 15 +-
.../dao/{IndexCreator.java => GpuDAOImpl.java} | 37 +-
.../backendapi/domain/NotebookTemplate.java | 10 +-
.../epam/datalab/backendapi/modules/DevModule.java | 104 +--
.../backendapi/modules/ProductionModule.java | 112 +--
.../backendapi/resources/ExploratoryResource.java | 3 +
.../resources/InfrastructureTemplateResource.java | 2 +-
.../resources/callback/ProjectCallback.java | 14 +-
.../resources/dto/ComputationalCreateFormDTO.java | 3 +
.../resources/dto/ExploratoryCreateFormDTO.java | 115 +--
.../backendapi/resources/dto/UserResourceInfo.java | 10 +
.../dto/gcp/GcpComputationalCreateForm.java | 11 +
.../resources/gcp/ComputationalResourceGcp.java | 3 +
.../datalab/backendapi/service/TagService.java | 4 +-
.../datalab/backendapi/service/TagServiceImpl.java | 6 +-
.../service/impl/ComputationalServiceImpl.java | 43 +-
.../service/impl/EnvironmentServiceImpl.java | 129 ++-
.../service/impl/ExploratoryServiceImpl.java | 60 +-
.../impl/InfrastructureInfoServiceImpl.java | 12 +-
.../impl/InfrastructureTemplateServiceImpl.java | 60 +-
.../service/impl/ProjectServiceImpl.java | 32 +-
.../datalab/backendapi/util/RequestBuilder.java | 133 ++--
.../management-grid/management-grid.component.html | 6 +-
.../administration/management/management.model.ts | 4 +
.../webapp/src/app/core/util/helpUtils.ts | 20 +
.../webapp/src/app/core/util/sortUtils.ts | 4 +-
.../cluster-details/cluster-details.component.html | 35 +-
...utational-resource-create-dialog.component.html | 186 ++++-
...utational-resource-create-dialog.component.scss | 8 +-
...mputational-resource-create-dialog.component.ts | 94 ++-
.../computational-resource-create.model.ts | 9 +-
.../create-environment.component.html | 83 +-
.../create-environment.component.scss | 5 +
.../create-environment.component.ts | 83 +-
.../detail-dialog/detail-dialog.component.html | 8 +-
.../detail-dialog/detail-dialog.component.ts | 1 -
.../install-libraries.component.html | 5 +-
.../install-libraries.component.scss | 2 +-
.../install-libraries.component.ts | 10 +-
.../resources-grid/resources-grid.component.html | 29 +-
.../resources-grid/resources-grid.component.scss | 6 +
.../resources-grid/resources-grid.model.ts | 4 +-
.../webapp/src/assets/styles/_dialogs.scss | 2 +-
.../webapp/src/assets/styles/_general.scss | 6 +
.../src/main/resources/webapp/src/styles.scss | 4 +
.../backendapi/service/TagServiceImplTest.java | 8 +-
.../InfrastructureTemplateServiceBaseTest.java | 27 +-
435 files changed, 7077 insertions(+), 6446 deletions(-)
copy
infrastructure-provisioning/src/general/scripts/{azure/rstudio_change_pass.py
=> gcp/common_install_gpu.py} (73%)
copy
infrastructure-provisioning/src/general/templates/gcp/{dataengine-service_cluster.json
=> dataengine-service_cluster_with_gpu.json} (71%)
create mode 100644
infrastructure-provisioning/src/general/templates/gcp/dataengine-service_livy-env.sh
copy infrastructure-provisioning/src/general/templates/{os/debian/livy.service
=> gcp/dataengine-service_livy.service} (87%)
copy
services/datalab-model/src/main/java/com/epam/datalab/dto/{base/keyload/UploadFile.java
=> imagemetadata/EdgeGPU.java} (77%)
copy
services/self-service/src/main/java/com/epam/datalab/backendapi/{domain/AuditResourceTypeEnum.java
=> dao/GpuDAO.java} (78%)
copy
services/self-service/src/main/java/com/epam/datalab/backendapi/dao/{IndexCreator.java
=> GpuDAOImpl.java} (52%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
