Re: [gentoo-user] Clusters on Gentoo ?
On Wednesday, August 06, 2014 04:50:22 PM James wrote: snipped Hopefully, we can all share ideas and brainstorm about how Gentoo users can lead the pack of linux distros into this brave_new world. [Overlays?] A good place to start would also be: http://www.yolinux.com/TUTORIALS/LinuxClustersAndFileSystems.html -- Joost
Re: [gentoo-user] Clusters on Gentoo ?
I'm a Hadoop and related software sysadmin at the University of Michigan. I'm a student still, so it's only a part-time position. I have some documentation at http://caen.github.io/hadoop - if something is not clear, I will gladly take feedback and make appropriate changes. In a recent thread (schedulers) it was noted that several folks had interest in clusters (privately operated clouds) as more than a passing interest. I'll try to chime in on any questions about scheduling/clusters in the future as we have a pretty large installation (~20,000 cores) running a traditional HPC stack, and a small Hadoop cluster. [2] http://hadoop.apache.org/docs/r1.2.1/cluster_setup.html Hadoop is currently stable on 2.x (specifically 2.4), so relevant documentation is at http://hadoop.apache.org/docs/stable. Alec
Re: [gentoo-user] Gnome, pam_mount, keyrings ...
Am 06.08.2014 um 15:18 schrieb Neil Bothwick: On Wed, 6 Aug 2014 13:30:44 +0100, Mick wrote: In any case 'cryptsetup -y luksAddKey /dev/sdaX' allows you to add a passphrase in another slot - can't recall how many passphrase slots are there without looking into it. 8. You can see which are in use with cryptsetup luksDump. I was successful at adding and using a second or third passphrase. But logging into gdm didn't use the new passphrase and I don't exactly know where to put that information. Gnome keyring? Stefan
[gentoo-user] Re: Clusters on Gentoo ?
Alec Ten Harmsel alec at alectenharmsel.com writes: I'm a Hadoop and related software sysadmin at the University of Michigan. I'm a student still, so it's only a part-time position. I have some documentation at http://caen.github.io/hadoop - if something is not clear, I will gladly take feedback and make appropriate changes. I'll try to chime in on any questions about scheduling/clusters in the future as we have a pretty large installation (~20,000 cores) running a traditional HPC stack, and a small Hadoop cluster. [2] http://hadoop.apache.org/docs/r1.2.1/cluster_setup.html Hadoop is currently stable on 2.x (specifically 2.4), so relevant documentation is at http://hadoop.apache.org/docs/stable. Which operating systems does you Hadoop systems run on top of? Whilst research, I ran across a FAT PAYCHECK at a startup for Hadoop expertise (California) : Extremely competitive pay: 150-175K base salary, large bonus plan, and a generous equity stake http://www.cybercoders.com/principal-software-engineer-backend-technology-agnostic-job-157829?jobId=EON-1157039ad=recruiticsindeedrx_job=19411798rx_source=Indeedrx_campaign=Indeed15rx_medium=CPC enjoy! James
Re: [gentoo-user] Re: Clusters on Gentoo ?
Which operating systems does you Hadoop systems run on top of? We use RedHat, although we make a fair amount of custom RPMs. It's just too much having to deal with Gentoo while maintaining high performance filesystems and schedulers, which are apparently a real pain. Whilst research, I ran across a FAT PAYCHECK at a startup for Hadoop expertise (California) : Extremely competitive pay: 150-175K base salary, large bonus plan, and a generous equity stake Lolz, a few of the full time staff regularly get headhunted for similar positions. I'm still a student and would like to finish the degree, though, so no high paying jobs for me yet. Alec
[gentoo-user] unclear (to me) errors from portage
I was away for two weeks and now one of my systems cannot be updated due
to conflicts. The entire (long) emerge output is at the end of
this msg.
-- The first conflict is ---
!!! Multiple package instances within a single package slot have been pulled
!!! into the dependency graph, resulting in a slot conflict:
dev-lang/perl:0
(dev-lang/perl-5.16.3::gentoo, installed) pulled in by
dev-lang/perl:0/5.16=[-build(-)] required by
(net-analyzer/net-snmp-5.7.3_pre3::gentoo, installed)
(dev-lang/perl-5.18.2-r1::gentoo, ebuild scheduled for merge) pulled in by
=dev-lang/perl-5.18* required by
(virtual/perl-File-Spec-3.400.0-r2::gentoo, installed)
(and 1 more with the same problem)
I can't follow this. For one thing net-snmp-5.7.3_pre3.ebuild does not
contain the string lang and I looked at all occurrences of perl in
the ebuild and don't see how dev-lang/perl-5.16.3 is required.
-- The second conflict is
* Error: The above package list contains packages which cannot be
* installed at the same time on the same system.
(media-video/ffmpeg-1.2.6-r1::gentoo, ebuild scheduled for merge) pulled in by
=media-video/ffmpeg-1.2.6-r1:0[abi_x86_32(-)?,abi_x86_64(-)?,abi_x86_x32(-)?,abi_mips_n32(-)?,abi_mips_n64(-)?,abi_mips_o32(-)?,abi_ppc_32(-)?,abi_ppc_64(-)?,abi_s390_32(-)?,abi_s390_64(-)?]
(=media-video/ffmpeg-1.2.6-r1:0[abi_x86_64(-)]) required by
(media-plugins/gst-plugins-ffmpeg-0.10.13_p201211-r2::gentoo, ebuild scheduled
for merge)
(media-video/libav-9.14::gentoo, installed) pulled in by
=media-video/libav-9.12[abi_x86_32(-)?,abi_x86_64(-)?,abi_x86_x32(-)?,abi_mips_n32(-)?,abi_mips_n64(-)?,abi_mips_o32(-)?,abi_ppc_32(-)?,abi_ppc_64(-)?,abi_s390_32(-)?,abi_s390_64(-)?,X?,encode?,gsm?,jpeg2k?,mp3?,opus?,sdl?,speex?,theora?,threads?,truetype?,vaapi?,vdpau?,x264?]
(=media-video/libav-9.12[abi_x86_64(-),X,encode,mp3,sdl,truetype,x264])
required by (virtual/ffmpeg-9-r1::gentoo, installed)
---
I don't understand this since it looks to me that virtual/ffmpeg-9-r1
wants EITHER media-video/ffmpeg OR media-video/libav. So if
gst-plugins-ffmpeg requires ffmpeg, why isn't virtual/ffmpeg satisfied,
i.e., why does it require that media-video/libav remain installed?
-- The entire emerge command and output follows
Note that I have
EMERGE_DEFAULT_OPTS=--ask --deep --tree --verbose --jobs --load-average=5
e6510 ~ # emerge --update --changed-use --deep @world
These are the packages that would be merged, in reverse order:
Calculating dependencies... done!
[nomerge ] gnome-base/gnome-3.12.0:2.0 USE=bluetooth cdr classic cups
extras -accessibility
[nomerge ] gnome-base/gnome-extra-apps-3.12.0:3.0 USE=games shotwell
tracker
[ebuild U ] media-video/cheese-3.12.2-r1:0/7 [3.12.2:0/7]
USE=introspection {-test} 0 kB
[nomerge ] app-office/libreoffice-bin-4.2.5.2 USE=gnome (-aqua) -java
-kde PYTHON_SINGLE_TARGET=python2_7 -python3_3 (-python3_4)
PYTHON_TARGETS=python2_7 python3_3 (-python3_4)
[ebuild R] dev-libs/redland-1.0.16 USE=berkdb xml -iodbc -mysql -odbc
-postgres -sqlite -static-libs (-ssl%*) 1,587 kB
[ebuild U ] app-admin/syslog-ng-3.4.8 [3.4.7] USE=ipv6 pcre ssl systemd
tcpd -amqp% -caps -dbi -geoip -json -mongodb -pacct% -smtp -spoof-source 3,096
kB
[ebuild UD ] www-client/firefox-24.7.0 [30.0] USE=alsa dbus gstreamer jit
libnotify minimal pulseaudio startup-notification -bindist -custom-cflags
-custom-optimization -debug (-pgo) (-selinux) -system-cairo -system-icu
-system-jpeg -system-sqlite {-test} -wifi (-hardened%) LINGUAS=-af -ak% -ar
-as -ast -be -bg -bn_BD -bn_IN -br -bs -ca -cs -csb -cy -da -de -el -en_GB
-en_ZA -eo -es_AR -es_CL -es_ES -es_MX -et -eu -fa -fi -fr -fy_NL -ga_IE -gd
-gl -gu_IN -he -hi_IN -hr -hu -hy_AM -id -is -it -ja -kk -km -kn -ko -ku -lg%
-lt -lv -mai -mk -ml -mr -nb_NO -nl -nn_NO -nso% -or -pa_IN -pl -pt_BR -pt_PT
-rm -ro -ru -si -sk -sl -son -sq -sr -sv_SE -ta -ta_LK% -te -th -tr -uk -vi
-zh_CN -zh_TW -zu (-xh%) 117,162 kB
[ebuild U ] www-servers/apache-2.2.27-r4:2 [2.2.27:2] USE=ldap ssl -debug
-doc (-selinux) -static -suexec -threads APACHE2_MODULES=actions alias
auth_basic auth_digest authn_alias authn_anon authn_dbm authn_default
authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner
authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache
env expires ext_filter file_cache filter headers include info log_config logio
mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id
userdir usertrack vhost_alias -asis -authn_dbd -cern_meta -charset_lite -dbd
-dumpio -ident -imagemap -log_forensic -proxy -proxy_ajp -proxy_balancer
-proxy_connect -proxy_ftp -proxy_http -proxy_scgi -reqtimeout -substitute
-version APACHE2_MPMS=-event -itk -peruser
Re: [gentoo-user] unclear (to me) errors from portage
On Thu, 07 Aug 2014 23:33:34 -0400
gottl...@nyu.edu wrote:
I was away for two weeks and now one of my systems cannot be updated
due to conflicts. The entire (long) emerge output is at the end of
this msg.
-- The first conflict is ---
!!! Multiple package instances within a single package slot have been
pulled !!! into the dependency graph, resulting in a slot conflict:
dev-lang/perl:0
(dev-lang/perl-5.16.3::gentoo, installed) pulled in by
dev-lang/perl:0/5.16=[-build(-)] required by
(net-analyzer/net-snmp-5.7.3_pre3::gentoo, installed)
(dev-lang/perl-5.18.2-r1::gentoo, ebuild scheduled for merge)
pulled in by =dev-lang/perl-5.18* required by
(virtual/perl-File-Spec-3.400.0-r2::gentoo, installed) (and 1 more
with the same problem)
I can't follow this. For one thing net-snmp-5.7.3_pre3.ebuild does
not contain the string lang and I looked at all occurrences of
perl in the ebuild and don't see how dev-lang/perl-5.16.3 is
required.
-- The second conflict is
* Error: The above package list contains packages which cannot be
* installed at the same time on the same system.
(media-video/ffmpeg-1.2.6-r1::gentoo, ebuild scheduled for merge)
pulled in by
=media-video/ffmpeg-1.2.6-r1:0[abi_x86_32(-)?,abi_x86_64(-)?,abi_x86_x32(-)?,abi_mips_n32(-)?,abi_mips_n64(-)?,abi_mips_o32(-)?,abi_ppc_32(-)?,abi_ppc_64(-)?,abi_s390_32(-)?,abi_s390_64(-)?]
(=media-video/ffmpeg-1.2.6-r1:0[abi_x86_64(-)]) required by
(media-plugins/gst-plugins-ffmpeg-0.10.13_p201211-r2::gentoo,
ebuild scheduled for merge)
(media-video/libav-9.14::gentoo, installed) pulled in by
=media-video/libav-9.12[abi_x86_32(-)?,abi_x86_64(-)?,abi_x86_x32(-)?,abi_mips_n32(-)?,abi_mips_n64(-)?,abi_mips_o32(-)?,abi_ppc_32(-)?,abi_ppc_64(-)?,abi_s390_32(-)?,abi_s390_64(-)?,X?,encode?,gsm?,jpeg2k?,mp3?,opus?,sdl?,speex?,theora?,threads?,truetype?,vaapi?,vdpau?,x264?]
(=media-video/libav-9.12[abi_x86_64(-),X,encode,mp3,sdl,truetype,x264])
required by (virtual/ffmpeg-9-r1::gentoo, installed)
---
I don't understand this since it looks to me that virtual/ffmpeg-9-r1
wants EITHER media-video/ffmpeg OR media-video/libav. So if
gst-plugins-ffmpeg requires ffmpeg, why isn't virtual/ffmpeg
satisfied, i.e., why does it require that media-video/libav remain
installed?
-- The entire emerge command and output follows
Note that I have
EMERGE_DEFAULT_OPTS=--ask --deep --tree --verbose --jobs
--load-average=5
e6510 ~ # emerge --update --changed-use --deep @world
These are the packages that would be merged, in reverse order:
Calculating dependencies... done!
[nomerge ] gnome-base/gnome-3.12.0:2.0 USE=bluetooth cdr
classic cups extras -accessibility [nomerge ]
gnome-base/gnome-extra-apps-3.12.0:3.0 USE=games shotwell
tracker [ebuild U ] media-video/cheese-3.12.2-r1:0/7
[3.12.2:0/7] USE=introspection {-test} 0 kB [nomerge ]
app-office/libreoffice-bin-4.2.5.2 USE=gnome (-aqua) -java -kde
PYTHON_SINGLE_TARGET=python2_7 -python3_3 (-python3_4)
PYTHON_TARGETS=python2_7 python3_3 (-python3_4) [ebuild R]
dev-libs/redland-1.0.16 USE=berkdb xml -iodbc -mysql -odbc
-postgres -sqlite -static-libs (-ssl%*) 1,587 kB [ebuild U ]
app-admin/syslog-ng-3.4.8 [3.4.7] USE=ipv6 pcre ssl systemd tcpd
-amqp% -caps -dbi -geoip -json -mongodb -pacct% -smtp -spoof-source
3,096 kB [ebuild UD ] www-client/firefox-24.7.0 [30.0] USE=alsa
dbus gstreamer jit libnotify minimal pulseaudio startup-notification
-bindist -custom-cflags -custom-optimization -debug (-pgo) (-selinux)
-system-cairo -system-icu -system-jpeg -system-sqlite {-test} -wifi
(-hardened%) LINGUAS=-af -ak% -ar -as -ast -be -bg -bn_BD -bn_IN
-br -bs -ca -cs -csb -cy -da -de -el -en_GB -en_ZA -eo -es_AR -es_CL
-es_ES -es_MX -et -eu -fa -fi -fr -fy_NL -ga_IE -gd -gl -gu_IN -he
-hi_IN -hr -hu -hy_AM -id -is -it -ja -kk -km -kn -ko -ku -lg% -lt
-lv -mai -mk -ml -mr -nb_NO -nl -nn_NO -nso% -or -pa_IN -pl -pt_BR
-pt_PT -rm -ro -ru -si -sk -sl -son -sq -sr -sv_SE -ta -ta_LK% -te
-th -tr -uk -vi -zh_CN -zh_TW -zu (-xh%) 117,162 kB [ebuild U ]
www-servers/apache-2.2.27-r4:2 [2.2.27:2] USE=ldap ssl -debug -doc
(-selinux) -static -suexec -threads APACHE2_MODULES=actions alias
auth_basic auth_digest authn_alias authn_anon authn_dbm authn_default
authn_file authz_dbm authz_default authz_groupfile authz_host
authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock
deflate dir disk_cache env expires ext_filter file_cache filter
headers include info log_config logio mem_cache mime mime_magic
negotiation rewrite setenvif speling status unique_id userdir
usertrack vhost_alias -asis -authn_dbd -cern_meta -charset_lite -dbd
-dumpio -ident -imagemap -log_forensic -proxy -proxy_ajp
