[Freeipa-users] Re: empty netgroups = all user could access to all machines?

[Thomas Lau via FreeIPA-users]

nevermind, solved it. It is actually HBAC rules, and I have to show
"Indirect Membership" within User Group to show those previously added
rules before upgrade to 4.4.0

Thanks all.

On Tue, Jun 27, 2017 at 4:36 PM, Thomas Lau <t...@tetrioncapital.com> wrote:

> Folks,
>
> After migrated from FreeIPA 3.3.0 to 4.4.0, all user groups to host groups
> mapping is gone, now 4.4.0 seems introduce this feature call "Netgroups",
> which is currently empty, I haven't hear any user complain, does it mean if
> "Netgroups" is empty all user could access to all machines which enrolled
> on FreeIPA?
>
___
FreeIPA-users mailing list -- freeipa-users@lists.fedorahosted.org
To unsubscribe send an email to freeipa-users-le...@lists.fedorahosted.org

[Freeipa-users] empty netgroups = all user could access to all machines?

[Thomas Lau via FreeIPA-users]

Folks,

After migrated from FreeIPA 3.3.0 to 4.4.0, all user groups to host groups
mapping is gone, now 4.4.0 seems introduce this feature call "Netgroups",
which is currently empty, I haven't hear any user complain, does it mean if
"Netgroups" is empty all user could access to all machines which enrolled
on FreeIPA?
___
FreeIPA-users mailing list -- freeipa-users@lists.fedorahosted.org
To unsubscribe send an email to freeipa-users-le...@lists.fedorahosted.org

[Freeipa-users] k5login loophole even account is disabled on FreeIPA

[Thomas Lau]

Folks,

let's say I am user thomas, and user "temp1" already marked as "disabled"
on FreeIPA, but tho...@domain.com is on /home/temp1/.k5login list, how come
I could still "sudo su - temp1"? It seems skip the checking on FreeIPA even
account is disabled. Did I miss any setting or it's normal?
-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go to http://freeipa.org for more info on the project

[Bug 1685131] Re: root cannot login to system without password

[Thomas Lau]

I am using this backport and it's working:

https://launchpad.net/~imphil/+archive/ubuntu/sssd

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1685131

Title:
  root cannot login to system without password

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/sssd/+bug/1685131/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1685131] [NEW] root cannot login to system without password

[Thomas Lau]

Public bug reported:

similar issue:
https://pagure.io/SSSD/sssd/issue/3003

(Workaround suggested above don't work on Xenial)

dev3 detail:
 /var/log/auth.log - dev3 sshd[77]: error: AuthorizedKeysCommand 
/usr/bin/sss_ssh_authorizedkeys root failed, status 1

root@dev3:~# cat .k5login 
us...@hk.domain.com
root@dev3:~# cat /root/.k5login 
us...@hk.domain.com
root@dev3:~# sss_ssh_authorizedkeys user1
root@dev3:~# sss_ssh_authorizedkeys root
Error looking up public keys
root@dev3:~# lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:Ubuntu 16.04.2 LTS
Release:16.04
Codename:   xenial
root@dev3:~# sssd --version
1.13.4
root@dev3:~# cat /etc/nsswitch.conf
passwd: compat sss
group:  compat sss
shadow: compat sss
gshadow:files

hosts:  files dns
networks:   files

protocols:  db files
services:   db files sss
ethers: db files
rpc:db files

netgroup:   nis sss
sudoers: files sss


login from Mocha to dev3:

user1@mocha:~$ ssh r...@dev3.hk.domain.com
r...@dev3.hk.domain.com's password: 

(Ctrl+c)

user1@mocha:~$ ssh us...@dev3.hk.domain.com
Welcome to Ubuntu 16.04.2 LTS (GNU/Linux 4.4.0-72-generic x86_64)
user1@dev3:/home/user1$

** Affects: sssd (Ubuntu)
 Importance: Undecided
 Status: New

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1685131

Title:
  root cannot login to system without password

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/sssd/+bug/1685131/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

Re: scheduler on Monit

[Thomas Lau]

OK Thanks.

On Mon, Oct 31, 2016 at 3:11 PM, Martin Pala <mart...@tildeslash.com> wrote:

> There is no default settings, it must be explicitly set. The value depends
> on your needs - to detect errors quickly, faster poll cycle is better (for
> example "set daemon 5" will poll each 5 seconds). If you want to reduce
> overhead, you can poll for example each 30 seconds: "set daemon 30" (or
> more)
>
>
>
> On 31 Oct 2016, at 08:07, Thomas Lau <t...@tetrioncapital.com> wrote:
>
> Thanks, may I know what's the default setting and suggested setting for
> scheduler job on Monit?
>
> On Mon, Oct 31, 2016 at 2:33 PM, Martin Pala <mart...@tildeslash.com>
> wrote:
>
>> Hi,
>>
>> the poll cycle is set by "set daemon " statement, see more
>> details in Monit manual: https://mmonit.com/mon
>> it/documentation/monit.html#DAEMON-MODE
>>
>> Best regards,
>> Martin
>>
>>
>> On 31 Oct 2016, at 03:48, Thomas Lau <t...@tetrioncapital.com> wrote:
>>
>> Hi All,
>>
>> I read some documents and found this:
>>
>> The current scheduler is poll cycle based. If a service check is
>> scheduled with the every cron statement, Monit will check if the current
>> time match the cron-string pattern. If it does, then the check is performed
>> otherwise it is skipped. The cron specification does not guarantee when
>> exactly the test will run, this depends on the default poll time and the
>> length of the check cycle. In other words, we cannot guarantee that Monit
>> will run on a specific time. Therefor we strongly recommend to use an
>> asterix in the minute field or at minimum a range, e..g. 0-15. Never use a
>> specific minute as Monit may not run on that minute.
>>
>>
>>
>> ​How could I find out what's the default poll time and the length of the
>> check cycle?​
>> --
>> To unsubscribe:
>> https://lists.nongnu.org/mailman/listinfo/monit-general
>>
>>
>>
>> --
>> To unsubscribe:
>> https://lists.nongnu.org/mailman/listinfo/monit-general
>>
>
>
> --
> To unsubscribe:
> https://lists.nongnu.org/mailman/listinfo/monit-general
>
>
>
> --
> To unsubscribe:
> https://lists.nongnu.org/mailman/listinfo/monit-general
>



-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: Suite 2716, Two IFC, Central, Hong Kong
--
To unsubscribe:
https://lists.nongnu.org/mailman/listinfo/monit-general

Re: scheduler on Monit

[Thomas Lau]

Thanks, may I know what's the default setting and suggested setting for
scheduler job on Monit?

On Mon, Oct 31, 2016 at 2:33 PM, Martin Pala <mart...@tildeslash.com> wrote:

> Hi,
>
> the poll cycle is set by "set daemon " statement, see more details
> in Monit manual: https://mmonit.com/monit/documentation/monit.
> html#DAEMON-MODE
>
> Best regards,
> Martin
>
>
> On 31 Oct 2016, at 03:48, Thomas Lau <t...@tetrioncapital.com> wrote:
>
> Hi All,
>
> I read some documents and found this:
>
> The current scheduler is poll cycle based. If a service check is scheduled
> with the every cron statement, Monit will check if the current time match
> the cron-string pattern. If it does, then the check is performed otherwise
> it is skipped. The cron specification does not guarantee when exactly the
> test will run, this depends on the default poll time and the length of the
> check cycle. In other words, we cannot guarantee that Monit will run on a
> specific time. Therefor we strongly recommend to use an asterix in the
> minute field or at minimum a range, e..g. 0-15. Never use a specific minute
> as Monit may not run on that minute.
>
>
>
> ​How could I find out what's the default poll time and the length of the
> check cycle?​
> --
> To unsubscribe:
> https://lists.nongnu.org/mailman/listinfo/monit-general
>
>
>
> --
> To unsubscribe:
> https://lists.nongnu.org/mailman/listinfo/monit-general
>
--
To unsubscribe:
https://lists.nongnu.org/mailman/listinfo/monit-general

scheduler on Monit

[Thomas Lau]

Hi All,

I read some documents and found this:

The current scheduler is poll cycle based. If a service check is scheduled
with the every cron statement, Monit will check if the current time match
the cron-string pattern. If it does, then the check is performed otherwise
it is skipped. The cron specification does not guarantee when exactly the
test will run, this depends on the default poll time and the length of the
check cycle. In other words, we cannot guarantee that Monit will run on a
specific time. Therefor we strongly recommend to use an asterix in the
minute field or at minimum a range, e..g. 0-15. Never use a specific minute
as Monit may not run on that minute.



​How could I find out what's the default poll time and the length of the
check cycle?​
--
To unsubscribe:
https://lists.nongnu.org/mailman/listinfo/monit-general

Re: monit crash

[Thomas Lau]

I see, okay thanks, I will upgrade and test again.

On Mon, Oct 17, 2016 at 2:57 PM, Martin Pala <mart...@tildeslash.com> wrote:

> It is related to the IOException from your log - it was not catched.
>
>
> On 17 Oct 2016, at 08:51, Thomas Lau <t...@tetrioncapital.com> wrote:
>
> mind to explain what's going on?
>
> On Mon, Oct 17, 2016 at 2:49 PM, Martin Pala <mart...@tildeslash.com>
> wrote:
>
>> Thanks for data. This problem was fixed in monit 5.7, please upgrade
>> monit.
>>
>> Best regards,
>> Martin
>>
>>
>> On 17 Oct 2016, at 08:45, Thomas Lau <t...@tetrioncapital.com> wrote:
>>
>>  monit -V
>> This is Monit version 5.6
>> Copyright (C) 2001-2013 Tildeslash Ltd. All Rights Reserved.
>>
>>
>> Date: Tue Oct 11 13:59:46 log file:
>> [HKT Oct 11 13:59:06] error: M/Monit: cannot open a connection to
>> http://10.0.0.107:8080/collector -- Connection timed out
>> [HKT Oct 11 13:59:16] error: Sendmail: Error receiving data from the
>> mailserver 'gmailrelay.hk.domain.com' -- Resource temporarily unavailable
>> [HKT Oct 11 13:59:46] critical : IOException: Error receiving data from
>> the mailserver 'gmailrelay.hk.domain.com' -- Resource temporarily
>> unavailable
>>  raised in do_status at src/sendmail.c:119
>>
>>
>> 2016-10-17 14:29 GMT+08:00 Martin Pala <mart...@tildeslash.com>:
>>
>>> Hello,
>>>
>>> please can you send the following informations?:
>>>
>>> 1.)  the coredump file
>>> 2.) the monit binary which generated the coredump
>>> 3.) which monit version it is? (monit -V)
>>> 4.) monit log file
>>>
>>>
>>> Best regards,
>>> Martin
>>>
>>>
>>> On 17 Oct 2016, at 03:24, Thomas Lau <t...@tetrioncapital.com> wrote:
>>>
>>> Hi all,
>>>
>>> we got a crash on monit main process, here is the crash report:
>>>
>>> ProblemType: Crash
>>> Architecture: amd64
>>> Date: Tue Oct 11 13:59:46 2016
>>> DistroRelease: Ubuntu 14.04
>>> ExecutablePath: /usr/bin/monit
>>> ExecutableTimestamp: 1384665445
>>> ProcCmdline: /usr/bin/monit -c /etc/monit/monitrc
>>> ProcCwd: /
>>> ProcEnviron:
>>>  TERM=linux
>>>  PATH=(custom, no user)
>>> ProcMaps:
>>>  0040-0048 r-xp  08:02 296656
>>>   /usr/bin/monit
>>>  0068-00681000 r--p 0008 08:02 296656
>>>   /usr/bin/monit
>>>  00681000-00683000 rw-p 00081000 08:02 296656
>>>   /usr/bin/monit
>>>  00683000-00686000 rw-p  00:00 0
>>>  02315000-02357000 rw-p  00:00 0
>>>  [heap]
>>>  02357000-0238b000 rw-p  00:00 0
>>>  [heap]
>>>  7f837400-7f8374021000 rw-p  00:00 0
>>>  7f8374021000-7f837800 ---p  00:00 0
>>>  7f837c00-7f837c021000 rw-p  00:00 0
>>>  7f837c021000-7f838000 ---p  00:00 0
>>>  7f8383ccb000-7f8383ccc000 ---p  00:00 0
>>>  7f8383ccc000-7f83844cc000 rw-p  00:00 0
>>>  [stack:2355]
>>>  7f83844cc000-7f83844cd000 ---p  00:00 0
>>>  7f83844cd000-7f8384ccd000 rw-p  00:00 0
>>>  [stack:2343]
>>>  7f8384ccd000-7f8384ce4000 r-xp  08:02 2186
>>>   /lib/x86_64-linux-gnu/libresolv-2.19.so
>>>  7f8384ce4000-7f8384ee4000 ---p 00017000 08:02 2186
>>>   /lib/x86_64-linux-gnu/libresolv-2.19.so
>>>  7f8384ee4000-7f8384ee5000 r--p 00017000 08:02 2186
>>>   /lib/x86_64-linux-gnu/libresolv-2.19.so
>>>  7f8384ee5000-7f8384ee6000 rw-p 00018000 08:02 2186
>>>   /lib/x86_64-linux-gnu/libresolv-2.19.so
>>>  7f8384ee6000-7f8384ee8000 rw-p  00:00 0
>>>  7f8384ee8000-7f8384eed000 r-xp  08:02 16698
>>>  /lib/x86_64-linux-gnu/libnss_dns-2.19.so
>>>  7f8384eed000-7f83850ec000 ---p 5000 08:02 16698
>>>  /lib/x86_64-linux-gnu/libnss_dns-2.19.so
>>>  7f83850ec000-7f83850ed000 r--p 4000 08:02 16698
>>>  /lib/x86_64-linux-gnu/libnss_dns-2.19.so
>>>  7f83850ed000-7f83850ee000 rw-p 5000 08:02 16698
>>>  /lib/x86_64-linux-gnu/libnss_dns-2.19.so
>>>  7f83850ee000-7f838576c000 r--s  08:06 5165
>>>   /var/lib/sss/mc/passwd
>>>  7f838576c000-7f8385773000 r-xp  08:02 14966
>>>  /lib/x86_64-linux-gnu/libnss_sss.so.2
>>>  7f8385773000-7f8385972000 ---p 7000 08:02 14966
>>>  /lib/x86_64-linux-gnu/libnss_sss.so.2
>>>  7f

Re: monit crash

[Thomas Lau]

mind to explain what's going on?

On Mon, Oct 17, 2016 at 2:49 PM, Martin Pala <mart...@tildeslash.com> wrote:

> Thanks for data. This problem was fixed in monit 5.7, please upgrade monit.
>
> Best regards,
> Martin
>
>
> On 17 Oct 2016, at 08:45, Thomas Lau <t...@tetrioncapital.com> wrote:
>
>  monit -V
> This is Monit version 5.6
> Copyright (C) 2001-2013 Tildeslash Ltd. All Rights Reserved.
>
>
> Date: Tue Oct 11 13:59:46 log file:
> [HKT Oct 11 13:59:06] error: M/Monit: cannot open a connection to
> http://10.0.0.107:8080/collector -- Connection timed out
> [HKT Oct 11 13:59:16] error: Sendmail: Error receiving data from the
> mailserver 'gmailrelay.hk.domain.com' -- Resource temporarily unavailable
> [HKT Oct 11 13:59:46] critical : IOException: Error receiving data from
> the mailserver 'gmailrelay.hk.domain.com' -- Resource temporarily
> unavailable
>  raised in do_status at src/sendmail.c:119
>
>
> 2016-10-17 14:29 GMT+08:00 Martin Pala <mart...@tildeslash.com>:
>
>> Hello,
>>
>> please can you send the following informations?:
>>
>> 1.)  the coredump file
>> 2.) the monit binary which generated the coredump
>> 3.) which monit version it is? (monit -V)
>> 4.) monit log file
>>
>>
>> Best regards,
>> Martin
>>
>>
>> On 17 Oct 2016, at 03:24, Thomas Lau <t...@tetrioncapital.com> wrote:
>>
>> Hi all,
>>
>> we got a crash on monit main process, here is the crash report:
>>
>> ProblemType: Crash
>> Architecture: amd64
>> Date: Tue Oct 11 13:59:46 2016
>> DistroRelease: Ubuntu 14.04
>> ExecutablePath: /usr/bin/monit
>> ExecutableTimestamp: 1384665445
>> ProcCmdline: /usr/bin/monit -c /etc/monit/monitrc
>> ProcCwd: /
>> ProcEnviron:
>>  TERM=linux
>>  PATH=(custom, no user)
>> ProcMaps:
>>  0040-0048 r-xp  08:02 296656
>> /usr/bin/monit
>>  0068-00681000 r--p 0008 08:02 296656
>> /usr/bin/monit
>>  00681000-00683000 rw-p 00081000 08:02 296656
>> /usr/bin/monit
>>  00683000-00686000 rw-p  00:00 0
>>  02315000-02357000 rw-p  00:00 0
>>  [heap]
>>  02357000-0238b000 rw-p  00:00 0
>>  [heap]
>>  7f837400-7f8374021000 rw-p  00:00 0
>>  7f8374021000-7f837800 ---p  00:00 0
>>  7f837c00-7f837c021000 rw-p  00:00 0
>>  7f837c021000-7f838000 ---p  00:00 0
>>  7f8383ccb000-7f8383ccc000 ---p  00:00 0
>>  7f8383ccc000-7f83844cc000 rw-p  00:00 0
>>  [stack:2355]
>>  7f83844cc000-7f83844cd000 ---p  00:00 0
>>  7f83844cd000-7f8384ccd000 rw-p  00:00 0
>>  [stack:2343]
>>  7f8384ccd000-7f8384ce4000 r-xp  08:02 2186
>> /lib/x86_64-linux-gnu/libresolv-2.19.so
>>  7f8384ce4000-7f8384ee4000 ---p 00017000 08:02 2186
>> /lib/x86_64-linux-gnu/libresolv-2.19.so
>>  7f8384ee4000-7f8384ee5000 r--p 00017000 08:02 2186
>> /lib/x86_64-linux-gnu/libresolv-2.19.so
>>  7f8384ee5000-7f8384ee6000 rw-p 00018000 08:02 2186
>> /lib/x86_64-linux-gnu/libresolv-2.19.so
>>  7f8384ee6000-7f8384ee8000 rw-p  00:00 0
>>  7f8384ee8000-7f8384eed000 r-xp  08:02 16698
>>  /lib/x86_64-linux-gnu/libnss_dns-2.19.so
>>  7f8384eed000-7f83850ec000 ---p 5000 08:02 16698
>>  /lib/x86_64-linux-gnu/libnss_dns-2.19.so
>>  7f83850ec000-7f83850ed000 r--p 4000 08:02 16698
>>  /lib/x86_64-linux-gnu/libnss_dns-2.19.so
>>  7f83850ed000-7f83850ee000 rw-p 5000 08:02 16698
>>  /lib/x86_64-linux-gnu/libnss_dns-2.19.so
>>  7f83850ee000-7f838576c000 r--s  08:06 5165
>> /var/lib/sss/mc/passwd
>>  7f838576c000-7f8385773000 r-xp  08:02 14966
>>  /lib/x86_64-linux-gnu/libnss_sss.so.2
>>  7f8385773000-7f8385972000 ---p 7000 08:02 14966
>>  /lib/x86_64-linux-gnu/libnss_sss.so.2
>>  7f8385972000-7f8385973000 r--p 6000 08:02 14966
>>  /lib/x86_64-linux-gnu/libnss_sss.so.2
>>  7f8385973000-7f8385974000 rw-p 7000 08:02 14966
>>  /lib/x86_64-linux-gnu/libnss_sss.so.2
>>  7f8385974000-7f838597f000 r-xp  08:02 16704
>>  /lib/x86_64-linux-gnu/libnss_files-2.19.so
>>  7f838597f000-7f8385b7e000 ---p b000 08:02 16704
>>  /lib/x86_64-linux-gnu/libnss_files-2.19.so
>>  7f8385b7e000-7f8385b7f000 r--p a000 08:02 16704
>>  /lib/x86_64-linux-gnu/libnss_files-2.19.so
>>  7f8385b7f000-7f8385b8 rw-p b000 08:02 16704
>>  /lib/x86_64-linux-gnu/libnss_files-2.19.so
>>  7f8385b8-7f8385b8b000 r-xp  08:02 16696
>>  /lib/x86_64-linux-gnu/libns

monit crash

[Thomas Lau]

Hi all,

we got a crash on monit main process, here is the crash report:

ProblemType: Crash
Architecture: amd64
Date: Tue Oct 11 13:59:46 2016
DistroRelease: Ubuntu 14.04
ExecutablePath: /usr/bin/monit
ExecutableTimestamp: 1384665445
ProcCmdline: /usr/bin/monit -c /etc/monit/monitrc
ProcCwd: /
ProcEnviron:
 TERM=linux
 PATH=(custom, no user)
ProcMaps:
 0040-0048 r-xp  08:02 296656
/usr/bin/monit
 0068-00681000 r--p 0008 08:02 296656
/usr/bin/monit
 00681000-00683000 rw-p 00081000 08:02 296656
/usr/bin/monit
 00683000-00686000 rw-p  00:00 0
 02315000-02357000 rw-p  00:00 0
 [heap]
 02357000-0238b000 rw-p  00:00 0
 [heap]
 7f837400-7f8374021000 rw-p  00:00 0
 7f8374021000-7f837800 ---p  00:00 0
 7f837c00-7f837c021000 rw-p  00:00 0
 7f837c021000-7f838000 ---p  00:00 0
 7f8383ccb000-7f8383ccc000 ---p  00:00 0
 7f8383ccc000-7f83844cc000 rw-p  00:00 0
 [stack:2355]
 7f83844cc000-7f83844cd000 ---p  00:00 0
 7f83844cd000-7f8384ccd000 rw-p  00:00 0
 [stack:2343]
 7f8384ccd000-7f8384ce4000 r-xp  08:02 2186
/lib/x86_64-linux-gnu/libresolv-2.19.so
 7f8384ce4000-7f8384ee4000 ---p 00017000 08:02 2186
/lib/x86_64-linux-gnu/libresolv-2.19.so
 7f8384ee4000-7f8384ee5000 r--p 00017000 08:02 2186
/lib/x86_64-linux-gnu/libresolv-2.19.so
 7f8384ee5000-7f8384ee6000 rw-p 00018000 08:02 2186
/lib/x86_64-linux-gnu/libresolv-2.19.so
 7f8384ee6000-7f8384ee8000 rw-p  00:00 0
 7f8384ee8000-7f8384eed000 r-xp  08:02 16698
 /lib/x86_64-linux-gnu/libnss_dns-2.19.so
 7f8384eed000-7f83850ec000 ---p 5000 08:02 16698
 /lib/x86_64-linux-gnu/libnss_dns-2.19.so
 7f83850ec000-7f83850ed000 r--p 4000 08:02 16698
 /lib/x86_64-linux-gnu/libnss_dns-2.19.so
 7f83850ed000-7f83850ee000 rw-p 5000 08:02 16698
 /lib/x86_64-linux-gnu/libnss_dns-2.19.so
 7f83850ee000-7f838576c000 r--s  08:06 5165
/var/lib/sss/mc/passwd
 7f838576c000-7f8385773000 r-xp  08:02 14966
 /lib/x86_64-linux-gnu/libnss_sss.so.2
 7f8385773000-7f8385972000 ---p 7000 08:02 14966
 /lib/x86_64-linux-gnu/libnss_sss.so.2
 7f8385972000-7f8385973000 r--p 6000 08:02 14966
 /lib/x86_64-linux-gnu/libnss_sss.so.2
 7f8385973000-7f8385974000 rw-p 7000 08:02 14966
 /lib/x86_64-linux-gnu/libnss_sss.so.2
 7f8385974000-7f838597f000 r-xp  08:02 16704
 /lib/x86_64-linux-gnu/libnss_files-2.19.so
 7f838597f000-7f8385b7e000 ---p b000 08:02 16704
 /lib/x86_64-linux-gnu/libnss_files-2.19.so
 7f8385b7e000-7f8385b7f000 r--p a000 08:02 16704
 /lib/x86_64-linux-gnu/libnss_files-2.19.so
 7f8385b7f000-7f8385b8 rw-p b000 08:02 16704
 /lib/x86_64-linux-gnu/libnss_files-2.19.so
 7f8385b8-7f8385b8b000 r-xp  08:02 16696
 /lib/x86_64-linux-gnu/libnss_nis-2.19.so
 7f8385b8b000-7f8385d8a000 ---p b000 08:02 16696
 /lib/x86_64-linux-gnu/libnss_nis-2.19.so
 7f8385d8a000-7f8385d8b000 r--p a000 08:02 16696
 /lib/x86_64-linux-gnu/libnss_nis-2.19.so
 7f8385d8b000-7f8385d8c000 rw-p b000 08:02 16696
 /lib/x86_64-linux-gnu/libnss_nis-2.19.so
 7f8385d8c000-7f8385da3000 r-xp  08:02 16692
 /lib/x86_64-linux-gnu/libnsl-2.19.so
 7f8385da3000-7f8385fa2000 ---p 00017000 08:02 16692
 /lib/x86_64-linux-gnu/libnsl-2.19.so
 7f8385fa2000-7f8385fa3000 r--p 00016000 08:02 16692
 /lib/x86_64-linux-gnu/libnsl-2.19.so
 7f8385fa3000-7f8385fa4000 rw-p 00017000 08:02 16692
 /lib/x86_64-linux-gnu/libnsl-2.19.so
 7f8385fa4000-7f8385fa6000 rw-p  00:00 0
 7f8385fa6000-7f8385faf000 r-xp  08:02 16691
 /lib/x86_64-linux-gnu/libnss_compat-2.19.so
 7f8385faf000-7f83861ae000 ---p 9000 08:02 16691
 /lib/x86_64-linux-gnu/libnss_compat-2.19.so
 7f83861ae000-7f83861af000 r--p 8000 08:02 16691
 /lib/x86_64-linux-gnu/libnss_compat-2.19.so
 7f83861af000-7f83861b rw-p 9000 08:02 16691
 /lib/x86_64-linux-gnu/libnss_compat-2.19.so
 7f83861b-7f83861b3000 r-xp  08:02 12620
 /lib/x86_64-linux-gnu/libdl-2.19.so
 7f83861b3000-7f83863b2000 ---p 3000 08:02 12620
 /lib/x86_64-linux-gnu/libdl-2.19.so
 7f83863b2000-7f83863b3000 r--p 2000 08:02 12620
 /lib/x86_64-linux-gnu/libdl-2.19.so
 7f83863b3000-7f83863b4000 rw-p 3000 08:02 12620
 /lib/x86_64-linux-gnu/libdl-2.19.so
 7f83863b4000-7f83863cd000 r-xp  08:02 172
 /lib/x86_64-linux-gnu/libaudit.so.1.0.0
 7f83863cd000-7f83865cc000 ---p 00019000 08:02 172
 /lib/x86_64-linux-gnu/libaudit.so.1.0.0
 7f83865cc000-7f83865cd000 r--p 00018000 08:02 172
 /lib/x86_64-linux-gnu/libaudit.so.1.0.0
 7f83865cd000-7f83865ce000 rw-p 00019000 08:02 172
 /lib/x86_64-linux-gnu/libaudit.so.1.0.0
 7f83865ce000-7f83865d8000 rw-p  00:00 0
 7f83865d8000-7f8386793000 r-xp  08:02 16701
 /lib/x86_64-linux-gnu/libc-2.19.so
 7f8386793000-7f8386992000 ---p 001bb000 08:02 16701
 /lib/x86_64-linux-gnu/libc-2.19.so
 7f8386992000-7f8386996000 r--p 001ba000 08:02 16701
 /lib/x86_64-linux-gnu/libc-2.19.so
 7f8386996000-7f8386998000 rw-p 001be000 

[Bug 913938] Re: Detected scanner fails to open device, "Invalid Argument"

[Thomas Lau]

Download drivers from Brother website both for printer and scanner and my model 
is DCP-L2540DW
http://support.brother.com/g/b/downloadtop.aspx?c=sg=en=dcpl2540dw_us_as
Choose Linux and deb to download. After downloading its very likely the file is 
found in Download file .
Open terminal and type 

thomas@thomas-H81MHV3 ~ $ cd Downloads
thomas@thomas-H81MHV3 ~/Downloads $ sudo dpkg -i dcpl2540dwlpr-3.2.0-1.i386.deb
[sudo] password for thomas: (Type in your own password )

thomas@thomas-H81MHV3 ~/Downloads $ scanimage -L
device `brother4:bus2;dev4' is a Brother DCP-L2540DW USB scanner
thomas@thomas-H81MHV3 ~/Downloads $ sudo dpkg -i brscan4-0.4.3-3.amd64.deb

thomas@thomas-H81MHV3 ~/Downloads $ scanimage -L
device `brother4:bus2;dev4' is a Brother DCP-L2540DW USB scanner
thomas@thomas-H81MHV3 ~/Downloads $ scanimage --test
scanimage: open of device brother4:bus2;dev4 failed: Invalid argument
thomas@thomas-H81MHV3 ~ $ lsusb
Bus 002 Device 002: ID 8087:8000 Intel Corp.
Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 001 Device 002: ID 8087:8008 Intel Corp.
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 004 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 003 Device 005: ID 0b05:1786 ASUSTek Computer, Inc. USB-N10 802.11n Network 
Adapter [Realtek RTL8188SU]
Bus 003 Device 004: ID 04f9:0328 Brother Industries, Ltd
Bus 003 Device 009: ID 046d:c31c Logitech, Inc. Keyboard K120
Bus 003 Device 008: ID 04d9:1135 Holtek Semiconductor, Inc.
Bus 003 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub

(The bus is 003 and Device is 004 for my brother printer you need to
change to yours accordingly)

thomas@thomas-H81MHV3 ~ $ sudo chmod a+w /dev/bus/usb/003/004
[sudo] password for thomas:
thomas@thomas-H81MHV3 ~ $ scanimage -L
device `brother4:bus2;dev4' is a Brother DCP-L2540DW USB scanner

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/913938

Title:
  Detected scanner fails to open device, "Invalid Argument"

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/sane-backends/+bug/913938/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Desktop-packages] [Bug 913938] Re: Detected scanner fails to open device, "Invalid Argument"

[Thomas Lau]

Download drivers from Brother website both for printer and scanner and my model 
is DCP-L2540DW
http://support.brother.com/g/b/downloadtop.aspx?c=sg=en=dcpl2540dw_us_as
Choose Linux and deb to download. After downloading its very likely the file is 
found in Download file .
Open terminal and type 

thomas@thomas-H81MHV3 ~ $ cd Downloads
thomas@thomas-H81MHV3 ~/Downloads $ sudo dpkg -i dcpl2540dwlpr-3.2.0-1.i386.deb
[sudo] password for thomas: (Type in your own password )

thomas@thomas-H81MHV3 ~/Downloads $ scanimage -L
device `brother4:bus2;dev4' is a Brother DCP-L2540DW USB scanner
thomas@thomas-H81MHV3 ~/Downloads $ sudo dpkg -i brscan4-0.4.3-3.amd64.deb

thomas@thomas-H81MHV3 ~/Downloads $ scanimage -L
device `brother4:bus2;dev4' is a Brother DCP-L2540DW USB scanner
thomas@thomas-H81MHV3 ~/Downloads $ scanimage --test
scanimage: open of device brother4:bus2;dev4 failed: Invalid argument
thomas@thomas-H81MHV3 ~ $ lsusb
Bus 002 Device 002: ID 8087:8000 Intel Corp.
Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 001 Device 002: ID 8087:8008 Intel Corp.
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 004 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 003 Device 005: ID 0b05:1786 ASUSTek Computer, Inc. USB-N10 802.11n Network 
Adapter [Realtek RTL8188SU]
Bus 003 Device 004: ID 04f9:0328 Brother Industries, Ltd
Bus 003 Device 009: ID 046d:c31c Logitech, Inc. Keyboard K120
Bus 003 Device 008: ID 04d9:1135 Holtek Semiconductor, Inc.
Bus 003 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub

(The bus is 003 and Device is 004 for my brother printer you need to
change to yours accordingly)

thomas@thomas-H81MHV3 ~ $ sudo chmod a+w /dev/bus/usb/003/004
[sudo] password for thomas:
thomas@thomas-H81MHV3 ~ $ scanimage -L
device `brother4:bus2;dev4' is a Brother DCP-L2540DW USB scanner

-- 
You received this bug notification because you are a member of Desktop
Packages, which is subscribed to sane-backends in Ubuntu.
https://bugs.launchpad.net/bugs/913938

Title:
  Detected scanner fails to open device, "Invalid Argument"

Status in sane-backends package in Ubuntu:
  Confirmed

Bug description:
  Hello,

  I've installed the latest drivers from the Brother support website for
  my Brother DCP-165C. Printing works fine, but I can't get scanning
  working... I have followed all instructions provided by the Brother
  support website (udev rules, etc). I'm running Ubuntu Server 11.10.

  No matter whether I'm running scanimage (or xsane) as sudo or not, I'm 
getting the same error message:
  "scanimage: open of device brother3:bus2;dev1 failed: Invalid argument"

  You can find a strace attached (ran with sudo).

  Some more outputs:
  scanimage -L
  device `brother3:bus2;dev1' is a Brother DCP-165C USB scanner

  sane-find-scanner 
  
# sane-find-scanner will now attempt to detect your scanner. If the 

# result is different from what you expected, first make sure your  

# scanner is powered up and properly connected to your computer.



# No SCSI scanners found. If you expected something different, make sure 
that   
# you have loaded a kernel SCSI driver for your SCSI adapter.   



  found USB scanner (vendor=0x04f9, product=0x0204) at libusb:007:002   

  found USB scanner (vendor=0x0bda, product=0x8187) at libusb:002:003   

# Your USB scanner was (probably) detected. It may or may not be supported 
by   
# SANE. Try scanimage -L and read the backend's manpage.



# Not checking for parallel port scanners.  



# Most Scanners connected to the parallel port or other proprietary ports   

# can't be detected by this program.
   

Re: Re[2]: error on logging and how to correctly implement svlogd?

[Thomas Lau]

Very interesting that after I change to symlink, it works fine, thanks.
On Jun 22, 2016 11:55 PM, "Avery Payne"  wrote:

>
> Hi,
>>
>> Thanks for replying. I don't use symlink, instead I put everything
>> directly
>> on /etc/service/test, then sv start test
>>
>> Try this:
>
> mkdir /etc/svcdef
> mkdir /etc/svcdef/test
> mkdir /etc/svcdef/test/log
>
> Put a copy of your test service ./run file into the new directory:
>
> cp /etc/service/test/run /etc/svcdef/test/run
>
> Now open an editor like this:
>
> vi /etc/svcdef/test/log/run
>
> and put this into it:
>
> #!/bin/sh
> exec 2>&1
> # extract the service name
> SVNAME=$( basename $( echo `pwd` | sed 's/log//' ) )
> # create a logging directory if one isn't present
> [ -d /var/log/$SVNAME ] || mkdir -p /var/log/$SVNAME ; chown :adm
> /var/log/$SVNAME
> # create a hard-coded path name to reference
> [ -d main ] || ln -s /var/log/$SVNAME main
> # launch the logger
> exec /usr/bin/svlogd -tt main
>
> after that, save the file and exit the editor, and do the following:
>
> mkdir /etc/sv
> cp -Rav /etc/svcdef/* /etc/sv/
> ln -s /etc/sv /service
>
> Now start your supervision and make sure it's pointing at /service instead
> of /etc/service.  Type
>
> ps fax
>
> ...and you should see a supervision "tree" complete with your test service
> and logger.  You don't have to use /etc/svcdef or /etc/sv or even /service,
> I'm just giving these as suggestions.  For that matter the logger could
> even be switched out, the logging done elsewhere, etc.
>
> The logging needs to start using a subdirectory of the service.  In this
> case, the service is /etc/sv/test and the logger would be
> /etc/sv/test/log.  A ./run file needs to be present in the log directory to
> launch the logger, which is the script we just created at
> /etc/svcdef/test/log/run.
>
> Hope this helps.
>
>

error on logging and how to correctly implement svlogd?

[Thomas Lau]

test/run:
#!/bin/bash
exec su - tlau  -c "/usr/bin/memcached -m 64"


test/log/run:
#/bin/bash
/usr/bin/svlogd -tt /tmp/test/test_log


root 12977  0.0  0.018836 ?Ss   18:48   0:00 runsvdir
-P /etc/service log: atal: unable to lock supervise/lock: temporary failure
runsv test: fatal: unable to lock supervise/lock: temporary failure runsv
test: fatal: unable to lock supervise/lock: temporary failure runsv test:
fatal: unable to lock supervise/lock: temporary failure runsv test: fatal:
unable to lock supervise/lock: temporary failure runsv test: fatal: unable
to lock supervise/lock: temporary failure


What exactly is wrong here? and what's the correct way to implement svlogd?


-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: Suite 2716, Two IFC, Central, Hong Kong

[jira] [Commented] (SPARK-15611) Got the same sequence random number in every forked worker.

[Thomas Lau (JIRA)]

[ 
https://issues.apache.org/jira/browse/SPARK-15611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15306204#comment-15306204
 ] 

Thomas Lau commented on SPARK-15611:


hi, can anyone review this fix?

> Got the same sequence random number in every forked worker.
> ---
>
> Key: SPARK-15611
> URL: https://issues.apache.org/jira/browse/SPARK-15611
> Project: Spark
>  Issue Type: Bug
>  Components: PySpark
>Affects Versions: 1.6.1
>    Reporter: Thomas Lau
>Priority: Minor
>
> hi, i'm writing some code as below:
> {code:java|title=marlkov.py|borderStyle=dashed|borderColor=#ccc|titleBGColor=#F7D6C1|bgColor=#CE}
> from random import random
> from operator import add
> def funcx( x ):
>   print x[0],x[1]
>   return 1 if x[0]** 2 + x[1]** 2 < 1 else 0
> def genRnd(ind):
>   x=random() * 2 - 1
>   y=random() * 2 - 1
>   return (x,y)
> def runsp(total):
>   ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
> y: x + y)/float(total) * 4
>   print ret
> runsp(3)
> {code}
> once started the pyspark shell, no matter how many times i run "runsp(N)" , 
> this code always get a same sequece of random numbers, like this
> {code:title=Output|borderStyle=solid}
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> >>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
> >>>  * 4
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> >>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
> >>>  * 4
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> {code}
> i think this is because when we import pyspark.worker in the daemon.py, we 
> alse import a random by shuffle.py which is imported by pyspark.worker, 
> this worker, forked by *pid = os.fork()*, also remains the state of the 
> parent's random, thus every forked worker get the same random.next().
> we need to re-random the random by random.seed, which will solve the problem, 
> but i think this PR. may not be the proper fix.
> ths.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Resolved] (SPARK-15611) Got the same sequence random number in every forked worker.

[Thomas Lau (JIRA)]

 [ 
https://issues.apache.org/jira/browse/SPARK-15611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thomas Lau resolved SPARK-15611.

  Resolution: Fixed
Target Version/s: 1.6.1

> Got the same sequence random number in every forked worker.
> ---
>
> Key: SPARK-15611
> URL: https://issues.apache.org/jira/browse/SPARK-15611
> Project: Spark
>  Issue Type: Bug
>  Components: PySpark
>Affects Versions: 1.6.1
>    Reporter: Thomas Lau
>Priority: Minor
>
> hi, i'm writing some code as below:
> {code:java|title=marlkov.py|borderStyle=dashed|borderColor=#ccc|titleBGColor=#F7D6C1|bgColor=#CE}
> from random import random
> from operator import add
> def funcx( x ):
>   print x[0],x[1]
>   return 1 if x[0]** 2 + x[1]** 2 < 1 else 0
> def genRnd(ind):
>   x=random() * 2 - 1
>   y=random() * 2 - 1
>   return (x,y)
> def runsp(total):
>   ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
> y: x + y)/float(total) * 4
>   print ret
> runsp(3)
> {code}
> once started the pyspark shell, no matter how many times i run "runsp(N)" , 
> this code always get a same sequece of random numbers, like this
> {code:title=Output|borderStyle=solid}
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> >>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
> >>>  * 4
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> >>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
> >>>  * 4
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> {code}
> i think this is because when we import pyspark.worker in the daemon.py, we 
> alse import a random by shuffle.py which is imported by pyspark.worker, 
> this worker, forked by *pid = os.fork()*, also remains the state of the 
> parent's random, thus every forked worker get the same random.next().
> we need to re-random the random by random.seed, which will solve the problem, 
> but i think this PR. may not be the proper fix.
> ths.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Updated] (SPARK-15611) Got the same sequence random number in every forked worker.

[Thomas Lau (JIRA)]

 [ 
https://issues.apache.org/jira/browse/SPARK-15611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thomas Lau updated SPARK-15611:
---
Summary: Got the same sequence random number in every forked worker.  (was: 
Each forked worker  in daemon.py keep the parent's random state)

> Got the same sequence random number in every forked worker.
> ---
>
> Key: SPARK-15611
> URL: https://issues.apache.org/jira/browse/SPARK-15611
> Project: Spark
>  Issue Type: Bug
>  Components: PySpark
>Affects Versions: 1.6.1
>    Reporter: Thomas Lau
>Priority: Minor
>
> hi, i'm writing some code as below:
> {code:java|title=marlkov.py|borderStyle=dashed|borderColor=#ccc|titleBGColor=#F7D6C1|bgColor=#CE}
> from random import random
> from operator import add
> def funcx( x ):
>   print x[0],x[1]
>   return 1 if x[0]** 2 + x[1]** 2 < 1 else 0
> def genRnd(ind):
>   x=random() * 2 - 1
>   y=random() * 2 - 1
>   return (x,y)
> def runsp(total):
>   ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
> y: x + y)/float(total) * 4
>   print ret
> runsp(3)
> {code}
> once started the pyspark shell, no matter how many times i run "runsp(N)" , 
> this code always get a same sequece of random numbers, like this
> {code:title=Output|borderStyle=solid}
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> >>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
> >>>  * 4
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> >>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
> >>>  * 4
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> {code}
> i think this is because when we import pyspark.worker in the daemon.py, we 
> alse import a random by shuffle.py which is imported by pyspark.worker, 
> this worker, forked by *pid = os.fork()*, also remains the state of the 
> parent's random, thus every forked worker get the same random.next().
> we need to re-random the random by random.seed, which will solve the problem, 
> but i think this PR. may not be the proper fix.
> ths.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Updated] (SPARK-15611) Each forked worker in daemon.py keep the parent's random state

[Thomas Lau (JIRA)]

 [ 
https://issues.apache.org/jira/browse/SPARK-15611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thomas Lau updated SPARK-15611:
---
Description: 
hi, i'm writing some code as below:

{code:java|title=marlkov.py|borderStyle=dashed|borderColor=#ccc|titleBGColor=#F7D6C1|bgColor=#CE}
from random import random
from operator import add
def funcx( x ):
  print x[0],x[1]
  return 1 if x[0]** 2 + x[1]** 2 < 1 else 0
def genRnd(ind):
  x=random() * 2 - 1
  y=random() * 2 - 1
  return (x,y)
def runsp(total):
  ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
y: x + y)/float(total) * 4
  print ret
runsp(3)
{code}

once started the pyspark shell, no matter how many times i run "runsp(N)" , 
this code always get a same sequece of random numbers, like this


{code:title=Output|borderStyle=solid}
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
{code}

i think this is because when we import pyspark.worker in the daemon.py, we alse 
import a random by shuffle.py which is imported by pyspark.worker, 
this worker, forked by *pid = os.fork()*, also remains the state of the 
parent's random, thus every forked worker get the same random.next().

we need to re-random the random by random.seed, which will solve the problem, 
but i think this PR. may not be the proper fix.
ths.

  was:
hi, i'm writing some code as below:

{code:java|title=marlkov.py|borderStyle=dashed|borderColor=#ccc|titleBGColor=#F7D6C1|bgColor=#CE}
from random import random
from operator import add
def funcx( x ):
  print x[0],x[1]
  return 1 if x[0]** 2 + x[1]** 2 < 1 else 0
def genRnd(ind):
  x=random() * 2 - 1
  y=random() * 2 - 1
  return (x,y)
def runsp(total):
  ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
y: x + y)/float(total) * 4
  print ret
runsp(3)
{code}

once started the pyspark shell, no matter how many times i run "runsp(N)" , 
this code always get a same sequece of random numbers, like this


{code:title=Output|borderStyle=solid}
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
{code}

i think this is because when we import pyspark.worker in the daemon.py, we alse 
import a random by the shuffle.py which is imported by pyspark.worker, this 
worker, forked by "pid = os.fork()", also remains the state of the parent's 
random, thus every forked worker get the same random.next().

we need to re-random the random by random.seed, which will solve the problem, 
but i think this PR. may not be the proper fix.
ths.


> Each forked worker  in daemon.py keep the parent's random state
> ---
>
> Key: SPARK-15611
> URL: https://issues.apache.org/jira/browse/SPARK-15611
> Project: Spark
>  Issue Type: Bug
>  Components: PySpark
>Affects Versions: 1.6.1
>Reporter: Thomas Lau
>Priority: Minor
>
> hi, i'm writing some code as below:
> {code:java|title=marlkov.py|borderStyle=dashed|borderColor=#ccc|titleBGColor=#F7D6C1|bgColor=#CE}
> from random import random
> from operator import add
> def funcx( x ):
>   print x[0],x[1]
>   return 1 if x[0]** 2 + x[1]** 2 < 1 else 0
> def genRnd(ind):
>   x=random() * 2 - 1
>   y=random() * 2 - 1
>   return (x,y)
> def runsp(total):
>   ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
> y: x + y)/float(total) * 4
>   print ret
> runsp(3)
> {code}
> once started the pyspark shell, no matter how many times i run "runsp(N)" , 
> this code always get a same sequece of random numbers, like this
> {code:title=Output|borderStyle=solid}
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.33

[jira] [Updated] (SPARK-15611) Each forked worker in daemon.py keep the parent's random state

[Thomas Lau (JIRA)]

 [ 
https://issues.apache.org/jira/browse/SPARK-15611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thomas Lau updated SPARK-15611:
---
Description: 
hi, i'm writing some code as below:

{code:java|title=marlkov.py|borderStyle=dashed|borderColor=#ccc|titleBGColor=#F7D6C1|bgColor=#CE}
from random import random
from operator import add
def funcx( x ):
  print x[0],x[1]
  return 1 if x[0]** 2 + x[1]** 2 < 1 else 0
def genRnd(ind):
  x=random() * 2 - 1
  y=random() * 2 - 1
  return (x,y)
def runsp(total):
  ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
y: x + y)/float(total) * 4
  print ret
runsp(3)
{code}

once started the pyspark shell, no matter how many times i run "runsp(N)" , 
this code always get a same sequece of random numbers, like this


{code:title=Output|borderStyle=solid}
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
{code}

i think this is because when we import pyspark.worker in the daemon.py, we alse 
import a random by the shuffle.py which is imported by pyspark.worker, this 
worker, forked by "pid = os.fork()", also remains the state of the parent's 
random, thus every forked worker get the same random.next().

we need to re-random the random by random.seed, which will solve the problem, 
but i think this PR. may not be the proper fix.
ths.

  was:
hi, i'm writing some code as below:

{code:python}
from random import random
from operator import add
def funcx( x ):
  print x[0],x[1]
  return 1 if x[0]** 2 + x[1]** 2 < 1 else 0
def genRnd(ind):
  x=random() * 2 - 1
  y=random() * 2 - 1
  return (x,y)
def runsp(total):
  ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
y: x + y)/float(total) * 4
  print ret
runsp(3)
{code}

once started the pyspark shell, no matter how many times i run "runsp(N)" , 
this code always get a same sequece of random numbers, like this

```sh
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
```
i think this is because when we import pyspark.worker in the daemon.py, we alse 
import a random by the shuffle.py which is imported by pyspark.worker, this 
worker, forked by "pid = os.fork()", also remains the state of the parent's 
random, thus every forked worker get the same random.next().

we need to re-random the random by random.seed, which will solve the problem, 
but i think this PR. may not be the proper fix.
ths.


> Each forked worker  in daemon.py keep the parent's random state
> ---
>
> Key: SPARK-15611
> URL: https://issues.apache.org/jira/browse/SPARK-15611
>         Project: Spark
>  Issue Type: Bug
>  Components: PySpark
>Affects Versions: 1.6.1
>Reporter: Thomas Lau
>Priority: Minor
>
> hi, i'm writing some code as below:
> {code:java|title=marlkov.py|borderStyle=dashed|borderColor=#ccc|titleBGColor=#F7D6C1|bgColor=#CE}
> from random import random
> from operator import add
> def funcx( x ):
>   print x[0],x[1]
>   return 1 if x[0]** 2 + x[1]** 2 < 1 else 0
> def genRnd(ind):
>   x=random() * 2 - 1
>   y=random() * 2 - 1
>   return (x,y)
> def runsp(total):
>   ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
> y: x + y)/float(total) * 4
>   print ret
> runsp(3)
> {code}
> once started the pyspark shell, no matter how many times i run "runsp(N)" , 
> this code always get a same sequece of random numbers, like this
> {code:title=Output|borderStyle=solid}
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> >>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
> >&g

[jira] [Updated] (SPARK-15611) Each forked worker in daemon.py keep the parent's random state

[Thomas Lau (JIRA)]

 [ 
https://issues.apache.org/jira/browse/SPARK-15611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thomas Lau updated SPARK-15611:
---
Description: 
hi, i'm writing some code as below:

{code:python}
from random import random
from operator import add
def funcx( x ):
  print x[0],x[1]
  return 1 if x[0]** 2 + x[1]** 2 < 1 else 0
def genRnd(ind):
  x=random() * 2 - 1
  y=random() * 2 - 1
  return (x,y)
def runsp(total):
  ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
y: x + y)/float(total) * 4
  print ret
runsp(3)
{code}

once started the pyspark shell, no matter how many times i run "runsp(N)" , 
this code always get a same sequece of random numbers, like this

```sh
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
```
i think this is because when we import pyspark.worker in the daemon.py, we alse 
import a random by the shuffle.py which is imported by pyspark.worker, this 
worker, forked by "pid = os.fork()", also remains the state of the parent's 
random, thus every forked worker get the same random.next().

we need to re-random the random by random.seed, which will solve the problem, 
but i think this PR. may not be the proper fix.
ths.

  was:
hi, i'm writing some code as below:

{quote}
from random import random
from operator import add
def funcx( x ):
  print x[0],x[1]
  return 1 if x[0]** 2 + x[1]** 2 < 1 else 0
def genRnd(ind):
  x=random() * 2 - 1
  y=random() * 2 - 1
  return (x,y)
def runsp(total):
  ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
y: x + y)/float(total) * 4
  print ret
runsp(3)
{quote}

once started the pyspark shell, no matter how many times i run "runsp(N)" , 
this code always get a same sequece of random numbers, like this

```sh
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
```
i think this is because when we import pyspark.worker in the daemon.py, we alse 
import a random by the shuffle.py which is imported by pyspark.worker, this 
worker, forked by "pid = os.fork()", also remains the state of the parent's 
random, thus every forked worker get the same random.next().

we need to re-random the random by random.seed, which will solve the problem, 
but i think this PR. may not be the proper fix.
ths.


> Each forked worker  in daemon.py keep the parent's random state
> ---
>
> Key: SPARK-15611
> URL: https://issues.apache.org/jira/browse/SPARK-15611
>         Project: Spark
>  Issue Type: Bug
>  Components: PySpark
>Affects Versions: 1.6.1
>Reporter: Thomas Lau
>Priority: Minor
>
> hi, i'm writing some code as below:
> {code:python}
> from random import random
> from operator import add
> def funcx( x ):
>   print x[0],x[1]
>   return 1 if x[0]** 2 + x[1]** 2 < 1 else 0
> def genRnd(ind):
>   x=random() * 2 - 1
>   y=random() * 2 - 1
>   return (x,y)
> def runsp(total):
>   ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
> y: x + y)/float(total) * 4
>   print ret
> runsp(3)
> {code}
> once started the pyspark shell, no matter how many times i run "runsp(N)" , 
> this code always get a same sequece of random numbers, like this
> ```sh
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> >>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
> >>>  * 4
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> >>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
> &

[jira] [Updated] (SPARK-15611) Each forked worker in daemon.py keep the parent's random state

[Thomas Lau (JIRA)]

 [ 
https://issues.apache.org/jira/browse/SPARK-15611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thomas Lau updated SPARK-15611:
---
Description: 
hi, i'm writing some code as below:

{quote}
from random import random
from operator import add
def funcx( x ):
  print x[0],x[1]
  return 1 if x[0]** 2 + x[1]** 2 < 1 else 0
def genRnd(ind):
  x=random() * 2 - 1
  y=random() * 2 - 1
  return (x,y)
def runsp(total):
  ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
y: x + y)/float(total) * 4
  print ret
runsp(3)
{quote}

once started the pyspark shell, no matter how many times i run "runsp(N)" , 
this code always get a same sequece of random numbers, like this

```sh
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
```
i think this is because when we import pyspark.worker in the daemon.py, we alse 
import a random by the shuffle.py which is imported by pyspark.worker, this 
worker, forked by "pid = os.fork()", also remains the state of the parent's 
random, thus every forked worker get the same random.next().

we need to re-random the random by random.seed, which will solve the problem, 
but i think this PR. may not be the proper fix.
ths.

  was:
hi, i'm writing some code as below:

```py
from random import random
from operator import add
def funcx( x ):
  print x[0],x[1]
  return 1 if x[0]** 2 + x[1]** 2 < 1 else 0
def genRnd(ind):
  x=random() * 2 - 1
  y=random() * 2 - 1
  return (x,y)
def runsp(total):
  ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
y: x + y)/float(total) * 4
  print ret
runsp(3)
```
once started the pyspark shell, no matter how many times i run "runsp(N)" , 
this code always get a same sequece of random numbers, like this

```sh
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
```
i think this is because when we import pyspark.worker in the daemon.py, we alse 
import a random by the shuffle.py which is imported by pyspark.worker, this 
worker, forked by "pid = os.fork()", also remains the state of the parent's 
random, thus every forked worker get the same random.next().

we need to re-random the random by random.seed, which will solve the problem, 
but i think this PR. may not be the proper fix.
ths.


> Each forked worker  in daemon.py keep the parent's random state
> ---
>
> Key: SPARK-15611
> URL: https://issues.apache.org/jira/browse/SPARK-15611
>         Project: Spark
>  Issue Type: Bug
>  Components: PySpark
>Affects Versions: 1.6.1
>Reporter: Thomas Lau
>Priority: Minor
>
> hi, i'm writing some code as below:
> {quote}
> from random import random
> from operator import add
> def funcx( x ):
>   print x[0],x[1]
>   return 1 if x[0]** 2 + x[1]** 2 < 1 else 0
> def genRnd(ind):
>   x=random() * 2 - 1
>   y=random() * 2 - 1
>   return (x,y)
> def runsp(total):
>   ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
> y: x + y)/float(total) * 4
>   print ret
> runsp(3)
> {quote}
> once started the pyspark shell, no matter how many times i run "runsp(N)" , 
> this code always get a same sequece of random numbers, like this
> ```sh
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> >>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
> >>>  * 4
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> >>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
> >>>  * 4
> 0.

[jira] [Updated] (SPARK-15611) Each forked worker in daemon.py keep the parent's random state

[Thomas Lau (JIRA)]

 [ 
https://issues.apache.org/jira/browse/SPARK-15611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thomas Lau updated SPARK-15611:
---
Summary: Each forked worker  in daemon.py keep the parent's random state  
(was: each forked worker  in daemon.py keep the parent's random state)

> Each forked worker  in daemon.py keep the parent's random state
> ---
>
> Key: SPARK-15611
> URL: https://issues.apache.org/jira/browse/SPARK-15611
> Project: Spark
>  Issue Type: Bug
>  Components: PySpark
>Affects Versions: 1.6.1
>    Reporter: Thomas Lau
>Priority: Minor
>
> hi, i'm writing some code as below:
> ```py
> from random import random
> from operator import add
> def funcx( x ):
>   print x[0],x[1]
>   return 1 if x[0]** 2 + x[1]** 2 < 1 else 0
> def genRnd(ind):
>   x=random() * 2 - 1
>   y=random() * 2 - 1
>   return (x,y)
> def runsp(total):
>   ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
> y: x + y)/float(total) * 4
>   print ret
> runsp(3)
> ```
> once started the pyspark shell, no matter how many times i run "runsp(N)" , 
> this code always get a same sequece of random numbers, like this
> ```sh
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> >>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
> >>>  * 4
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> >>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
> >>>  * 4
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> ```
> i think this is because when we import pyspark.worker in the daemon.py, we 
> alse import a random by the shuffle.py which is imported by pyspark.worker, 
> this worker, forked by "pid = os.fork()", also remains the state of the 
> parent's random, thus every forked worker get the same random.next().
> we need to re-random the random by random.seed, which will solve the problem, 
> but i think this PR. may not be the proper fix.
> ths.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Updated] (SPARK-15611) each forked worker in daemon.py keep the parent's random state

[Thomas Lau (JIRA)]

 [ 
https://issues.apache.org/jira/browse/SPARK-15611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thomas Lau updated SPARK-15611:
---
Description: 
hi, i'm writing some code as below:

```py
from random import random
from operator import add
def funcx( x ):
  print x[0],x[1]
  return 1 if x[0]**2 + x[1]**2 < 1 else 0
def genRnd(ind):
  x=random() * 2 - 1
  y=random() * 2 - 1
  return (x,y)
def runsp(total):
  ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
y: x + y)/float(total) * 4
  print ret
runsp(3)
```
once started the pyspark shell, no matter how many times i run "runsp(N)" , 
this code always get a same sequece of random numbers, like this

```sh
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
```
i think this is because when we import pyspark.worker in the daemon.py, we alse 
import a random by the shuffle.py which is imported by pyspark.worker, this 
worker, forked by "pid = os.fork()", also remains the state of the parent's 
random, thus every forked worker get the same random.next().

we need to re-random the random by random.seed, which will solve the problem, 
but i think this PR. may not be the proper fix.
ths.

  was:
hi, i'm writing some code as below:

```py
from random import random
from operator import add
def funcx(x):
  print x[0],x[1]
  return 1 if x[0]**2 + x[1]**2 < 1 else 0
def genRnd(ind):
  x=random() * 2 - 1
  y=random() * 2 - 1
  return (x,y)
def runsp(total):
  ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
y: x + y)/float(total) * 4
  print ret
runsp(3)
```
once started the pyspark shell, no matter how many times i run "runsp(N)" , 
this code always get a same sequece of random numbers, like this

```sh
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
```
i think this is because when we import pyspark.worker in the daemon.py, we alse 
import a random by the shuffle.py which is imported by pyspark.worker, this 
worker, forked by "pid = os.fork()", also remains the state of the parent's 
random, thus every forked worker get the same random.next().

we need to re-random the random by random.seed, which will solve the problem, 
but i think this PR. may not be the proper fix.
ths.


> each forked worker  in daemon.py keep the parent's random state
> ---
>
> Key: SPARK-15611
> URL: https://issues.apache.org/jira/browse/SPARK-15611
>         Project: Spark
>  Issue Type: Bug
>  Components: PySpark
>Affects Versions: 1.6.1
>Reporter: Thomas Lau
>Priority: Minor
>
> hi, i'm writing some code as below:
> ```py
> from random import random
> from operator import add
> def funcx( x ):
>   print x[0],x[1]
>   return 1 if x[0]**2 + x[1]**2 < 1 else 0
> def genRnd(ind):
>   x=random() * 2 - 1
>   y=random() * 2 - 1
>   return (x,y)
> def runsp(total):
>   ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
> y: x + y)/float(total) * 4
>   print ret
> runsp(3)
> ```
> once started the pyspark shell, no matter how many times i run "runsp(N)" , 
> this code always get a same sequece of random numbers, like this
> ```sh
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> >>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
> >>>  * 4
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> >>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
> >>>  * 4
> 0.896083541418 -0.63

[jira] [Updated] (SPARK-15611) each forked worker in daemon.py keep the parent's random state

[Thomas Lau (JIRA)]

 [ 
https://issues.apache.org/jira/browse/SPARK-15611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thomas Lau updated SPARK-15611:
---
Description: 
hi, i'm writing some code as below:

```py
from random import random
from operator import add
def funcx( x ):
  print x[0],x[1]
  return 1 if x[0]** 2 + x[1]** 2 < 1 else 0
def genRnd(ind):
  x=random() * 2 - 1
  y=random() * 2 - 1
  return (x,y)
def runsp(total):
  ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
y: x + y)/float(total) * 4
  print ret
runsp(3)
```
once started the pyspark shell, no matter how many times i run "runsp(N)" , 
this code always get a same sequece of random numbers, like this

```sh
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
```
i think this is because when we import pyspark.worker in the daemon.py, we alse 
import a random by the shuffle.py which is imported by pyspark.worker, this 
worker, forked by "pid = os.fork()", also remains the state of the parent's 
random, thus every forked worker get the same random.next().

we need to re-random the random by random.seed, which will solve the problem, 
but i think this PR. may not be the proper fix.
ths.

  was:
hi, i'm writing some code as below:

```py
from random import random
from operator import add
def funcx( x ):
  print x[0],x[1]
  return 1 if x[0]**2 + x[1]**2 < 1 else 0
def genRnd(ind):
  x=random() * 2 - 1
  y=random() * 2 - 1
  return (x,y)
def runsp(total):
  ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
y: x + y)/float(total) * 4
  print ret
runsp(3)
```
once started the pyspark shell, no matter how many times i run "runsp(N)" , 
this code always get a same sequece of random numbers, like this

```sh
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
```
i think this is because when we import pyspark.worker in the daemon.py, we alse 
import a random by the shuffle.py which is imported by pyspark.worker, this 
worker, forked by "pid = os.fork()", also remains the state of the parent's 
random, thus every forked worker get the same random.next().

we need to re-random the random by random.seed, which will solve the problem, 
but i think this PR. may not be the proper fix.
ths.


> each forked worker  in daemon.py keep the parent's random state
> ---
>
> Key: SPARK-15611
> URL: https://issues.apache.org/jira/browse/SPARK-15611
>         Project: Spark
>  Issue Type: Bug
>  Components: PySpark
>Affects Versions: 1.6.1
>Reporter: Thomas Lau
>Priority: Minor
>
> hi, i'm writing some code as below:
> ```py
> from random import random
> from operator import add
> def funcx( x ):
>   print x[0],x[1]
>   return 1 if x[0]** 2 + x[1]** 2 < 1 else 0
> def genRnd(ind):
>   x=random() * 2 - 1
>   y=random() * 2 - 1
>   return (x,y)
> def runsp(total):
>   ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
> y: x + y)/float(total) * 4
>   print ret
> runsp(3)
> ```
> once started the pyspark shell, no matter how many times i run "runsp(N)" , 
> this code always get a same sequece of random numbers, like this
> ```sh
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> >>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
> >>>  * 4
> 0.896083541418 -0.635625854075
> -0.0423532645466 -0.526910255885
> 0.498518696049 -0.872983895832
> 1.
> >>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
> >>>  * 4
> 0.89608354

[jira] [Created] (SPARK-15611) each forked worker in daemon.py keep the parent's random state

[Thomas Lau (JIRA)]

Thomas Lau created SPARK-15611:
--

 Summary: each forked worker  in daemon.py keep the parent's random 
state
 Key: SPARK-15611
 URL: https://issues.apache.org/jira/browse/SPARK-15611
 Project: Spark
  Issue Type: Bug
  Components: PySpark
Affects Versions: 1.6.1
Reporter: Thomas Lau
Priority: Minor


hi, i'm writing some code as below:

```py
from random import random
from operator import add
def funcx(x):
  print x[0],x[1]
  return 1 if x[0]**2 + x[1]**2 < 1 else 0
def genRnd(ind):
  x=random() * 2 - 1
  y=random() * 2 - 1
  return (x,y)
def runsp(total):
  ret=sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(lambda x, 
y: x + y)/float(total) * 4
  print ret
runsp(3)
```
once started the pyspark shell, no matter how many times i run "runsp(N)" , 
this code always get a same sequece of random numbers, like this

```sh
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
>>> sc.parallelize(xrange(total),1).map(genRnd).map(funcx).reduce(add)/float(total)
>>>  * 4
0.896083541418 -0.635625854075
-0.0423532645466 -0.526910255885
0.498518696049 -0.872983895832
1.
```
i think this is because when we import pyspark.worker in the daemon.py, we alse 
import a random by the shuffle.py which is imported by pyspark.worker, this 
worker, forked by "pid = os.fork()", also remains the state of the parent's 
random, thus every forked worker get the same random.next().

we need to re-random the random by random.seed, which will solve the problem, 
but i think this PR. may not be the proper fix.
ths.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[pfSense] pfSense NAT UDP port forwarding packet lost

[Thomas Lau]

Ping Packet loss between OpenVPN point to point interface: (notice 1754 ->
loss -> 1775)


Network Diagram:


OpenVPN point to point interface: 172.24.0.17 <> 172.24.0.18
OpenVPN UDP port: 15172

pfSense setup:




Once I put public IP x.x.x.20 on OpenVPN server directly, everything just
go fine.

-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: Suite 2716, Two IFC, Central, Hong Kong
___
pfSense mailing list
https://lists.pfsense.org/mailman/listinfo/list
Support the project with Gold! https://pfsense.org/gold

[Freeipa-users] Ticket transfer from host to host

[Thomas Lau]

​Hi all,

I am running FreeIPA 3.3.x in our environment. First I did is kinit on
client 1, then ssh to host A, it works fine; But then if I want to ssh from
host A to host B, I have to do kinit again, is there have a way to do
ticket transfer? Or is it call "Ticket Delegation"? How could I config it
to function properly?​
-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go to http://freeipa.org for more info on the project

Re: [Freeipa-users] Ticket transfer from host to host

[Thomas Lau]

Hi Rob,

So what you are trying to say is that it's nothing to do with FreeIPA but
ssh client itself?

On Mon, Nov 30, 2015 at 11:39 AM, Rob Crittenden <rcrit...@redhat.com>
wrote:

> Thomas Lau wrote:
> > ​Hi all,
> >
> > I am running FreeIPA 3.3.x in our environment. First I did is kinit on
> > client 1, then ssh to host A, it works fine; But then if I want to ssh
> > from host A to host B, I have to do kinit again, is there have a way to
> > do ticket transfer? Or is it call "Ticket Delegation"? How could I
> > config it to function properly?​
> >
> >
>
> man ssh
>
>  -K  Enables GSSAPI-based authentication and forwarding
> (delegation)
>  of GSSAPI credentials to the server.
>
> rob
>
-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go to http://freeipa.org for more info on the project

[Freeipa-users] IPA client enrollment check

[Thomas Lau]

Does anyone know how could I check if client enrolled or not?

trying to automate enrollment process by using generic tool since I am
using Ubuntu, only ipa-client-install available.

-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go to http://freeipa.org for more info on the project

[bareos-users] important files to backup for Bareos Director

[Thomas Lau]

Hi All,

I know Catalog and Bootstrap are the most important files to backup on
Bareos Director, so in the case of bareos system crash, how do you recover
bootstrap and catalog files from existing bareos backup volume? should I
use bscan then bextract?

-- 
You received this message because you are subscribed to the Google Groups 
bareos-users group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[bareos-users] Windows config file location

[Thomas Lau]

Anyone know where is the config file for bareos on Windows FD?

-- 
You received this message because you are subscribed to the Google Groups 
bareos-users group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Freeipa-users] FreeIPA 3.3.3 backup and restore

[Thomas Lau]

CentOS Linux release 7.0.1406 (Core)  - this is the version we are using
now.

On Wed, May 27, 2015 at 5:54 PM, Martin Kosek mko...@redhat.com wrote:

 On 05/27/2015 04:14 AM, Thomas Lau wrote:
  Hi All,
 
  I was reading this page but seems very confusing:
 
 https://www.freeipa.org/page/V3/Backup_and_Restore#Data_Backup_.26_Restore_Process_.28online.29

 We also have this:
 https://www.freeipa.org/page/Backup_and_Restore

  ​ipa-backup and ipa-restore command doesn't exists.

 What platform do you use? RHEL/CentOS speaking, the command was introduced
 in 7.1.

  I know full system
  backup works, but is there have a way to do core Kerberos DB backup? or
 the
  most important DB would be LDAP only?​

 Yup, this is what ipa-backup does.

  ​Other than full system backup, is there have any other way to do backup
  and restore for FreeIPA?​

 ipa-backup/ipa-restore in RHEL-7.1+.

-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go to http://freeipa.org for more info on the project

[Freeipa-users] FreeIPA 3.3.3 backup and restore

[Thomas Lau]

Hi All,

I was reading this page but seems very confusing:
https://www.freeipa.org/page/V3/Backup_and_Restore#Data_Backup_.26_Restore_Process_.28online.29

​ipa-backup and ipa-restore command doesn't exists. I know full system
backup works, but is there have a way to do core Kerberos DB backup? or the
most important DB would be LDAP only?​


​Other than full system backup, is there have any other way to do backup
and restore for FreeIPA?​
-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go to http://freeipa.org for more info on the project

Re: [Freeipa-users] FreeIPA cluster shutdown sequence

[Thomas Lau]

thanks, sorry that I missed that message.

On Mon, May 4, 2015 at 4:33 PM, David Kupka dku...@redhat.com wrote:
 On 05/04/2015 07:09 AM, Thomas Lau wrote:

 Hi All,

 We got a power maintenance soon, so all servers need to shutdown. Is
 there have a shutdown / starting up procedure for FreeIPA cluster? We
 are currently running two node cluster.


 Hello,
 as I responded a month ago
 (https://www.redhat.com/archives/freeipa-users/2015-April/msg00016.html)
 there is no special procedure. You just turn the servers off before the
 power outage and then turn them back on.

 --
 David Kupka



-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong

-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go to http://freeipa.org for more info on the project

[Freeipa-users] FreeIPA cluster shutdown sequence

[Thomas Lau]

Hi All,

We got a power maintenance soon, so all servers need to shutdown. Is
there have a shutdown / starting up procedure for FreeIPA cluster? We
are currently running two node cluster.

-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go to http://freeipa.org for more info on the project

Re: [Freeipa-users] CRON: Authentication service cannot retrieve authentication info

[Thomas Lau]

I think the semi-online status cause SSSD confused about what to do
and causing it to timeout.

So that means no fix for now.

On Thu, Apr 16, 2015 at 11:10 AM, Dmitri Pal d...@redhat.com wrote:
 On 04/15/2015 10:17 PM, Thomas Lau wrote:

 Hi,

 I just checked with developer, there is no authentication related code
 in the program, we could treat it as normal cron job.

 is that possible to make sssd less contact with FreeIPA? for example,
 refresh all user info every 5 minutes, else use cache info.


 OK, thanks for clarification.
 Then it is SSSD.

 It would be hard to understand where the problem is.
 For authentication SSSD does online if it knows that it is online. Packet
 loss can cause it to loose connection and time out.
 It might not failing over to offline mode as it is semi online because of
 the packet loss and retries.

 The SSSD logs would really be helpful to diagnose the issue.
 Also https://fedorahosted.org/sssd/ticket/1807 might be what you are looking
 for. It is being worked on for the next release.


 On Tue, Apr 14, 2015 at 10:07 PM, Dmitri Pal d...@redhat.com wrote:

 On 04/13/2015 10:41 PM, Thomas Lau wrote:

 Hi,

 It's an in-house program which runs on one kerberos user.

 You need to look what this program is doing.
 I suspect it is doing some sort of kinit itself and does not rely on the
 PAM
 stack, i.e it bypasses SSSD in the given scenario.
 Can this be the case?


 On Tue, Apr 14, 2015 at 5:34 AM, Dmitri Pal d...@redhat.com wrote:

 On 04/13/2015 08:23 AM, Thomas Lau wrote:

 Hi,

 These problem appear randomly, sometime it still work even under heavy
 packet loss, some times would be like this. So its hard to catch.

 On Apr 13, 2015 3:22 PM, Jakub Hrozek jhro...@redhat.com wrote:

 On Mon, Apr 13, 2015 at 01:15:09PM +0800, Thomas Lau wrote:

 Hi all,

 We have cronjob which running on a FreeIPA LDAP user; When connection
 between IPA server and client having heavy packet loss, following
 error would occur:

 CRON[20637]: Authentication service cannot retrieve authentication
 info

 I have cache credentials and store password if offline enabled on
 sssd, how these problem would still happening?


 It might be that the cause of the problem is actually the packet loss
 or
 some kind of delay.
 SSSD might not think that it is offline but cron job itself times out
 and
 reports failure.
 Do you know what operation in the job fails?


 sssd.conf:

 cache_credentials = True
 krb5_store_password_if_offline = True

 Did the use log in at least once offline? You can verify if the
 password
 has been cached using the ldbsearch utility. It would be best to catch
 the occurence of the problem in logs.

 --
 Manage your subscription for the Freeipa-users mailing list:
 https://www.redhat.com/mailman/listinfo/freeipa-users
 Go to http://freeipa.org for more info on the project





 --
 Thank you,
 Dmitri Pal

 Sr. Engineering Manager IdM portfolio
 Red Hat, Inc.


 --
 Manage your subscription for the Freeipa-users mailing list:
 https://www.redhat.com/mailman/listinfo/freeipa-users
 Go to http://freeipa.org for more info on the project




 --
 Thank you,
 Dmitri Pal

 Sr. Engineering Manager IdM portfolio
 Red Hat, Inc.





 --
 Thank you,
 Dmitri Pal

 Sr. Engineering Manager IdM portfolio
 Red Hat, Inc.




-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong

-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go to http://freeipa.org for more info on the project

Re: [Freeipa-users] CRON: Authentication service cannot retrieve authentication info

[Thomas Lau]

Hi,

It's an in-house program which runs on one kerberos user.

On Tue, Apr 14, 2015 at 5:34 AM, Dmitri Pal d...@redhat.com wrote:
 On 04/13/2015 08:23 AM, Thomas Lau wrote:

 Hi,

 These problem appear randomly, sometime it still work even under heavy
 packet loss, some times would be like this. So its hard to catch.

 On Apr 13, 2015 3:22 PM, Jakub Hrozek jhro...@redhat.com wrote:

 On Mon, Apr 13, 2015 at 01:15:09PM +0800, Thomas Lau wrote:
  Hi all,
 
  We have cronjob which running on a FreeIPA LDAP user; When connection
  between IPA server and client having heavy packet loss, following
  error would occur:
 
  CRON[20637]: Authentication service cannot retrieve authentication info
 
  I have cache credentials and store password if offline enabled on
  sssd, how these problem would still happening?


 It might be that the cause of the problem is actually the packet loss or
 some kind of delay.
 SSSD might not think that it is offline but cron job itself times out and
 reports failure.
 Do you know what operation in the job fails?


 
 
  sssd.conf:
 
  cache_credentials = True
  krb5_store_password_if_offline = True

 Did the use log in at least once offline? You can verify if the password
 has been cached using the ldbsearch utility. It would be best to catch
 the occurence of the problem in logs.

 --
 Manage your subscription for the Freeipa-users mailing list:
 https://www.redhat.com/mailman/listinfo/freeipa-users
 Go to http://freeipa.org for more info on the project





 --
 Thank you,
 Dmitri Pal

 Sr. Engineering Manager IdM portfolio
 Red Hat, Inc.


 --
 Manage your subscription for the Freeipa-users mailing list:
 https://www.redhat.com/mailman/listinfo/freeipa-users
 Go to http://freeipa.org for more info on the project



-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong

-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go to http://freeipa.org for more info on the project

Re: [Freeipa-users] CRON: Authentication service cannot retrieve authentication info

[Thomas Lau]

Hi,

These problem appear randomly, sometime it still work even under heavy
packet loss, some times would be like this. So its hard to catch.
On Apr 13, 2015 3:22 PM, Jakub Hrozek jhro...@redhat.com wrote:

 On Mon, Apr 13, 2015 at 01:15:09PM +0800, Thomas Lau wrote:
  Hi all,
 
  We have cronjob which running on a FreeIPA LDAP user; When connection
  between IPA server and client having heavy packet loss, following
  error would occur:
 
  CRON[20637]: Authentication service cannot retrieve authentication info
 
  I have cache credentials and store password if offline enabled on
  sssd, how these problem would still happening?
 
 
  sssd.conf:
 
  cache_credentials = True
  krb5_store_password_if_offline = True

 Did the use log in at least once offline? You can verify if the password
 has been cached using the ldbsearch utility. It would be best to catch
 the occurence of the problem in logs.

 --
 Manage your subscription for the Freeipa-users mailing list:
 https://www.redhat.com/mailman/listinfo/freeipa-users
 Go to http://freeipa.org for more info on the project

-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go to http://freeipa.org for more info on the project

[Freeipa-users] CRON: Authentication service cannot retrieve authentication info

[Thomas Lau]

Hi all,

We have cronjob which running on a FreeIPA LDAP user; When connection
between IPA server and client having heavy packet loss, following
error would occur:

CRON[20637]: Authentication service cannot retrieve authentication info

I have cache credentials and store password if offline enabled on
sssd, how these problem would still happening?


sssd.conf:

cache_credentials = True
krb5_store_password_if_offline = True

-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go to http://freeipa.org for more info on the project

[Freeipa-users] Power down all FreeIPA servers

[Thomas Lau]

Hi all,

we are going to have power maintenance and needed to shutdown two core
FreeIPA server. Is there have any sequence to shutdown and power on FreeIPA
server? Anything I need to aware of?
-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go to http://freeipa.org for more info on the project

Re: [Gluster-users] GlusterFS geo-replication can't start even start command successful

[Thomas Lau]

Found the problem, a bug on ubuntu package.

On Fri, Jan 9, 2015 at 2:08 AM, Vijay Bellur vbel...@redhat.com wrote:
 On 01/07/2015 04:57 PM, Thomas Lau wrote:

 root@test1:/home# gluster volume geo-replication testvol1
 repl2.domain.com::testvol2 start
 Starting geo-replication session between testvol1 
 repl2.domain.com::testvol2 has been successful
 root@test1:/home# gluster volume geo-replication testvol1
 repl2.domain.com::testvol2 status

 MASTER NODEMASTER VOLMASTER BRICK  SLAVE
STATUS CHECKPOINT STATUSCRAWL STATUS

 --
 test1  testvol1  /home/testvol1
 repl2.domain.com::testvol2Not StartedN/A  N/A


 root@test1:/home# cat /etc/hosts | grep domain
 172.16.0.1 repl1.domain.com
 172.16.0.2 repl2.domain.com
 root@test1:/home# uname -a
 Linux test1 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC
 2014 x86_64 x86_64 x86_64 GNU/Linux
 root@test1:/home# cat /etc/glusterfs/glusterd.vol
 volume management
  type mgmt/glusterd
  option working-directory /var/lib/glusterd
  option transport-type socket,rdma
  option transport.socket.keepalive-time 10
  option transport.socket.keepalive-interval 2
  option transport.socket.read-fail-log off
 #   option base-port 49152
 end-volume
 root@test1:/home# lsb_release  -a
 No LSB modules are available.
 Distributor ID: Ubuntu
 Description: Ubuntu 14.04.1 LTS
 Release: 14.04
 Codename: trusty

 

 Any idea?



 Which version of glusterfs is in use here? Geo-replication has changed quite
 a bit over the last few releases. Recommend using a 3.5.x or 3.6.x release
 of glusterfs for geo-replication.

 Regards,
 Vijay







-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

[Gluster-users] GlusterFS geo-replication can't start even start command successful

[Thomas Lau]

root@test1:/home# gluster volume geo-replication testvol1
repl2.domain.com::testvol2 start
Starting geo-replication session between testvol1 
repl2.domain.com::testvol2 has been successful
root@test1:/home# gluster volume geo-replication testvol1
repl2.domain.com::testvol2 status

MASTER NODEMASTER VOLMASTER BRICK  SLAVE
  STATUS CHECKPOINT STATUSCRAWL STATUS
--
test1  testvol1  /home/testvol1
repl2.domain.com::testvol2Not StartedN/A  N/A


root@test1:/home# cat /etc/hosts | grep domain
172.16.0.1 repl1.domain.com
172.16.0.2 repl2.domain.com
root@test1:/home# uname -a
Linux test1 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC
2014 x86_64 x86_64 x86_64 GNU/Linux
root@test1:/home# cat /etc/glusterfs/glusterd.vol
volume management
type mgmt/glusterd
option working-directory /var/lib/glusterd
option transport-type socket,rdma
option transport.socket.keepalive-time 10
option transport.socket.keepalive-interval 2
option transport.socket.read-fail-log off
#   option base-port 49152
end-volume
root@test1:/home# lsb_release  -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 14.04.1 LTS
Release: 14.04
Codename: trusty



Any idea?

-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

Re: Windows 7 VM BSOD

[Thomas Lau]

Hi Vadim,

Now turning on is OK somehow, shutdown still stuck.

On Tue, Dec 9, 2014 at 4:03 PM, Vadim Rozenfeld vroze...@redhat.com wrote:
 On Tue, 2014-12-09 at 15:54 +0800, Thomas Lau wrote:
 I changed CPU type to Westmere, it boot up with 0x05C BSOD

 It should be four parameters printed on the screen, right below
 the error code string. Could you please post them?

 Vadim.


 On Tue, Dec 9, 2014 at 3:10 PM, Vadim Rozenfeld vroze...@redhat.com wrote:
  On Tue, 2014-12-09 at 11:54 +0800, Thomas Lau wrote:
  Hi Vadim,
 
  I want to quote back to your original post back in early 2014:
  https://www.mail-archive.com/kvm@vger.kernel.org/msg99782.html
 
 
  According to 
  http://msdn.microsoft.com/en-us/library/windows/hardware/ff559069(v=vs.85).aspx
   the 0x5C means HAL_INITIALIZATION_FAILED
 
  Problem matched exactly, which I am using CPU IvyBridge-EP and I got
  same BSOD as well.
 
  Some CPU flags (feature bits) should be missing.
  Can you try changing cpu type?
 
  Best regards,
  Vadim.
 
 
  Are we missing some hyperv feature?
 
  On Wed, Dec 3, 2014 at 7:29 PM, Vadim Rozenfeld vroze...@redhat.com 
  wrote:
   If you run WS2008(R2) or Win7 - always turn on relaxed timing. Otherwise
   it's just a matter of time when you hit 101 BOSD.
   Bugcheck 78 is quite rare one. What is your setup, and how easy it's
   reproducible?
  
   Best regards,
   Vadim.
  
   On Wed, 2014-12-03 at 19:13 +0800, Thomas Lau wrote:
   it works on your side meaning that you had such issue but afterwards
   it's all fixed by apply hv_relaxed ?
  
   On Wed, Dec 3, 2014 at 7:08 PM, Zhang Haoyu zhan...@sangfor.com 
   wrote:
https://bugzilla.redhat.com/show_bug.cgi?id=893857
   
In fact I am doing testing now, but are we fixing one problem and
introduce other problem?!
   
I'm not sure about this, but it works on my side,
I think BSOD(error:0x0078) has been fixed,
please show your environment.
   
Thanks,
Zhang Haoyu
On Wed, Dec 3, 2014 at 6:36 PM, Thomas Lau 
t...@tetrioncapital.com wrote:
 Hi,

 How do I know if my qemu-kvm version support this?

 On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu zhan...@sangfor.com 
 wrote:
 Hi All,

 I am running 3.13.0-24-generic kernel on Ubuntu 14, Windows 7 VM
 installation was fine, but it does random reboot by itself, the 
 error
 code is 0x0101, does anyone know how to fix this?
 Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.

 Thanks,
 Zhang Haoyu
   
   --
   To unsubscribe from this list: send the line unsubscribe kvm in
   the body of a message to majord...@vger.kernel.org
   More majordomo info at  http://vger.kernel.org/majordomo-info.html
  
  
 
 
 
 
 








-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Windows 7 VM BSOD

[Thomas Lau]

I briefly tested Penryn, Westmere. Bug still could reproduce.

how could I set level, model and enforce on libvirt ?! I could also
test it if you could tell me how to add those options on libvirtd.

On Wed, Dec 10, 2014 at 2:19 PM, Vadim Rozenfeld vroze...@redhat.com wrote:
 On Wed, 2014-12-10 at 08:51 +0800, t...@tetrioncapital.com wrote:
 Hi,

 Anything you want me to try on my side?

 There is an open bug in bugzilla which looks
 pretty similar to your problem
 https://bugzilla.redhat.com/show_bug.cgi?id=1139928

 Please take a look at comment #18 posted by Eduardo
  https://bugzilla.redhat.com/show_bug.cgi?id=1139928#c18

 Best regards,
 Vadim.

 Sent from my BlackBerry 10 smartphone.

 Thomas Lau
 Director of Infrastructure
 Tetrion Capital Limited

 Direct: +852-3976-8903
 Mobile: +852-9323-9670
 Address: 20/F, IFC 1, Central district, Hong Kong
   Original Message
 From: Thomas Lau
 Sent: Tuesday, 9 December, 2014 4:24 PM
 To: Vadim Rozenfeld
 Cc: Zhang Haoyu; kvm; imammedo
 Subject: Re: Windows 7 VM BSOD

 Hi Vadim,

 Now turning on is OK somehow, shutdown still stuck.

 On Tue, Dec 9, 2014 at 4:03 PM, Vadim Rozenfeld vroze...@redhat.com wrote:
  On Tue, 2014-12-09 at 15:54 +0800, Thomas Lau wrote:
  I changed CPU type to Westmere, it boot up with 0x05C BSOD
 
  It should be four parameters printed on the screen, right below
  the error code string. Could you please post them?
 
  Vadim.
 
 
  On Tue, Dec 9, 2014 at 3:10 PM, Vadim Rozenfeld vroze...@redhat.com 
  wrote:
   On Tue, 2014-12-09 at 11:54 +0800, Thomas Lau wrote:
   Hi Vadim,
  
   I want to quote back to your original post back in early 2014:
   https://www.mail-archive.com/kvm@vger.kernel.org/msg99782.html
  
  
   According to 
   http://msdn.microsoft.com/en-us/library/windows/hardware/ff559069(v=vs.85).aspx
   the 0x5C means HAL_INITIALIZATION_FAILED
  
   Problem matched exactly, which I am using CPU IvyBridge-EP and I got
   same BSOD as well.
  
   Some CPU flags (feature bits) should be missing.
   Can you try changing cpu type?
  
   Best regards,
   Vadim.
  
  
   Are we missing some hyperv feature?
  
   On Wed, Dec 3, 2014 at 7:29 PM, Vadim Rozenfeld vroze...@redhat.com 
   wrote:
If you run WS2008(R2) or Win7 - always turn on relaxed timing. 
Otherwise
it's just a matter of time when you hit 101 BOSD.
Bugcheck 78 is quite rare one. What is your setup, and how easy it's
reproducible?
   
Best regards,
Vadim.
   
On Wed, 2014-12-03 at 19:13 +0800, Thomas Lau wrote:
it works on your side meaning that you had such issue but 
afterwards
it's all fixed by apply hv_relaxed ?
   
On Wed, Dec 3, 2014 at 7:08 PM, Zhang Haoyu zhan...@sangfor.com 
wrote:
 https://bugzilla.redhat.com/show_bug.cgi?id=893857

 In fact I am doing testing now, but are we fixing one problem and
 introduce other problem?!

 I'm not sure about this, but it works on my side,
 I think BSOD(error:0x0078) has been fixed,
 please show your environment.

 Thanks,
 Zhang Haoyu
 On Wed, Dec 3, 2014 at 6:36 PM, Thomas Lau 
 t...@tetrioncapital.com wrote:
  Hi,
 
  How do I know if my qemu-kvm version support this?
 
  On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu 
  zhan...@sangfor.com wrote:
  Hi All,
 
  I am running 3.13.0-24-generic kernel on Ubuntu 14, Windows 
  7 VM
  installation was fine, but it does random reboot by itself, 
  the error
  code is 0x0101, does anyone know how to fix this?
  Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.
 
  Thanks,
  Zhang Haoyu

--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
   
   
  
  
  
  
  
 
 
 
 
 








-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

[Freeipa-users] Change default password expiry date

[Thomas Lau]

Hi All,

FreeIPA Default is using 60days password expiry, how could I change it?

Also, for existing accounts, can I just change krbPasswordExpiration
on LDAP? anywhere else I need to change? do I need to generate keytab
on Kerberos to activate new expiry date?

-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go To http://freeipa.org for more info on the project

[Freeipa-users] change directory manager password

[Thomas Lau]

Hi All,

Does anyone know to change directory manager password?

-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go To http://freeipa.org for more info on the project

Re: [Freeipa-users] change directory manager password

[Thomas Lau]

By the way, if I change Directory manager password, do I need to do
anything else for replication cluster?

On Wed, Dec 10, 2014 at 10:45 AM, Thomas Lau t...@tetrioncapital.com wrote:
 Hi All,

 Does anyone know to change directory manager password?



-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong

-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go To http://freeipa.org for more info on the project

Re: [Freeipa-users] change directory manager password

[Thomas Lau]

Hi All,

So I am using FreeIPA 3.3.3, when I change password on one IPA host,
the other clusters will in sync with the change or I need to do it one
by one manually?

On Wed, Dec 10, 2014 at 12:03 PM, Simo Sorce s...@redhat.com wrote:
 On Tue, 09 Dec 2014 20:33:32 -0700
 Rich Megginson rmegg...@redhat.com wrote:

 On 12/09/2014 07:46 PM, Thomas Lau wrote:
  By the way, if I change Directory manager password, do I need to do
  anything else for replication cluster?

 http://www.port389.org/docs/389ds/howto/howto-resetdirmgrpassword.html

 Unless you are using directory manager for replication (please tell
 me you are not), you shouldn't have to do anything.

 Given this is freeipa-users I assume ipa-replica-install/manage
 converted his replication agreements to use GSSAPI :-)

 So, no, in FreeIPA replication doesn't care about the DM password.

 Simo.

 --
 Simo Sorce * Red Hat, Inc * New York

 --
 Manage your subscription for the Freeipa-users mailing list:
 https://www.redhat.com/mailman/listinfo/freeipa-users
 Go To http://freeipa.org for more info on the project



-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong

-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go To http://freeipa.org for more info on the project

Windows 7 stable running setting

[Thomas Lau]

Hi All,

I want to recap the previous discussion that I had BSOD due to
following config is missing, after applied those settings, Windows 7
running a lot more stable than before, but BSOD still appear once in a
while, anyone could show KVM options which makes Windows 7 stable
running for months please?

My missing settings:
hv_relaxed
hv_vapic
hv_spinlocks, retries 8191
__

I read somewhere mention something related with hv_reftime, but Google
didn't show any patch related to it. Any idea?

-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Windows 7 0x0000005C

[Thomas Lau]

Hi All,

When I try to shutdown Windows 7 on KVM, it shows 0x05C BSOD, anyone
know why it happens?

-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Windows 7 VM BSOD

[Thomas Lau]

Hi Vadim,

I want to quote back to your original post back in early 2014:
https://www.mail-archive.com/kvm@vger.kernel.org/msg99782.html


According to 
http://msdn.microsoft.com/en-us/library/windows/hardware/ff559069(v=vs.85).aspx
 the 0x5C means HAL_INITIALIZATION_FAILED

Problem matched exactly, which I am using CPU IvyBridge-EP and I got
same BSOD as well.

Are we missing some hyperv feature?

On Wed, Dec 3, 2014 at 7:29 PM, Vadim Rozenfeld vroze...@redhat.com wrote:
 If you run WS2008(R2) or Win7 - always turn on relaxed timing. Otherwise
 it's just a matter of time when you hit 101 BOSD.
 Bugcheck 78 is quite rare one. What is your setup, and how easy it's
 reproducible?

 Best regards,
 Vadim.

 On Wed, 2014-12-03 at 19:13 +0800, Thomas Lau wrote:
 it works on your side meaning that you had such issue but afterwards
 it's all fixed by apply hv_relaxed ?

 On Wed, Dec 3, 2014 at 7:08 PM, Zhang Haoyu zhan...@sangfor.com wrote:
  https://bugzilla.redhat.com/show_bug.cgi?id=893857
 
  In fact I am doing testing now, but are we fixing one problem and
  introduce other problem?!
 
  I'm not sure about this, but it works on my side,
  I think BSOD(error:0x0078) has been fixed,
  please show your environment.
 
  Thanks,
  Zhang Haoyu
  On Wed, Dec 3, 2014 at 6:36 PM, Thomas Lau t...@tetrioncapital.com 
  wrote:
   Hi,
  
   How do I know if my qemu-kvm version support this?
  
   On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu zhan...@sangfor.com wrote:
   Hi All,
  
   I am running 3.13.0-24-generic kernel on Ubuntu 14, Windows 7 VM
   installation was fine, but it does random reboot by itself, the error
   code is 0x0101, does anyone know how to fix this?
   Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.
  
   Thanks,
   Zhang Haoyu
 
 --
 To unsubscribe from this list: send the line unsubscribe kvm in
 the body of a message to majord...@vger.kernel.org
 More majordomo info at  http://vger.kernel.org/majordomo-info.html





-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Windows 7 VM BSOD

[Thomas Lau]

I changed CPU type to Westmere, it boot up with 0x05C BSOD

On Tue, Dec 9, 2014 at 3:10 PM, Vadim Rozenfeld vroze...@redhat.com wrote:
 On Tue, 2014-12-09 at 11:54 +0800, Thomas Lau wrote:
 Hi Vadim,

 I want to quote back to your original post back in early 2014:
 https://www.mail-archive.com/kvm@vger.kernel.org/msg99782.html


 According to 
 http://msdn.microsoft.com/en-us/library/windows/hardware/ff559069(v=vs.85).aspx
  the 0x5C means HAL_INITIALIZATION_FAILED

 Problem matched exactly, which I am using CPU IvyBridge-EP and I got
 same BSOD as well.

 Some CPU flags (feature bits) should be missing.
 Can you try changing cpu type?

 Best regards,
 Vadim.


 Are we missing some hyperv feature?

 On Wed, Dec 3, 2014 at 7:29 PM, Vadim Rozenfeld vroze...@redhat.com wrote:
  If you run WS2008(R2) or Win7 - always turn on relaxed timing. Otherwise
  it's just a matter of time when you hit 101 BOSD.
  Bugcheck 78 is quite rare one. What is your setup, and how easy it's
  reproducible?
 
  Best regards,
  Vadim.
 
  On Wed, 2014-12-03 at 19:13 +0800, Thomas Lau wrote:
  it works on your side meaning that you had such issue but afterwards
  it's all fixed by apply hv_relaxed ?
 
  On Wed, Dec 3, 2014 at 7:08 PM, Zhang Haoyu zhan...@sangfor.com wrote:
   https://bugzilla.redhat.com/show_bug.cgi?id=893857
  
   In fact I am doing testing now, but are we fixing one problem and
   introduce other problem?!
  
   I'm not sure about this, but it works on my side,
   I think BSOD(error:0x0078) has been fixed,
   please show your environment.
  
   Thanks,
   Zhang Haoyu
   On Wed, Dec 3, 2014 at 6:36 PM, Thomas Lau t...@tetrioncapital.com 
   wrote:
Hi,
   
How do I know if my qemu-kvm version support this?
   
On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu zhan...@sangfor.com 
wrote:
Hi All,
   
I am running 3.13.0-24-generic kernel on Ubuntu 14, Windows 7 VM
installation was fine, but it does random reboot by itself, the 
error
code is 0x0101, does anyone know how to fix this?
Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.
   
Thanks,
Zhang Haoyu
  
  --
  To unsubscribe from this list: send the line unsubscribe kvm in
  the body of a message to majord...@vger.kernel.org
  More majordomo info at  http://vger.kernel.org/majordomo-info.html
 
 








-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

[libvirt-users] all.accept_redirects force disabled with libvirt

[Thomas Lau]

Hi All,

I was having trouble to enable all.accept_redirects due to our network
structure, we have to enable it, but all libvirt installed machines
contain this setting:
net.ipv4.conf.all.accept_redirects = 0

I even use sysctl.conf to force to enable it, still no go, anyone know why?

-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong

___
libvirt-users mailing list
libvirt-users@redhat.com
https://www.redhat.com/mailman/listinfo/libvirt-users

bridge mode without network rework

[Thomas Lau]

Hi All,

I just wondering is it possible not to rework our host machine network
structure to get KVM guest working on bridge mode? Current
implementation is using brctl to control it, which is destructive
especially you have a host which is using that network card to connect
internet.
--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: kvm ivy bridge support?

[Thomas Lau]

virsh cpu-models x86_64 | sort

486
Conroe
Haswell
Nehalem
Opteron_G1
Opteron_G2
Opteron_G3
Opteron_G4
Opteron_G5
Penryn
SandyBridge
Westmere
athlon
core2duo
coreduo
cpu64-rhel5
cpu64-rhel6
kvm32
kvm64
n270
pentium
pentium2
pentium3
pentiumpro
phenom
qemu32
qemu64

interesting that it doesn't have Ivy Bridge, any reason?

On Fri, Dec 5, 2014 at 3:29 PM, Paolo Bonzini pbonz...@redhat.com wrote:


 On 05/12/2014 02:33, t...@tetrioncapital.com wrote:
 May I know how could I check CPU support list on KVM?

 QEMU: qemu-kvm -cpu help|grep x86

 (or /usr/libexec/qemu-kvm -cpu help|grep x86 depending on your
 distribution)

 Libvirt: virsh cpu-models x86_64|sort

 Paolo



-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Windows 7 VM BSOD

[Thomas Lau]

since they change the logic inside a function and never change
function name, it's hard to tell by using nm kvm.ko as it only shows
what function name included on kernel module.

On Thu, Dec 4, 2014 at 3:15 PM, Zhang Haoyu zhan...@sangfor.com wrote:
Is this the correct function?
kvm_lapic_set_eoi

 No, see the detail of commit fc57ac2c9ca,
 https://git.kernel.org/cgit/virt/kvm/kvm.git/commit/arch/x86/kvm/lapic.c?id=fc57ac2c9ca8109ea97fcc594f4be436944230cc

I found that one tho.

On Thu, Dec 4, 2014 at 2:22 PM, Thomas Lau t...@tetrioncapital.com wrote:
 I see, so it's minor performance gain, and not stability related
 option which is good.

 I am checking 
 http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.13.11.5-trusty/,
 changelog showing lsr function is included, but when I download and
 extract kvm.ko out then run nm kvm.ko | grep lsr, nothing found.

 On Thu, Dec 4, 2014 at 12:32 PM, Zhang Haoyu zhan...@sangfor.com wrote:
what does vapic affect Windows 7 at all if I disable it? if it just a
minor performance drop, I am fine with that.

 hv_vapic provides accelerated MSR access to high usage memory mapped APIC
 registers, EOI, ICR, TPR.
 You can gain performance promotion from it, not too much,
 but it also depends on the frequency of access to above three apic regs.

On Thu, Dec 4, 2014 at 10:06 AM, Zhang Haoyu zhan...@sangfor.com wrote:
Sure, but I am little confused as KVM is part of linux kernel now, if
I want to try it, should I just upgrade kernel or compile kvm kernel
module by myself ?!

 You can just apply the patch to kvm module and rebuild it.

On Thu, Dec 4, 2014 at 10:01 AM, Zhang Haoyu zhan...@sangfor.com wrote:
I just confirmed that vapic is causing win7 stuck.

 You'd better try the commit fc57ac2c9ca :-)

On Thu, Dec 4, 2014 at 9:34 AM, Thomas Lau t...@tetrioncapital.com 
wrote:
 Hi,

 I don't want to recompile stuff, does it matter to have hv_vapic on 
 at all?

 On Thu, Dec 4, 2014 at 9:24 AM, Zhang Haoyu zhan...@sangfor.com 
 wrote:
 Oh I see,

 So 101 BSOD problem is well known? Can't find any document mention 
 about 101 BSOD online.

 I tried to use hv_ other options but Win7 can't boot up properly 
 and stucked at starting Windows screen.

 Could you confirm that the stuck was caused by vhich hv feature?
 The commit fc57ac2c9ca can resolve a stuck caused by hv_vapic which 
 I encountered before.
 https://git.kernel.org/cgit/virt/kvm/kvm.git/commit/arch/x86/kvm/lapic.c?id=fc57ac2c9ca8109ea97fcc594f4be436944230cc

 Sent from my BlackBerry 10 smartphone.
   Original Message
 From: Vadim Rozenfeld
 Sent: Wednesday, 3 December, 2014 7:30 PM
 To: Thomas Lau
 Cc: Zhang Haoyu; kvm; imammedo
 Subject: Re: Windows 7 VM BSOD

 If you run WS2008(R2) or Win7 - always turn on relaxed timing. 
 Otherwise
 it's just a matter of time when you hit 101 BOSD.
 Bugcheck 78 is quite rare one. What is your setup, and how easy 
 it's
 reproducible?

 Best regards,
 Vadim.

 On Wed, 2014-12-03 at 19:13 +0800, Thomas Lau wrote:
  it works on your side meaning that you had such issue but 
  afterwards
  it's all fixed by apply hv_relaxed ?
 
  On Wed, Dec 3, 2014 at 7:08 PM, Zhang Haoyu 
  zhan...@sangfor.com wrote:
   https://bugzilla.redhat.com/show_bug.cgi?id=893857
  
   In fact I am doing testing now, but are we fixing one problem 
   and
   introduce other problem?!
  
   I'm not sure about this, but it works on my side,
   I think BSOD(error:0x0078) has been fixed,
   please show your environment.
  
   Thanks,
   Zhang Haoyu
   On Wed, Dec 3, 2014 at 6:36 PM, Thomas Lau 
   t...@tetrioncapital.com wrote:
Hi,
   
How do I know if my qemu-kvm version support this?
   
On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu 
zhan...@sangfor.com wrote:
Hi All,
   
I am running 3.13.0-24-generic kernel on Ubuntu 14, 
Windows 7 VM
installation was fine, but it does random reboot by 
itself, the error
code is 0x0101, does anyone know how to fix this?
Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.
   
Thanks,
Zhang Haoyu



 --
 Thomas Lau
 Director of Infrastructure
 Tetrion Capital Limited

 Direct: +852-3976-8903
 Mobile: +852-9323-9670
 Address: 20/F, IFC 1, Central district, Hong Kong




 --
 Thomas Lau
 Director of Infrastructure
 Tetrion Capital Limited

 Direct: +852-3976-8903
 Mobile: +852-9323-9670
 Address: 20/F, IFC 1, Central district, Hong Kong




-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

kvm ivy bridge support?

[Thomas Lau]

Hi,

Does KVM support ivy bridge instruction?
--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Windows 7 VM BSOD

[Thomas Lau]

By the way, after I installed new version of kernel which have vapic
patch on, Win7 is running properly now. Thanks.

On Thu, Dec 4, 2014 at 4:37 PM, Thomas Lau t...@tetrioncapital.com wrote:
 since they change the logic inside a function and never change
 function name, it's hard to tell by using nm kvm.ko as it only shows
 what function name included on kernel module.

 On Thu, Dec 4, 2014 at 3:15 PM, Zhang Haoyu zhan...@sangfor.com wrote:
Is this the correct function?
kvm_lapic_set_eoi

 No, see the detail of commit fc57ac2c9ca,
 https://git.kernel.org/cgit/virt/kvm/kvm.git/commit/arch/x86/kvm/lapic.c?id=fc57ac2c9ca8109ea97fcc594f4be436944230cc

I found that one tho.

On Thu, Dec 4, 2014 at 2:22 PM, Thomas Lau t...@tetrioncapital.com wrote:
 I see, so it's minor performance gain, and not stability related
 option which is good.

 I am checking 
 http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.13.11.5-trusty/,
 changelog showing lsr function is included, but when I download and
 extract kvm.ko out then run nm kvm.ko | grep lsr, nothing found.

 On Thu, Dec 4, 2014 at 12:32 PM, Zhang Haoyu zhan...@sangfor.com wrote:
what does vapic affect Windows 7 at all if I disable it? if it just a
minor performance drop, I am fine with that.

 hv_vapic provides accelerated MSR access to high usage memory mapped APIC
 registers, EOI, ICR, TPR.
 You can gain performance promotion from it, not too much,
 but it also depends on the frequency of access to above three apic regs.

On Thu, Dec 4, 2014 at 10:06 AM, Zhang Haoyu zhan...@sangfor.com wrote:
Sure, but I am little confused as KVM is part of linux kernel now, if
I want to try it, should I just upgrade kernel or compile kvm kernel
module by myself ?!

 You can just apply the patch to kvm module and rebuild it.

On Thu, Dec 4, 2014 at 10:01 AM, Zhang Haoyu zhan...@sangfor.com 
wrote:
I just confirmed that vapic is causing win7 stuck.

 You'd better try the commit fc57ac2c9ca :-)

On Thu, Dec 4, 2014 at 9:34 AM, Thomas Lau t...@tetrioncapital.com 
wrote:
 Hi,

 I don't want to recompile stuff, does it matter to have hv_vapic on 
 at all?

 On Thu, Dec 4, 2014 at 9:24 AM, Zhang Haoyu zhan...@sangfor.com 
 wrote:
 Oh I see,

 So 101 BSOD problem is well known? Can't find any document 
 mention about 101 BSOD online.

 I tried to use hv_ other options but Win7 can't boot up properly 
 and stucked at starting Windows screen.

 Could you confirm that the stuck was caused by vhich hv feature?
 The commit fc57ac2c9ca can resolve a stuck caused by hv_vapic 
 which I encountered before.
 https://git.kernel.org/cgit/virt/kvm/kvm.git/commit/arch/x86/kvm/lapic.c?id=fc57ac2c9ca8109ea97fcc594f4be436944230cc

 Sent from my BlackBerry 10 smartphone.
   Original Message
 From: Vadim Rozenfeld
 Sent: Wednesday, 3 December, 2014 7:30 PM
 To: Thomas Lau
 Cc: Zhang Haoyu; kvm; imammedo
 Subject: Re: Windows 7 VM BSOD

 If you run WS2008(R2) or Win7 - always turn on relaxed timing. 
 Otherwise
 it's just a matter of time when you hit 101 BOSD.
 Bugcheck 78 is quite rare one. What is your setup, and how easy 
 it's
 reproducible?

 Best regards,
 Vadim.

 On Wed, 2014-12-03 at 19:13 +0800, Thomas Lau wrote:
  it works on your side meaning that you had such issue but 
  afterwards
  it's all fixed by apply hv_relaxed ?
 
  On Wed, Dec 3, 2014 at 7:08 PM, Zhang Haoyu 
  zhan...@sangfor.com wrote:
   https://bugzilla.redhat.com/show_bug.cgi?id=893857
  
   In fact I am doing testing now, but are we fixing one 
   problem and
   introduce other problem?!
  
   I'm not sure about this, but it works on my side,
   I think BSOD(error:0x0078) has been fixed,
   please show your environment.
  
   Thanks,
   Zhang Haoyu
   On Wed, Dec 3, 2014 at 6:36 PM, Thomas Lau 
   t...@tetrioncapital.com wrote:
Hi,
   
How do I know if my qemu-kvm version support this?
   
On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu 
zhan...@sangfor.com wrote:
Hi All,
   
I am running 3.13.0-24-generic kernel on Ubuntu 14, 
Windows 7 VM
installation was fine, but it does random reboot by 
itself, the error
code is 0x0101, does anyone know how to fix this?
Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.
   
Thanks,
Zhang Haoyu



 --
 Thomas Lau
 Director of Infrastructure
 Tetrion Capital Limited

 Direct: +852-3976-8903
 Mobile: +852-9323-9670
 Address: 20/F, IFC 1, Central district, Hong Kong




 --
 Thomas Lau
 Director of Infrastructure
 Tetrion Capital Limited

 Direct: +852-3976-8903
 Mobile: +852-9323-9670
 Address: 20/F, IFC 1, Central district, Hong Kong




 --
 Thomas Lau
 Director of Infrastructure
 Tetrion Capital Limited

 Direct: +852-3976-8903
 Mobile: +852-9323-9670
 Address: 20/F, IFC 1, Central district, Hong Kong



-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
--
To unsubscribe from this list: send the line unsubscribe kvm

Re: Windows 7 VM BSOD

[Thomas Lau]

I would stick with reading changelog and save some trouble!

On Thu, Dec 4, 2014 at 5:19 PM, Zhang Haoyu zhan...@sangfor.com wrote:
since they change the logic inside a function and never change
function name, it's hard to tell by using nm kvm.ko as it only shows
what function name included on kernel module.

 Yes,
 if you have the source, you can directly check it.,
 otherwise, decompile kvm.ko, because apic_clear_isr() is inline function,
 which is called by apic_set_eoi(), you can check it, this method is a bit 
 complicated.
 Any better ideas?

On Thu, Dec 4, 2014 at 3:15 PM, Zhang Haoyu zhan...@sangfor.com wrote:
Is this the correct function?
kvm_lapic_set_eoi

 No, see the detail of commit fc57ac2c9ca,
 https://git.kernel.org/cgit/virt/kvm/kvm.git/commit/arch/x86/kvm/lapic.c?id=fc57ac2c9ca8109ea97fcc594f4be436944230cc

I found that one tho.

On Thu, Dec 4, 2014 at 2:22 PM, Thomas Lau t...@tetrioncapital.com wrote:
 I see, so it's minor performance gain, and not stability related
 option which is good.

 I am checking 
 http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.13.11.5-trusty/,
 changelog showing lsr function is included, but when I download and
 extract kvm.ko out then run nm kvm.ko | grep lsr, nothing found.

 On Thu, Dec 4, 2014 at 12:32 PM, Zhang Haoyu zhan...@sangfor.com wrote:
what does vapic affect Windows 7 at all if I disable it? if it just a
minor performance drop, I am fine with that.

 hv_vapic provides accelerated MSR access to high usage memory mapped APIC
 registers, EOI, ICR, TPR.
 You can gain performance promotion from it, not too much,
 but it also depends on the frequency of access to above three apic regs.

On Thu, Dec 4, 2014 at 10:06 AM, Zhang Haoyu zhan...@sangfor.com wrote:
Sure, but I am little confused as KVM is part of linux kernel now, if
I want to try it, should I just upgrade kernel or compile kvm kernel
module by myself ?!

 You can just apply the patch to kvm module and rebuild it.

On Thu, Dec 4, 2014 at 10:01 AM, Zhang Haoyu zhan...@sangfor.com 
wrote:
I just confirmed that vapic is causing win7 stuck.

 You'd better try the commit fc57ac2c9ca :-)

On Thu, Dec 4, 2014 at 9:34 AM, Thomas Lau t...@tetrioncapital.com 
wrote:
 Hi,

 I don't want to recompile stuff, does it matter to have hv_vapic 
 on at all?

 On Thu, Dec 4, 2014 at 9:24 AM, Zhang Haoyu zhan...@sangfor.com 
 wrote:
 Oh I see,

 So 101 BSOD problem is well known? Can't find any document 
 mention about 101 BSOD online.

 I tried to use hv_ other options but Win7 can't boot up properly 
 and stucked at starting Windows screen.

 Could you confirm that the stuck was caused by vhich hv feature?
 The commit fc57ac2c9ca can resolve a stuck caused by hv_vapic 
 which I encountered before.
 https://git.kernel.org/cgit/virt/kvm/kvm.git/commit/arch/x86/kvm/lapic.c?id=fc57ac2c9ca8109ea97fcc594f4be436944230cc

 Sent from my BlackBerry 10 smartphone.
   Original Message
 From: Vadim Rozenfeld
 Sent: Wednesday, 3 December, 2014 7:30 PM
 To: Thomas Lau
 Cc: Zhang Haoyu; kvm; imammedo
 Subject: Re: Windows 7 VM BSOD

 If you run WS2008(R2) or Win7 - always turn on relaxed timing. 
 Otherwise
 it's just a matter of time when you hit 101 BOSD.
 Bugcheck 78 is quite rare one. What is your setup, and how easy 
 it's
 reproducible?

 Best regards,
 Vadim.

 On Wed, 2014-12-03 at 19:13 +0800, Thomas Lau wrote:
  it works on your side meaning that you had such issue but 
  afterwards
  it's all fixed by apply hv_relaxed ?
 
  On Wed, Dec 3, 2014 at 7:08 PM, Zhang Haoyu 
  zhan...@sangfor.com wrote:
   https://bugzilla.redhat.com/show_bug.cgi?id=893857
  
   In fact I am doing testing now, but are we fixing one 
   problem and
   introduce other problem?!
  
   I'm not sure about this, but it works on my side,
   I think BSOD(error:0x0078) has been fixed,
   please show your environment.
  
   Thanks,
   Zhang Haoyu
   On Wed, Dec 3, 2014 at 6:36 PM, Thomas Lau 
   t...@tetrioncapital.com wrote:
Hi,
   
How do I know if my qemu-kvm version support this?
   
On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu 
zhan...@sangfor.com wrote:
Hi All,
   
I am running 3.13.0-24-generic kernel on Ubuntu 14, 
Windows 7 VM
installation was fine, but it does random reboot by 
itself, the error
code is 0x0101, does anyone know how to fix this?
Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.
   
Thanks,
Zhang Haoyu



 --
 Thomas Lau
 Director of Infrastructure
 Tetrion Capital Limited

 Direct: +852-3976-8903
 Mobile: +852-9323-9670
 Address: 20/F, IFC 1, Central district, Hong Kong




 --
 Thomas Lau
 Director of Infrastructure
 Tetrion Capital Limited

 Direct: +852-3976-8903
 Mobile: +852-9323-9670
 Address: 20/F, IFC 1, Central district, Hong Kong




-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
--
To unsubscribe from this list: send the line unsubscribe

Windows 7 VM BSOD

[Thomas Lau]

Hi All,

I am running 3.13.0-24-generic kernel on Ubuntu 14, Windows 7 VM
installation was fine, but it does random reboot by itself, the error
code is 0x0101, does anyone know how to fix this?
--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Windows 7 VM BSOD

[Thomas Lau]

Hi,

How do I know if my qemu-kvm version support this?

On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu zhan...@sangfor.com wrote:
 Hi All,

 I am running 3.13.0-24-generic kernel on Ubuntu 14, Windows 7 VM
 installation was fine, but it does random reboot by itself, the error
 code is 0x0101, does anyone know how to fix this?
 Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.

 Thanks,
 Zhang Haoyu

--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Windows 7 VM BSOD

[Thomas Lau]

https://bugzilla.redhat.com/show_bug.cgi?id=893857

In fact I am doing testing now, but are we fixing one problem and
introduce other problem?!

On Wed, Dec 3, 2014 at 6:36 PM, Thomas Lau t...@tetrioncapital.com wrote:
 Hi,

 How do I know if my qemu-kvm version support this?

 On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu zhan...@sangfor.com wrote:
 Hi All,

 I am running 3.13.0-24-generic kernel on Ubuntu 14, Windows 7 VM
 installation was fine, but it does random reboot by itself, the error
 code is 0x0101, does anyone know how to fix this?
 Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.

 Thanks,
 Zhang Haoyu

--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Windows 7 VM BSOD

[Thomas Lau]

qemu-system-x86_64 -version
QEMU emulator version 2.0.0 (Debian 2.0.0+dfsg-2ubuntu1.7), Copyright
(c) 2003-2008 Fabrice Bellard


On Wed, Dec 3, 2014 at 7:01 PM, Zhang Haoyu zhan...@sangfor.com wrote:
 Hi,

 How do I know if my qemu-kvm version support this?

 I don't know which qemu version starts to support hv-relaxed,
 but I'm sure qemu-1.4.1 and later versions support it.
 qemu will report error if it dosen't support it.

 Please show your qemu version.

 Thanks,
 Zhang Haoyu
 hv-relaxed was started to support from commit 89314504,
 On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu zhan...@sangfor.com wrote:
  Hi All,
 
  I am running 3.13.0-24-generic kernel on Ubuntu 14, Windows 7 VM
  installation was fine, but it does random reboot by itself, the error
  code is 0x0101, does anyone know how to fix this?
  Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.
 
  Thanks,
  Zhang Haoyu

--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Windows 7 VM BSOD

[Thomas Lau]

it works on your side meaning that you had such issue but afterwards
it's all fixed by apply hv_relaxed ?

On Wed, Dec 3, 2014 at 7:08 PM, Zhang Haoyu zhan...@sangfor.com wrote:
 https://bugzilla.redhat.com/show_bug.cgi?id=893857

 In fact I am doing testing now, but are we fixing one problem and
 introduce other problem?!

 I'm not sure about this, but it works on my side,
 I think BSOD(error:0x0078) has been fixed,
 please show your environment.

 Thanks,
 Zhang Haoyu
 On Wed, Dec 3, 2014 at 6:36 PM, Thomas Lau t...@tetrioncapital.com wrote:
  Hi,
 
  How do I know if my qemu-kvm version support this?
 
  On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu zhan...@sangfor.com wrote:
  Hi All,
 
  I am running 3.13.0-24-generic kernel on Ubuntu 14, Windows 7 VM
  installation was fine, but it does random reboot by itself, the error
  code is 0x0101, does anyone know how to fix this?
  Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.
 
  Thanks,
  Zhang Haoyu

--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Windows 7 VM BSOD

[Thomas Lau]

Thanks for the link,

Here is my qemu command line:
qemu-system-x86_64 -enable-kvm -name test_server_Windows1 -S -machine
pc-i440fx-trusty,accel=kvm,usb=off -cpu
SandyBridge,+erms,+smep,+fsgsbase,+pdpe1gb,+rdrand,+f16c,+osxsave,+dca,+pcid,+pdcm,+xtpr,+tm2,+est,+smx,+vmx,+ds_cpl,+monitor,+dtes64,+pbe,+tm,+ht,+ss,+acpi,+ds,+vme,hv_relaxed
-m 16000 -realtime mlock=off -smp 8,sockets=8,cores=1,threads=1 -uuid
bdab5b38-855d-3a47-136d-42e2ca9ea86e -no-user-config -nodefaults
-chardev 
socket,id=charmonitor,path=/var/lib/libvirt/qemu/test_server_Windows1.monitor,server,nowait
-mon chardev=charmonitor,id=monitor,mode=control -rtc base=localtime
-no-reboot -boot menu=off,strict=on -device
piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -drive
file=/var/lib/libvirt/images/test_server_Windows1.img,if=none,id=drive-virtio-disk0,format=raw,cache=none
-device 
virtio-blk-pci,scsi=off,bus=pci.0,addr=0x5,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1
-drive 
file=/var/lib/libvirt/images/test_server_Windows1-1.img,if=none,id=drive-virtio-disk1,format=raw,cache=none
-device 
virtio-blk-pci,scsi=off,bus=pci.0,addr=0x7,drive=drive-virtio-disk1,id=virtio-disk1
-drive if=none,id=drive-ide0-1-0,readonly=on,format=raw -device
ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0 -netdev
tap,fd=27,id=hostnet0,vhost=on,vhostfd=28 -device
virtio-net-pci,netdev=hostnet0,id=net0,mac=52:54:00:dd:cf:5f,bus=pci.0,addr=0x3
-netdev tap,fd=29,id=hostnet1,vhost=on,vhostfd=30 -device
virtio-net-pci,netdev=hostnet1,id=net1,mac=52:54:00:85:66:fe,bus=pci.0,addr=0x6
-chardev pty,id=charserial0 -device
isa-serial,chardev=charserial0,id=serial0 -device usb-tablet,id=input0
-vnc 0.0.0.0:0,password -device VGA,id=video0,bus=pci.0,addr=0x2
-device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x4

the number of cores have mistake, I will change to 2 sockets, 4 cores,
1 thread tomorrow after overnight test is done.

On Wed, Dec 3, 2014 at 8:14 PM, Vadim Rozenfeld vroze...@redhat.com wrote:
 On Wed, 2014-12-03 at 19:36 +0800, t...@tetrioncapital.com wrote:
 Oh I see,

 So 101 BSOD problem is well known? Can't find any document mention about 101 
 BSOD online.


 http://msdn.microsoft.com/en-us/library/windows/hardware/ff557211%
 28v=vs.85%29.aspx

 I tried to use hv_ other options but Win7 can't boot up properly and stucked 
 at starting Windows screen.


 Can you post the qemu command line?

 Sent from my BlackBerry 10 smartphone.
   Original Message
 From: Vadim Rozenfeld
 Sent: Wednesday, 3 December, 2014 7:30 PM
 To: Thomas Lau
 Cc: Zhang Haoyu; kvm; imammedo
 Subject: Re: Windows 7 VM BSOD

 If you run WS2008(R2) or Win7 - always turn on relaxed timing. Otherwise
 it's just a matter of time when you hit 101 BOSD.
 Bugcheck 78 is quite rare one. What is your setup, and how easy it's
 reproducible?

 Best regards,
 Vadim.

 On Wed, 2014-12-03 at 19:13 +0800, Thomas Lau wrote:
  it works on your side meaning that you had such issue but afterwards
  it's all fixed by apply hv_relaxed ?
 
  On Wed, Dec 3, 2014 at 7:08 PM, Zhang Haoyu zhan...@sangfor.com wrote:
   https://bugzilla.redhat.com/show_bug.cgi?id=893857
  
   In fact I am doing testing now, but are we fixing one problem and
   introduce other problem?!
  
   I'm not sure about this, but it works on my side,
   I think BSOD(error:0x0078) has been fixed,
   please show your environment.
  
   Thanks,
   Zhang Haoyu
   On Wed, Dec 3, 2014 at 6:36 PM, Thomas Lau t...@tetrioncapital.com 
   wrote:
Hi,
   
How do I know if my qemu-kvm version support this?
   
On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu zhan...@sangfor.com 
wrote:
Hi All,
   
I am running 3.13.0-24-generic kernel on Ubuntu 14, Windows 7 VM
installation was fine, but it does random reboot by itself, the 
error
code is 0x0101, does anyone know how to fix this?
Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.
   
Thanks,
Zhang Haoyu
  
  --
  To unsubscribe from this list: send the line unsubscribe kvm in
  the body of a message to majord...@vger.kernel.org
  More majordomo info at http://vger.kernel.org/majordomo-info.html


 --
 To unsubscribe from this list: send the line unsubscribe kvm in
 the body of a message to majord...@vger.kernel.org
 More majordomo info at  http://vger.kernel.org/majordomo-info.html





-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Windows 7 VM BSOD

[Thomas Lau]

the link that I was trying to follow and Win7 bootup stuck is this:
http://blog.wikichoon.com/2014/07/enabling-hyper-v-enlightenments-with-kvm.html

On Wed, Dec 3, 2014 at 10:51 PM, Thomas Lau t...@tetrioncapital.com wrote:
 Thanks for the link,

 Here is my qemu command line:
 qemu-system-x86_64 -enable-kvm -name test_server_Windows1 -S -machine
 pc-i440fx-trusty,accel=kvm,usb=off -cpu
 SandyBridge,+erms,+smep,+fsgsbase,+pdpe1gb,+rdrand,+f16c,+osxsave,+dca,+pcid,+pdcm,+xtpr,+tm2,+est,+smx,+vmx,+ds_cpl,+monitor,+dtes64,+pbe,+tm,+ht,+ss,+acpi,+ds,+vme,hv_relaxed
 -m 16000 -realtime mlock=off -smp 8,sockets=8,cores=1,threads=1 -uuid
 bdab5b38-855d-3a47-136d-42e2ca9ea86e -no-user-config -nodefaults
 -chardev 
 socket,id=charmonitor,path=/var/lib/libvirt/qemu/test_server_Windows1.monitor,server,nowait
 -mon chardev=charmonitor,id=monitor,mode=control -rtc base=localtime
 -no-reboot -boot menu=off,strict=on -device
 piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -drive
 file=/var/lib/libvirt/images/test_server_Windows1.img,if=none,id=drive-virtio-disk0,format=raw,cache=none
 -device 
 virtio-blk-pci,scsi=off,bus=pci.0,addr=0x5,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1
 -drive 
 file=/var/lib/libvirt/images/test_server_Windows1-1.img,if=none,id=drive-virtio-disk1,format=raw,cache=none
 -device 
 virtio-blk-pci,scsi=off,bus=pci.0,addr=0x7,drive=drive-virtio-disk1,id=virtio-disk1
 -drive if=none,id=drive-ide0-1-0,readonly=on,format=raw -device
 ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0 -netdev
 tap,fd=27,id=hostnet0,vhost=on,vhostfd=28 -device
 virtio-net-pci,netdev=hostnet0,id=net0,mac=52:54:00:dd:cf:5f,bus=pci.0,addr=0x3
 -netdev tap,fd=29,id=hostnet1,vhost=on,vhostfd=30 -device
 virtio-net-pci,netdev=hostnet1,id=net1,mac=52:54:00:85:66:fe,bus=pci.0,addr=0x6
 -chardev pty,id=charserial0 -device
 isa-serial,chardev=charserial0,id=serial0 -device usb-tablet,id=input0
 -vnc 0.0.0.0:0,password -device VGA,id=video0,bus=pci.0,addr=0x2
 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x4

 the number of cores have mistake, I will change to 2 sockets, 4 cores,
 1 thread tomorrow after overnight test is done.

 On Wed, Dec 3, 2014 at 8:14 PM, Vadim Rozenfeld vroze...@redhat.com wrote:
 On Wed, 2014-12-03 at 19:36 +0800, t...@tetrioncapital.com wrote:
 Oh I see,

 So 101 BSOD problem is well known? Can't find any document mention about 
 101 BSOD online.


 http://msdn.microsoft.com/en-us/library/windows/hardware/ff557211%
 28v=vs.85%29.aspx

 I tried to use hv_ other options but Win7 can't boot up properly and 
 stucked at starting Windows screen.


 Can you post the qemu command line?

 Sent from my BlackBerry 10 smartphone.
   Original Message
 From: Vadim Rozenfeld
 Sent: Wednesday, 3 December, 2014 7:30 PM
 To: Thomas Lau
 Cc: Zhang Haoyu; kvm; imammedo
 Subject: Re: Windows 7 VM BSOD

 If you run WS2008(R2) or Win7 - always turn on relaxed timing. Otherwise
 it's just a matter of time when you hit 101 BOSD.
 Bugcheck 78 is quite rare one. What is your setup, and how easy it's
 reproducible?

 Best regards,
 Vadim.

 On Wed, 2014-12-03 at 19:13 +0800, Thomas Lau wrote:
  it works on your side meaning that you had such issue but afterwards
  it's all fixed by apply hv_relaxed ?
 
  On Wed, Dec 3, 2014 at 7:08 PM, Zhang Haoyu zhan...@sangfor.com wrote:
   https://bugzilla.redhat.com/show_bug.cgi?id=893857
  
   In fact I am doing testing now, but are we fixing one problem and
   introduce other problem?!
  
   I'm not sure about this, but it works on my side,
   I think BSOD(error:0x0078) has been fixed,
   please show your environment.
  
   Thanks,
   Zhang Haoyu
   On Wed, Dec 3, 2014 at 6:36 PM, Thomas Lau t...@tetrioncapital.com 
   wrote:
Hi,
   
How do I know if my qemu-kvm version support this?
   
On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu zhan...@sangfor.com 
wrote:
Hi All,
   
I am running 3.13.0-24-generic kernel on Ubuntu 14, Windows 7 VM
installation was fine, but it does random reboot by itself, the 
error
code is 0x0101, does anyone know how to fix this?
Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.
   
Thanks,
Zhang Haoyu
  
  --
  To unsubscribe from this list: send the line unsubscribe kvm in
  the body of a message to majord...@vger.kernel.org
  More majordomo info at http://vger.kernel.org/majordomo-info.html


 --
 To unsubscribe from this list: send the line unsubscribe kvm in
 the body of a message to majord...@vger.kernel.org
 More majordomo info at  http://vger.kernel.org/majordomo-info.html





--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Windows 7 VM BSOD

[Thomas Lau]

Hi,

I don't want to recompile stuff, does it matter to have hv_vapic on at all?

On Thu, Dec 4, 2014 at 9:24 AM, Zhang Haoyu zhan...@sangfor.com wrote:
 Oh I see,

 So 101 BSOD problem is well known? Can't find any document mention about 101 
 BSOD online.

 I tried to use hv_ other options but Win7 can't boot up properly and stucked 
 at starting Windows screen.

 Could you confirm that the stuck was caused by vhich hv feature?
 The commit fc57ac2c9ca can resolve a stuck caused by hv_vapic which I 
 encountered before.
 https://git.kernel.org/cgit/virt/kvm/kvm.git/commit/arch/x86/kvm/lapic.c?id=fc57ac2c9ca8109ea97fcc594f4be436944230cc

 Sent from my BlackBerry 10 smartphone.
   Original Message
 From: Vadim Rozenfeld
 Sent: Wednesday, 3 December, 2014 7:30 PM
 To: Thomas Lau
 Cc: Zhang Haoyu; kvm; imammedo
 Subject: Re: Windows 7 VM BSOD

 If you run WS2008(R2) or Win7 - always turn on relaxed timing. Otherwise
 it's just a matter of time when you hit 101 BOSD.
 Bugcheck 78 is quite rare one. What is your setup, and how easy it's
 reproducible?

 Best regards,
 Vadim.

 On Wed, 2014-12-03 at 19:13 +0800, Thomas Lau wrote:
  it works on your side meaning that you had such issue but afterwards
  it's all fixed by apply hv_relaxed ?
 
  On Wed, Dec 3, 2014 at 7:08 PM, Zhang Haoyu zhan...@sangfor.com wrote:
   https://bugzilla.redhat.com/show_bug.cgi?id=893857
  
   In fact I am doing testing now, but are we fixing one problem and
   introduce other problem?!
  
   I'm not sure about this, but it works on my side,
   I think BSOD(error:0x0078) has been fixed,
   please show your environment.
  
   Thanks,
   Zhang Haoyu
   On Wed, Dec 3, 2014 at 6:36 PM, Thomas Lau t...@tetrioncapital.com 
   wrote:
Hi,
   
How do I know if my qemu-kvm version support this?
   
On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu zhan...@sangfor.com 
wrote:
Hi All,
   
I am running 3.13.0-24-generic kernel on Ubuntu 14, Windows 7 VM
installation was fine, but it does random reboot by itself, the 
error
code is 0x0101, does anyone know how to fix this?
Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.
   
Thanks,
Zhang Haoyu



-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Windows 7 VM BSOD

[Thomas Lau]

I just confirmed that vapic is causing win7 stuck.

On Thu, Dec 4, 2014 at 9:34 AM, Thomas Lau t...@tetrioncapital.com wrote:
 Hi,

 I don't want to recompile stuff, does it matter to have hv_vapic on at all?

 On Thu, Dec 4, 2014 at 9:24 AM, Zhang Haoyu zhan...@sangfor.com wrote:
 Oh I see,

 So 101 BSOD problem is well known? Can't find any document mention about 
 101 BSOD online.

 I tried to use hv_ other options but Win7 can't boot up properly and 
 stucked at starting Windows screen.

 Could you confirm that the stuck was caused by vhich hv feature?
 The commit fc57ac2c9ca can resolve a stuck caused by hv_vapic which I 
 encountered before.
 https://git.kernel.org/cgit/virt/kvm/kvm.git/commit/arch/x86/kvm/lapic.c?id=fc57ac2c9ca8109ea97fcc594f4be436944230cc

 Sent from my BlackBerry 10 smartphone.
   Original Message
 From: Vadim Rozenfeld
 Sent: Wednesday, 3 December, 2014 7:30 PM
 To: Thomas Lau
 Cc: Zhang Haoyu; kvm; imammedo
 Subject: Re: Windows 7 VM BSOD

 If you run WS2008(R2) or Win7 - always turn on relaxed timing. Otherwise
 it's just a matter of time when you hit 101 BOSD.
 Bugcheck 78 is quite rare one. What is your setup, and how easy it's
 reproducible?

 Best regards,
 Vadim.

 On Wed, 2014-12-03 at 19:13 +0800, Thomas Lau wrote:
  it works on your side meaning that you had such issue but afterwards
  it's all fixed by apply hv_relaxed ?
 
  On Wed, Dec 3, 2014 at 7:08 PM, Zhang Haoyu zhan...@sangfor.com wrote:
   https://bugzilla.redhat.com/show_bug.cgi?id=893857
  
   In fact I am doing testing now, but are we fixing one problem and
   introduce other problem?!
  
   I'm not sure about this, but it works on my side,
   I think BSOD(error:0x0078) has been fixed,
   please show your environment.
  
   Thanks,
   Zhang Haoyu
   On Wed, Dec 3, 2014 at 6:36 PM, Thomas Lau t...@tetrioncapital.com 
   wrote:
Hi,
   
How do I know if my qemu-kvm version support this?
   
On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu zhan...@sangfor.com 
wrote:
Hi All,
   
I am running 3.13.0-24-generic kernel on Ubuntu 14, Windows 7 VM
installation was fine, but it does random reboot by itself, the 
error
code is 0x0101, does anyone know how to fix this?
Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.
   
Thanks,
Zhang Haoyu



 --
 Thomas Lau
 Director of Infrastructure
 Tetrion Capital Limited

 Direct: +852-3976-8903
 Mobile: +852-9323-9670
 Address: 20/F, IFC 1, Central district, Hong Kong



-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Windows 7 VM BSOD

[Thomas Lau]

Sure, but I am little confused as KVM is part of linux kernel now, if
I want to try it, should I just upgrade kernel or compile kvm kernel
module by myself ?!

On Thu, Dec 4, 2014 at 10:01 AM, Zhang Haoyu zhan...@sangfor.com wrote:
I just confirmed that vapic is causing win7 stuck.

 You'd better try the commit fc57ac2c9ca :-)

On Thu, Dec 4, 2014 at 9:34 AM, Thomas Lau t...@tetrioncapital.com wrote:
 Hi,

 I don't want to recompile stuff, does it matter to have hv_vapic on at all?

 On Thu, Dec 4, 2014 at 9:24 AM, Zhang Haoyu zhan...@sangfor.com wrote:
 Oh I see,

 So 101 BSOD problem is well known? Can't find any document mention about 
 101 BSOD online.

 I tried to use hv_ other options but Win7 can't boot up properly and 
 stucked at starting Windows screen.

 Could you confirm that the stuck was caused by vhich hv feature?
 The commit fc57ac2c9ca can resolve a stuck caused by hv_vapic which I 
 encountered before.
 https://git.kernel.org/cgit/virt/kvm/kvm.git/commit/arch/x86/kvm/lapic.c?id=fc57ac2c9ca8109ea97fcc594f4be436944230cc

 Sent from my BlackBerry 10 smartphone.
   Original Message
 From: Vadim Rozenfeld
 Sent: Wednesday, 3 December, 2014 7:30 PM
 To: Thomas Lau
 Cc: Zhang Haoyu; kvm; imammedo
 Subject: Re: Windows 7 VM BSOD

 If you run WS2008(R2) or Win7 - always turn on relaxed timing. Otherwise
 it's just a matter of time when you hit 101 BOSD.
 Bugcheck 78 is quite rare one. What is your setup, and how easy it's
 reproducible?

 Best regards,
 Vadim.

 On Wed, 2014-12-03 at 19:13 +0800, Thomas Lau wrote:
  it works on your side meaning that you had such issue but afterwards
  it's all fixed by apply hv_relaxed ?
 
  On Wed, Dec 3, 2014 at 7:08 PM, Zhang Haoyu zhan...@sangfor.com wrote:
   https://bugzilla.redhat.com/show_bug.cgi?id=893857
  
   In fact I am doing testing now, but are we fixing one problem and
   introduce other problem?!
  
   I'm not sure about this, but it works on my side,
   I think BSOD(error:0x0078) has been fixed,
   please show your environment.
  
   Thanks,
   Zhang Haoyu
   On Wed, Dec 3, 2014 at 6:36 PM, Thomas Lau t...@tetrioncapital.com 
   wrote:
Hi,
   
How do I know if my qemu-kvm version support this?
   
On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu zhan...@sangfor.com 
wrote:
Hi All,
   
I am running 3.13.0-24-generic kernel on Ubuntu 14, Windows 7 VM
installation was fine, but it does random reboot by itself, the 
error
code is 0x0101, does anyone know how to fix this?
Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.
   
Thanks,
Zhang Haoyu



 --
 Thomas Lau
 Director of Infrastructure
 Tetrion Capital Limited

 Direct: +852-3976-8903
 Mobile: +852-9323-9670
 Address: 20/F, IFC 1, Central district, Hong Kong




-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Windows 7 VM BSOD

[Thomas Lau]

what does vapic affect Windows 7 at all if I disable it? if it just a
minor performance drop, I am fine with that.

On Thu, Dec 4, 2014 at 10:06 AM, Zhang Haoyu zhan...@sangfor.com wrote:
Sure, but I am little confused as KVM is part of linux kernel now, if
I want to try it, should I just upgrade kernel or compile kvm kernel
module by myself ?!

 You can just apply the patch to kvm module and rebuild it.

On Thu, Dec 4, 2014 at 10:01 AM, Zhang Haoyu zhan...@sangfor.com wrote:
I just confirmed that vapic is causing win7 stuck.

 You'd better try the commit fc57ac2c9ca :-)

On Thu, Dec 4, 2014 at 9:34 AM, Thomas Lau t...@tetrioncapital.com wrote:
 Hi,

 I don't want to recompile stuff, does it matter to have hv_vapic on at 
 all?

 On Thu, Dec 4, 2014 at 9:24 AM, Zhang Haoyu zhan...@sangfor.com wrote:
 Oh I see,

 So 101 BSOD problem is well known? Can't find any document mention 
 about 101 BSOD online.

 I tried to use hv_ other options but Win7 can't boot up properly and 
 stucked at starting Windows screen.

 Could you confirm that the stuck was caused by vhich hv feature?
 The commit fc57ac2c9ca can resolve a stuck caused by hv_vapic which I 
 encountered before.
 https://git.kernel.org/cgit/virt/kvm/kvm.git/commit/arch/x86/kvm/lapic.c?id=fc57ac2c9ca8109ea97fcc594f4be436944230cc

 Sent from my BlackBerry 10 smartphone.
   Original Message
 From: Vadim Rozenfeld
 Sent: Wednesday, 3 December, 2014 7:30 PM
 To: Thomas Lau
 Cc: Zhang Haoyu; kvm; imammedo
 Subject: Re: Windows 7 VM BSOD

 If you run WS2008(R2) or Win7 - always turn on relaxed timing. Otherwise
 it's just a matter of time when you hit 101 BOSD.
 Bugcheck 78 is quite rare one. What is your setup, and how easy it's
 reproducible?

 Best regards,
 Vadim.

 On Wed, 2014-12-03 at 19:13 +0800, Thomas Lau wrote:
  it works on your side meaning that you had such issue but afterwards
  it's all fixed by apply hv_relaxed ?
 
  On Wed, Dec 3, 2014 at 7:08 PM, Zhang Haoyu zhan...@sangfor.com 
  wrote:
   https://bugzilla.redhat.com/show_bug.cgi?id=893857
  
   In fact I am doing testing now, but are we fixing one problem and
   introduce other problem?!
  
   I'm not sure about this, but it works on my side,
   I think BSOD(error:0x0078) has been fixed,
   please show your environment.
  
   Thanks,
   Zhang Haoyu
   On Wed, Dec 3, 2014 at 6:36 PM, Thomas Lau 
   t...@tetrioncapital.com wrote:
Hi,
   
How do I know if my qemu-kvm version support this?
   
On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu 
zhan...@sangfor.com wrote:
Hi All,
   
I am running 3.13.0-24-generic kernel on Ubuntu 14, Windows 7 
VM
installation was fine, but it does random reboot by itself, 
the error
code is 0x0101, does anyone know how to fix this?
Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.
   
Thanks,
Zhang Haoyu



 --
 Thomas Lau
 Director of Infrastructure
 Tetrion Capital Limited

 Direct: +852-3976-8903
 Mobile: +852-9323-9670
 Address: 20/F, IFC 1, Central district, Hong Kong




-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Windows 7 VM BSOD

[Thomas Lau]

I see, so it's minor performance gain, and not stability related
option which is good.

I am checking http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.13.11.5-trusty/,
changelog showing lsr function is included, but when I download and
extract kvm.ko out then run nm kvm.ko | grep lsr, nothing found.

On Thu, Dec 4, 2014 at 12:32 PM, Zhang Haoyu zhan...@sangfor.com wrote:
what does vapic affect Windows 7 at all if I disable it? if it just a
minor performance drop, I am fine with that.

 hv_vapic provides accelerated MSR access to high usage memory mapped APIC
 registers, EOI, ICR, TPR.
 You can gain performance promotion from it, not too much,
 but it also depends on the frequency of access to above three apic regs.

On Thu, Dec 4, 2014 at 10:06 AM, Zhang Haoyu zhan...@sangfor.com wrote:
Sure, but I am little confused as KVM is part of linux kernel now, if
I want to try it, should I just upgrade kernel or compile kvm kernel
module by myself ?!

 You can just apply the patch to kvm module and rebuild it.

On Thu, Dec 4, 2014 at 10:01 AM, Zhang Haoyu zhan...@sangfor.com wrote:
I just confirmed that vapic is causing win7 stuck.

 You'd better try the commit fc57ac2c9ca :-)

On Thu, Dec 4, 2014 at 9:34 AM, Thomas Lau t...@tetrioncapital.com 
wrote:
 Hi,

 I don't want to recompile stuff, does it matter to have hv_vapic on at 
 all?

 On Thu, Dec 4, 2014 at 9:24 AM, Zhang Haoyu zhan...@sangfor.com wrote:
 Oh I see,

 So 101 BSOD problem is well known? Can't find any document mention 
 about 101 BSOD online.

 I tried to use hv_ other options but Win7 can't boot up properly and 
 stucked at starting Windows screen.

 Could you confirm that the stuck was caused by vhich hv feature?
 The commit fc57ac2c9ca can resolve a stuck caused by hv_vapic which I 
 encountered before.
 https://git.kernel.org/cgit/virt/kvm/kvm.git/commit/arch/x86/kvm/lapic.c?id=fc57ac2c9ca8109ea97fcc594f4be436944230cc

 Sent from my BlackBerry 10 smartphone.
   Original Message
 From: Vadim Rozenfeld
 Sent: Wednesday, 3 December, 2014 7:30 PM
 To: Thomas Lau
 Cc: Zhang Haoyu; kvm; imammedo
 Subject: Re: Windows 7 VM BSOD

 If you run WS2008(R2) or Win7 - always turn on relaxed timing. 
 Otherwise
 it's just a matter of time when you hit 101 BOSD.
 Bugcheck 78 is quite rare one. What is your setup, and how easy it's
 reproducible?

 Best regards,
 Vadim.

 On Wed, 2014-12-03 at 19:13 +0800, Thomas Lau wrote:
  it works on your side meaning that you had such issue but 
  afterwards
  it's all fixed by apply hv_relaxed ?
 
  On Wed, Dec 3, 2014 at 7:08 PM, Zhang Haoyu zhan...@sangfor.com 
  wrote:
   https://bugzilla.redhat.com/show_bug.cgi?id=893857
  
   In fact I am doing testing now, but are we fixing one problem and
   introduce other problem?!
  
   I'm not sure about this, but it works on my side,
   I think BSOD(error:0x0078) has been fixed,
   please show your environment.
  
   Thanks,
   Zhang Haoyu
   On Wed, Dec 3, 2014 at 6:36 PM, Thomas Lau 
   t...@tetrioncapital.com wrote:
Hi,
   
How do I know if my qemu-kvm version support this?
   
On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu 
zhan...@sangfor.com wrote:
Hi All,
   
I am running 3.13.0-24-generic kernel on Ubuntu 14, Windows 
7 VM
installation was fine, but it does random reboot by itself, 
the error
code is 0x0101, does anyone know how to fix this?
Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.
   
Thanks,
Zhang Haoyu



 --
 Thomas Lau
 Director of Infrastructure
 Tetrion Capital Limited

 Direct: +852-3976-8903
 Mobile: +852-9323-9670
 Address: 20/F, IFC 1, Central district, Hong Kong




-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Windows 7 VM BSOD

[Thomas Lau]

Is this the correct function?
kvm_lapic_set_eoi

I found that one tho.

On Thu, Dec 4, 2014 at 2:22 PM, Thomas Lau t...@tetrioncapital.com wrote:
 I see, so it's minor performance gain, and not stability related
 option which is good.

 I am checking 
 http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.13.11.5-trusty/,
 changelog showing lsr function is included, but when I download and
 extract kvm.ko out then run nm kvm.ko | grep lsr, nothing found.

 On Thu, Dec 4, 2014 at 12:32 PM, Zhang Haoyu zhan...@sangfor.com wrote:
what does vapic affect Windows 7 at all if I disable it? if it just a
minor performance drop, I am fine with that.

 hv_vapic provides accelerated MSR access to high usage memory mapped APIC
 registers, EOI, ICR, TPR.
 You can gain performance promotion from it, not too much,
 but it also depends on the frequency of access to above three apic regs.

On Thu, Dec 4, 2014 at 10:06 AM, Zhang Haoyu zhan...@sangfor.com wrote:
Sure, but I am little confused as KVM is part of linux kernel now, if
I want to try it, should I just upgrade kernel or compile kvm kernel
module by myself ?!

 You can just apply the patch to kvm module and rebuild it.

On Thu, Dec 4, 2014 at 10:01 AM, Zhang Haoyu zhan...@sangfor.com wrote:
I just confirmed that vapic is causing win7 stuck.

 You'd better try the commit fc57ac2c9ca :-)

On Thu, Dec 4, 2014 at 9:34 AM, Thomas Lau t...@tetrioncapital.com 
wrote:
 Hi,

 I don't want to recompile stuff, does it matter to have hv_vapic on at 
 all?

 On Thu, Dec 4, 2014 at 9:24 AM, Zhang Haoyu zhan...@sangfor.com 
 wrote:
 Oh I see,

 So 101 BSOD problem is well known? Can't find any document mention 
 about 101 BSOD online.

 I tried to use hv_ other options but Win7 can't boot up properly and 
 stucked at starting Windows screen.

 Could you confirm that the stuck was caused by vhich hv feature?
 The commit fc57ac2c9ca can resolve a stuck caused by hv_vapic which I 
 encountered before.
 https://git.kernel.org/cgit/virt/kvm/kvm.git/commit/arch/x86/kvm/lapic.c?id=fc57ac2c9ca8109ea97fcc594f4be436944230cc

 Sent from my BlackBerry 10 smartphone.
   Original Message
 From: Vadim Rozenfeld
 Sent: Wednesday, 3 December, 2014 7:30 PM
 To: Thomas Lau
 Cc: Zhang Haoyu; kvm; imammedo
 Subject: Re: Windows 7 VM BSOD

 If you run WS2008(R2) or Win7 - always turn on relaxed timing. 
 Otherwise
 it's just a matter of time when you hit 101 BOSD.
 Bugcheck 78 is quite rare one. What is your setup, and how easy it's
 reproducible?

 Best regards,
 Vadim.

 On Wed, 2014-12-03 at 19:13 +0800, Thomas Lau wrote:
  it works on your side meaning that you had such issue but 
  afterwards
  it's all fixed by apply hv_relaxed ?
 
  On Wed, Dec 3, 2014 at 7:08 PM, Zhang Haoyu zhan...@sangfor.com 
  wrote:
   https://bugzilla.redhat.com/show_bug.cgi?id=893857
  
   In fact I am doing testing now, but are we fixing one problem 
   and
   introduce other problem?!
  
   I'm not sure about this, but it works on my side,
   I think BSOD(error:0x0078) has been fixed,
   please show your environment.
  
   Thanks,
   Zhang Haoyu
   On Wed, Dec 3, 2014 at 6:36 PM, Thomas Lau 
   t...@tetrioncapital.com wrote:
Hi,
   
How do I know if my qemu-kvm version support this?
   
On Wed, Dec 3, 2014 at 6:25 PM, Zhang Haoyu 
zhan...@sangfor.com wrote:
Hi All,
   
I am running 3.13.0-24-generic kernel on Ubuntu 14, Windows 
7 VM
installation was fine, but it does random reboot by itself, 
the error
code is 0x0101, does anyone know how to fix this?
Could you try hv_relaxed, like -cpu kvm64,hv_relaxed.
   
Thanks,
Zhang Haoyu



 --
 Thomas Lau
 Director of Infrastructure
 Tetrion Capital Limited

 Direct: +852-3976-8903
 Mobile: +852-9323-9670
 Address: 20/F, IFC 1, Central district, Hong Kong




 --
 Thomas Lau
 Director of Infrastructure
 Tetrion Capital Limited

 Direct: +852-3976-8903
 Mobile: +852-9323-9670
 Address: 20/F, IFC 1, Central district, Hong Kong



-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Direct: +852-3976-8903
Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
--
To unsubscribe from this list: send the line unsubscribe kvm in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: [Freeipa-users] Laptop user

[Thomas Lau]

What will happen if laptop haven't turn on for a long time and ticket
expired with cache and store password enabled? Does user unable to login
after expired?

On Thu, Nov 20, 2014 at 5:10 PM, Jakub Hrozek jhro...@redhat.com wrote:

 On Thu, Nov 20, 2014 at 05:04:02PM +0800, Thomas Lau wrote:
  Does anyone know what's the behavior look like if a mobile user (laptop)
  being disconnected from Kerberos for too long even cache is enabled by
  default in our environment?

 SSSD caches the user data and if cache_credentials is enabled, then also
 a salted password hash to enable offline logins.

 Your TGT will eventually expire, but that hardly matters since you're
 offline. When you reconnect to the network, you can either run kinit
 manually, or for better user experience enable
 krb5_store_password_if_offline
 to keep your password in the kernel keyring and let sssd kinit on your
 behalf when it detects you've gone online again.

 --
 Manage your subscription for the Freeipa-users mailing list:
 https://www.redhat.com/mailman/listinfo/freeipa-users
 Go To http://freeipa.org for more info on the project

-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go To http://freeipa.org for more info on the project

Re: [Freeipa-users] Laptop user

[Thomas Lau]

Thanks, that solve my concern!

On Thu, Nov 20, 2014 at 5:35 PM, Jakub Hrozek jhro...@redhat.com wrote:

 On Thu, Nov 20, 2014 at 05:19:57PM +0800, Thomas Lau wrote:
  What will happen if laptop haven't turn on for a long time and ticket
  expired with cache and store password enabled? Does user unable to login
  after expired?

 SSSD doesn't use the ticket to authenticate in offline case, so sssd
 doesn't really care the ticket expired.

 Rather, when cache_credentials is enabled, we store a hash of the user's
 password in the cache and if offline, compare what the user entered
 with the stored hash.

 By default, the cache password hash never expires, unless you configure
 sssd to do so with offline_credentials_expiration


 
  On Thu, Nov 20, 2014 at 5:10 PM, Jakub Hrozek jhro...@redhat.com
 wrote:
 
   On Thu, Nov 20, 2014 at 05:04:02PM +0800, Thomas Lau wrote:
Does anyone know what's the behavior look like if a mobile user
 (laptop)
being disconnected from Kerberos for too long even cache is enabled
 by
default in our environment?
  
   SSSD caches the user data and if cache_credentials is enabled, then
 also
   a salted password hash to enable offline logins.
  
   Your TGT will eventually expire, but that hardly matters since you're
   offline. When you reconnect to the network, you can either run kinit
   manually, or for better user experience enable
   krb5_store_password_if_offline
   to keep your password in the kernel keyring and let sssd kinit on your
   behalf when it detects you've gone online again.
  
   --
   Manage your subscription for the Freeipa-users mailing list:
   https://www.redhat.com/mailman/listinfo/freeipa-users
   Go To http://freeipa.org for more info on the project
  

-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go To http://freeipa.org for more info on the project

Re: [Freeipa-users] Kerberos for cronjoob

[Thomas Lau]

Hi,

​Thanks for replying.

I am running Ubuntu 14 IPA client, here is the result when I try to run
kinit -R
tlau@mocha:~$ kinit -R
kinit: KDC can't fulfill requested option while renewing credentials
tlau@mocha:~$ klist
Ticket cache: FILE:/tmp/krb5cc_121843_rZ7eX7
Default principal: t...@domain.com

Valid starting   Expires  Service principal
2014-11-07T16:59:42  2014-11-08T16:59:42  krbtgt/domain@domain.com
tlau@mocha:~$ date
Fri Nov  7 17:09:24 HKT 2014​

Any idea why?


On Fri, Nov 7, 2014 at 4:41 PM, Sumit Bose sb...@redhat.com wrote:

 On Thu, Nov 06, 2014 at 10:28:34PM -0500, Dmitri Pal wrote:
  On 11/06/2014 08:20 PM, Thomas Lau wrote:
  ?Hi,
  
  Is it possible to renew ticket once in a while for cronjob to run on
  certain users? How do you guys run cronjob on Kerberos user without
  getting ticket expire?
  
  Sent from my BlackBerry 10 smartphone.
  
  
  Here is an example:
 http://adam.younglogic.com/2013/05/kerberizing-postgresql-with-freeipa-for-keystone/
 
  But starting kerberos  1.11 kerberos library should be able to
 automatically
  renew the ticket for service accounts
  http://k5wiki.kerberos.org/wiki/Projects/Keytab_initiation

 SSSD can renew tickets as well, see krb5_renew_interval option described
 in sssd-krb5(5).

 Depending on how often your cronjob is run and what is the lifetime of
 your tickets you might just call 'kinit -R' at the beginning of the
 cronjob.

 bye,
 Sumit

 
  --
  Thank you,
  Dmitri Pal
 
  Sr. Engineering Manager IdM portfolio
  Red Hat, Inc.
 

  --
  Manage your subscription for the Freeipa-users mailing list:
  https://www.redhat.com/mailman/listinfo/freeipa-users
  Go To http://freeipa.org for more info on the project

 --
 Manage your subscription for the Freeipa-users mailing list:
 https://www.redhat.com/mailman/listinfo/freeipa-users
 Go To http://freeipa.org for more info on the project

-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go To http://freeipa.org for more info on the project

[Freeipa-users] Kerberos for cronjoob

[Thomas Lau]

 ‎Hi,

Is it possible to renew ticket once in a while for cronjob to run on
certain users? How do you guys run cronjob on Kerberos user without getting
ticket expire?

Sent from my BlackBerry 10 smartphone.
-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go To http://freeipa.org for more info on the project

Re: [Freeipa-users] vsftpd PAM setup problem

[Thomas Lau]

Thanks, all good now.

On Fri, Oct 31, 2014 at 1:40 PM, Alexander Bokovoy aboko...@redhat.com
wrote:

 On Fri, 31 Oct 2014, Thomas Lau wrote:

 Hi All,

 I am using vsftpd and auth against PAM (eventually to sss), but I can't
 login even using admin account, anyone could provide some hints on how to
 make it work? here is the detail log on sssd_us.domain.com.log:


 You need to fix permissions of /tmp:

 [krb5_auth_prepare_ccache_name] (0x4000): Recreating  ccache file.
 [check_parent_stat] (0x0020): Private directory can only be created below
 a directory belonging to root or to [121843][121843].
 [create_ccache_dir] (0x0080): check_parent_stat failed for directory
 [/tmp].
 [krb5_auth_prepare_ccache_name] (0x0040): ccache creation failed.
 [ipa_auth_handler_done] (0x0040): krb5_auth_recv request failed.
 [be_pam_handler_callback] (0x0100): Backend returned: (0, 4, NULL)
 [Success]



 --
 / Alexander Bokovoy




-- 
Thomas Lau
Director of Infrastructure
Tetrion Capital Limited

Mobile: +852-9323-9670
Address: 20/F, IFC 1, Central district, Hong Kong
-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go To http://freeipa.org for more info on the project

Re: [Openvpn-users] Wireless Extender?

[Thomas Lau]

It still depends on what OpenVPN client you are using. If you use the
cheapest one it might not work.

Sent from my BlackBerry 10 smartphone.
  Original Message
From: Eric Crist
Sent: Friday, 5 September, 2014 9:20 PM
To: David Frascone
Reply To: Eric Crist
Cc: openvpn-users@lists.sourceforge.net
Subject: Re: [Openvpn-users] Wireless Extender?

Completely off topic.

However, if you simply set the SSID and password the same, it's always
just magically worked in my experience.

 On Sep 5, 2014, at 8:12 AM, David Frascone d...@frascone.com wrote:


 Does anyone have any experience using a wireless extender? I do not want to 
 deal with multiple SSID's, unless I have to. I'd prefer it to just work 
 magically.

 And, I'd rather not take up two bands -- I'm happy to run gigabit. (So, 
 basically, as far as my openwrt router is concerned, the data would come in 
 over ethernet -- but share the SSID?)

 Thoughts? Is this possible? I just want a basic AP :)

 My current setup is openwrt on a Buffalo AirStation

 Thanks in advance,


 -Dave
 --
 Slashdot TV.
 Video for Nerds. Stuff that matters.
 http://tv.slashdot.org/
 ___
 Openvpn-users mailing list
 Openvpn-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/openvpn-users

--
Slashdot TV.
Video for Nerds. Stuff that matters.
http://tv.slashdot.org/
___
Openvpn-users mailing list
Openvpn-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/openvpn-users

--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
Openvpn-users mailing list
Openvpn-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/openvpn-users

[rt-users] customfield error: date

[Thomas Lau]

[critical]: Unknown CustomField type: Date (/opt/rt4/share/html/Elements/BulkCustomFields:81)






Does anyone have idea what's wrong with CustomField after upgrade from 4.0.13 to 4.2.0?

[rt-users] blue login bar after upgrade to RT 4.2

[Thomas Lau]

Hi All,

there is a strange blue Login bar on the top if login page, how could I change color into Red? Attached screenshot for you to have a look.








attachment: Image 1.png

[rt-users] One reminder for multiple queues

[Thomas Lau]

Dear All,

Currently we use rt-remind to send out daily reminder for each queue. But as 
our number of queue growth, number of reminder email also growing. Is that 
possible to consolidate multiple queues reminder into single email which 
execute via cronjob?

We found something like this:
http://requesttracker.wikia.com/wiki/RtUnifiedreminder


is it safe to use on RT 4.x ?

Re: [rt-users] Upgrade RT, what about plugin module?

[Thomas Lau]

Hi, Thanks for replying.


Does it means basically no extra step should do on plugin during minor version 
upgrade?

From: ruslan.zaki...@gmail.com [mailto:ruslan.zaki...@gmail.com] On Behalf Of 
Ruslan Zakirov
Sent: Thursday, May 23, 2013 1:27 PM
To: Thomas Lau
Cc: rt-users@lists.bestpractical.com
Subject: Re: [rt-users] Upgrade RT, what about plugin module?

On Thu, May 23, 2013 at 5:15 AM, Thomas Lau 
thomas@principleone.commailto:thomas@principleone.com wrote:
Hi,

I am wondering if plugin would have problem if I perform general minor version 
upgrade on 4.0.x?

They shouldn't. We work hard not to break backwards compatibility in minor 
versions and avoid database changes as much as possible.


Recently we intensively use more and more plugin which I am not sure if it will 
drive the upgrade more complicated.

We are using RT-Extension-CommandByMail, RT-Extension-RepeatTicket and 
RT-Extension-SLA.

All these should work with recent versions of 4.0.x.




--
RT Training in Seattle, June 19-20: http://bestpractical.com/training



--
Best regards, Ruslan.


-- 
RT Training in Seattle, June 19-20: http://bestpractical.com/training

[rt-users] Upgrade RT, what about plugin module?

[Thomas Lau]

Hi,

I am wondering if plugin would have problem if I perform general minor version 
upgrade on 4.0.x?

Recently we intensively use more and more plugin which I am not sure if it will 
drive the upgrade more complicated.

We are using RT-Extension-CommandByMail, RT-Extension-RepeatTicket and 
RT-Extension-SLA.


-- 
RT Training in Seattle, June 19-20: http://bestpractical.com/training

Re: [rt-users] Flaws on RT::Extension::RepeatTicket search

[Thomas Lau]

Hi Jim,

How could you put a debug statement on the script?


-Original Message-
From: Jim Brandt [mailto:jbra...@bestpractical.com] 
Sent: Friday, May 17, 2013 8:47 PM
To: Thomas Lau
Cc: rt-users@lists.bestpractical.com
Subject: Re: [rt-users] Flaws on RT::Extension::RepeatTicket search



 I did and it did show up. But the problem is that field only appear 
 when ticket already repeat at least one time, am I correct? For 
 example, now I create a recurrent ticket same month and day in next 
 year, after 3 months and I did a search, OriginalTicket should not 
 create as it haven't been repeat, please clarify if something wrong in 
 my concept. Thanks.

You're correct, the initial ticket doesn't record a link to itself which would 
allow you to search on it. To track down the repeating tickets that haven't 
repeated yet, look at the code in the rt-repeat-ticket script you schedule in 
cron. It looks for all tickets with attribute 'RepeatTicketSettings'. You could 
just put a debug statement in that script to print the ticket id of each 
ticket, then run the script.


-- 
RT Training in Seattle, June 19-20: http://bestpractical.com/training

Re: [rt-users] Flaws on RT::Extension::RepeatTicket search

[Thomas Lau]

Dear Jim, 

I did and it did show up. But the problem is that field only appear when ticket 
already repeat at least one time, am I correct? For example, now I create a 
recurrent ticket same month and day in next year, after 3 months and I did a 
search, OriginalTicket should not create as it haven't been repeat, please 
clarify if something wrong in my concept. Thanks.

Thomas Lau
Senior Technology Analyst
Principle One Limited
27/F Kinwick Centre, 32 Hollywood Road, Central, Hong Kong
T  +852 3555 2217 F  +852 3555   M  +852 3555 2017
Hong Kong   .   Singapore   .   Tokyo 

-Original Message-
From: rt-users-boun...@lists.bestpractical.com 
[mailto:rt-users-boun...@lists.bestpractical.com] On Behalf Of Jim Brandt
Sent: Wednesday, May 15, 2013 7:46 PM
To: rt-users@lists.bestpractical.com
Subject: Re: [rt-users] Flaws on RT::Extension::RepeatTicket search

On 5/14/13 10:26 PM, Thomas Lau wrote:
 Hi,

 I recently tested out the new RT::Extension::RepeatTicket module, it 
 works out great, but the search feature is basically non-existence.

 How could I search the original ticket which is GOING to repeat later 
 on? Current situation there is no way to do this, please advise.

Each ticket created in the recurrence should have a custom field called 
Original Ticket with the id of the ticket that controls the recurrence. 
Maybe you didn't run the 'make initdb' step when installing to create the 
custom field?



--
RT Training in Seattle, June 19-20: http://bestpractical.com/training


-- 
RT Training in Seattle, June 19-20: http://bestpractical.com/training

[rt-users] Flaws on RT::Extension::RepeatTicket search

[Thomas Lau]

Hi,

I recently tested out the new RT::Extension::RepeatTicket module, it works out 
great, but the search feature is basically non-existence.

How could I search the original ticket which is GOING to repeat later on? 
Current situation there is no way to do this, please advise.


-- 
RT Training in Seattle, June 19-20: http://bestpractical.com/training

[rt-users] CommandByMailGroup setting

[Thomas Lau]

Hi all,

CommandByMailGroup does not work in my server. May I know if this setting is 
correct?

Set(@Plugins, qw(
RT::Extension::CommandByMail
RT::Extension::SLA
RT::Extension::RepeatTicket
));

Set($CommandByMailGroup, 310346);
Set($CommandByMailGroup, 310347);
Set($CommandByMailGroup, 310348);
Set($CommandByMailGroup, 246519);


-- 
RT Training in Seattle, June 19-20: http://bestpractical.com/training

Re: [rt-users] CommandByMailGroup setting

[Thomas Lau]

What if I need multiple groups?

-Original Message-
From: Jok Thuau [mailto:jth...@spacex.com] 
Sent: Thursday, May 09, 2013 11:54 AM
To: Thomas Lau
Cc: rt-users@lists.bestpractical.com
Subject: Re: [rt-users] CommandByMailGroup setting

You can only have one I believe.

Jok

On May 8, 2013, at 8:15 PM, Thomas Lau 
thomas@principleone.commailto:thomas@principleone.com wrote:

Hi all,

CommandByMailGroup does not work in my server. May I know if this setting is 
correct?

Set(@Plugins, qw(
RT::Extension::CommandByMail
RT::Extension::SLA
RT::Extension::RepeatTicket
));

Set($CommandByMailGroup, 310346);
Set($CommandByMailGroup, 310347);
Set($CommandByMailGroup, 310348);
Set($CommandByMailGroup, 246519);


--
RT Training in Seattle, June 19-20: http://bestpractical.com/training


-- 
RT Training in Seattle, June 19-20: http://bestpractical.com/training

[rt-users] show all CC email address on email

[Thomas Lau]

Dear All,

Does anyone know how to show all CC email address on the ticket itself when 
email out?

Thomas Lau
Senior Technology Analyst
Principle One Limited
27/F Kinwick Centre, 32 Hollywood Road, Central, Hong Kong
T  +852 3555 2217 F  +852 3555   M  +852 9880 1217
Hong Kong   .   Singapore   .   Tokyo



-- 
RT training in Amsterdam, March 20-21: 
http://bestpractical.com/services/training.html

Help improve RT by taking our user survey: 
https://www.surveymonkey.com/s/N23JW9T

Re: [rt-users] RT: Scrip IsApplicable died?

[Thomas Lau]

Dear Ruslan,

How could I tell? Which one is the core problem?


-Original Message-
From: ruslan.zaki...@gmail.com [mailto:ruslan.zaki...@gmail.com] On Behalf Of 
Ruslan Zakirov
Sent: Thursday, January 31, 2013 7:40 PM
To: Thomas Lau
Cc: rt-users@lists.bestpractical.com
Subject: Re: [rt-users] RT: Scrip IsApplicable died?

Hi,

@Plugins options is set incorrectly or permissions on files are incorrect.

On Thu, Jan 31, 2013 at 9:50 AM, Thomas Lau thomas@principleone.com wrote:
 Hi all, after install command by email. Something strange appear on my 
 message log:



 RT: Scrip IsApplicable 43 died. - Require of 
 RT::Condition::SLA_RequireStartsSet failed.#012Can't locate 
 RT/Condition/SLA_RequireStartsSet.pm in @INC (@INC contains:
 /opt/rt4/sbin/../local/lib
 /opt/rt4/local/plugins/RT-Extension-CommandByMail/lib 
 /opt/rt4/sbin/../lib
 /usr/local/lib64/perl5 /usr/local/share/perl5 
 /usr/lib64/perl5/vendor_perl /usr/share/perl5/vendor_perl 
 /usr/lib64/perl5 /usr/share/perl5 . /etc/httpd) at (eval 2487) line 
 3.#012#012Stack:#012  [(eval 2487):3]#012
 [/opt/rt4/sbin/../lib/RT/Scrip.pm:404]#012
 [/opt/rt4/sbin/../lib/RT/Scrips.pm:225]#012
 [/opt/rt4/sbin/../lib/RT/Transaction.pm:179]#012
 [/opt/rt4/sbin/../lib/RT/Record.pm:1493]#012
 [/opt/rt4/sbin/../lib/RT/Ticket.pm:676]#012
 [/opt/rt4/local/plugins/RT-Extension-CommandByMail/lib/RT/Interface/Em
 ail/Filter/TakeAction.pm:531]#012
 [/opt/rt4/sbin/../lib/RT/Interface/Email.pm:1664]#012
 [/opt/rt4/sbin/../lib/RT/Interface/Email.pm:1481]#012
 [/opt/rt4/share/html/REST/1.0/NoAuth/mail-gateway:61]#012#012#012Stack
 :#012
 [/opt/rt4/sbin/../lib/RT/ScripCondition.pm:171]#012
 [/opt/rt4/sbin/../lib/RT/Scrip.pm:404]#012
 [/opt/rt4/sbin/../lib/RT/Scrips.pm:225]#012
 [/opt/rt4/sbin/../lib/RT/Transaction.pm:179]#012
 [/opt/rt4/sbin/../lib/RT/Record.pm:1493]#012
 [/opt/rt4/sbin/../lib/RT/Ticket.pm:676]#012
 [/opt/rt4/local/plugins/RT-Extension-CommandByMail/lib/RT/Interface/Em
 ail/Filter/TakeAction.pm:531]#012
 [/opt/rt4/sbin/../lib/RT/Interface/Email.pm:1664]#012
 [/opt/rt4/sbin/../lib/RT/Interface/Email.pm:1481]#012
 [/opt/rt4/share/html/REST/1.0/NoAuth/mail-gateway:61]
 (/opt/rt4/sbin/../lib/RT/Scrip.pm:419)



 But SLA_RequireStartsSet.pm is in location of 
 /opt/rt4/local/plugins/RT-Extension-SLA/lib/RT/Condition/SLA_RequireSt
 artsSet.pm



 How could I modify to make the error message disappear ?

 Thomas Lau
 Senior Technology Analyst
 Principle One Limited
 27/F Kinwick Centre, 32 Hollywood Road, Central, Hong Kong
 T  +852 3555 2217 F  +852 3555   M  +852 9880 1217

 Hong Kong   .   Singapore   .   Tokyo





--
Best regards, Ruslan.

[rt-users] template modification

[Thomas Lau]

Following is the current situation:



Wed Jan 16 08:31:41 2013: Request 124 was acted upon.



   Transaction : Given to y by o

   Queue   : Test

  Subject : Test Printer does not work

   Owner   : y

   Requestors  : a...@abc.com

   Status  : new

   Ticket URL  : http://domain.com/Ticket/Display.html?id=81134

   Type:

   Summary:

   ResolvedMethodBy:

   Category:

   Response Time (Minutes):

   SLA : platinum

   Overdue:

   Client Response:

   DN:

   Problem Status:

   Rework:

   Severity:







This transaction appears to have no content

___
RT-Attach-Message: yes

{$Transaction-CreatedAsString}: Request {$Ticket-id} was acted upon.

   Transaction : {$Transaction-Description}
   Queue   : {$Ticket-QueueObj-Name}
   Subject : {$Transaction-Subject || $Ticket-Subject || (No subject 
given)}
   Owner   : {$Ticket-OwnerObj-Name}
   Requestors  : {$Ticket-RequestorAddresses}
   Status  : {$Ticket-Status}
   Ticket URL  : {$RT::WebURL}Ticket/Display.html?id={$Ticket-id}
{
my $CustomFields = $Ticket-QueueObj-TicketCustomFields();
while (my $CustomField = $CustomFields-Next()) {
   my $CustomFieldValues=$Ticket-CustomFieldValues($CustomField-Id);
   $OUT .= . $CustomField-Name;
   if ($CustomFieldValues-Count) {
 my $spacer;
 if ( $CustomField-Type ne 'FreeformMultiple' and
  $CustomField-Type ne 'SelectMultiple' ) {
   $spacer =   x (12 - length($CustomField-Name));
 } else {
   $spacer = \n;
 }
 $OUT .= $spacer . : ;
   } else {
 $OUT .= : \n;
 next;
   }
   while (my $CustomFieldValue = $CustomFieldValues-Next) {
 $OUT .=   if ( $CustomField-Type eq 'FreeformMultiple' or
   $CustomField-Type eq 'SelectMultiple' );
 $OUT .= $CustomFieldValue-Content . \n;
   }
   $OUT .= \n if ( $CustomField-Type eq 'FreeformMultiple' or
   $CustomField-Type eq 'SelectMultiple' );
}
$OUT;
}


{$Transaction-Content()}

How could I cut off all other field down to this?


   Transaction : Given to y by o
   Queue   : Principle One Asia
   Subject : test change owner
   Owner   : y
   Summary:
   Ticket URL  : http://domain.com/Ticket/Display.html?id=81476

[rt-users] RT: Scrip IsApplicable died?

[Thomas Lau]

Hi all, after install command by email. Something strange appear on my message 
log:

RT: Scrip IsApplicable 43 died. - Require of 
RT::Condition::SLA_RequireStartsSet failed.#012Can't locate 
RT/Condition/SLA_RequireStartsSet.pm in @INC (@INC contains: 
/opt/rt4/sbin/../local/lib 
/opt/rt4/local/plugins/RT-Extension-CommandByMail/lib /opt/rt4/sbin/../lib 
/usr/local/lib64/perl5 /usr/local/share/perl5 /usr/lib64/perl5/vendor_perl 
/usr/share/perl5/vendor_perl /usr/lib64/perl5 /usr/share/perl5 . /etc/httpd) at 
(eval 2487) line 3.#012#012Stack:#012  [(eval 2487):3]#012  
[/opt/rt4/sbin/../lib/RT/Scrip.pm:404]#012  
[/opt/rt4/sbin/../lib/RT/Scrips.pm:225]#012  
[/opt/rt4/sbin/../lib/RT/Transaction.pm:179]#012  
[/opt/rt4/sbin/../lib/RT/Record.pm:1493]#012  
[/opt/rt4/sbin/../lib/RT/Ticket.pm:676]#012  
[/opt/rt4/local/plugins/RT-Extension-CommandByMail/lib/RT/Interface/Email/Filter/TakeAction.pm:531]#012
  [/opt/rt4/sbin/../lib/RT/Interface/Email.pm:1664]#012  
[/opt/rt4/sbin/../lib/RT/Interface/Email.pm:1481]#012  
[/opt/rt4/share/html/REST/1.0/NoAuth/mail-gateway:61]#012#012#012Stack:#012  
[/opt/rt4/sbin/../lib/RT/ScripCondition.pm:171]#012  
[/opt/rt4/sbin/../lib/RT/Scrip.pm:404]#012  
[/opt/rt4/sbin/../lib/RT/Scrips.pm:225]#012  
[/opt/rt4/sbin/../lib/RT/Transaction.pm:179]#012  
[/opt/rt4/sbin/../lib/RT/Record.pm:1493]#012  
[/opt/rt4/sbin/../lib/RT/Ticket.pm:676]#012  
[/opt/rt4/local/plugins/RT-Extension-CommandByMail/lib/RT/Interface/Email/Filter/TakeAction.pm:531]#012
  [/opt/rt4/sbin/../lib/RT/Interface/Email.pm:1664]#012  
[/opt/rt4/sbin/../lib/RT/Interface/Email.pm:1481]#012  
[/opt/rt4/share/html/REST/1.0/NoAuth/mail-gateway:61] 
(/opt/rt4/sbin/../lib/RT/Scrip.pm:419)

But SLA_RequireStartsSet.pm is in location of 
/opt/rt4/local/plugins/RT-Extension-SLA/lib/RT/Condition/SLA_RequireStartsSet.pm

How could I modify to make the error message disappear ?
Thomas Lau
Senior Technology Analyst
Principle One Limited
27/F Kinwick Centre, 32 Hollywood Road, Central, Hong Kong
T  +852 3555 2217 F  +852 3555   M  +852 9880 1217
Hong Kong   .   Singapore   .   Tokyo

[rt-users] command by mail line breaker

[Thomas Lau]

Got a slight problem on command by mail. I'm trying to update a multi line test 
box but I can only update it via example 1 instead of example 2, any idea how 
to add in a line break?

Eg1
Cf.{Summary}: line 1
Line 2 -- this will not be recorded



Eg2
Cf.{summary}: line1 line 2
We need line 2 on the second line

Any idea how to get it working?
Thomas Lau
Senior Technology Analyst
Principle One Limited
27/F Kinwick Centre, 32 Hollywood Road, Central, Hong Kong
T  +852 3555 2217 F  +852 3555   M  +852 9880 1217
Hong Kong   .   Singapore   .   Tokyo

[rt-users] email dashboard with grid

[Thomas Lau]

Dear All,

Does anyone know if dashboard which scheduled to send out could include grid on 
table?

Thomas Lau
Senior Technology Analyst
Principle One Limited
27/F Kinwick Centre, 32 Hollywood Road, Central, Hong Kong
T  +852 3555 2217 F  +852 3555   M  +852 9880 1217
Hong Kong   .   Singapore   .   Tokyo


We're hiring! http://bestpractical.com/jobs

[rt-users] User remote ticket ID on title

[Thomas Lau]

Dear All,

May I know what's the best method to avoid user remove ticket ID on title 
during email forwarding?

Is that possible to insert a random string into email content at the end of 
email which generate by each ticket? So that RT could capture and match the 
string even the email being forward.

Please advise.

Thomas Lau
Senior Technology Analyst
Principle One Limited
27/F Kinwick Centre, 32 Hollywood Road, Central, Hong Kong
T  +852 3555 2217 F  +852 3555   M  +852 9880 1217
Hong Kong   .   Singapore   .   Tokyo


We're hiring! http://bestpractical.com/jobs

[Bacula-users] backup truecrypt container

[Thomas Lau]

Dear All,

I am wondering how could we do bacula backup on truecrypt container, we have 3 
container which the boss keep the key, so everyday boss will open the container 
image and send files, afterward the container is closed, and we need to backup 
everyday, each container consist with 600GB image. I tested with incremental 
backup, seems bacula can't copy delta within files, but the redo full backup on 
those containers because it have been changed.

Any solution to deal with this ?

Thomas Lau
Senior Technology Analyst
Principle One Limited
27/F Kinwick Centre, 32 Hollywood Road, Central, Hong Kong
T  +852 3555 2217 F  +852 3555   M  +852 9880 1217
Hong Kong   .   Singapore   .   Tokyo

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[rt-users] extra safety on RT internal comments

[Thomas Lau]

Dear All,

We have something call 
abc-inter...@clientdomain.commailto:abc-inter...@clientdomain.com which use 
as internal comments, sometime someone accidently send out email without 
-internal to cause email directly send to client, is there have a way to 
confirm if the internal comment is being filter and not send to client ?!

Thomas Lau
Senior Technology Analyst
Principle One Limited
27/F Kinwick Centre, 32 Hollywood Road, Central, Hong Kong
T  +852 3555 2217 F  +852 3555   M  +852 9880 1217
Hong Kong   .   Singapore   .   Tokyo

[rsyslog] severity discard

[Thomas Lau]

Dear All,

Does anyone know how could I discard severity from 6 -7?

0 Emergency: system is unusable
1 Alert: action must be taken immediately
2 Critical: critical conditions
3 Error: error conditions
4 Warning: warning conditions
5 Notice: normal but significant condition
6 Informational: informational messages
7 Debug: debug-level messages


Thomas Lau
Senior Technology Analyst
Principle One Limited
27/F Kinwick Centre, 32 Hollywood Road, Central, Hong Kong
T  +852 3555 2217 F  +852 3555   M  +852 9880 1217
Hong Kong   .   Singapore   .   Tokyo

___
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards

Re: [rsyslog] severity discard

[Thomas Lau]

*.info;*.debug ~ :ommysql

Like that ?

Thomas Lau
Senior Technology Analyst 
Principle One Limited
27/F Kinwick Centre, 32 Hollywood Road, Central, Hong Kong
T  +852 3555 2217 F  +852 3555   M  +852 9880 1217
Hong Kong   .   Singapore   .   Tokyo 


-Original Message-
From: rsyslog-boun...@lists.adiscon.com 
[mailto:rsyslog-boun...@lists.adiscon.com] On Behalf Of da...@lang.hm
Sent: Friday, June 22, 2012 9:18 AM
To: rsyslog-users
Subject: Re: [rsyslog] severity discard

this should work

*.debug,*.info ~

David Lang

On Fri, 22 Jun 2012, Thomas Lau wrote:

 Date: Fri, 22 Jun 2012 08:56:05 +0800
 From: Thomas Lau thomas@principleone.com
 Reply-To: rsyslog-users rsyslog@lists.adiscon.com
 To: rsyslog@lists.adiscon.com rsyslog@lists.adiscon.com
 Subject: [rsyslog] severity discard
 
 Dear All,

 Does anyone know how could I discard severity from 6 -7?

 0 Emergency: system is unusable
 1 Alert: action must be taken immediately
 2 Critical: critical conditions
 3 Error: error conditions
 4 Warning: warning conditions
 5 Notice: normal but significant condition
 6 Informational: informational messages
 7 Debug: debug-level messages


 Thomas Lau
 Senior Technology Analyst
 Principle One Limited
 27/F Kinwick Centre, 32 Hollywood Road, Central, Hong Kong
 T  +852 3555 2217 F  +852 3555   M  +852 9880 1217
 Hong Kong   .   Singapore   .   Tokyo

 ___
 rsyslog mailing list
 http://lists.adiscon.net/mailman/listinfo/rsyslog
 http://www.rsyslog.com/professional-services/
 What's up with rsyslog? Follow https://twitter.com/rgerhards

___
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
___
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards