[Sikuli-driver] [Question #678057]: capture command wrong using vnc
New question #678057 on Sikuli:
https://answers.launchpad.net/sikuli/+question/678057
Hello,
I managed to use sikulix on a vnc connection and are writing due to two points:
- I'd like to share my experience making it work
- I'd like to report an issue.
Point 1, my way:
I have a Windows 7 machine running in a virtual box that I'd like to control
with sikulix (1.1.3 BTW) using vnc. My host also is Windows 7.
The first vnc server I tried to use was UltraVNC. Installation procedure worked
really smooth, connection using vncviewer from the host worked but with sikulix
I was not able to read screen content. capture only showed black screens (yes,
I played around with wait(1-5)).
The next vnc-server I played around was tiger vnc because I read success
messaged here and in the docs.
Unfortunately the tiger vnc installer let me alone with the firewall settings
and did not tell me. Since I found that out and opened the firewall for vnc, I
was able to capture the screen and work with sikulix.
My script currently is looking like this:
client = vncStart(ip="192.168.56.104", port=5900 )
#wait( 5 )
img = client.capture()
client.click( client.wait("StartButton.png",10) )
client.type( "Explorer" )
client.click( client.wait("Windows-Explorer.png") )
client.stop();
Point 2:
when I use the capture(filename) variant as capture( client, "Test.png" ) my
screenshot file shows a screenshot from the host instead of the virtual box, so
I guess there's something like a 'feature' somewhere in there.
Thank you for listeing!
Regards,
Christoph
--
You received this question notification because your team Sikuli Drivers
is an answer contact for Sikuli.
___
Mailing list: https://launchpad.net/~sikuli-driver
Post to : sikuli-driver@lists.launchpad.net
Unsubscribe : https://launchpad.net/~sikuli-driver
More help : https://help.launchpad.net/ListHelp
Re: [Sikuli-driver] [Question #678057]: capture command wrong using vnc
Question #678057 on Sikuli changed: https://answers.launchpad.net/sikuli/+question/678057 Christoph Fetzer posted a new comment: Hi! Thank you very much for the information. I think, your first point (client.capture( client, "Test.png" )) won't help, because docs say: only available in Python scripting (MUST be used as such undotted) That's why I didn't even try. I'll give it a chance But I am very happy with your second solution because I only intend to work with the mut using vnc and that will also help with all other undotted commands. Thank you very much again! Regards, Christoph -- You received this question notification because your team Sikuli Drivers is an answer contact for Sikuli. ___ Mailing list: https://launchpad.net/~sikuli-driver Post to : sikuli-driver@lists.launchpad.net Unsubscribe : https://launchpad.net/~sikuli-driver More help : https://help.launchpad.net/ListHelp
Re: [Sikuli-driver] [Question #678057]: capture command wrong using vnc
Question #678057 on Sikuli changed: https://answers.launchpad.net/sikuli/+question/678057 Status: Answered => Solved Christoph Fetzer confirmed that the question is solved: Thanks RaiMan, that solved my question. -- You received this question notification because your team Sikuli Drivers is an answer contact for Sikuli. ___ Mailing list: https://launchpad.net/~sikuli-driver Post to : sikuli-driver@lists.launchpad.net Unsubscribe : https://launchpad.net/~sikuli-driver More help : https://help.launchpad.net/ListHelp
Re: [Sikuli-driver] [Question #678057]: capture command wrong using vnc
Question #678057 on Sikuli changed: https://answers.launchpad.net/sikuli/+question/678057 Status: Solved => Open Christoph Fetzer is still having a problem: Hm, sorry, i have to come back here. That's what I do: client = vncStart(ip="192.168.56.102", port=5900 ) use( client ) wait( 1 ) type( "R", Key.WIN ) wait( 1 ) capture( client, "1.png" ) That's what I get: [error] script [ Install ] stopped with error at line --unknown-- [error] Error caused by: Traceback (most recent call last): File "D:\x\anovis2\Funktionstest\sikuli\Install.sikuli\Install.py", line 7, in capture( client, "1.png" ) File "C:\Users\CKl\AppData\Roaming\Sikulix\Lib\sikuli\Sikuli.py", line 57, in capture shot = SCREEN.cmdCapture(args) AttributeError: 'org.sikuli.vnc.VNCScreen' object has no attribute 'cmdCapture' -- You received this question notification because your team Sikuli Drivers is an answer contact for Sikuli. ___ Mailing list: https://launchpad.net/~sikuli-driver Post to : sikuli-driver@lists.launchpad.net Unsubscribe : https://launchpad.net/~sikuli-driver More help : https://help.launchpad.net/ListHelp
Re: [Sikuli-driver] [Question #678057]: capture command wrong using vnc
Question #678057 on Sikuli changed: https://answers.launchpad.net/sikuli/+question/678057 Christoph Fetzer posted a new comment: Sorry, forgot about one thing: type( "R", Key.WIN ) doesn't seem to work. Also a combination of keyDowns doesn't work. -- You received this question notification because your team Sikuli Drivers is an answer contact for Sikuli. ___ Mailing list: https://launchpad.net/~sikuli-driver Post to : sikuli-driver@lists.launchpad.net Unsubscribe : https://launchpad.net/~sikuli-driver More help : https://help.launchpad.net/ListHelp
Re: [Sikuli-driver] [Question #678057]: capture command wrong using vnc
Question #678057 on Sikuli changed: https://answers.launchpad.net/sikuli/+question/678057 Christoph Fetzer posted a new comment: Some more questions, as I am going the first steps inside sikulix now and I'm wondering about some oddities: Documentation recommends entering text via "paste()". Ever tried this in a cmd-Window? (Hint: the result you get looks "^V") Documentation says, you can enter text using type() only on US keyboards and instead it recommends paste(). Ever tried to enter a path in a cmd-shell of a german windows? -- You received this question notification because your team Sikuli Drivers is an answer contact for Sikuli. ___ Mailing list: https://launchpad.net/~sikuli-driver Post to : sikuli-driver@lists.launchpad.net Unsubscribe : https://launchpad.net/~sikuli-driver More help : https://help.launchpad.net/ListHelp
Re: [Sikuli-driver] [Question #678057]: capture command wrong using vnc
Question #678057 on Sikuli changed:
https://answers.launchpad.net/sikuli/+question/678057
Christoph Fetzer posted a new comment:
Thank you very much for your investigations!
Some experiences from me:
For me it seems, I accidentally used my machine under test using the
virtual box GUI instead of the vnc interface. As I am consequently using
client.blabla hardly anything is working.
My script:
client = vncStart(ip="192.168.56.102", port=5900 )
wait( 1 )
client.type( "r", Key.WIN )
client.capture().saveInBundle("1.png")
client.keyDown( Key.WIN )
client.keyUp()
wait( 10 )
client.capture().saveInBundle("2.png")
client.wait("Ausfuehren.png",10)
client.capture().saveInBundle("3.png")
Capture 1 shows only the clean desktop (OK, I should wait but there really
happens nothing).
Capture 2 shows an incomplete Start menu that doesn't contain what I'd like to
search for in the next step (is there a way to give you the file?).
In the virtual box GUI I see a complete Start menu.
When I remove the client. before the wait(), everything s working but not the
intended way. (it's supposed to run on a jenkins controlling virtual test
machines on vSphere).
By the way I updated to 1.1.4 in the meantime.
A - surprise! With that typing paths suddenly works.
--
You received this question notification because your team Sikuli Drivers
is an answer contact for Sikuli.
___
Mailing list: https://launchpad.net/~sikuli-driver
Post to : sikuli-driver@lists.launchpad.net
Unsubscribe : https://launchpad.net/~sikuli-driver
More help : https://help.launchpad.net/ListHelp
Re: [Sikuli-driver] [Question #678057]: capture command wrong using vnc
Question #678057 on Sikuli changed: https://answers.launchpad.net/sikuli/+question/678057 Christoph Fetzer posted a new comment: Hi! I mixed two issues, sorry for making this not clear enough: client.type( "r", Key.WIN ) -> will never show any result, regardlesss how long I wait. Neither on the screen of the virtual box, nor over the vnc connection. Instead I hear some sound out of the virtual machine but I can't relate the source. client.keyDown( Key.WIN ) client.keyUp() # wait for the start menu instead of the ausführen window is a workaround for failing step 1. client.type( "cmd.exe" ) Issue two: this wait for the screenshot will fail regardless how long I wait (I went up to 20s). Cause: the captures taken from the vnc connection show an incomplete startmenu with the parts missing, I am searching for ( the entry field at the bottom with the text "Programme/Dateien durchsuchen"). If I use the wait undotted and instead search on my host system in the virtual box window, everything works fine. -- You received this question notification because your team Sikuli Drivers is an answer contact for Sikuli. ___ Mailing list: https://launchpad.net/~sikuli-driver Post to : sikuli-driver@lists.launchpad.net Unsubscribe : https://launchpad.net/~sikuli-driver More help : https://help.launchpad.net/ListHelp
Re: [Sikuli-driver] [Question #678057]: capture command wrong using vnc
Question #678057 on Sikuli changed: https://answers.launchpad.net/sikuli/+question/678057 Christoph Fetzer posted a new comment: Any news on this? Can I help by explaining more detailed what the problem is for me? I might take some screenshots and upload or make a short video and upload to youtube if it helps. -- You received this question notification because your team Sikuli Drivers is an answer contact for Sikuli. ___ Mailing list: https://launchpad.net/~sikuli-driver Post to : sikuli-driver@lists.launchpad.net Unsubscribe : https://launchpad.net/~sikuli-driver More help : https://help.launchpad.net/ListHelp
[Sikuli-driver] [Bug 1817031] Re: VNC some key commands not working in Windows guests
Sorry, was intended to become a question. -- You received this bug notification because you are a member of Sikuli Drivers, which is subscribed to Sikuli. https://bugs.launchpad.net/bugs/1817031 Title: VNC some key commands not working in Windows guests Status in Sikuli: New Bug description: Hi! I am currently developing some software tests using virtual Windows 7 and 10 guests in VirtualBox. My VNC-Server on the guests is TigerVNC. I am discovering some keystrokes on the machines not working properly. On Windows 10 my problems are: the code: client = vncStart(ip="192.168.56.100", port=5900, password="vnc" ) wait( 1 ) client.type( "r", Key.WIN ) nothing happens. Instead this is working: client.keyDown( Key.WIN ) client.type( "r" ) client.keyUp() when I do this sequence: client.keyDown( Key.WIN ) client.keyUp() wait(1) client.type( "cmd.exe" ) client.type( Key.ENTER ) wait(1) client.type( "cd \\" ) client.type( Key.ENTER ) wait(1) I am missing all the ENTER-keys The combination client.type( "cmd.exe" + Key.ENTER ) isn't working as well. With the Windows 7 client, I have the following: client = vncStart(ip="192.168.56.101", port=5900, password="vnc" ) wait( 1 ) client.type( "r", Key.WIN ) -> nothing happens client.keyDown( Key.WIN ) client.type( "r", Key.WIN ) client.keyUp() -> works In this code snippet RETURN-keys are working: client.type( "cmd.exe" ) client.type( Key.ENTER ) wait(1) client.type( "cd \\" ) client.type( Key.ENTER ) wait(1) I am aware that I need to implement something like a handshake, a combination of type(...) and wait(...) for a screenshot but with the waits I have another issue I am asking for in another question. Best regards, Christoph To manage notifications about this bug go to: https://bugs.launchpad.net/sikuli/+bug/1817031/+subscriptions ___ Mailing list: https://launchpad.net/~sikuli-driver Post to : sikuli-driver@lists.launchpad.net Unsubscribe : https://launchpad.net/~sikuli-driver More help : https://help.launchpad.net/ListHelp
[Sikuli-driver] [Bug 1817031] [NEW] VNC some key commands not working in Windows guests
Public bug reported: Hi! I am currently developing some software tests using virtual Windows 7 and 10 guests in VirtualBox. My VNC-Server on the guests is TigerVNC. I am discovering some keystrokes on the machines not working properly. On Windows 10 my problems are: the code: client = vncStart(ip="192.168.56.100", port=5900, password="vnc" ) wait( 1 ) client.type( "r", Key.WIN ) nothing happens. Instead this is working: client.keyDown( Key.WIN ) client.type( "r" ) client.keyUp() when I do this sequence: client.keyDown( Key.WIN ) client.keyUp() wait(1) client.type( "cmd.exe" ) client.type( Key.ENTER ) wait(1) client.type( "cd \\" ) client.type( Key.ENTER ) wait(1) I am missing all the ENTER-keys The combination client.type( "cmd.exe" + Key.ENTER ) isn't working as well. With the Windows 7 client, I have the following: client = vncStart(ip="192.168.56.101", port=5900, password="vnc" ) wait( 1 ) client.type( "r", Key.WIN ) -> nothing happens client.keyDown( Key.WIN ) client.type( "r", Key.WIN ) client.keyUp() -> works In this code snippet RETURN-keys are working: client.type( "cmd.exe" ) client.type( Key.ENTER ) wait(1) client.type( "cd \\" ) client.type( Key.ENTER ) wait(1) I am aware that I need to implement something like a handshake, a combination of type(...) and wait(...) for a screenshot but with the waits I have another issue I am asking for in another question. Best regards, Christoph ** Affects: sikuli Importance: Undecided Status: New -- You received this bug notification because you are a member of Sikuli Drivers, which is subscribed to Sikuli. https://bugs.launchpad.net/bugs/1817031 Title: VNC some key commands not working in Windows guests Status in Sikuli: New Bug description: Hi! I am currently developing some software tests using virtual Windows 7 and 10 guests in VirtualBox. My VNC-Server on the guests is TigerVNC. I am discovering some keystrokes on the machines not working properly. On Windows 10 my problems are: the code: client = vncStart(ip="192.168.56.100", port=5900, password="vnc" ) wait( 1 ) client.type( "r", Key.WIN ) nothing happens. Instead this is working: client.keyDown( Key.WIN ) client.type( "r" ) client.keyUp() when I do this sequence: client.keyDown( Key.WIN ) client.keyUp() wait(1) client.type( "cmd.exe" ) client.type( Key.ENTER ) wait(1) client.type( "cd \\" ) client.type( Key.ENTER ) wait(1) I am missing all the ENTER-keys The combination client.type( "cmd.exe" + Key.ENTER ) isn't working as well. With the Windows 7 client, I have the following: client = vncStart(ip="192.168.56.101", port=5900, password="vnc" ) wait( 1 ) client.type( "r", Key.WIN ) -> nothing happens client.keyDown( Key.WIN ) client.type( "r", Key.WIN ) client.keyUp() -> works In this code snippet RETURN-keys are working: client.type( "cmd.exe" ) client.type( Key.ENTER ) wait(1) client.type( "cd \\" ) client.type( Key.ENTER ) wait(1) I am aware that I need to implement something like a handshake, a combination of type(...) and wait(...) for a screenshot but with the waits I have another issue I am asking for in another question. Best regards, Christoph To manage notifications about this bug go to: https://bugs.launchpad.net/sikuli/+bug/1817031/+subscriptions ___ Mailing list: https://launchpad.net/~sikuli-driver Post to : sikuli-driver@lists.launchpad.net Unsubscribe : https://launchpad.net/~sikuli-driver More help : https://help.launchpad.net/ListHelp
[Sikuli-driver] [Bug 1817046] [NEW] VNC synchronisation of screen content for wait and capture not working properly
Public bug reported:
Hi!
I am currently developing some software tests using virtual Windows 7
and 10 guests in VirtualBox. My VNC-Server on the guests is TigerVNC.
What I am trying:
client = vncStart(ip="192.168.56.100", port=5900, password="vnc" )
wait( 1 )
client.keyDown( Key.WIN )
client.type( "r" )
client.keyUp()
client.wait("Run.png",60)
Run.png is a screenshot of the "run"-panel in Windows 7 or 10.
This wait fails on both Windows 7 and 10.
The reason seems to be a failing synchronisation of the screen contents to the
client-object.
As a proof I made a capture of the client after 120s and attached the files for
Windows 7 and 10.
The code:
client.keyDown( Key.WIN )
client.type( "r" )
client.keyUp()
wait( 120 )
client.capture().saveInBundle("Win10.png")
Remark: on the virtual box window itself, I see the open run-panel, only the
capture is empty.
When I'm doing the wait and search-commands in my tests undotted on the
virtual desktop window , everything works fine. I only avoid this with
the goal starting the tests from a jenkins server testing virtual
machines later.
Best regards,
Christoph
** Affects: sikuli
Importance: Undecided
Status: New
** Attachment added: "screenshots.zip"
https://bugs.launchpad.net/bugs/1817046/+attachment/5240598/+files/screenshots.zip
--
You received this bug notification because you are a member of Sikuli
Drivers, which is subscribed to Sikuli.
https://bugs.launchpad.net/bugs/1817046
Title:
VNC synchronisation of screen content for wait and capture not working
properly
Status in Sikuli:
New
Bug description:
Hi!
I am currently developing some software tests using virtual Windows 7
and 10 guests in VirtualBox. My VNC-Server on the guests is TigerVNC.
What I am trying:
client = vncStart(ip="192.168.56.100", port=5900, password="vnc" )
wait( 1 )
client.keyDown( Key.WIN )
client.type( "r" )
client.keyUp()
client.wait("Run.png",60)
Run.png is a screenshot of the "run"-panel in Windows 7 or 10.
This wait fails on both Windows 7 and 10.
The reason seems to be a failing synchronisation of the screen contents to
the client-object.
As a proof I made a capture of the client after 120s and attached the files
for Windows 7 and 10.
The code:
client.keyDown( Key.WIN )
client.type( "r" )
client.keyUp()
wait( 120 )
client.capture().saveInBundle("Win10.png")
Remark: on the virtual box window itself, I see the open run-panel, only the
capture is empty.
When I'm doing the wait and search-commands in my tests undotted on
the virtual desktop window , everything works fine. I only avoid this
with the goal starting the tests from a jenkins server testing virtual
machines later.
Best regards,
Christoph
To manage notifications about this bug go to:
https://bugs.launchpad.net/sikuli/+bug/1817046/+subscriptions
___
Mailing list: https://launchpad.net/~sikuli-driver
Post to : sikuli-driver@lists.launchpad.net
Unsubscribe : https://launchpad.net/~sikuli-driver
More help : https://help.launchpad.net/ListHelp
