Virtual Keyboard

DeltaRocked · February 5, 2011

Hello All,

Designing a Vritual Keyboard is a bit easy stuff, but due to the existence of keyloggers, using the existing methods viz. Send / ControlSend do not serve the purpose.

This Virtual Keyboard has been designed to specifically defeat keyloggers and uses some un-usual methods to evade a keylogger.

1: ControlCommand with editpaste

2: IE browser - $oRange = 'x'

ControlCommand interacts directly with the GUI controls and effectively bypasses the keystate messages which are sent during Send / ControlSend. When working with IE , we need to understand the concepts of DOM, and have to interact with the DOM using COM . Since this is a simple task of inserting a character at the CARET's position not much complex coding is required, but as in my case, I had no idea on using DOM nor after completing this Virtual Keyboard makes me an expert on this topic but I found it very intriguing.

NOTE : Firefox, Google Chrome and Opera all have different deployments of COM (essential to interact with the DHTML controls) , IE is one browser which exposes the COM interface. With Firefox or Google Chrome this is not so.

Any ideas to extend the functionality of this Virtual Keyboard to make it work with Firefox or Chrome or Opera is always welcome.

[Edit 7Feb 2011 - 1]

presently looking into WAITR to find something useful.

[Edit]

[Edit 7Feb 2011 - 2]

presently working on defeating ZEUS type malware which take screenshots when a mouse is clicked. Which means when you click the button with the character is known to the malware by way of a screenshot. Some Malwares also take 20 by 20 pixel screenshots .

So the logic over here is to execute the code when Mouse button is down and then move the mouse pointer to its resting position and then do nothing on MouseUP event. So effectively this becomes a DRAG and not a click.

[Edit]

[Edit 7Feb 2011 - 3]

modified the au3 for anti Zeus. mouse events detected button down , code executed and mouse up. essentially creates the illusion of a drag.

[Edit]

[Edit 8Feb 2011 - 1]

modified the au3 for for mousemove. Now Mouse pointer is moved within the window.

[Edit]

This code has been borrowed generously from

And a big thanks to : PSaltyDS, Mat

Development Conversations:

Qwerty Version:

VirtualKeyboard.au3

For AZERTY Version : View Post No. 10

Edited February 14, 2011 by deltarocked

Emiel Wieldraaijer · February 6, 2011

Hi,

I tried the script and i must say .. nice..

ALT and KeyPad does not work to retrieve the ascii codes http://www.ascii.nl/

best regards,

Emiel

DeltaRocked · February 7, 2011

Hi,
I tried the script and i must say .. nice..
ALT and KeyPad does not work to retrieve the ascii codes http://www.ascii.nl/
best regards,
Emiel

Hi Emiel,

Keypad ? is which key?

Regards

Deltarocked

Yashied · February 7, 2011

Looks nice, but

Switch $nMsg
    Case $GUI_EVENT_CLOSE
        Exit
    Case ...
        
    Case ...

    Case ...
        
etc.

May be an array would be the best solution? Your code would be x10 less.

Edited February 7, 2011 by Yashied

jvanegmond · February 7, 2011

[Edit 7Feb 2011 - 2]
presently working on defeating ZEUS type malware which take screenshots when a mouse is clicked. Which means when you click the button with the character is known to the malware by way of a screenshot. Some Malwares also take 20 by 20 pixel screenshots .

So the logic over here is to execute the code when Mouse button is down and then move the mouse pointer to its resting position and then do nothing on MouseUP event. So effectively this becomes a DRAG and not a click.
[Edit]

The MMORPG RuneScape has had to face a lot of attacks from similar systems. You can use their knowledge and experience for your own benefit. This video: http://www.youtube.com/watch?v=wHz3CUNNW0I shows their approach used when the user has to enter a 4-digit PIN code to access their in-game banka account. For full security, I imagine that a similar approach will work very well for you.

Alternatively, KeePass (a program to store and auto-type your passwords) has been in the business for years. I have no idea how exactly they approach the problem, but it is worth checking out. Their website is here: http://keepass.info/

Edited February 7, 2011 by Manadar

DeltaRocked · February 7, 2011

The MMORPG RuneScape has had to face a lot of attacks from similar systems. You can use their knowledge and experience for your own benefit. This video: http://www.youtube.com/watch?v=wHz3CUNNW0I shows their approach used when the user has to enter a 4-digit PIN code to access their in-game banka account. For full security, I imagine that a similar approach will work very well for you.
Alternatively, KeePass (a program to store and auto-type your passwords) has been in the business for years. I have no idea how exactly they approach the problem, but it is worth checking out. Their website is here: http://keepass.info/

MMORPG - nice idea to make the button invisible on mouse hover ... and then interchanging the buttons.... wonder what would be the user perception wont the user get confused with the ever changing keyboard ? but there might be a way out .

KeePass - encryption great .... but uses the standard keystrokes sending mechanism .... cannot avert keyloggers... use SPY++ to view the messages (keyboard)...

Yashied : will incorporate the arrays ... even I am fed up with the longer code... as such I am not the original author of that code... all i have done is change the key-sending function...

Edited February 7, 2011 by deltarocked

Emiel Wieldraaijer · February 7, 2011

The KeyPad are the numeric keys

zackrspv · February 7, 2011

The KeyPad are the numeric keys

Interesting concept, and would cool skinned. However, when i move the keyboard to another monitor, and try to use it to control a window, it resets to 0,0 on the primary monitor (mouse moves there that is), and you have to keep moving back for every keypress.

Win 7 x64 here.

DeltaRocked · February 8, 2011

The KeyPad are the numeric keys

Ahh KeyPad - numeric keypad is functional ... the only difference being that instead of sending NUMPAD0 to NUMPAD9 , i am sending 0 to 9 signals... but yet I will check it out ...

[EDIT]

Tested the NumKeyPad ... it works ... tested on WInXP and W2k3 Only issue is it display {NumLock} will check it out in the code.

561

+-*/0.{NumLock}{NumLock}

[Edit]

The newer code resets the mouse to 0,0 on screen . The reason is that I have tested it against Zeus malware which takes a screenshot at EVERY CLICK and by this method all we get is a screenshot without any mouse Cursor hovering over the keyboard. .

In case you want, you may comment the line MouseMove(0,0,0) which is inside the function WM_EVENTS.

On Dual Monitors: the desktop is an extended one so I think a routine needs to be added to find the 0,0 of the current monitor and then reset the mouse to the 0,0 or another method would be find the co-ordinates of the window and move the mouse within the keyboard window .

yesterday I was trying to do this but found 0,0 to be a v v easy ... (Lazy...)

[DONE]

$arr_win = WinGetPos(WinGetTitle($Form1))
MouseMove($arr_win[0] + $arr_win[2] - 40, $arr_win[1] + 25, 0)

[DONE]

Regards

DeltaRocked.

Edited February 8, 2011 by deltarocked

pierrotm777 · February 14, 2011

This is my AZERTY version

#NoTrayIcon
#region ;**** Directives created by AutoIt3Wrapper_GUI ****
#AutoIt3Wrapper_icon=1295599487_Gnome-Input-Keyboard-64.ico
#AutoIt3Wrapper_outfile=Virtual_Keyboard.exe
#AutoIt3Wrapper_Compression=4
#AutoIt3Wrapper_Res_Description=Virtual Keyboard with Anti - KeyLogger
#AutoIt3Wrapper_Res_Fileversion=1.1.0.6
#AutoIt3Wrapper_Res_Language=1033
#AutoIt3Wrapper_Res_Field=ProductName|Virtual Keyboard with Anti - KeyLogger
#AutoIt3Wrapper_Res_Field=InternalName|VirtualKeyboard.exe
#AutoIt3Wrapper_Res_Field=ProductVersion|1.1.0.6
#AutoIt3Wrapper_Res_Field=OriginalFilename|VirtualKeyboard.exe
#AutoIt3Wrapper_Run_Tidy=y
#endregion ;**** Directives created by AutoIt3Wrapper_GUI ****

#include <ButtonConstants.au3>
#include <GUIConstantsEx.au3>
#include <WindowsConstants.au3>
#include <StaticConstants.au3>
#include <Array.au3>
#include <WinAPI.au3>
#include <IE.au3>

Opt("WinWaitDelay", 0)
Opt("SendKeyDelay", 0)
Opt("SendKeyDownDelay", 0)
Opt("Sendcapslockmode", 0)
Opt("TrayIconHide", 1)
Opt("GUICloseOnESC", 0)

Global $fLeftShiftHolden = False
Global $fLeftAltHolden = False
Global $fLeftCtrlHolden = False
Global $fRightShiftHolden = False
Global $fRightAltHolden = False
Global $fRightCtrlHolden = False
Global Const $VK_NUMLOCK = 0x90
Global Const $VK_SCROLL = 0x91
Global Const $VK_CAPITAL = 0x14
Global $ctrlstatus = 0, $altstatus = 0, $shiftstatus = 0
;
Global $_NOACTIVATE = 0x08000000
Global $MA_NOACTIVATE = 3
Global $MA_NOACTIVATEANDEAT = 4
Global $keyStroke_Array[68] = ['{SPACE}', '{ENTER}', '{ALT}', '{BS}', '{BACKSPACE}', '{DEL}', '{UP}', '{DOWN}', _
        '{LEFT}', '{RIGHT}', '{HOME}', '{END}', '{ESC}', '{INS}', '{PGUP}', '{PGDN}', '{F1}', '{F2}', '{F3}', _
        '{F4}', '{F5}', '{F6}', '{F7}', '{F8}', '{F9}', '{F10}', '{F11}', '{F12}', '{TAB}', '{PRINTSCREEN}', '{LWIN}', _
        '{RWIN}', '{BREAK}', '{PAUSE}', '{NUMPADMULT}', '{NUMPADADD}', '{NUMPADSUB}', '{NUMPADDIV}', '{NUMPADDOT}', _
        '{NUMPADENTER}', '{APPSKEY}', '{LALT}', '{RALT}', '{LCTRL}', '{RCTRL}', '{LSHIFT}', '{RSHIFT}', '{SLEEP}', _
        '{NUMPAD0}', '{NUMPAD1}', '{NUMPAD2}', '{NUMPAD3}', '{NUMPAD4}', '{NUMPAD5}', '{NUMPAD6}', '{NUMPAD7}', _
        '{NUMPAD8}', '{NUMPAD9}', '{ALTDOWN}', '{SHIFTDOWN}', '{CTRLDOWN}', '{ALTUP}', '{CTRLUP}', '{SHIFTUP}', '{CAPSLOCK}', _
        '{INSERT}', '{DELETE}', '{Escape}']

_ArraySort($keyStroke_Array)

HotKeySet("{Esc}", "Quit")

$ProductVersion = "v0.1"
$MainGUITitle = "Virtual Keyboard " & $ProductVersion & " - "
$Form1 = GUICreate($MainGUITitle, 722, 194, 300, 300, -1, BitOR($WS_EX_TOOLWINDOW, $WS_EX_TOPMOST, $_NOACTIVATE));$WS_POPUPWINDOW;BitOR($WS_EX_TOOLWINDOW, $WS_EX_TOPMOST, $WS_EX_WINDOWEDGE))
$Esc = GUICtrlCreateButton("Esc", 0, 0, 33, 25, $WS_GROUP)
$F1 = GUICtrlCreateButton("F1", 48, 0, 33, 25, $WS_GROUP)
$F2 = GUICtrlCreateButton("F2", 80, 0, 33, 25, $WS_GROUP)
$F3 = GUICtrlCreateButton("F3", 112, 0, 33, 25, $WS_GROUP)
$F4 = GUICtrlCreateButton("F4", 144, 0, 33, 25, $WS_GROUP)
$F5 = GUICtrlCreateButton("F5", 184, 0, 33, 25, $WS_GROUP)
$F6 = GUICtrlCreateButton("F6", 216, 0, 33, 25, $WS_GROUP)
$F7 = GUICtrlCreateButton("F7", 248, 0, 33, 25, $WS_GROUP)
$F8 = GUICtrlCreateButton("F8", 280, 0, 33, 25, $WS_GROUP)
$F9 = GUICtrlCreateButton("F9", 320, 0, 33, 25, $WS_GROUP)
$F10 = GUICtrlCreateButton("F10", 352, 0, 33, 25, $WS_GROUP)
$F11 = GUICtrlCreateButton("F11", 385, 0, 33, 25, $WS_GROUP)
$F12 = GUICtrlCreateButton("F12", 417, 0, 33, 25, $WS_GROUP)
$PrintScreen = GUICtrlCreateButton("prtscr", 488, 0, 33, 25, $WS_GROUP)
$ScrollLock = GUICtrlCreateButton("scr lo", 520, 0, 33, 25, $WS_GROUP)
$PauseBreak = GUICtrlCreateButton("pa br", 552, 0, 33, 25, $WS_GROUP)
$petit2 = GUICtrlCreateButton("²", 0, 32, 33, 33, $WS_GROUP)
$Etcommercial = GUICtrlCreateButton("&&", 32, 32, 33, 33, $WS_GROUP)
$Eaccentaigue = GUICtrlCreateButton("é", 64, 32, 33, 33, $WS_GROUP)
$Cote = GUICtrlCreateButton('"', 96, 32, 33, 33, $WS_GROUP)
$Apostrophe = GUICtrlCreateButton("'", 128, 32, 33, 33, $WS_GROUP)
$Ouvreparenthese = GUICtrlCreateButton("(", 160, 32, 33, 33, $WS_GROUP)
$Minus = GUICtrlCreateButton("-", 192, 32, 33, 33, $WS_GROUP)
$Eaccentgrave = GUICtrlCreateButton("è", 224, 32, 33, 33, $WS_GROUP)
$Underscore = GUICtrlCreateButton("_", 256, 32, 33, 33, $WS_GROUP)
$Ccedille = GUICtrlCreateButton("ç", 288, 32, 33, 33, $WS_GROUP)
$Aaccentgrave = GUICtrlCreateButton("à", 320, 32, 33, 33, $WS_GROUP)
$Fermeparenthese = GUICtrlCreateButton(")", 352, 32, 33, 33, $WS_GROUP)
$Equal = GUICtrlCreateButton("=", 384, 32, 33, 33, $WS_GROUP)
$Back = GUICtrlCreateButton("<-------", 416, 32, 65, 33, $WS_GROUP)
$Insert = GUICtrlCreateButton("Insert", 488, 32, 33, 33, $WS_GROUP)
$Home = GUICtrlCreateButton("Home", 520, 32, 33, 33, $WS_GROUP)
$PageUp = GUICtrlCreateButton("PgUp", 552, 32, 33, 33, $WS_GROUP)
$NumberLock = GUICtrlCreateButton("NmLo", 592, 32, 33, 33, $WS_GROUP)
$NumberPadSlash = GUICtrlCreateButton("/", 624, 32, 33, 33, $WS_GROUP)
$NumberPadX = GUICtrlCreateButton("*", 656, 32, 33, 33, $WS_GROUP)
$NumberPadMinus = GUICtrlCreateButton("-", 688, 32, 33, 33, $WS_GROUP)
$Tab = GUICtrlCreateButton("Tab", 0, 64, 41, 33, $WS_GROUP)
$a = GUICtrlCreateButton("A", 40, 64, 33, 33, $WS_GROUP)
$z = GUICtrlCreateButton("Z", 72, 64, 33, 33, $WS_GROUP)
$e = GUICtrlCreateButton("E", 104, 64, 33, 33, $WS_GROUP)
$r = GUICtrlCreateButton("R", 136, 64, 33, 33, $WS_GROUP)
$t = GUICtrlCreateButton("T", 168, 64, 33, 33, $WS_GROUP)
$y = GUICtrlCreateButton("Y", 200, 64, 33, 33, $WS_GROUP)
$u = GUICtrlCreateButton("U", 232, 64, 33, 33, $WS_GROUP)
$i = GUICtrlCreateButton("I", 264, 64, 33, 33, $WS_GROUP)
$o = GUICtrlCreateButton("O", 296, 64, 33, 33, $WS_GROUP)
$p = GUICtrlCreateButton("P", 328, 64, 33, 33, $WS_GROUP)
$Acentcirconflex = GUICtrlCreateButton("^", 360, 64, 33, 33, $WS_GROUP)
$Dollar = GUICtrlCreateButton("$", 392, 64, 33, 33, $WS_GROUP)
$Enter = GUICtrlCreateButton("Enter", 424, 64, 57, 65, $WS_GROUP)
$Delete = GUICtrlCreateButton("Del", 488, 64, 33, 33, $WS_GROUP)
$End = GUICtrlCreateButton("End", 520, 64, 33, 33, $WS_GROUP)
$PageDown = GUICtrlCreateButton("PgDn", 552, 64, 33, 33, $WS_GROUP)
$NumberPad7 = GUICtrlCreateButton("7", 592, 64, 33, 33, $WS_GROUP)
$NumberPad8 = GUICtrlCreateButton("8", 624, 64, 33, 33, $WS_GROUP)
$NumberPad9 = GUICtrlCreateButton("9", 656, 64, 33, 33, $WS_GROUP)
$NumberPadPlus = GUICtrlCreateButton("+", 688, 64, 33, 65, $WS_GROUP)
$CapsLock = GUICtrlCreateButton("CapsLck", 0, 96, 49, 33, $WS_GROUP)
$q = GUICtrlCreateButton("Q", 48, 96, 33, 33, $WS_GROUP)
$s = GUICtrlCreateButton("S", 80, 96, 33, 33, $WS_GROUP)
$d = GUICtrlCreateButton("D", 112, 96, 33, 33, $WS_GROUP)
$f = GUICtrlCreateButton("F", 144, 96, 33, 33, $WS_GROUP)
$g = GUICtrlCreateButton("G", 176, 96, 33, 33, $WS_GROUP)
$h = GUICtrlCreateButton("H", 208, 96, 33, 33, $WS_GROUP)
$j = GUICtrlCreateButton("J", 240, 96, 33, 33, $WS_GROUP)
$k = GUICtrlCreateButton("K", 272, 96, 33, 33, $WS_GROUP)
$l = GUICtrlCreateButton("L", 304, 96, 33, 33, $WS_GROUP)
$m = GUICtrlCreateButton("M", 336, 96, 33, 33, $WS_GROUP)
$Uaccentaigue = GUICtrlCreateButton("ù", 368, 96, 33, 33, $WS_GROUP)
$Etoile = GUICtrlCreateButton("*", 400, 96, 33, 33, $WS_GROUP)
$NumberPad4 = GUICtrlCreateButton("4", 592, 96, 33, 33, $WS_GROUP)
$NumberPad5 = GUICtrlCreateButton("5", 624, 96, 33, 33, $WS_GROUP)
$NumberPad6 = GUICtrlCreateButton("6", 656, 96, 33, 33, $WS_GROUP)
$LeftShift = GUICtrlCreateButton("Shift", 0, 128, 33, 33, $WS_GROUP)
$LeftSlash = GUICtrlCreateButton("\", 32, 128, 33, 33, $WS_GROUP)
$w = GUICtrlCreateButton("W", 64, 128, 33, 33, $WS_GROUP)
$x = GUICtrlCreateButton("X", 96, 128, 33, 33, $WS_GROUP)
$c = GUICtrlCreateButton("C", 128, 128, 33, 33, $WS_GROUP)
$v = GUICtrlCreateButton("V", 160, 128, 33, 33, $WS_GROUP)
$b = GUICtrlCreateButton("B", 192, 128, 33, 33, $WS_GROUP)
$n = GUICtrlCreateButton("N", 224, 128, 33, 33, $WS_GROUP)
$Comma = GUICtrlCreateButton(",", 256, 128, 33, 33, $WS_GROUP)
$Colon = GUICtrlCreateButton(";", 288, 128, 33, 33, $WS_GROUP)
$DoubleDot = GUICtrlCreateButton(":", 320, 128, 33, 33, $WS_GROUP)
$EsclamationDot = GUICtrlCreateButton("!", 352, 128, 33, 33, $WS_GROUP)
$RightShift = GUICtrlCreateButton("Shift", 384, 128, 97, 33, $WS_GROUP)
$NumberPad1 = GUICtrlCreateButton("1", 592, 128, 33, 33, $WS_GROUP)
$NumberPad2 = GUICtrlCreateButton("2", 624, 128, 33, 33, $WS_GROUP)
$NumberPad3 = GUICtrlCreateButton("3", 656, 128, 33, 33, $WS_GROUP)
$NumberPadEnter = GUICtrlCreateButton("Enter", 688, 128, 33, 65, $WS_GROUP)
$LeftCtrl = GUICtrlCreateButton("Ctrl", 0, 160, 41, 33, $WS_GROUP)
$LeftWindows = GUICtrlCreateButton("Win", 40, 160, 41, 33, $WS_GROUP)
$LeftAlt = GUICtrlCreateButton("Alt", 80, 160, 41, 33, $WS_GROUP)
$Space = GUICtrlCreateButton("Space", 120, 160, 201, 33, $WS_GROUP)
$RightAlt = GUICtrlCreateButton("Alt", 320, 160, 41, 33, $WS_GROUP)
$RightWindows = GUICtrlCreateButton("Win", 360, 160, 41, 33, $WS_GROUP)
$RightCtrl = GUICtrlCreateButton("Ctrl", 400, 160, 81, 33, $WS_GROUP)
$NumberPad0 = GUICtrlCreateButton("0", 592, 160, 65, 33, $WS_GROUP)
$NumberPadDot = GUICtrlCreateButton(".", 656, 160, 33, 33, $WS_GROUP)
$LeftArrow = GUICtrlCreateButton("<", 488, 160, 33, 33, $WS_GROUP)
$DownArrow = GUICtrlCreateButton("|", 520, 160, 33, 33, $WS_GROUP)
$RightArrow = GUICtrlCreateButton(">", 552, 160, 33, 33, $WS_GROUP)
$UpArrow = GUICtrlCreateButton("^", 520, 128, 33, 33, $WS_GROUP)
;Pictures:
$NumberLockOnPic = GUICtrlCreatePic("on.bmp", 600, 3, 18, 26, BitOR($SS_NOTIFY, $WS_GROUP, $WS_CLIPSIBLINGS))
$NumberLockOffPic = GUICtrlCreatePic("off.bmp", 600, 3, 18, 26, BitOR($SS_NOTIFY, $WS_GROUP, $WS_CLIPSIBLINGS))
$CapsLockOnPic = GUICtrlCreatePic("on.bmp", 624, 3, 18, 26, BitOR($SS_NOTIFY, $WS_GROUP, $WS_CLIPSIBLINGS))
$CapsLockOffPic = GUICtrlCreatePic("off.bmp", 624, 3, 18, 26, BitOR($SS_NOTIFY, $WS_GROUP, $WS_CLIPSIBLINGS))
$ScrollLockOnPic = GUICtrlCreatePic("on.bmp", 648, 3, 18, 26, BitOR($SS_NOTIFY, $WS_GROUP, $WS_CLIPSIBLINGS))
$ScrollLockOffPic = GUICtrlCreatePic("off.bmp", 648, 3, 18, 26, BitOR($SS_NOTIFY, $WS_GROUP, $WS_CLIPSIBLINGS))

;Setting Pictures:
_GetNumLock()
_GetCapsLock()
_GetScrollLock()
If _GetNumLock() = 1 Then
    $NumberLockOn = True
Else
    GUICtrlSetState($NumberLockOnPic, $GUI_HIDE)
    $NumberLockOn = False
EndIf

If _GetCapsLock() = 1 Then
    $CapsLockOn = True
Else
    GUICtrlSetState($CapsLockOnPic, $GUI_HIDE);;
    $CapsLockOn = False
EndIf

If _GetScrollLock() = 1 Then
    $ScrollLockOn = True
Else
    GUICtrlSetState($ScrollLockOnPic, $GUI_HIDE)
    $ScrollLockOn = False
EndIf
;Current focused window will remain focused even after the keyboard GUI is up:
;~ GUISetState()
GUISetState(@SW_HIDE)
GUIRegisterMsg($WM_MOUSEACTIVATE, 'WM_EVENTS')
$WGT = WinGetTitle("", "")
GUISetState(@SW_SHOWNOACTIVATE)
WinActivate($WGT)


While 1
    If WinActive($Form1) = False Then
        WinSetTitle($Form1, "", $MainGUITitle & WinGetTitle("", ""))
    EndIf
    $nMsg = GUIGetMsg()
    Switch $nMsg
        Case $GUI_EVENT_CLOSE
            Exit
        Case $ScrollLock
            _ScrollLockPushed()
        Case $NumberLock
            _NumberLockPushed()
        Case $CapsLock
            _CapsLockPushed()
        Case $Esc
            PressButton("{Escape}", 0)
        Case $F1
            PressButton("{F1}", 0)
        Case $F2
            PressButton("{F2}", 0)
        Case $F3
            PressButton("{F3}", 0)
        Case $F4
            PressButton("{F4}", 0)
        Case $F5
            PressButton("{F5}", 0)
        Case $F6
            PressButton("{F6}", 0)
        Case $F7
            PressButton("{F7}", 0)
        Case $F8
            PressButton("{F8}", 0)
        Case $F9
            PressButton("{F9}", 0)
        Case $F10
            PressButton("{F10}", 0)
        Case $F11
            PressButton("{F11}", 0)
        Case $F12
            PressButton("{F12}", 0)
        Case $PrintScreen
            GUISetState(@SW_HIDE)
            PressButton("{PrintScreen}", 0)
            GUISetState(@SW_SHOW)
        Case $PauseBreak
            PressButton("{PAUSE}", 0)
        Case $petit2
            PressButton("²", 0)
        Case $Etcommercial
            PressButton("&", 0)
        Case $Eaccentaigue
            PressButton("é", 0)
        Case $Cote
            PressButton('"', 0)
        Case $Apostrophe
            PressButton("'", 0)
        Case $Ouvreparenthese
            PressButton("(", 0)
        Case $Minus
            PressButton("-", 0)
        Case $Eaccentgrave
            PressButton("è", 0)
        Case $Underscore
            PressButton("_", 0)
        Case $Ccedille
            PressButton("ç", 0)
        Case $Aaccentgrave
            PressButton("à", 0)
        Case $Fermeparenthese
            PressButton(")", 0)
        Case $Equal
            PressButton("=", 0)
        Case $Back
            PressButton("{Backspace}", 0)
        Case $Insert
            PressButton("{Insert}", 0)
        Case $Home
            PressButton("{Home}", 0)
        Case $PageUp
            PressButton("{PgUp}", 0)
        Case $NumberPadSlash
            PressButton("/", 0)
        Case $NumberPadX
            PressButton("*", 0)
        Case $NumberPadMinus
            PressButton("-", 0)
        Case $Tab
            PressButton("{Tab}", 0)
        Case $q
            PressButton("q", 0)
        Case $w
            PressButton("w", 0)
        Case $e
            PressButton("e", 0)
        Case $r
            PressButton("r", 0)
        Case $t
            PressButton("t", 0)
        Case $y
            PressButton("y", 0)
        Case $u
            PressButton("u", 0)
        Case $i
            PressButton("i", 0)
        Case $o
            PressButton("o", 0)
        Case $p
            PressButton("p", 0)
        Case $Acentcirconflex
            PressButton("^", 0)
        Case $Dollar
            PressButton("$", 0)
        Case $Enter
            PressButton("{Enter}", 0)
        Case $Delete
            PressButton("{Delete}", 0)
        Case $End
            PressButton("{End}", 0)
        Case $PageDown
            PressButton("{PgDn}", 0)
        Case $NumberPad7
            PressButton("7", 0)
        Case $NumberPad8
            PressButton("8", 0)
        Case $NumberPad9
            PressButton("9", 0)
        Case $NumberPadPlus
            PressButton("+", 0)
        Case $a
            PressButton("a", 0)
        Case $s
            PressButton("s", 0)
        Case $d
            PressButton("d", 0)
        Case $f
            PressButton("f", 0)
        Case $g
            PressButton("g", 0)
        Case $h
            PressButton("h", 0)
        Case $j
            PressButton("j", 0)
        Case $k
            PressButton("k", 0)
        Case $l
            PressButton("l", 0)
        Case $Colon
            PressButton(";", 0)
        Case $Uaccentaigue
            PressButton("ù", 0)
        Case $Etoile
            PressButton("*", 0)
        Case $NumberPad4
            PressButton("4", 0)
        Case $NumberPad5
            PressButton("5", 0)
        Case $NumberPad6
            PressButton("6", 0)
        Case $LeftSlash
            PressButton("\", 0)
        Case $z
            PressButton("z", 0)
        Case $x
            PressButton("x", 0)
        Case $c
            PressButton("c", 0)
        Case $v
            PressButton("v", 0)
        Case $b
            PressButton("b", 0)
        Case $n
            PressButton("n", 0)
        Case $m
            PressButton("m", 0)
        Case $Comma
            PressButton(",", 0)
        Case $DoubleDot
            PressButton(":", 0)
        Case $EsclamationDot
            PressButton("!", 0)
        Case $NumberPad1
            PressButton("1", 0)
        Case $NumberPad2
            PressButton("2", 0)
        Case $NumberPad3
            PressButton("3", 0)
        Case $NumberPadEnter
            PressButton("{Enter}", 0)
        Case $LeftWindows
            PressButton("{Lwin}", 0)
        Case $Space
            PressButton("{Space}", 0)
        Case $RightWindows
            PressButton("{Rwin}", 0)
        Case $NumberPad0
            PressButton("0", 0)
        Case $NumberPadDot
            PressButton(".", 0)
        Case $LeftArrow
            PressButton("{Left}", 0)
        Case $DownArrow
            PressButton("{Down}", 0)
        Case $RightArrow
            PressButton("{Right}", 0)
        Case $UpArrow
            PressButton("{Up}", 0)
        Case $LeftShift
            If $fLeftShiftHolden = False And $fRightShiftHolden = False Then
                PressButton("{SHIFTDOWN}", 1)
                $fLeftShiftHolden = True
                GUICtrlDelete($LeftShift)
                $LeftShift = GUICtrlCreateButton("Shift", 0, 128, 33, 33, $WS_GROUP, $WS_EX_CLIENTEDGE)
            ElseIf $fLeftShiftHolden = True And $fRightShiftHolden = False Then
                PressButton("{SHIFTUP}", 1)
                $fLeftShiftHolden = False
                GUICtrlDelete($LeftShift)
                $LeftShift = GUICtrlCreateButton("Shift", 0, 128, 33, 33, $WS_GROUP)
            ElseIf $fLeftShiftHolden = False And $fRightShiftHolden = True Then
                PressButton("{SHIFTDOWN}", 1)
                $fRightShiftHolden = False
                $fLeftShiftHolden = True
                GUICtrlDelete($LeftShift)
                GUICtrlDelete($RightShift)
                $LeftShift = GUICtrlCreateButton("Shift", 0, 128, 33, 33, $WS_GROUP, $WS_EX_CLIENTEDGE)
                $RightShift = GUICtrlCreateButton("Shift", 384, 128, 97, 33, $WS_GROUP)
            EndIf
        Case $RightShift
            If $fRightShiftHolden = False And $fLeftShiftHolden = False Then
                PressButton("{SHIFTDOWN}", 1)
                $fRightShiftHolden = True
                GUICtrlDelete($RightShift)
                $RightShift = GUICtrlCreateButton("Shift", 384, 128, 97, 33, $WS_GROUP, $WS_EX_CLIENTEDGE)
            ElseIf $fRightShiftHolden = True And $fLeftShiftHolden = False Then
                PressButton("{SHIFTUP}", 1)
                $fRightShiftHolden = False
                GUICtrlDelete($RightShift)
                $RightShift = GUICtrlCreateButton("Shift", 384, 128, 97, 33, $WS_GROUP)
            ElseIf $fRightShiftHolden = False And $fLeftShiftHolden = True Then
                PressButton("{SHIFTDOWN}", 1)
                $fLeftShiftHolden = False
                $fRightShiftHolden = True
                GUICtrlDelete($RightShift)
                GUICtrlDelete($LeftShift)
                $RightShift = GUICtrlCreateButton("Shift", 384, 128, 97, 33, $WS_GROUP, $WS_EX_CLIENTEDGE)
                $LeftShift = GUICtrlCreateButton("Shift", 0, 128, 33, 33, $WS_GROUP)
            EndIf
        Case $LeftCtrl
            If $fLeftCtrlHolden = False And $fRightCtrlHolden = False Then
                PressButton("{CTRLDOWN}", 1)
                $fLeftCtrlHolden = True
                GUICtrlDelete($LeftCtrl)
                $LeftCtrl = GUICtrlCreateButton("Ctrl", 0, 160, 41, 33, $WS_GROUP, $WS_EX_CLIENTEDGE)
            ElseIf $fLeftCtrlHolden = True And $fRightCtrlHolden = False Then
                PressButton("{CTRLUP}", 1)
                $fLeftCtrlHolden = False
                GUICtrlDelete($LeftCtrl)
                $LeftCtrl = GUICtrlCreateButton("Ctrl", 0, 160, 41, 33, $WS_GROUP)
            ElseIf $fLeftCtrlHolden = False And $fRightCtrlHolden = True Then
                PressButton("{CTRLDOWN}", 1)
                $fRightCtrlHolden = False
                $fLeftCtrlHolden = True
                GUICtrlDelete($LeftCtrl)
                GUICtrlDelete($RightCtrl)
                $LeftCtrl = GUICtrlCreateButton("Ctrl", 0, 160, 41, 33, $WS_GROUP, $WS_EX_CLIENTEDGE)
                $RightCtrl = GUICtrlCreateButton("Ctrl", 400, 160, 81, 33, $WS_GROUP)
            EndIf
        Case $RightCtrl
            If $fRightCtrlHolden = False And $fLeftCtrlHolden = False Then
                PressButton("{CTRLDOWN}", 1)
                $fRightCtrlHolden = True
                GUICtrlDelete($RightCtrl)
                $RightCtrl = GUICtrlCreateButton("Ctrl", 400, 160, 81, 33, $WS_GROUP, $WS_EX_CLIENTEDGE)
            ElseIf $fRightCtrlHolden = True And $fLeftCtrlHolden = False Then
                PressButton("{CTRLUP}", 1)
                $fRightCtrlHolden = False
                GUICtrlDelete($RightCtrl)
                $RightCtrl = GUICtrlCreateButton("Ctrl", 400, 160, 81, 33, $WS_GROUP)
            ElseIf $fRightCtrlHolden = False And $fLeftCtrlHolden = True Then
                PressButton("{CTRLDOWN}", 1)
                $fLeftCtrlHolden = False
                $fRightCtrlHolden = True
                GUICtrlDelete($RightCtrl)
                GUICtrlDelete($LeftCtrl)
                $RightCtrl = GUICtrlCreateButton("Ctrl", 400, 160, 81, 33, $WS_GROUP, $WS_EX_CLIENTEDGE)
                $LeftCtrl = GUICtrlCreateButton("Ctrl", 0, 160, 41, 33, $WS_GROUP)
            EndIf
        Case $LeftAlt
            If $fLeftAltHolden = False And $fRightAltHolden = False Then
                PressButton("{ALTDOWN}", 1)
                $fLeftAltHolden = True
                GUICtrlDelete($LeftAlt)
                $LeftAlt = GUICtrlCreateButton("Alt", 80, 160, 41, 33, $WS_GROUP, $WS_EX_CLIENTEDGE)
            ElseIf $fLeftAltHolden = True And $fRightAltHolden = False Then
                PressButton("{ALTUP}", 1)
                $fLeftAltHolden = False
                GUICtrlDelete($LeftAlt)
                $LeftAlt = GUICtrlCreateButton("Alt", 80, 160, 41, 33, $WS_GROUP)
            ElseIf $fLeftAltHolden = False And $fRightAltHolden = True Then
                PressButton("{ALTDOWN}", 1)
                $fRightAltHolden = False
                $fLeftAltHolden = True
                GUICtrlDelete($LeftAlt)
                GUICtrlDelete($RightAlt)
                $LeftAlt = GUICtrlCreateButton("Alt", 80, 160, 41, 33, $WS_GROUP, $WS_EX_CLIENTEDGE)
                $RightAlt = GUICtrlCreateButton("Alt", 320, 160, 41, 33, $WS_GROUP)
            EndIf
        Case $RightAlt
            If $fRightAltHolden = False And $fLeftAltHolden = False Then
                PressButton("{ALTDOWN}", 1)
                $fRightAltHolden = True
                GUICtrlDelete($RightAlt)
                $RightAlt = GUICtrlCreateButton("Alt", 320, 160, 41, 33, $WS_GROUP, $WS_EX_CLIENTEDGE)
            ElseIf $fRightAltHolden = True And $fLeftAltHolden = False Then
                PressButton("{ALTUP}", 1)
                $fRightAltHolden = False
                GUICtrlDelete($RightAlt)
                $RightAlt = GUICtrlCreateButton("Alt", 320, 160, 41, 33, $WS_GROUP)
            ElseIf $fRightAltHolden = False And $fLeftAltHolden = True Then
                PressButton("{ALTDOWN}", 1)
                $fLeftAltHolden = False
                $fRightAltHolden = True
                GUICtrlDelete($RightAlt)
                GUICtrlDelete($LeftAlt)
                $RightAlt = GUICtrlCreateButton("Alt", 320, 160, 41, 33, $WS_GROUP, $WS_EX_CLIENTEDGE)
                $LeftAlt = GUICtrlCreateButton("Alt", 80, 160, 41, 33, $WS_GROUP)
            EndIf
    EndSwitch
WEnd

Func PressButton($_Key, $_HoldNeeded)
    Local $ctrl
    $ReplacedString = StringReplace(WinGetTitle($Form1), "Virtual Keyboard v0.1 - ", "")
    $ctrl = ControlGetFocus($ReplacedString)
    $ie_handle = WinWaitActive(WinGetTitle('', ''))
    If WinActivate($ReplacedString) Then
        If _ArrayBinarySearch($keyStroke_Array, $_Key) <> -1 And $_Key <> "{TAB}" Then
            Select
                Case $_Key == '{SHIFTDOWN}'
                    $shiftstatus = 1
                Case $_Key == '{SHIFTUP}'
                    $shiftstatus = 0
                Case $_Key == '{CTRLDOWN}'
                    $ctrlstatus = 1
                Case $_Key == '{CTRLUP}'
                    $ctrlstatus = 0
                Case $_Key == '{ALTUP}'
                    $altstatus = 0
                Case $_Key == '{ALTDOWN}'
                    $altstatus = 1
                Case StringLower($_Key) == StringLower('{BS}')
                    ControlFocus($ReplacedString, "", $ctrl)
                    ControlSend($ReplacedString, "", $ctrl, "{ASC 008}")
                Case StringLower($_Key) == StringLower('{BACKSPACE}')
                    ControlFocus($ReplacedString, "", $ctrl)
                    ControlSend($ReplacedString, "", $ctrl, "{ASC 008}")
                Case Else
                    Send($_Key)
            EndSelect
        Else
            If $shiftstatus == 1 And $CapsLockOn == False And $ctrlstatus == 0 And $altstatus == 0 And $_Key <> "{TAB}" Then
;~              Send('0')
                ControlFocus($ReplacedString, "", $ctrl)
                If $ie_handle <> 0 And StringInStr($ctrl, 'Internet Explorer_Server', 0) > 0 Then
                    get_keyboard_focus($ie_handle, $ctrl, StringUpper($_Key))
                Else
                    ControlCommand($ReplacedString, "", $ctrl, "EditPaste", StringUpper($_Key))
                EndIf
            ElseIf $shiftstatus == 0 And $CapsLockOn == True And $ctrlstatus == 0 And $altstatus == 0 And $_Key <> "{TAB}" Then
                ControlFocus($ReplacedString, "", $ctrl)
                If $ie_handle <> 0 And StringInStr($ctrl, 'Internet Explorer_Server', 0) > 0 Then
                    get_keyboard_focus($ie_handle, $ctrl, StringUpper($_Key))
                Else
                    ControlCommand($ReplacedString, "", $ctrl, "EditPaste", StringUpper($_Key))
                EndIf
            ElseIf $shiftstatus == 1 And $CapsLockOn == True And $ctrlstatus == 0 And $altstatus == 0 And $_Key <> "{TAB}" Then
                ControlFocus($ReplacedString, "", $ctrl)
                If $ie_handle <> 0 And StringInStr($ctrl, 'Internet Explorer_Server', 0) > 0 Then
                    get_keyboard_focus($ie_handle, $ctrl, $_Key)
                Else
                    ControlCommand($ReplacedString, "", $ctrl, "EditPaste", $_Key)
                EndIf
            ElseIf $shiftstatus == 0 And $CapsLockOn == False And $ctrlstatus == 0 And $altstatus == 0 And $_Key <> "{TAB}" Then
                ControlFocus($ReplacedString, "", $ctrl)
                If $ie_handle <> 0 And StringInStr($ctrl, 'Internet Explorer_Server', 0) > 0 Then
                    get_keyboard_focus($ie_handle, $ctrl, $_Key)
                Else
                    ControlCommand($ReplacedString, "", $ctrl, "EditPaste", $_Key)
                EndIf
            ElseIf $ctrlstatus == 1 And $altstatus == 0 Then
                ControlFocus($ReplacedString, "", $ctrl)
                If $ie_handle <> 0 And StringInStr($ctrl, 'Internet Explorer_Server', 0) > 0 Then
                    get_keyboard_focus($ie_handle, $ctrl, $_Key)
                Else
                    ControlSend($ReplacedString, "", $ctrl, '^' & $_Key)
                EndIf
            ElseIf $ctrlstatus == 0 And $altstatus == 1 Then
                ControlFocus($ReplacedString, "", $ctrl)
                ControlSend($ReplacedString, "", $ctrl, '!' & $_Key)
            Else
                ControlFocus($ReplacedString, "", $ctrl)
                ControlSend($ReplacedString, "", $ctrl, "{ASC 0x09}")
            EndIf
        EndIf
    EndIf
    If $_HoldNeeded = 1 Then
        SoundPlay("Hold.wav")
    Else
        SoundPlay("Type.wav")
        SoundSetWaveVolume(10);Set volume for both Hold.wav and Type.wav
    EndIf
EndFunc   ;==>PressButton

Func get_keyboard_focus($ie_handle, $control_class_namenn, $key)
    _IEErrorHandlerRegister("MyErrFunc")
    $oIE = _IEAttach($ie_handle, 'Embedded')
    If IsObj($oIE) Then
        $oIE.document.activeElement.name
        If @error == 0 Then
            $oRange = $oIE.document.selection.createRange()
            $oRange.text = $key
            Return
        Else
            ConsoleWrite($key)
            ControlSend('', '', '', $key)
        EndIf
    EndIf
EndFunc   ;==>get_keyboard_focus

Func MyErrFunc()
    SetError(1, 1, 1)
    Return
EndFunc   ;==>MyErrFunc

Func _GetNumLock(); By GaryFrost
    Local $ret
    $ret = DllCall("user32.dll", "long", "GetKeyState", "long", $VK_NUMLOCK)
    Return $ret[0]
EndFunc   ;==>_GetNumLock

Func _GetScrollLock(); By GaryFrost
    Local $ret
    $ret = DllCall("user32.dll", "long", "GetKeyState", "long", $VK_SCROLL)
    Return $ret[0]
EndFunc   ;==>_GetScrollLock

Func _GetCapsLock(); By GaryFrost
    Local $ret
    $ret = DllCall("user32.dll", "long", "GetKeyState", "long", $VK_CAPITAL)
    Return $ret[0]
EndFunc   ;==>_GetCapsLock

Func Quit()
    GUIDelete($Form1)
    Exit
EndFunc   ;==>Quit

Func _NumberLockPushed()
    If $NumberLockOn = True Then
        GUICtrlSetState($NumberLockOnPic, $GUI_HIDE)
        PressButton("{NumLock}", 1)
        $NumberLockOn = False
    Else
        GUICtrlSetState($NumberLockOnPic, $GUI_SHOW)
        PressButton("{NumLock}", 1)
        $NumberLockOn = True
    EndIf
EndFunc   ;==>_NumberLockPushed

Func _ScrollLockPushed()
    If $ScrollLockOn = True Then
        GUICtrlSetState($ScrollLockOnPic, $GUI_HIDE)
        PressButton("{ScrollLock}", 1)
        $ScrollLockOn = False
    Else
        GUICtrlSetState($ScrollLockOnPic, $GUI_SHOW)
        PressButton("{ScrollLock}", 1)
        $ScrollLockOn = True
    EndIf
EndFunc   ;==>_ScrollLockPushed

Func _CapsLockPushed()
    If $CapsLockOn = True Then
        GUICtrlSetState($CapsLockOnPic, $GUI_HIDE)
        PressButton("{CapsLock}", 1)
        $CapsLockOn = False
    Else
        GUICtrlSetState($CapsLockOnPic, $GUI_SHOW)
        PressButton("{CapsLock}", 1)
        $CapsLockOn = True
    EndIf
EndFunc   ;==>_CapsLockPushed

Func WM_EVENTS($hWndGUI, $MsgID, $WParam, $LParam)
    Switch $hWndGUI
        Case $Form1
            Switch $MsgID
                Case $WM_MOUSEACTIVATE
                    ; Check mouse position
                    Local $aMouse_Pos = GUIGetCursorInfo($Form1)
                    If $aMouse_Pos[4] > 0 Then
                        Local $word = _WinAPI_MakeLong($aMouse_Pos[4], $BN_CLICKED)
                        _SendMessage($Form1, $WM_COMMAND, $word, GUICtrlGetHandle($aMouse_Pos[4]))
                        $arr_win = WinGetPos(WinGetTitle($Form1))
                        MouseMove($arr_win[0] + $arr_win[2] - 40, $arr_win[1] + 25, 0)
                    ElseIf $aMouse_Pos[1] < 0 And $aMouse_Pos[0] > 700 Then
                        Quit()
                    Else
                        WinActivate($Form1)
                    EndIf
                    Return $MA_NOACTIVATEANDEAT
            EndSwitch
    EndSwitch
    Return $GUI_RUNDEFMSG
EndFunc   ;==>WM_EVENTS

StandardUser · February 14, 2011

Why not just use default Windows on screen keyboard? (Start->Run->osk.exe)

DeltaRocked · February 14, 2011

Why not just use default Windows on screen keyboard? (Start->Run->osk.exe)

Cause most of the Virtual Keyboards are vulnerable to key-loggers.

pierrotm777 - Thanks for the AZERTY version.

Edited February 14, 2011 by deltarocked

DeltaRocked · April 12, 2011

Dear All,

IAccessible2Proxy.dll is to be used for Firefox for sending keystrokes. basically we set the text / modify the text of the string.

This dll is a component of accprobe, register the dll and utilise the IAccessibleEditableText function provided by the dll.

http://accessibility.linuxfoundation.org/a11yweb/util/accprobe/

working with dll's is not my cup of tea... so this is a open request for anyone who is an expert with using dll function calls in autoit.

A lot many things can be accomplished with IAccessible2 basically providing a UDF similar to IE.au3

Regards

Delta Rocked

PS for those who want to straightaway get cracking, here is the IAccessible2Proxy.dll

Mat · April 12, 2011

It's not a dll that's easy to use from AutoIt unfortunately :unsure: I imagine you'll have to do some research into using objects and interfaces in AutoIt (something I know little about), but my guess would be to get AutoItObject (usually somewhere near the top of example scripts) and download that. There are a few examples I know of already for dealing with similar dlls... If not then post in help and support. There should be someone who can help.

That could be an interesting alternative to FF.au3

DeltaRocked · April 14, 2011

It's not a dll that's easy to use from AutoIt unfortunately I imagine you'll have to do some research into using objects and interfaces in AutoIt (something I know little about), but my guess would be to get AutoItObject (usually somewhere near the top of example scripts) and download that. There are a few examples I know of already for dealing with similar dlls... If not then post in help and support. There should be someone who can help.
That could be an interesting alternative to FF.au3

Hello Mat,

thanks for your valuable input. started a new topic in General Support Forum.

Regards

Deltarocked.

Virtual Keyboard

Recommended Posts

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Create an account or sign in to comment

Create an account

Sign in

Recently Browsing 0 members