Jump to content

need help to create a tool for the blind users

Recommended Posts

hello sirs, i've created a tool to the blind users, this tool helps the blind to listen to a audio effect when moving between the GUIs controls on they computers
where this tool can get the class for the current focus control and play a sound from a folder
i've added all the knowne classes, but i found some problems i hope any one can help me.

this is the code that i created

#include <WinAPISys.au3>
Global $h_CurrentHWNDFocus = "", $h_CurrentControlHWNDFocus = ""
AdlibRegister("WindowAudioFocus", 50)
Func WindowAudioFocus()
    Local $h_NewHWNDFocus = WinGetHandle("[active]", "")
    Local $h_NewControlHWNDFocus = ControlGetFocus($h_NewHWNDFocus, "")
    If ($h_NewHWNDFocus = $h_CurrentHWNDFocus) And ($h_NewControlHWNDFocus = $h_CurrentControlHWNDFocus) Then Return 0
    If Not ($h_NewHWNDFocus = $h_CurrentHWNDFocus) Then
        SoundPlay(@ScriptDir & "\focus_Audio\WindowChanged.wav")
        Switch _WinAPI_GetClassName(ControlGetHandle($h_NewHWNDFocus, "", $h_NewControlHWNDFocus))
            Case "Button", "Start", "TrayButton", "TrayShowDesktopButtonWClass", "sbutton", "CirrussButton", "ODbcButton", "ThunderRTCommandButton", "ThunderSSOption", "ThunderSSCommand", "ThunderCommandButton", "ThunderRT6CommandButton", "ThunderRT5CommandButton", "TButton", "TBitBtn", "TAdvGlowButton", "ButtonWndClass", "afx:0:376:baa946", "_AOL_Button"
                If _IsCheckBox(ControlGetHandle($h_NewHWNDFocus, "", $h_NewControlHWNDFocus)) Then
                    SoundPlay(@ScriptDir & "\focus_Audio\checkBox.wav")
                ElseIf _IsRadio(ControlGetHandle($h_NewHWNDFocus, "", $h_NewControlHWNDFocus)) Then
                    SoundPlay(@ScriptDir & "\focus_Audio\radio.wav")
                    SoundPlay(@ScriptDir & "\focus_Audio\button.wav")
            Case "ComboBox", "ComboBoxEx32", "MSOBALLOONREComboBox20W", "REComboBox20W", "ThunderComboBox", "ThunderDriveListBox", "ThunderRT6ComboBox", "TORComboEdit", "TCombobox", "TComboBoxEx", "TORComboBox", "TColorBox", "TNFComboBox", "Internet Explorer_TridentCmbobx", "ComboWndClass", "_AOL_ComboBox", "ThunderRT5ComboBox", "ComboLBox"
                SoundPlay(@ScriptDir & "\focus_Audio\list.wav")
            Case "Edit", "SearchBox", "TChatRichEdit", "_WwN", "_WwO", "RichEdit20A", "RichEdit20WPT", "RICHEDIT60W", "OKttbx", "RichEditA", "ThunderTextBox", "ThunderRT6TextBox", "ThunderRT5TextBox", "TEdit", "TRichEdit", "TRichEditViewer", "TMemo", "TInplaceEditList", "TLabeledEdit", "TMaskEdit", "TDateTimePicker", "TRichEdit", "TCaptionMemo", "TAddictRichEdit", "TCaptionEdit", "RichTextWndClass", "TextWndClass", "PasswordWndClass", "TextAreaWndClass", "MSWorksDoc", "_AOL_Edit", "SysDateTimePick32"
                SoundPlay(@ScriptDir & "\focus_Audio\edit.wav")
            Case "ListBox", "ComboLBox", "REListBox20W", "SUPERGRID", "OUTEXVLB", "WMSUIVLB", "SchdmapiVLB", "VLBClass", "ThunderDirListBox", "ThunderFileListBox", "ThunderListBox", "ThunderRT6ListBox", "ThunderRT5ListBox", "TListbox", "TValueListEditor", "TORCalendar", "TColorListBox", "TCheckListBox", "Internet Explorer_TridentLstBox", "ListBoxWndClass", "ListWndClass", "hh_kwd_vlist", "afx:8:376:0:946", "_AOL_ListBox", "_AOL_Tree", ""
                SoundPlay(@ScriptDir & "\focus_Audio\List.wav")
            Case "SysListView32", "OpenListView", "wuDuiListView", "ListView20WndClass", "TcxGridSite", "TListView", "TSystemListView", "ListViewWndClass", ""
                SoundPlay(@ScriptDir & "\focus_Audio\ListView.wav")
            Case "SysTreeView32", "SearchTreeList", "FeatureTree", "TreeView20WndClass", "TSystemTreeView", "TTreeView", ""
                SoundPlay(@ScriptDir & "\focus_Audio\TreeView.wav")
            Case Else
                SoundPlay(@ScriptDir & "\focus_Audio\focus.wav")
    $h_CurrentHWNDFocus = $h_NewHWNDFocus
    $h_CurrentControlHWNDFocus = $h_NewControlHWNDFocus
    AdlibRegister("WindowAudioFocus", 50)
    Return 1
EndFunc   ;==>WindowAudioFocus
Func _IsCheckBox($ctrl_hwnd)
    $Style = _WinAPI_GetWindowLong($ctrl_hwnd, $GWL_STYLE)
    Return BitAND($Style, $BS_CHECKBOX) = $BS_CHECKBOX
EndFunc   ;==>_IsCheckBox
    Func _IsRadio($ctrl_hwnd)
    $Style = _WinAPI_GetWindowLong($ctrl_hwnd, $GWL_STYLE)
EndFunc   ;==>_IsRadio

what i need from you is :
play a sound when a menu item focus, that sound named menu.wav
play a sound named items.wav when the users move on list box items or list view or treeview items or a combobox items
please if can any one help me i'll very happy
thanks on advance

Edited by nacerbaaziz
Link to post
Share on other sites

May I make a simple suggestion:

When building stuff like this, start small and only use a few classes. Get that working, Then add a class, test again. Once you get that test to pass, save that copy of the script then repeat the cycle. This way when something goes wrong, you have a MUCH simpler time trying to figure out what is broke. Right now you have a large script and I have no idea what the problem is or what is not working.

Link to post
Share on other sites

sir, i haven't any problem, i wanna add a futures and i asked for the help. what i need is to get the menu item focus to play a sound, and get list items and comboboxes item focus and  play a sound when navigating.

if any one can help me i'll very happy

Link to post
Share on other sites


For the various Focus/Hover events on those controls, you may take a look at WM_COMMAND and WM_NOTIFY handlers.

These two handlers "capture" messages sent from or to the various controls in a GUI (click, double click, drag, and so on), and you can use them to make some fun things.

For example, there is a Notification Code (so are called) that is sent by a ListView when you hover on an item, which is called $LVN_HOTTRACK.

You could use it to do what you need.

There are plenty samples on the Forums; just take a look at and play with them :)

Click here to see my signature:




Link to post
Share on other sites

hello again

i search allot and at the end i found the WM_menuSelect

when i tried it in a internal  GUI it worked

but i did not know how to use it with the External Windows

here is the code that i tried

#include <GUIConstantsEx.au3>
#include <MsgBoxConstants.au3>
#include <WindowsConstants.au3>
    $menuGUI = GUICreate("menu")
$menuFile = GUICtrlCreateMenu("&file")
$menuOpen = GUICtrlCreateMenuItem("&Open", $menuFile)
$menuGo = GUICtrlCreateMenuItem("&get", $menuFile)
While 1
Switch GUIGetMSG()
case "-3", 3
Func WM_MENUSELECT($hWnd, $iMsg, $wParam, $lParam)
#forceref $hWnd, $iMsg, $wParam, $lParam
EndFunc   ;==>WM_COMMAND

i hope that any one can help me to do that

Link to post
Share on other sites

hello sir @Nine , i find this, but i couldn't know how to use it to get the menu focus or  the listView items when changed.
that what i can't do.
am sure that it posible because the screen readers do that.
i hope you can help me, because i will add a new wey for the blind to navigate their computers.
i am making a tool that add a shortCut keys to move Between the different classes, also it play a sount to each different control

#include <WinAPISysWin.au3>
    HotKeySet("{ESC}", "Close") ; Set ESC as a hotkey to exit the script.
    Global $g_tStruct = DllStructCreate($tagPOINT) ; Create a structure that defines the point to be checked.
    Func Example()
    Local $hWnd
        While 1
        Position() ; Update the X and Y elements with the X and Y co-ordinates of the mouse.
        $hWnd = _WinAPI_WindowFromPoint($g_tStruct) ; Retrieve the window handle.
        ToolTip($hWnd) ; Set the tooltip with the handle under the mouse pointer.
EndFunc   ;==>Example
    Func Position()
    DllStructSetData($g_tStruct, "x", MouseGetPos(0))
    DllStructSetData($g_tStruct, "y", MouseGetPos(1))
EndFunc   ;==>Position
Func Close()
EndFunc   ;==>Close

i hope that you can help me

Edited by nacerbaaziz
Link to post
Share on other sites
1 hour ago, Nine said:

After you get the $hWnd you can use any other function like _WinAPI_GetClassName

i got the class and all controls worked fine

but the problem with the menus and the lists items i couldn't get the focus on them 


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
  • Recently Browsing   0 members

    No registered users viewing this page.

  • Similar Content

    • By Skysnake
      Good morning
      In terms of AutoIt, what is that? A GUI with an input control?
      How would that be coded?
      I have never done anything like this.
    • By CYCho
      This file includes the source code for zPlayer, which is a stand-alone, simple, intuitive and easy-to-use, yet fully functional media player.  I made this to suit my purpose and you can tweak it to your taste. The source code is only about 1600 lines and only standard #include files were used. Also included in the source code file are some image files which are used for drawing the graphical media controls in the main window.
      As of its release date, the compiled exe file of this player, as attached hereto, is not flagged by Windows Defender with latest Security Intelligence Update.
      This player has the following features:
      - Play back all formats of media files which can be played back by the Windows Media Player in your computer
      - Depending on the file types specified by the user in zPlayer.ini file this player can be either audio only, video only or both.
      - Video window is independent of other windows and, when maximized, increases the immersion of the user
      - Graphical media controls similar to embedded Windows Media Player
      - Forward, backward, pause, repeat, shuffle function
      - Increase/decrease/mute sound volume
      - Change folders and create playlist for all media files in that folder and its subfolders, and support for manually-made playlists
      - Save play-back environment when terminating and resume that environment when restarting
      - 'Continue playback' option for a file you left off in the middle of playback
      - With one click, you can see internet search results for the file selected in playlist
      - With a double-click, you can play back an item in the playlist
      - Search strings in the playlist
      - Option to see long file names including folder names
      - View file properties for any file in the playlist and copy their values
      - Resize the playlist and video windows, and restore them to their default positions
      - Very small footprint: very low CPU and memory usage, with only about 1MB when compiled
      - You can even hide all the windows and manipulate the player with hotkeys only
      Note: zPlayer is the name I used when I introduced the early version of this player in my blog back in early 2009 and, therefore, has nothing to do with the mobile media player of the same name which started marketing in 2015.
    • By XGamerGuide
      👋 Hey
      I want to call a function when something changes on an element in my GUI. That should work for a combo box (with $CBS_DROPDOWNLIST) when I select an item and for a text input when I type.
    • By NassauSky
      Hi all,
      The more projects I work on, the harder it is to find old scripts I created with certain techniques in them. I'd like to leave this here for others to get an idea from and it will be available now by keyword searching in this forum.
      This project needed an evenly distributed button grid setup on a touch screen with half decent sized buttons and spacing so the user would be less likely to press the key beside it. Here is one quick example to give anyone an idea of a way to handle it.
      #include <GUIConstants.au3> GUICreate("Button Grid", 1080, 100) ; will create a dialog box that when displayed is centered GUISetState(@SW_SHOW) ; will display an empty dialog box ;--Create and Position Controls Dim $btnActivated[1][2] ;Col 1 is button id, Col 2 is True/False used in 1 example as depressed Dim $btnArray[100][2] ;Col 1 is button id, Col 2 is True/False used in 1 example as depressed $num = 0 $btnActivated[0][0] = GUICtrlCreateButton("Activated", 0, 0, 100, 100) ;x,y,w,h $btnActivated[0][1] = True GUICtrlSetBkColor(-1,0x00ff00) GUICtrlSetColor(-1,0x005500) GUICtrlSetFont(-1,14) For $Y = 0 To 1 For $X = 0 To 7 ConsoleWrite( ($X * 100) + ($X*20) + 120 & @CRLF) If $Y=0 Then $btnArray[$num][0] = GUICtrlCreateButton($num + 1, ($X * 100) + ($X*20) + 120, 0, 100, 40) ;x,y,w,h Else $btnArray[$num][0] = GUICtrlCreateButton($num + 1, ($X * 100) + ($X*20) + 120, ($Y * 40) + $Y*20, 100, 40) ;x,y,w,h EndIf GUICtrlSetBkColor($btnArray[$num][0], 0xFFFFFF) $num += 1 Next Next ;--Set Button Names GUICtrlSetData($btnArray[0][0],"Autoit") GUICtrlSetData($btnArray[1][0],"Is") GUICtrlSetData($btnArray[2][0],"Cool") ; Run the GUI until the dialog is closed While 1 $msg = GUIGetMsg() Switch $msg Case $GUI_EVENT_CLOSE ExitLoop Case $btnActivated[0][0] $btnActivated[0][1] = NOT $btnActivated[0][1] If $btnActivated[0][1] Then GUICtrlSetBkColor($btnActivated[0][0],0x00ff00) GUICtrlSetColor($btnActivated[0][0],0x005500) GUICtrlSetData($btnActivated[0][0],"Activated") GUICtrlSetFont($btnActivated[0][0],14) Else GUICtrlSetBkColor($btnActivated[0][0],0xFF9999) GUICtrlSetColor($btnActivated[0][0],0x550000) GUICtrlSetData($btnActivated[0][0],"DeActivated") GUICtrlSetFont($btnActivated[0][0],13) EndIf Case $btnArray[0][0] If $btnActivated[0][1] Then MsgBox(0,"Notice","Btn1",1) EndIf Case $btnArray[1][0] If $btnActivated[0][1] Then MsgBox(0,"Notice","Btn2",1) EndIf Case $btnArray[2][0] If $btnActivated[0][1] Then MsgBox(0,"Notice","Btn3",1) EndIf EndSwitch WEnd I couldn't find one of my old projects that broke the button array into more columns that included the actual button name in the field. Feel free to share your own or share a more flexible version of this simple example.

    • By It_is_me_Me
      I am making some GUI with combobox for the Baudrates communications and I listed 9600, 57600, 115200. 
      I wrote the code to be defaulted to 57600 like this:
      GUICtrlSetData($comboBox_opticalBaudRate, "9600|57600|115200", "57600")
      But I wanted the GUI to remember the last item the user picks so the baudrates will NOT be defaulted to 57600.
      Example, I pick 9600 as my baudrates, then I close the GUI, after opening it, it always prompt 57600 since that is what I did in my code. But I want that if I choose 9600 and close the GUI, opening it again will show 9600 now instead of 57600.
      Is there a way to do it in GUI setting?
  • Create New...