Jump to content

need help to create a tool for the blind users

Recommended Posts

hello sirs, i've created a tool to the blind users, this tool helps the blind to listen to a audio effect when moving between the GUIs controls on they computers
where this tool can get the class for the current focus control and play a sound from a folder
i've added all the knowne classes, but i found some problems i hope any one can help me.

this is the code that i created

#include <WinAPISys.au3>
Global $h_CurrentHWNDFocus = "", $h_CurrentControlHWNDFocus = ""
AdlibRegister("WindowAudioFocus", 50)
Func WindowAudioFocus()
    Local $h_NewHWNDFocus = WinGetHandle("[active]", "")
    Local $h_NewControlHWNDFocus = ControlGetFocus($h_NewHWNDFocus, "")
    If ($h_NewHWNDFocus = $h_CurrentHWNDFocus) And ($h_NewControlHWNDFocus = $h_CurrentControlHWNDFocus) Then Return 0
    If Not ($h_NewHWNDFocus = $h_CurrentHWNDFocus) Then
        SoundPlay(@ScriptDir & "\focus_Audio\WindowChanged.wav")
        Switch _WinAPI_GetClassName(ControlGetHandle($h_NewHWNDFocus, "", $h_NewControlHWNDFocus))
            Case "Button", "Start", "TrayButton", "TrayShowDesktopButtonWClass", "sbutton", "CirrussButton", "ODbcButton", "ThunderRTCommandButton", "ThunderSSOption", "ThunderSSCommand", "ThunderCommandButton", "ThunderRT6CommandButton", "ThunderRT5CommandButton", "TButton", "TBitBtn", "TAdvGlowButton", "ButtonWndClass", "afx:0:376:baa946", "_AOL_Button"
                If _IsCheckBox(ControlGetHandle($h_NewHWNDFocus, "", $h_NewControlHWNDFocus)) Then
                    SoundPlay(@ScriptDir & "\focus_Audio\checkBox.wav")
                ElseIf _IsRadio(ControlGetHandle($h_NewHWNDFocus, "", $h_NewControlHWNDFocus)) Then
                    SoundPlay(@ScriptDir & "\focus_Audio\radio.wav")
                    SoundPlay(@ScriptDir & "\focus_Audio\button.wav")
            Case "ComboBox", "ComboBoxEx32", "MSOBALLOONREComboBox20W", "REComboBox20W", "ThunderComboBox", "ThunderDriveListBox", "ThunderRT6ComboBox", "TORComboEdit", "TCombobox", "TComboBoxEx", "TORComboBox", "TColorBox", "TNFComboBox", "Internet Explorer_TridentCmbobx", "ComboWndClass", "_AOL_ComboBox", "ThunderRT5ComboBox", "ComboLBox"
                SoundPlay(@ScriptDir & "\focus_Audio\list.wav")
            Case "Edit", "SearchBox", "TChatRichEdit", "_WwN", "_WwO", "RichEdit20A", "RichEdit20WPT", "RICHEDIT60W", "OKttbx", "RichEditA", "ThunderTextBox", "ThunderRT6TextBox", "ThunderRT5TextBox", "TEdit", "TRichEdit", "TRichEditViewer", "TMemo", "TInplaceEditList", "TLabeledEdit", "TMaskEdit", "TDateTimePicker", "TRichEdit", "TCaptionMemo", "TAddictRichEdit", "TCaptionEdit", "RichTextWndClass", "TextWndClass", "PasswordWndClass", "TextAreaWndClass", "MSWorksDoc", "_AOL_Edit", "SysDateTimePick32"
                SoundPlay(@ScriptDir & "\focus_Audio\edit.wav")
            Case "ListBox", "ComboLBox", "REListBox20W", "SUPERGRID", "OUTEXVLB", "WMSUIVLB", "SchdmapiVLB", "VLBClass", "ThunderDirListBox", "ThunderFileListBox", "ThunderListBox", "ThunderRT6ListBox", "ThunderRT5ListBox", "TListbox", "TValueListEditor", "TORCalendar", "TColorListBox", "TCheckListBox", "Internet Explorer_TridentLstBox", "ListBoxWndClass", "ListWndClass", "hh_kwd_vlist", "afx:8:376:0:946", "_AOL_ListBox", "_AOL_Tree", ""
                SoundPlay(@ScriptDir & "\focus_Audio\List.wav")
            Case "SysListView32", "OpenListView", "wuDuiListView", "ListView20WndClass", "TcxGridSite", "TListView", "TSystemListView", "ListViewWndClass", ""
                SoundPlay(@ScriptDir & "\focus_Audio\ListView.wav")
            Case "SysTreeView32", "SearchTreeList", "FeatureTree", "TreeView20WndClass", "TSystemTreeView", "TTreeView", ""
                SoundPlay(@ScriptDir & "\focus_Audio\TreeView.wav")
            Case Else
                SoundPlay(@ScriptDir & "\focus_Audio\focus.wav")
    $h_CurrentHWNDFocus = $h_NewHWNDFocus
    $h_CurrentControlHWNDFocus = $h_NewControlHWNDFocus
    AdlibRegister("WindowAudioFocus", 50)
    Return 1
EndFunc   ;==>WindowAudioFocus
Func _IsCheckBox($ctrl_hwnd)
    $Style = _WinAPI_GetWindowLong($ctrl_hwnd, $GWL_STYLE)
    Return BitAND($Style, $BS_CHECKBOX) = $BS_CHECKBOX
EndFunc   ;==>_IsCheckBox
    Func _IsRadio($ctrl_hwnd)
    $Style = _WinAPI_GetWindowLong($ctrl_hwnd, $GWL_STYLE)
EndFunc   ;==>_IsRadio

what i need from you is :
play a sound when a menu item focus, that sound named menu.wav
play a sound named items.wav when the users move on list box items or list view or treeview items or a combobox items
please if can any one help me i'll very happy
thanks on advance

Edited by nacerbaaziz
Link to post
Share on other sites

May I make a simple suggestion:

When building stuff like this, start small and only use a few classes. Get that working, Then add a class, test again. Once you get that test to pass, save that copy of the script then repeat the cycle. This way when something goes wrong, you have a MUCH simpler time trying to figure out what is broke. Right now you have a large script and I have no idea what the problem is or what is not working.

Link to post
Share on other sites

sir, i haven't any problem, i wanna add a futures and i asked for the help. what i need is to get the menu item focus to play a sound, and get list items and comboboxes item focus and  play a sound when navigating.

if any one can help me i'll very happy

Link to post
Share on other sites


For the various Focus/Hover events on those controls, you may take a look at WM_COMMAND and WM_NOTIFY handlers.

These two handlers "capture" messages sent from or to the various controls in a GUI (click, double click, drag, and so on), and you can use them to make some fun things.

For example, there is a Notification Code (so are called) that is sent by a ListView when you hover on an item, which is called $LVN_HOTTRACK.

You could use it to do what you need.

There are plenty samples on the Forums; just take a look at and play with them :)

Click here to see my signature:




Link to post
Share on other sites

hello again

i search allot and at the end i found the WM_menuSelect

when i tried it in a internal  GUI it worked

but i did not know how to use it with the External Windows

here is the code that i tried

#include <GUIConstantsEx.au3>
#include <MsgBoxConstants.au3>
#include <WindowsConstants.au3>
    $menuGUI = GUICreate("menu")
$menuFile = GUICtrlCreateMenu("&file")
$menuOpen = GUICtrlCreateMenuItem("&Open", $menuFile)
$menuGo = GUICtrlCreateMenuItem("&get", $menuFile)
While 1
Switch GUIGetMSG()
case "-3", 3
Func WM_MENUSELECT($hWnd, $iMsg, $wParam, $lParam)
#forceref $hWnd, $iMsg, $wParam, $lParam
EndFunc   ;==>WM_COMMAND

i hope that any one can help me to do that

Link to post
Share on other sites

hello sir @Nine , i find this, but i couldn't know how to use it to get the menu focus or  the listView items when changed.
that what i can't do.
am sure that it posible because the screen readers do that.
i hope you can help me, because i will add a new wey for the blind to navigate their computers.
i am making a tool that add a shortCut keys to move Between the different classes, also it play a sount to each different control

#include <WinAPISysWin.au3>
    HotKeySet("{ESC}", "Close") ; Set ESC as a hotkey to exit the script.
    Global $g_tStruct = DllStructCreate($tagPOINT) ; Create a structure that defines the point to be checked.
    Func Example()
    Local $hWnd
        While 1
        Position() ; Update the X and Y elements with the X and Y co-ordinates of the mouse.
        $hWnd = _WinAPI_WindowFromPoint($g_tStruct) ; Retrieve the window handle.
        ToolTip($hWnd) ; Set the tooltip with the handle under the mouse pointer.
EndFunc   ;==>Example
    Func Position()
    DllStructSetData($g_tStruct, "x", MouseGetPos(0))
    DllStructSetData($g_tStruct, "y", MouseGetPos(1))
EndFunc   ;==>Position
Func Close()
EndFunc   ;==>Close

i hope that you can help me

Edited by nacerbaaziz
Link to post
Share on other sites
1 hour ago, Nine said:

After you get the $hWnd you can use any other function like _WinAPI_GetClassName

i got the class and all controls worked fine

but the problem with the menus and the lists items i couldn't get the focus on them 


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
  • Recently Browsing   0 members

    No registered users viewing this page.

  • Similar Content

    • By It_is_me_Me
      I am making some GUI with combobox for the Baudrates communications and I listed 9600, 57600, 115200. 
      I wrote the code to be defaulted to 57600 like this:
      GUICtrlSetData($comboBox_opticalBaudRate, "9600|57600|115200", "57600")
      But I wanted the GUI to remember the last item the user picks so the baudrates will NOT be defaulted to 57600.
      Example, I pick 9600 as my baudrates, then I close the GUI, after opening it, it always prompt 57600 since that is what I did in my code. But I want that if I choose 9600 and close the GUI, opening it again will show 9600 now instead of 57600.
      Is there a way to do it in GUI setting?
    • By ashraful089
      #include <ButtonConstants.au3>
      #include <ComboConstants.au3>
      #include <GUIConstantsEx.au3>
      #include <WindowsConstants.au3>
      #Region ### START Koda GUI section ### Form=C:\Users\Engr. Ashraful\Videos\koda_1.7.3.0\Forms\ProgramPlayer\FormProgamToOpen.kxf
      $FormInput = GUICreate("Input", 302, 205, 454, 285)
      $Resolution = GUICtrlCreateCombo("Resolution", 80, 24, 145, 25)
      GUICtrlSetData(-1, "1920|VM1920|1366")
      $ComboProgramType = GUICtrlCreateCombo("Program Type Selection", 80, 64, 145, 25, BitOR($CBS_DROPDOWN,$CBS_AUTOHSCROLL))
      GUICtrlSetData(-1, "Multimedia|Official|Design|Web")
      $ButtonEnter = GUICtrlCreateButton("Enter", 104, 104, 75, 25)
      #EndRegion ### END Koda GUI section ###
      While 1
          $nMsg = GUIGetMsg()
          Switch $nMsg
              Case $GUI_EVENT_CLOSE
      please help me to read combo box input and use the value for another function/ work
    • By Aapjuh
      I am having a problem properly saving the Width of a resizable Gui.
      When a user resizes the Gui it gets saved in an ini when the Gui closes to then restore the new Width upon reopening the app.
      with GUICreate("myGui",300,200,Default,Default,$WS_SIZEBOX)
      WinGetPos($hGUI) returns 314, and WinGetClientSize($hGUI) returns 298
      when its then saved in the ini the gui keeps expanding or shrinking every time its opened by +14 or -2
      I figure it has to do with borders etc, but i also guess borders depend on the window theme and whatnot or is user specific, so i can't just do $GuiWidth = $GetGuiWidth[arr] -14 or +2 right?

      is there a proper way of doing this?
      Thanks in advance,
    • By CYCho
      This file includes the source code for zPlayer, which is a stand-alone, simple, intuitive and easy-to-use, yet fully functional media player.  I made this to suit my purpose and you can tweak it to your taste. The source code is only about 1600 lines and only standard #include files were used. Also included in the source code file are some image files which are used for drawing the graphical media controls in the main window.
      As of its release date, the compiled exe file of this player, as attached hereto, is not flagged by Windows Defender with latest Security Intelligence Update.
      Hash values for compiled file of the latest version are as follows:
      SHA256: ED6FA666192AD8420161BB3E082F7440886A5DFA9D258AFB54D486AEA2D9703B
      SHA1: 9F41B7B1E01DA66A0A1C59398769D5AEB26A62D6

      This player has the following features:
      - Play back all formats of media files which can be played back by the Windows Media Player in your computer
      - Depending on the file types specified by the user in zPlayer.ini file this player can be either audio only, video only or both.
      - Video window is independent of other windows and, when maximized, increases the immersion of the user
      - Graphical media controls similar to embedded Windows Media Player
      - Forward, backward, pause, repeat, shuffle function
      - Increase/decrease/mute sound volume
      - Change folders and create playlist for all media files in that folder and its subfolders, and support for manually-made playlists
      - Save play-back environment when terminating and resume that environment when restarting
      - 'Continue playback' option for a file you left off in the middle of playback
      - With one click, you can see internet search results for the file selected in playlist
      - With a double-click, you can play back an item in the playlist
      - Search strings in the playlist
      - Option to see long file names including folder names
      - View file properties for any file in the playlist and copy their values
      - Resize the playlist and video windows, and restore them to their default positions
      - Very small footprint: very low CPU and memory usage, with only about 1MB when compiled
      - You can even hide all the windows and manipulate the player with hotkeys only
      Note: zPlayer is the name I used when I introduced the early version of this player in my blog back in early 2009 and, therefore, has nothing to do with the mobile media player of the same name which started marketing in 2015.
    • By CYCho
      zPlayer is the name I used when I introduced the early version of this player in my blog back in early 2009 and, therefore, has nothing to do with the mobile media player of the same name which started marketing in 2015.
      After I retired from active duty in 2002 I spent much time listening to music. First I started with CD's and LP's, then quickly moved on to mp3 files. I converted many of my CD's to mp3 and I collected many more from various sources which were freely available at the time. As the number of my mp3 files grew, I put them in folders according to their genres and my favorite classifications. I mainly used Windows Media Player to listen to them and I slowly began to dislike wmp because it had massive user interface while I just wanted to listen to music in the background while I was doing other work in the foreground, hopping between folders from time to time. It was the time I was beginning to learn AutoIt and I thought I should make my own player with AutoIt. Coming from a sales career with no experience in programming, it was not an easy task. Somehow, after about 2 years of learning and trying, I had my own audio player which worked with only hotkeys without any graphical interface. I gave it to some of my friends who were not as computer-savvy as I. They liked it but definitely wanted something to clcik with mouse. So I came up with very rude gui which took a form similar to what it is now.
      The attached source files include one au3 file, one icon file and 14 jpg files. The jpg files are used for drawing a graphical player and are fileinstalled in @DocumentsCommonDir folder. This player uses WMPlayer.OCX as its engine and supports all audio file formats supported by wmp and additional codecs installed. I would like to thank @Bilgus for kind answers to my questions and would appreciate it if anyone could review the code and give me any suggestion. This player works for me, but I don't know whether the code is presentable as an example. I am posting this here with a hope to learn much from AutoIt community.
      PS: Video function was added in August 2020. 
      Please see Downloads section of this forum for the latest version of this player.

  • Create New...