IUIAutomation MS framework automate chrome, FF, IE, ....

[SEKOMD]

I found a great function and I'm surprised that your library doesn't have a similar function. Why not? Sending keyboard presses (CTRL + C) is not convenient/suitable for everyone...

Func UIA_GetAeCurrentPropertyValue($oAe, $PropertyID)
    If Not IsObj($UIA_oUIAutomation) Then Return SetError(1)
    If Not IsObj($oAe) Then Return SetError(2)

    Local $tVal
    $oAe.GetCurrentPropertyValue($PropertyID, $tVal)
    If Not IsArray($tVal) Then Return $tVal
    Local $tStr = $tVal[0]
    For $i = 1 To UBound($tVal) - 1
        $tStr &= "; " & $tVal[$i]
    Next
    Return $tStr
EndFunc   ;==>UIA_GetAeCurrentPropertyValue

https://www.autoitscript.com/forum/topic/211768-automate-combobox-using-ui-automation/

Sorry for my English!!!

Edited January 20, 2025 by SEKOMD

[junkew]

There are many ways to set a value. More or less I added some wrappers and alias functions like

setvalue","settextvalue"
 "setvalue using keys"
 "setValue using clipboard"
 "getvalue"
 "sendkeys", "enterstring", "type", "typetext"

so no specific reason that certain ways are not there.

Edited January 20, 2025 by junkew

[SEKOMD]

13 hours ago, junkew said:

"getvalue"

        Case "getValue"
            $obj2ActOn.setfocus()
            Send("^a")
            Sleep(50)
            Send("^c")
            $retValue = ClipGet()

only keyboard keys are used - this is not always convenient/reliable

when selecting text - for example, the input focus is lost..

[junkew]

This is in the wrappers with propertyvalue, property and most likely when I wrote the library I had to deal with textboxes from java or other not fully iUIAutomation compatible textboxes and choosed to do it by keyboard commands and have another way to get to the propertys by a property command action.
 

Case "propertyvalue", "property"
            Local $i = _UIA_getPropertyIndex($p1)
            If Not @error <> 0 Then
                $retValue = _UIA_getPropertyValue($obj2ActOn, $UIA_propertiesSupportedArray[$i][1])
            Else
                $retValue = _UIA_getPropertyValue($obj2ActOn, $p1)
            EndIf

and implemented like

Func _UIA_getPropertyValue($UIA_oUIElement, $id)
    Local $tmpValue, $tmpStr, $iProperty

    If Not _UIA_IsElement($UIA_oUIElement) Then
        Return SetError($_UIASTATUS_GeneralError, $_UIASTATUS_GeneralError, "** NO PROPERTYVALUE DUE TO NONEXISTING OBJECT **")
    EndIf

    $UIA_oUIElement.GetCurrentPropertyValue($id, $tmpValue)
    $tmpStr = "" & $tmpValue
    If IsArray($tmpValue) Then
        $tmpStr = ""
        For $iProperty = 0 To UBound($tmpValue) - 1
            $tmpStr = $tmpStr & StringStripWS($tmpValue[$iProperty], $STR_STRIPLEADING + $STR_STRIPTRAILING)
            If $iProperty <> UBound($tmpValue) - 1 Then
                $tmpStr = $tmpStr & ";"
            EndIf
        Next
        Return $tmpStr
    EndIf
    Return SetError($_UIASTATUS_GeneralError, $_UIASTATUS_GeneralError, $tmpStr)
EndFunc   ;==>_UIA_getPropertyValue

And setting your keyboard focus back to begin or end could be done with keys like ctrl+home and ctrl+end. There are to many aspects in remotely controlling different applications and all kinds of different textboxes from different programming languages. Nowadays probably more and more html frontend applications but in 2010-2015 dealing with many windows UX technologies (Visual Basic, Java, Win32 forms, Delphi, HTML, QWidgets, ....)

Edited April 24, 2025 by junkew

[SEKOMD]

Sorry, scrolling down the page - I understand this is not possible? Only using Send()?

[junkew]

1 hour ago, SEKOMD said:

Sorry, scrolling down the page - I understand this is not possible? Only using Send()?

Is that a question? You can interact with scrollbars using IUIAutomation. The wrappers I made are not wrapping all possibilities there are many examples made on the forum around IUIAutomation just search and you will find a lot. UIASpy is a nice one that gives you directly when you spy the ability to generate code for it.
Using the keyboard with send can be in many cases a good alternative its just one of the things you can use when you want to automate a GUI.

Microsoft supports the basic scrolling unfortunately many suppliers of derived scrollbars implement not full logic for IuIAutomation. Basically they should if they want to have their applications accessible for the impaired people.

https://learn.microsoft.com/en-us/dotnet/framework/ui-automation/ui-automation-support-for-the-scrollbar-control-type 

 

[kalavo]

Hello, 
I currently have an Autoit script that "controls" a webpage running the Youtube Iframe API via embedded IE. It has become a bit unreliable recently so I've
decided to move over to Chrome and utilise UIAutomation to control the page.
I haven't started coding yet, just looking at what I'm currently doing in my existing script and how I can achieve the equivalent with UIAutomation.

At present, there is a textarea in the webpage HTML (id="event_log") which the javascript updates when the Youtube player changes status etc.
The autoit script utilises ObjEvent to fire off a function if the textarea changes i.e.
...
$xxx_event = $ie_o.document.all.event_log
ObjEvent($xxx_event, "jw_xxx_event_")
'''
Func jw_xxx_event_onPropertyChange() ;text in event_log field has changed

    Local $str = $xxx_event.value

    '''
EndFunc

Is there a way in UIAutomation where I can fire off a function if the textarea changes? It would be nicer than having to keep checking the textarea's value.

Thanks
 

[mLipok]

I think You should move to WebDriver or WebView

[kalavo]

Thankyou mLipok. Will look into those.