Automating Non-WinAPI Windows

[SkeleDrew]

Been using AutoIt3 for several years now. Have just recently started expanding into more advanced automation and am now experiencing some difficulties. I'm unable to manage some windows such as Pidgin (pure GTK+) and TeamViewer 5 (partly ATL; probably used for security).

The part of TV 5 I'm really interested in is the recorded sessions playback control, which is ATL except for the time tracker. I mainly want to detect the state of the play/pause buttons at this time. NB: I've observed that TV 5 crashes when I try to open a recorded session and Windows Info is examining windows (unfrozen state); could be a bug somewhere or security feature...

For Pidgin (2.6.5), I've noticed that Windows Info is able to only differentiate the controls as randomly numbered instances of "gdkWindowChild", and cannot access the type or text. Is there a way I can get a list of ALL the controls in a window (non-interactively) AND their available information?

[PsaltyDS]

On by using... wait for it... the Windows APIs. For example, WinGetClassList().

AutoIt is written to automate the use of Windows APIs. If your app doesn't use those APIs, or provide an similar one (DLL, COM interface, etc.) then AutoIt can't help you.

Grid controls and Flash apps are additional common examples where AutoIt can't help you much, because they were not compiled with an available Windows API.

[tjwilli58]

Been using AutoIt3 for several years now. Have just recently started expanding into more advanced automation and am now experiencing some difficulties. I'm unable to manage some windows such as Pidgin (pure GTK+) and TeamViewer 5 (partly ATL; probably used for security).

 

The part of TV 5 I'm really interested in is the recorded sessions playback control, which is ATL except for the time tracker. I mainly want to detect the state of the play/pause buttons at this time. NB: I've observed that TV 5 crashes when I try to open a recorded session and Windows Info is examining windows (unfrozen state); could be a bug somewhere or security feature...

 

For Pidgin (2.6.5), I've noticed that Windows Info is able to only differentiate the controls as randomly numbered instances of "gdkWindowChild", and cannot access the type or text. Is there a way I can get a list of ALL the controls in a window (non-interactively) AND their available information?

I have a Python application with a GUI using Gtk (actually PyGObject) and was wondering if AutoIt could access the various widgets. I also noticed that Windows Info could only "see" the gkWindowChild widgets.  We have an existing AutoIt program that controls a Java application that I was hoping to modify to control the Python application. I'm glad I saw this post so I won't be wasting my time.