Sign in to follow this  
Followers 0
Akashrai

autoit info tool is not detecting GUI components

20 posts in this topic

I want to automate a client application but auto it info tool is not detecting the GUI components. I don't know what to do. please help me out. Screenshot  of first login page of application is in attachment 

 

visa.png

Share this post


Link to post
Share on other sites



Please help It is very important. Alternate of auto it is also welcome.  

Share this post


Link to post
Share on other sites

There are lots of alternative GUI inspection tools, many of them free. I use Ranorex myself, but that one is now proprietary.

1 person likes this

Share this post


Link to post
Share on other sites

Yes but what about auto it why it is not detecting the GUI components and what and way to achieve the solution i am attaching page after login it also has same problem.  

visa1.png

Share this post


Link to post
Share on other sites

The "AutoIt Window Info" tool generally only detects standard Windows controls implemented with the functions in ComCtl32.dll. These controls have existed since Windows XP. You can find a list of the controls in the Control Library.

Many modern controls including modern MicroSoft controls are not detected by the "AutoIt Window Info" tool. These controls can be detected with Inspect.exe in Windows SDK or the "Simple Spy Tool" in the UI Automation framework.

Share this post


Link to post
Share on other sites

#8 ·  Posted (edited)

I have fetched info by Autoit info tool and attached please help. You can see it is not detecting any thing.

Please help

Login.png

Edited by Akashrai

Share this post


Link to post
Share on other sites

Where I will get simplespy.au3 file . I am new so please help. I have searched on google as well as in auto it setup but did not got .

Share this post


Link to post
Share on other sites

Yes, Gone through your given link and also searched on google but :sweating:. Could you provide link to download the same.

Share this post


Link to post
Share on other sites

#14 ·  Posted (edited)

I have tried it . It is also not detecting .

The VISA application which i am automating is a java (Applet ) application. I have searched for that and got "FEST" but do not know how to get id/class name of GUI component of the VISA application. Is there any spy tool in fest.

Other that FEST any other open source tool to automate applet desktop application?

Please help.

Edited by Akashrai

Share this post


Link to post
Share on other sites

#16 ·  Posted (edited)

Thanks for support.

Here it says ctrl+w. After pressing Ctrl+w  it gives me following code -

Mouse position is retrieved 133-54
  JAVA window found <> Java Window Title= Handle=0x00000000002A0740     res: 1
Result getAccessibleContextFromHWND is <> ubound: 4
  We have a VMid 789588 ac 369080852
Call version info: PASSED VMID found : 789588
  VMVersion: <1.8.0_65>
  bridgeJavaClassVersion: <1.8.0_65>
  bridgeJavaDLLVersion: <1.8.0_65>
  bridgeWinDLLVersion: <AccessBridge 2.0.4>
 *** getAccessibleContextAT result is <369081228>
 *** getAccessibleContextAT result is <369081228>
Paste

push button
push button
enabled,focusable,visible,showing
enabled,focusable,visible,showing
2
0
98
35
46
0
End of getAcceccibleContextAt info

 

How to use above info in my autoit script. By which Detail of button i cab use.

The application on which i am testing is bellow

 

 

applet.PNG

Edited by Akashrai

Share this post


Link to post
Share on other sites

For that you have to read a lot on java accessibility bridge and study source of jaws and other open source implementations of java accessibility bridge. It all starts with building a ui tree and traversing that to get the right item. And if its internally developed explain developers that they have to fill the accessibility properties.

1 person likes this

Share this post


Link to post
Share on other sites

Thanks for reply.

But the application i want to automate is on client side and and we do not know any thing except GUI. In the case it seems impossible by auto it.

I have searched for any other tool/spy(FREE) but did not get much. I went through Fest but do not know how to start. Any way thanks again.        

Share this post


Link to post
Share on other sites

search harder ;-)

 

https://github.com/ckundo/nvda/tree/master/source

http://www.oracle.com/technetwork/java/javase/downloads/downloads-jsp-138220.html    ferret and monkey

it is possible from AutoIT and the JAB Simplespy shows you the basics

1. Get an element : BOOL GetAccessibleContextAt(long vmID, AccessibleContext acParent, jint x, jint y, AccessibleContext *ac)

2. Get an info reference BOOL GetAccessibleContextInfo(long vmID, AccessibleContext ac, AccessibleContextInfo *info);

3. Get the text by using the reference you get in step 2 BOOL GetAccessibleTextInfo(long vmID, AccessibleText at, AccessibleTextInfo *textInfo, jint x, jint y);

 

 

Share this post


Link to post
Share on other sites

I searched a little further and played with JABSimpleSpy

Its all working with demo's as can be found in JDK ..\jdk-8u25-windows-i586-demos\jdk1.8.0_25\demo\jfc\SwingSet2

And as you have shown you get with JABSimpleSpy the text of your button the concept fully works

Combined with this where we iterate the tree from top to bottom

 

 

another AWT monitor found using same Java Access Bridge

https://docs.oracle.com/cd/E17802_01/j2se/javase/technologies/accessibility/docs/jaccess-1.3/doc/AWTMonitor.html

 

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!


Register a new account

Sign in

Already have an account? Sign in here.


Sign In Now
Sign in to follow this  
Followers 0

  • Similar Content

    • sree161
      By sree161
      Hi,
      i have a code which generates two numeric outputs.i have to save them in excel.
      Is there any way to export them to specific cells in excel???
    • TotalAuto
      By TotalAuto
      Howdy All
      I've gone around and around in circles wasting hours trying to fix this problem to no avail so I thought I would try posting for help given there are some real smart people in this forum.
      Background
      I have 5 separate .au3 scripts that all do different basic tasks. For example:
      1.au3 = opens Chrome browser to obtain information from a specific website then closes
      2.au3 = opens an Excel workbook to run a macro then saves and closes
      3.au3 = Open two seperate workbooks and transfers data from one to the other then saves and closes
      4.au3 = .......etc
      5.au3 = .......etc
      These 5 separate scripts, doing completely different tasks, need to each run once per day at 5 different designated times within a day and then close. For example:
      1.au3 = 10am
      2.au3 = 12pm
      3.au3 = 2pm
      4.au3 = 4pm
      5.au3 = 5pm
      Problem
      I can not get these different scripts to reliably run at their designated times. When I manually run these scripts individually by using 'Go F5' they work perfectly. If I convert these scripts to an .exe and manually run each one they work about 98% of time.
      How can I schedule these different .au3 files or associated .exe files to reliably run each day at different times?
      Attempts To Fix The Issue
      1. I have tried converting each .au3 script into their own .exe file and use Window's Task Scheduler to run these .exe files at their designated time but the success rate  of running each .exe in full, to completion, without error is very low at about 30%. Things that commonly go wrong include a browser not opening but movement still continues on the desk top. Other times things just do not happen at all.
      2. I have Windows 7 64 bit and have tried creating and running both (x86) and (x64) .exe files but again reliability problems exist;
      3. I have also tried moving each .exe file to the My Documents folder as I read someone that keeping your files on your desktop ties your files to individual Windows user profiles which can cause AutoIt operating errors. Not sure if this is correct but thought I would try it anyway. It did not fix my issue.
      4. I installed a program called AlwaysUp which supposedly always reliably runs in the background and will reliably execute your AutoIt script or .exe files. Still have significant reliability issues.
      Therefore, can someone please provide advice on how I can get my 5 different .au3 files to run at 5 designated times through the day, every day, without fail? Overtime I will be creating more and more different .au3 files to run certain tasks throughout the day and do not want to create one large AutoIt file that continually runs and attempts to do all the different tasks itself.
      Any help is very appreciated.
      Thanks
      Dan
       
       
    • hugomito
      By hugomito
      Hi all,
      I built an AutoIt application that interacts with several other applications/software. Now, it's turn to interfact with Visual Studio Team Services (VSTS).
      Does anyone has a blog, demo, script to share?
      Thanks!
    • Viki
      By Viki
      This is my first time here so please dont bombard me that what a silly question I am asking!!
      I have 500 rows (A1:A500) in a spreadsheet and I just want to copy one by one row and then paste into another application and then press enter, loop should repeat this until finishes all 500 rows.
      I have looked at clipget(), clip(put() but dont know how to select next row in next turn. I also looked at Array to store but again no luck. Can some guide me please..
    • DineshPawar
      By DineshPawar
      0down votefavorite   In my current project, Excel macro open AutoIt script using a function Call Shell("location of autoit script").
      For proper functioning of AutoIt script it's need to be close parent Excel workbook, so this closing Excel action is written in AutoIt script itself.
      But as soon as AutoIt script close parent Excel workbook then script get pause and it do nothing.
      How open the AutoIt script from Excel workbook and after that parent Workbook get close?