QWidget Help

[JustinM]

Hello all, 

I've read up on QWidgets and I am so lost. This goes beyond my understanding. 

I can easily get the mouse coordinates and have it click the run button, but my issue comes in when the resolution is different, which is why I cannot use coordinates. I've also tried PixelSearch, but it doesn't seem to work.

Below is an image of the AutoIt Window Info and the program I am trying to use. Please help me. 

 

Edit - I've also tried Ranorex Spy, but it only gives me the top border information, nothing on the GUI

Edited September 12, 2016 by JustinM

[JLogan3o13]

Locked briefly...

Edit: Topic was locked while a Mod read through it. Before we get a ton of reports, the application is a Benchmarking tool not a game, so is fine to move forward.

[rcmaehl]

PixelSearch Most likely isn't working because a LOT of those pixels are the same color. There's a UDF somewhere for searching for an image (which I'd make an image of the word "Resolution" from the Benchmarking tool and then add like +40 to $X to get the drop down box). Gimme a second to find it.

EDIT:

Also it looks like their advanced edition supports command line options

 

Edited September 12, 2016 by rcmaehl

[JustinM]

1 hour ago, rcmaehl said:

PixelSearch Most likely isn't working because a LOT of those pixels are the same color. There's a UDF somewhere for searching for an image (which I'd make an image of the word "Resolution" from the Benchmarking tool and then add like +40 to $X to get the drop down box). Gimme a second to find it.

EDIT:

Also it looks like their advanced edition supports command line options
 

Yes the Pro Version does support command line options, but that's $500 for a single license. 

I will try and work with what you provided. I'll let you know how it goes.

[orbs]

@JustinM,

if this GUI workable with keyboard only? i.e. does it respond to Tab for switching between controls? does it respond to Enter or spacebar when focus is on a clickable control? does it respond to Ctrl+C to copy text to clipboard?

if so, you can forget about mouse click simulation and focus on keyboard simulation, which you will find more robust.

[JustinM]

10 minutes ago, orbs said:

@JustinM,

if this GUI workable with keyboard only? i.e. does it respond to Tab for switching between controls? does it respond to Enter or spacebar when focus is on a clickable control? does it respond to Ctrl+C to copy text to clipboard?

if so, you can forget about mouse click simulation and focus on keyboard simulation, which you will find more robust.

The tab, spacebar, and arrow keys only work on the drop down menus, not the "Run" Button. :/

Also, the imagesearch is giving me errors when returning. Is there another way to manipulate this program? 

Edit: Is there a way to move the mouse to the last active location? Like if I tab all the way down to the "resolution" drop down, can I work with MouseMove, or MouseClick from there? 

Edited September 12, 2016 by JustinM
Adding More Information

[orbs]

how is the "Run" button positioned relative to the edges of the window?

i.e. when you resize the window, does it remain in the same distance from the lower-right corner? from the upper-right corner? etc.

[JustinM]

Just now, orbs said:

how is the "Run" button positioned relative to the edges of the window?

i.e. when you resize the window, does it remain in the same distance from the lower-right corner? from the upper-right corner? etc.

Yes it remains in the same position. As shown with my image attached.

[orbs]

let me get this straight: if you resize the window to a size larger than the original size, the right extra and the lower extra are painted black? that, i think, is a qualified contender in the "worst GUI design concepts ever" category. 

anyways, is the "Run" button always positioned at a constant X and Y distances from the upper-left corner of the window? if so, use WinGetPos to get the window position, add the constant X and Y distances, throw in some tolerance, and click.

[AutoBert]

1 hour ago, JustinM said:

Yes the Pro Version does support command line options, but that's $500 for a single license. 

The Advanced also, but only $14.95.

 

Afair QWidgets could be automated with ControlClick, so post summary Tab of Au3Info.

[JustinM]

17 hours ago, AutoBert said:

The Advanced also, but only $14.95.

 

Afair QWidgets could be automated with ControlClick, so post summary Tab of Au3Info.

Here is a snip of the summary tab

[AutoBert]

17 hours ago, AutoBert said:

so post summary Tab of Au3Info.

i don't want a picture, i need all text (C&P) from this tab and release mouse over one of the Combo-Dropdown-Buttons.

[JustinM]

10 minutes ago, AutoBert said:

i don't want a picture, i need all text (C&P) from this tab and release mouse over one of the Combo-Dropdown-Buttons.

C&P mean copy and paste? I selected the drop down list with the mouse 

 

expandcollapse popup

>>>> Window <<<<
Title:  Unigine Heaven Benchmark 4.0 (Basic Edition)
Class:  QWidget
Position:   585, 227
Size:   766, 626
Style:  0x96CE0000
ExStyle:    0x00000100
Handle: 0x0000000000010418

>>>> Control <<<<
Class:  
Instance:   
ClassnameNN:    
Name:   
Advanced (Class):   
ID: 
Text:   
Position:   
Size:   
ControlClick Coords:    
Style:  
ExStyle:    
Handle: 

>>>> Mouse <<<<
Position:   647, 261
Cursor ID:  0
Color:  0x6F2D00

>>>> StatusBar <<<<

>>>> ToolsBar <<<<

>>>> Visible Text <<<<


>>>> Hidden Text <<<<

 

[JustinM]

Can anyone download Heaven (Here), and dissect the program to see how I can manipulate the run button?  

[junkew]

Try simplespy and see links in faq question 31

[JustinM]

28 minutes ago, junkew said:

Try simplespy and see links in faq question 31

 

Where do I find simplespy? Is it built into AutoIt? Sorry :/

[rcmaehl]

2 hours ago, JustinM said:

 

Where do I find simplespy? Is it built into AutoIt? Sorry :/

 

[JustinM]

Ok , I did some reading and was able to get some information. Please see below -- 

expandcollapse popup

Mouse position is retrieved 2064-1030
At least we have an element [Unigine Heaven Benchmark 4.0 (Advanced Edition)][QWidget]
Having the following values for all properties: 
Title is: <Unigine Heaven Benchmark 4.0 (Advanced Edition)> Class   := <QWidget>    controltype:= <UIA_WindowControlTypeId> ,<50032>    , (0000C370)    
*** Parent Information ***
Title is: <Desktop> Class   := <#32769> controltype:= <UIA_PaneControlTypeId>   ,<50033>    , (0000C371)    
*** Detailed properties of the highlighted element ***
UIA_AcceleratorKeyPropertyId :=
UIA_AccessKeyPropertyId :=
UIA_AriaPropertiesPropertyId :=
UIA_AriaRolePropertyId :=
UIA_AutomationIdPropertyId :=
UIA_BoundingRectanglePropertyId :=1390;577;766;537
UIA_ClassNamePropertyId :=QWidget
UIA_ClickablePointPropertyId :=
UIA_ControllerForPropertyId :=
UIA_ControlTypePropertyId :=50032
UIA_CulturePropertyId :=0
UIA_DescribedByPropertyId :=
UIA_DockDockPositionPropertyId :=5
UIA_ExpandCollapseExpandCollapseStatePropertyId :=3
UIA_FlowsToPropertyId :=
UIA_FrameworkIdPropertyId :=Win32
UIA_GridColumnCountPropertyId :=0
UIA_GridItemColumnPropertyId :=0
UIA_GridItemColumnSpanPropertyId :=1
UIA_GridItemContainingGridPropertyId :=
UIA_GridItemRowPropertyId :=0
UIA_GridItemRowSpanPropertyId :=1
UIA_GridRowCountPropertyId :=0
UIA_HasKeyboardFocusPropertyId :=True
UIA_HelpTextPropertyId :=
UIA_IsContentElementPropertyId :=True
UIA_IsControlElementPropertyId :=True
UIA_IsDataValidForFormPropertyId :=False
UIA_IsDockPatternAvailablePropertyId :=False
UIA_IsEnabledPropertyId :=True
UIA_IsExpandCollapsePatternAvailablePropertyId :=False
UIA_IsGridItemPatternAvailablePropertyId :=False
UIA_IsGridPatternAvailablePropertyId :=False
UIA_IsInvokePatternAvailablePropertyId :=False
UIA_IsItemContainerPatternAvailablePropertyId :=False
UIA_IsKeyboardFocusablePropertyId :=True
UIA_IsLegacyIAccessiblePatternAvailablePropertyId :=True
UIA_IsMultipleViewPatternAvailablePropertyId :=False
UIA_IsOffscreenPropertyId :=False
UIA_IsPasswordPropertyId :=False
UIA_IsRangeValuePatternAvailablePropertyId :=False
UIA_IsRequiredForFormPropertyId :=False
UIA_IsScrollItemPatternAvailablePropertyId :=False
UIA_IsScrollPatternAvailablePropertyId :=False
UIA_IsSelectionItemPatternAvailablePropertyId :=False
UIA_IsSelectionPatternAvailablePropertyId :=False
UIA_IsSynchronizedInputPatternAvailablePropertyId :=False
UIA_IsTableItemPatternAvailablePropertyId :=False
UIA_IsTablePatternAvailablePropertyId :=False
UIA_IsTextPatternAvailablePropertyId :=False
UIA_IsTogglePatternAvailablePropertyId :=False
UIA_IsTransformPatternAvailablePropertyId :=True
UIA_IsValuePatternAvailablePropertyId :=False
UIA_IsVirtualizedItemPatternAvailablePropertyId :=False
UIA_IsWindowPatternAvailablePropertyId :=True
UIA_ItemStatusPropertyId :=
UIA_ItemTypePropertyId :=
UIA_LabeledByPropertyId :=
UIA_LegacyIAccessibleChildIdPropertyId :=0
UIA_LegacyIAccessibleDefaultActionPropertyId :=
UIA_LegacyIAccessibleDescriptionPropertyId :=
UIA_LegacyIAccessibleHelpPropertyId :=
UIA_LegacyIAccessibleKeyboardShortcutPropertyId :=
UIA_LegacyIAccessibleNamePropertyId :=Unigine Heaven Benchmark 4.0 (Advanced Edition)
UIA_LegacyIAccessibleRolePropertyId :=10
UIA_LegacyIAccessibleSelectionPropertyId :=
UIA_LegacyIAccessibleStatePropertyId :=1048580
UIA_LegacyIAccessibleValuePropertyId :=
UIA_LocalizedControlTypePropertyId :=window
UIA_MultipleViewCurrentViewPropertyId :=0
UIA_MultipleViewSupportedViewsPropertyId :=
UIA_NamePropertyId :=Unigine Heaven Benchmark 4.0 (Advanced Edition)
UIA_NativeWindowHandlePropertyId :=3998954
UIA_OrientationPropertyId :=0
UIA_ProcessIdPropertyId :=3260
UIA_ProviderDescriptionPropertyId :=[pid:2124,hwnd:0x3D04EA Main:Nested [pid:3260,hwnd:0x3D04EA Annotation(parent link):Microsoft: Annotation Proxy (unmanaged:uiautomationcore.dll); Main:Microsoft: MSAA Proxy (unmanaged:uiautomationcore.dll)]; Nonclient:Microsoft: Non-Client Proxy (unmanaged:uiautomationcore.dll); Hwnd(parent link):Microsoft: HWND Proxy (unmanaged:uiautomationcore.dll)]
UIA_RangeValueIsReadOnlyPropertyId :=True
UIA_RangeValueLargeChangePropertyId :=0
UIA_RangeValueMaximumPropertyId :=0
UIA_RangeValueMinimumPropertyId :=0
UIA_RangeValueSmallChangePropertyId :=0
UIA_RangeValueValuePropertyId :=0
UIA_RuntimeIdPropertyId :=42;3998954
UIA_ScrollHorizontallyScrollablePropertyId :=False
UIA_ScrollHorizontalScrollPercentPropertyId :=0
UIA_ScrollHorizontalViewSizePropertyId :=100
UIA_ScrollVerticallyScrollablePropertyId :=False
UIA_ScrollVerticalScrollPercentPropertyId :=0
UIA_ScrollVerticalViewSizePropertyId :=100
UIA_SelectionCanSelectMultiplePropertyId :=False
UIA_SelectionIsSelectionRequiredPropertyId :=False
UIA_SelectionselectionPropertyId :=
UIA_SelectionItemIsSelectedPropertyId :=False
UIA_SelectionItemSelectionContainerPropertyId :=
UIA_TableColumnHeadersPropertyId :=
UIA_TableItemColumnHeaderItemsPropertyId :=
UIA_TableRowHeadersPropertyId :=
UIA_TableRowOrColumnMajorPropertyId :=2
UIA_TableItemRowHeaderItemsPropertyId :=
UIA_ToggleToggleStatePropertyId :=2
UIA_TransformCanMovePropertyId :=True
UIA_TransformCanResizePropertyId :=True
UIA_TransformCanRotatePropertyId :=False
UIA_ValueIsReadOnlyPropertyId :=True
UIA_ValueValuePropertyId :=
UIA_WindowCanMaximizePropertyId :=False
UIA_WindowCanMinimizePropertyId :=True
UIA_WindowIsModalPropertyId :=False
UIA_WindowIsTopmostPropertyId :=False
UIA_WindowWindowInteractionStatePropertyId :=2
UIA_WindowWindowVisualStatePropertyId :=0

 

[junkew]

You should tell the supplier to read this https://doc.qt.io/archives/qq/qq24-accessibility.html

I tried with NVDA http://www.nvaccess.org/ but also they cannot handle the text/dropdown boxes

I have FPS 2 so probably I have to buy a new system

Edited September 16, 2016 by junkew

[JustinM]

Am I SH!t out of luck?

Edit: Is it possible to Move my Mouse to the position where tab is currently selecting? Not sure if that sounds correct...Say I select the program and Send("{TAB}"), am I able to move the mouse cursor to that location?  

Edited September 16, 2016 by JustinM