Mouse Movement based on Pixel Color - (Moved)

[hellomoto]

Hello! New to AutoIt but have used AHK and some other languages.  I am trying to write something where if I press a key, auto-it finds a preset color on the screen.  It then locks the cursor onto that color, wherever it goes until either 1) the color is no longer on the screen or 2) I press the same key to toggle it off.  I don't want any key presses or mouse clicks, just to control the mouse.  Is this possible?  I have found other posts on here from 10-12 years ago so I wasn't sure how much they would apply.  If I'm missing recent posts that deal with this because I'm not searching the right params, please link.  Thanks!

[water]

Welcome to AutoIt and the forum!

That's a quite general question. Can you please describe which program you try to automate or which goal you try to achieve?

[Melba23]

Moved to the appropriate forum, as the Developer General Discussion forum very clearly states:

Quote

General development and scripting discussions. If it's super geeky and you don't know where to put it - it's probably here.

---

Do not create AutoIt-related topics here, use the AutoIt General Help and Support or AutoIt Technical Discussion forums.

Moderation Team

[hellomoto]

It will be a program running a video clip.  The clip will have a lot of movement with one specific person that shows up (and sometimes blends back into a crowd) and is as uniquely dressed as possible.  Imagine where's waldo but in video.  Some of these may get very hard to find, so having an "answer" button to toggle on which will move the mouse to the color and then stay on it as this person moves releasing if the color disappears and immediately regaining once it reappears.

I expect there will be some variance of color allowed due to lighting changes so I'm not looking for a perfect solution, but trying to get as close as I can for this.

[Melba23]

hellomoto,

And what is the purpose of all this?

M23

[hellomoto]

Well, my kids love seek and find books. I was hoping for a way to take it to the next level and make it easy to make new puzzles. Like me wearing some specific hat and having some else record on their phone in a mall, street corner, restaurant. Then I could queue this up as a way to find me if they get stuck

 Just for fun. Like a moving wheres waldo. Which is why I'd like it to be program agnostic. Just find the color and stay on it. I'm even thinking a snap function would be nice. So if they need a little help, they can mouse over close by and find it. Or have the option to get the answer by scanning the whole screen.

[Melba23]

hellomoto,

That sounds like a fun project - but one which is perilously close to game automation, which you will see is not permitted by the Forum rules. The thread can remain open for the moment, but will remain under review.

M23

[Malkey]

This example may help.

expandcollapse popup

#include <WinAPIGdi.au3>

; Press Esc key to terminate script.
; Press Home key to toggle search for color.
; Press Shift-Alt-d keys to enter a new color.

Global $g_bPaused = False, $iColor = 0x63C4AB ; "H" avatar greenish color on AutoIt Forums. ;
Global $scale = _WinAPI_EnumDisplaySettings('', $ENUM_CURRENT_SETTINGS)[0] / @DesktopWidth

HotKeySet("{HOME}", "TogglePause")
HotKeySet("{ESC}", "Terminate")
HotKeySet("+!d", "SearchColor") ; Shift-Alt-d

While 1
    Sleep(100)
WEnd

Func TogglePause()
    $g_bPaused = Not $g_bPaused
    While $g_bPaused
        Sleep(100)
        $a = PixelSearch(0, 0, @DesktopWidth, @DesktopHeight, $iColor, 5)
        #cs
            The search directions (from AutoIt help file - PixelSearch() function):
            Left-to-Right because "left" parameter < "right" parameter
            and
            Top-to-Bottom because "top" parameter < "bottom" parameter
            So, the top left search color is found first.
        #ce
        If IsArray($a) Then
            MouseMove($a[0] / $scale, $a[1] / $scale)
            ToolTip('Script is "Running"')
        Else
            ToolTip('Script is "Running"')
            $a = 0
        EndIf
    WEnd
    ToolTip('')
EndFunc   ;==>TogglePause

Func Terminate()
    Exit
EndFunc   ;==>Terminate

Func SearchColor()
    $iColor = InputBox("Color", "Enter color (0xRRGGBB) you wish to find." & @CR & " eg. For red enter 0xFF0000", "0xFF0000")
EndFunc   ;==>SearchColor

 

Edited October 15, 2018 by Malkey
Replaced _GetScale() function from https://www.autoitscript.com/forum/topic/156251-mouse-coordinates/?do=findComment&comment=1130002

[hellomoto]

Melba23,

Wow.  Sorry.  Don't want to break any rules.  I travel a lot, so there's always cool new places to do this.  Kind of a virtual hide and seek.  Thanks for allowing the community to help.

Malkey,

Gonna read through this. Thanks for the start.

[junkew]

if pixelsearch is not getting you further this has more indepth information on analysing pixels and finding stuff in images

https://www.autoitscript.com/wiki/FAQ#How_can_I_search_an_image_in_another_image.3F

 

[Bert]

I really like this idea for it allows for a father to connect with his child. The only problem I can see is the color may change due to lighting issues thus you would need to do a color range. 

[caramen]

I dont want to do the atmosphere breacker  But it also depend of the video. 

 

There is 10 000 000 of colors. So ... gonna be hard. 

 

I will folow this project too. If you give us feedbacks  . I like it too.

Edited October 17, 2018 by caramen