LegitStack

ScreenCapture 4k res - how to get dpi awareness?

6 posts in this topic

#1 ·  Posted (edited)

Been struggling with this one for a while. 

when I do a _screencapture_capture call on a high resolution monitor (like my surface book) it gives me an image that has 2 problems:

1. its in the wrong location on the screen

and

2. it gives me a picture that is larger than the area of the screen I selected, though it only has the content of what I selected. 

---------------------------

I was able to easily fix problem #1 by manually adjusting the x y coordinates to compensate for the amount of DPI scale I have.

for instance if I'm 200% zoomed in the code looks like this:

Local $bmp = _ScreenCapture_Capture("", $iX1*2, $iY1*2, $iX2*2, $iY2*2, false)

 it's problem #2 that is the big problem. I'd like to attach a screen shot of what I'm talking about (see capture.png)

Capture.PNG

---------------------------

Now I basically understand why this is happening. ScreenCapture grabs each pixel of the screen. This screen, being a high resolution, when its zoomed in adds up several pixels to make one on the screen. 

This is a problem for me because I'm taking images of the screen and later looking for those exact images on the screen. if everything is blown up by an indeterminate amount (in my case 2x) then those images can't be found later on. 

Does anyone know what I can do? 

I tried resizing the images back down to no avail. 

_GDIPlus_ImageResize and _GDIPlus_ImageScale don't work because they don't compress the pixels correctly. quality is lost. and the exact image isn't preserved, so I can't search for it later. (see capture1.png)

Capture1.PNG

 

Anyway, I'm about to give up, been on this problem for too long! does anyone know what I can do? Seems to me that the ideal solution would be to eventually have autoit add an argument to _screencapture_capture that lets you specify a DPI scale amount or something.  that can be pulled from the registry at HKEY_CURRENT_USER\control panel\desktop\windowmetrics\appliedDPI.

But in the meantime, does anyone have any suggestions for how I can make my program compatible with 4k resolution monitors? I either need to take the screen capture like normal, then scale it down appropriately without losing quality, or I need to capture the screen in the first place like the human sees it. But I don't know how to do that either. 

I'll post my relevant code here: (in my project I call ScreenCapture_DPI_Aware)

#include <Security.au3>

Func _GetAppliedDPI()
  Local $aArrayOfData = _Security__LookupAccountName(@UserName)

  If IsArray($aArrayOfData) Then
    ;msgbox(64, "SID String = ", $aArrayOfData[0] & @CRLF)
    ;msgbox(64, "Domain name = ", $aArrayOfData[1] & @CRLF)
    ;msgbox(64, "SID type = ", _Security__SidTypeStr($aArrayOfData[2]) & @CRLF)
    ;Local $AppliedDPI = RegRead("HKEY_USERS\" & $aArrayOfData[0] & "\Control Panel\Desktop\WindowMetrics", "AppliedDPI")
    Local $AppliedDPI = RegRead("HKEY_CURRENT_USER\Control Panel\Desktop\WindowMetrics", "AppliedDPI")
    return $AppliedDPI
  EndIf
EndFunc



Func GetScale()
  $applied = _GetAppliedDPI()
  if $applied == "" then
    return 1
  else
    return $applied / 96
  EndIf
EndFunc



Func ScreenCapture_Capture_DPI_Aware($sBMP_Path, $iX1, $iY1, $iX2, $iY2, $bool)
  $R = GetScale() ;Raito

  Local $bmp = _ScreenCapture_Capture($sBMP_Path, $iX1*$R, $iY1*$R, $iX2*$R, $iY2*$R, $bool)

  ;Scaling didn't work:
  ;_ScaleImage($bmp, $sBMP_Path, abs($iX2 - $iX1), abs($iY2 - $iY1), $R)
  ;return _ScreenCapture_Capture($sBMP_Path, $iX1*$R, $iY1*$R, $iX2*$R, $iY2*$R, $bool)
  
EndFunc







;Func _ScaleImage($bmp, $outimage, $w, $h, $scale)

;  _GDIPlus_Startup()
    ;Get the encoder of to save the resized image in the format you want.
;    Local $Ext = StringUpper(StringMid($outimage, StringInStr($outimage, ".", 0, -1) + 1))
;    $CLSID = _GDIPlus_EncodersGetCLSID($Ext)
    ; code found here : https://www.autoitscript.com/autoit3/docs/libfunctions/_GDIPlus_ImageSaveToStream.htm
;    Local $sImgCLSID = _GDIPlus_EncodersGetCLSID("png") ;create CLSID for a JPG image file type
;    Local $tGUID = _WinAPI_GUIDFromString($sImgCLSID) ;convert CLSID GUID to binary form and returns $tagGUID structure
;    Local $tParams = _GDIPlus_ParamInit(1) ;initialize an encoder parameter list and return $tagGDIPENCODERPARAMS structure
;    Local $tData = DllStructCreate("int Quality") ;create struct to set JPG quality setting
;    DllStructSetData($tData, "Quality", 100) ;quality 0-100 (0: lowest, 100: highest)
;    Local $pData = DllStructGetPtr($tData) ;get pointer from quality struct
;    _GDIPlus_ParamAdd($tParams, $GDIP_EPGQUALITY, 1, $GDIP_EPTLONG, $pData) ;add a value to an encoder parameter list

;    Local $gbmp = _GDIPlus_BitmapCreateFromHBITMAP($bmp)
;    _WinAPI_DeleteObject($bmp)

;    Local $gsbmp = _GDIPlus_ImageResize($gbmp, $w * $scale, $h * $scale)
    ;Local $ext = _GDIPlus_EncodersGetCLSID("PNG")
;    _GDIPlus_ImageSaveToFileEx($gsbmp, $outimage, $sImgCLSID)

;    _GDIPlus_BitmapDispose($gbmp)
;    _GDIPlus_BitmapDispose($gsbmp)
;  _GDIPlus_Shutdown()
;EndFunc


Thanks for any help you can give me!!!

Edited by LegitStack

Share this post


Link to post
Share on other sites



2 hours ago, RTFC said:

I'm having a deja-lu:blink:

Thanks RTFC!

this is what I came up with to fix the prob:

#include <lib\applieddpi.au3>


Func Load_ScreenCapture_High_DPI_Check()
  $R = GetScale()
  if $R == 1 then
    ; should fix this to work with dual monitors. later.
  else
    #Region ;**** Directives created by AutoIt3Wrapper_GUI ****
    #AutoIt3Wrapper_Res_HiDpi=Y
    #EndRegion ;**** Directives created by AutoIt3Wrapper_GUI ****
    DllCall("User32.dll","bool","SetProcessDPIAware")
    ;(work around) first screencapture doesn't seem to work right, so take one and throw away.
    _ScreenCapture_Capture("",0,0,@DesktopWidth,@DesktopHeight)
  endif
EndFunc

Load_ScreenCapture_High_DPI_Check()

;;;;;;;AppliedDPI.au3


#include <Security.au3>


Func _GetAppliedDPI()
  Local $AppliedDPI = RegRead("HKEY_CURRENT_USER\Control Panel\Desktop\WindowMetrics", "AppliedDPI")
  return $AppliedDPI
EndFunc


Func GetScale()
  $applied = _GetAppliedDPI()
  if $applied == "" then
    return 1
  else
    return $applied / 96
  EndIf
EndFunc

 

 

Share this post


Link to post
Share on other sites
On 10/16/2016 at 2:36 PM, LegitStack said:

Thanks RTFC!

this is what I came up with to fix the prob:

#include <lib\applieddpi.au3>


Func Load_ScreenCapture_High_DPI_Check()
  $R = GetScale()
  if $R == 1 then
    ; should fix this to work with dual monitors. later.
  else
    #Region ;**** Directives created by AutoIt3Wrapper_GUI ****
    #AutoIt3Wrapper_Res_HiDpi=Y
    #EndRegion ;**** Directives created by AutoIt3Wrapper_GUI ****
    DllCall("User32.dll","bool","SetProcessDPIAware")
    ;(work around) first screencapture doesn't seem to work right, so take one and throw away.
    _ScreenCapture_Capture("",0,0,@DesktopWidth,@DesktopHeight)
  endif
EndFunc

Load_ScreenCapture_High_DPI_Check()

;;;;;;;AppliedDPI.au3


#include <Security.au3>


Func _GetAppliedDPI()
  Local $AppliedDPI = RegRead("HKEY_CURRENT_USER\Control Panel\Desktop\WindowMetrics", "AppliedDPI")
  return $AppliedDPI
EndFunc


Func GetScale()
  $applied = _GetAppliedDPI()
  if $applied == "" then
    return 1
  else
    return $applied / 96
  EndIf
EndFunc

 

 

New to using computers with High Resolution screens...    and trying to get my scripts to adjust similar problems to this thread.  I'm having difficulty getting autoit to locate 

#include <lib\applieddpi.au3>

what file or location would I have it search for that?  thank you for entertaining a noob question... never had issues before  guessing the script itself isnt saved in the right location to find the file. 

 

 

Share this post


Link to post
Share on other sites

@JennMaughan: AFAIK, that's not a standard AutoIt include file, but probably something user LegitStack put together. You should be alright just copying only those functions to your own script(s), if you wish to use them.:)

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!


Register a new account

Sign in

Already have an account? Sign in here.


Sign In Now

  • Similar Content

    • Fhelipe
      By Fhelipe
      So I wanted to use my machine as a server for a program that had a unique login system. It can only log in 1 person and the password is in the script itself. I would like to adptar my code or change it completely so that I can create a database and the Script At Time Of Login Get Database Login And Log In
      Experience with Autoit: Basic                      (sorry for bad English)
      Experience with SQL: None                              (translator only)
      Code Currently Used To Login:
      ;=========================================================
      While 1
          $MSG = GUIGetMsg()
          Switch $MSG
          Case $ButtonOk
              If VerifyLogin(GUICtrlRead($USERNAME),GUICtrlRead($PASSWORD)) = 1 Then
                  GUIDelete($Form1)
                  MsgBox(-1,"Logado com Sucesso","Login Sucedido, Para Parar o Aimbot Pressione ESC!")
                  Run ("C:\Program Files (x86)\Steam\steamapps\common\Mitos.is The Game\Mitosis.exe")
                  RunP()
              Else
                  MsgBox(-1,"Error","Usúario ou Senha está incorreto, Ou Ainda Não Pagou!")
               EndIf
          Case -3
              Exit
           Case $ButtonCancel
              Exit
                Case $HelpButton
               MsgBox(-1, "Criadores", "Criadores: Zummey & Ralta")
      Case $Register
         MsgBox(-1, "ERRO", "PROGRAMA EM DESENVOLVIMENTO FUNÇÃO DESABILITADA")
          EndSwitch
      WEnd
      Func VerifyLogin($USERNAME,$PASSWORD)
          If $USERNAME = "Zummey" And $PASSWORD = "xd90fe10" Then
              Return 1
          Else
              Return 0
          EndIf
      EndFunc; End login
      ;=========================================================
    • IamKJ
      By IamKJ
      I am trying to allow the GUI to gather info as to when to execute a function.  I am having trouble doing this.  So far this is what I have.
       
      ;Timer Func timer () If Not IsDeclared("iMsgBoxAnswer") Then Local $iMsgBoxAnswer $iMsgBoxAnswer = MsgBox(36,"Timer","Please format your answer in 00:00:00:000") Select Case $iMsgBoxAnswer = 6 ;Yes Global $infotime = InputBox ('Time', 'What time to execute?') Do $rawtimer = ToolTip(@Hour & ':' & @Min & ':' & @Sec & ':' & _MSec()) until $rawtimer = $infotime if $rawtimer = $infotime Then msgbox (0,'Worked','Worked') Else EndIf Case $iMsgBoxAnswer = 7 ;No Exit EndSelect EndFunc Func _MSec() Local $stSystemTime = DllStructCreate('ushort;ushort;ushort;ushort;ushort;ushort;ushort;ushort') DllCall('kernel32.dll', 'none', 'GetSystemTime', 'ptr', DllStructGetPtr($stSystemTime)) $sMilliSeconds = StringFormat('%03d', DllStructGetData($stSystemTime, 8)) $stSystemTime = 0 Return $sMilliSeconds EndFunc I have also tried _GUIToolTip_GetText in order to read the tooltip until the time specified, but it still doesn't work.  Any help would be great.
    • IamKJ
      By IamKJ
      So I have a lot of different functions in the little program I'm making.  Most of them use the Do statement, such as finding images, clicking buttons, etc.
       
      The question I have is how would I be able to both
      1) Create a hotkey to pause whatever I am doing at the moment.  If I have to put something into every function in the program, I don't mind.
      2) Create a hotkey to exit whatever I am doing and stop all loops or commands and bring back the main GUI?
    • Manivel
      By Manivel
      Hi,
      Can any one please share the Connection string for SQL Developer. 
      How to Connect the SQL Developer from AutoIT. We need to execute the query through AutoIt. is that possible ?
    • Manivel
      By Manivel
      We are launching the AutoIT script through selenium and passing the values through command lines.
      Similarly able to return the value from AutoIt to selenium ?  If yes ? how to return the values ?