DocInTraining Posted June 18, 2012 Share Posted June 18, 2012 (edited) Hello, I am attempting to make a spider via Autoit to download PDFs from a variety of sources. Unfortunately, some of those sources will occasionally trigger an "error exceeded requests" error in response to excessive downloads. This error can be removed by image verification. I am trying to determine how this error is triggered and enforced so that I might bypass it through autoit without the need for image verification programming. Things I have tested: I can download from a different browser (i.e. the error triggers after N downloads while using Internet Explorer via autoit. attempting to download from Firefox triggers no such error until an additional N downloads via firefox) Deleting the internet explorer browsing history (cache, cookies, etc) and restarting IE does not help. Changing my IP address does not help. Has anyone else encountered similar problems, or does anyone have ideas of ways that the host networks might be recognizing and enforcing attempts to exceed request limits? Edited June 18, 2012 by DocInTraining Link to comment Share on other sites More sharing options...
Moderators Melba23 Posted June 19, 2012 Moderators Share Posted June 19, 2012 DocInTraining,Welcome to the AutoIt forum. I am trying to determine how this error is triggered and enforced so that I might bypass itYou suggest (no doubt correctly) that the limit has been put in place to prevent "excessive" downloads. Although not specifically prohibited by the Forum Rules, any script aiming to break or bypass that limit would, in my opinion, fall in the "by-passing anti-bot measures or other methods for by-passing software activation" category. And any code to deal with the "This error can be removed by image verification" part of your question would certainly fall foul of the "Breaking CAPTCHA's" prohibition. So as we are not prepared to support any effort to bypass the limit that you have encountered, I am locking this thread. Please read the rules before posting again - and I hope we can be of more help to you next time. M23 Any of my own code posted anywhere on the forum is available for use by others without any restriction of any kind Open spoiler to see my UDFs: Spoiler ArrayMultiColSort ---- Sort arrays on multiple columnsChooseFileFolder ---- Single and multiple selections from specified path treeview listingDate_Time_Convert -- Easily convert date/time formats, including the language usedExtMsgBox --------- A highly customisable replacement for MsgBoxGUIExtender -------- Extend and retract multiple sections within a GUIGUIFrame ---------- Subdivide GUIs into many adjustable framesGUIListViewEx ------- Insert, delete, move, drag, sort, edit and colour ListView itemsGUITreeViewEx ------ Check/clear parent and child checkboxes in a TreeViewMarquee ----------- Scrolling tickertape GUIsNoFocusLines ------- Remove the dotted focus lines from buttons, sliders, radios and checkboxesNotify ------------- Small notifications on the edge of the displayScrollbars ----------Automatically sized scrollbars with a single commandStringSize ---------- Automatically size controls to fit textToast -------------- Small GUIs which pop out of the notification area Link to comment Share on other sites More sharing options...
Recommended Posts