Jump to content
Sign in to follow this  

capture text from website between tags in utf-8

Recommended Posts


i wrote a script to look for a specific ikea product page to see when it becomes available as its out of stock currently

my script is

#include <ButtonConstants.au3>
#include <EditConstants.au3>
#include <GUIConstantsEx.au3>
#include <WindowsConstants.au3>
#include <string.au3>
#include <FTPEx.au3>
#include <File.au3>
#include <Misc.au3>
#include <ClipBoard.au3>
;#include "ModernSplash.au3"
#include <date.au3>
#include <ProgressConstants.au3>
#include <IE.au3>
#Include <Constants.au3>
#Include <INET.au3>
#include <SendMessage.au3>
GUICtrlCreateProgress(10, 10, 780, 20, $PBS_MARQUEE)
_SendMessage(GUICtrlGetHandle(-1), $PBM_SETMARQUEE, True, 50)
Opt("GUIOnEventMode", 1)  ; Change to OnEvent mode 
while 1
GUICtrlCreateLabel("RECEIVING DATA...", 10, 35, 300)
$html = _StringBetween(_INetGetSource('http://www.ikea.gr/DefaultLM.aspx?page=productavail&store=365&iID=6614'), '<span id="_ctl10__ctl0_lbProductDraw">&nbsp;&nbsp;', '</span>')
$font=GUICtrlCreateLabel($html[0], 50, 65, 900)
while ProcessExists("iexplore.exe")
$timerr=3600000     ;3600000
GUICtrlCreateLabel("will check again in 60 mins..", 10, 35, 300)
Func CLOSEClicked()  ;exit  ;===========for gui close
while ProcessExists("iexplore.exe")
it seems to capture the text between those
$html = _StringBetween(_INetGetSource('http://www.ikea.gr/DefaultLM.aspx?page=productavail&store=365&iID=6614'), '<span id="_ctl10__ctl0_lbProductDraw">&nbsp;&nbsp;', '</span>')
BUT problem is the output is in GREEK in the website (utf8) and it wont display it correctly in my autoit window it displays junk, if i try and capture english text it works great
any solution ? cheers
Edited by asiawatcher

Share this post

Link to post
Share on other sites

have you tried opening up the page with the IE functions and getting the source from them??

Share this post

Link to post
Share on other sites

Please remember that when posting code to the forum to use the code box (the blue box in the editor with the A on it), so that your code doesn't take up 3 screens of data and is nicely formatted. Thank you.

If I posted any code, assume that code was written using the latest release version unless stated otherwise. Also, if it doesn't work on XP I can't help with that because I don't have access to XP, and I'm not going to.
Give a programmer the correct code and he can do his work for a day. Teach a programmer to debug and he can do his work for a lifetime - by Chirag Gude
How to ask questions the smart way!

I hereby grant any person the right to use any code I post, that I am the original author of, on the autoitscript.com forums, unless I've specifically stated otherwise in the code or the thread post. If you do use my code all I ask, as a courtesy, is to make note of where you got it from.

Back up and restore Windows user files _Array.au3 - Modified array functions that include support for 2D arrays.  -  ColorChooser - An add-on for SciTE that pops up a color dialog so you can select and paste a color code into a script.  -  Customizable Splashscreen GUI w/Progress Bar - Create a custom "splash screen" GUI with a progress bar and custom label.  -  _FileGetProperty - Retrieve the properties of a file  -  SciTE Toolbar - A toolbar demo for use with the SciTE editor  -  GUIRegisterMsg demo - Demo script to show how to use the Windows messages to interact with controls and your GUI.  -   Latin Square password generator

Share this post

Link to post
Share on other sites

Use _IE* functions or convert the read html from utf8 to utf16.

This wonderful site allows debugging and testing regular expressions (many flavors available). An absolute must have in your bookmarks.
Another excellent RegExp tutorial. Don't forget downloading your copy of up-to-date pcretest.exe and pcregrep.exe here
RegExp tutorial: enough to get started
PCRE v8.33 regexp documentation latest available release and currently implemented in AutoIt beta.

SQLitespeed is another feature-rich premier SQLite manager (includes import/export). Well worth a try.
SQLite Expert (freeware Personal Edition or payware Pro version) is a very useful SQLite database manager.
An excellent eBook covering almost every aspect of SQLite3: a must-read for anyone doing serious work.
SQL tutorial (covers "generic" SQL, but most of it applies to SQLite as well)
A work-in-progress SQLite3 tutorial. Don't miss other LxyzTHW pages!
SQLite official website with full documentation (may be newer than the SQLite library that comes standard with AutoIt)

Share this post

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
Sign in to follow this