[SOLVED] Unicode? Character Decoding

[aNewLyfe]

Hi there im working on a json project, i've tried all json topics on forum but some json coming corrupt (i think)

so i need to convert characters like \u003c to their originals.

For expample, \u003c == <

sorry for my bad english and waiting for your help

Edited May 31, 2011 by mistakilla

[Maffe811]

i dont know if this will work but just write

"\u003c" = "<"

at the top

[KaFu]

Regarding Unicode... I always search for posts containing the keyword and made by jchd ...

;Local $str = "Here is your example codes:\u0634\u0628\u0633where you can find other text as well\u0625\u064a\u0647\u0638"
Local $str = "\u003c"
Local $s = StringRegexpReplace($str, "\\u([[:xdigit:]]{2,4})", '"&chrw(0x$1)&"')
$s = '"' & $s & '"'
$s = Execute($s)
_ConsoleWrite($s & @LF)

Func _ConsoleWrite($sString)
    Local $aResult = DllCall("kernel32.dll", "int", "WideCharToMultiByte", "uint", 65001, "dword", 0, "wstr", $sString, "int", -1, _
                                "ptr", 0, "int", 0, "ptr", 0, "ptr", 0)
    If @error Then Return SetError(1, @error, 0)
    Local $tText = DllStructCreate("char[" & $aResult[0] & "]")
    $aResult = DllCall("Kernel32.dll", "int", "WideCharToMultiByte", "uint", 65001, "dword", 0, "wstr", $sString, "int", -1, _
                            "ptr", DllStructGetPtr($tText), "int", $aResult[0], "ptr", 0, "ptr", 0)
    If @error Then Return SetError(2, @error, 0)
    ConsoleWrite(DllStructGetData($tText, 1))
EndFunc

[aNewLyfe]

i dont know if this will work but just write

"\u003c" = "<"

at the top

i know that but its the long way, i have to add every unicode tag, there could be forgotten ones.

Regarding Unicode... I always search for posts containing the keyword and made by jchd ...

;Local $str = "Here is your example codes:\u0634\u0628\u0633where you can find other text as well\u0625\u064a\u0647\u0638"
Local $str = "\u003c"
Local $s = StringRegexpReplace($str, "\\u([[:xdigit:]]{2,4})", '"&chrw(0x$1)&"')
$s = '"' & $s & '"'
$s = Execute($s)
_ConsoleWrite($s & @LF)

Func _ConsoleWrite($sString)
    Local $aResult = DllCall("kernel32.dll", "int", "WideCharToMultiByte", "uint", 65001, "dword", 0, "wstr", $sString, "int", -1, _
                                "ptr", 0, "int", 0, "ptr", 0, "ptr", 0)
    If @error Then Return SetError(1, @error, 0)
    Local $tText = DllStructCreate("char[" & $aResult[0] & "]")
    $aResult = DllCall("Kernel32.dll", "int", "WideCharToMultiByte", "uint", 65001, "dword", 0, "wstr", $sString, "int", -1, _
                            "ptr", DllStructGetPtr($tText), "int", $aResult[0], "ptr", 0, "ptr", 0)
    If @error Then Return SetError(2, @error, 0)
    ConsoleWrite(DllStructGetData($tText, 1))
EndFunc

thanks for your answer but this outputs:

&chrw(0x00b7)&

Execute not running i think. Also, there is " in my source. So i have to stringReplace " with ' to get output and its not a good idea i think

Btw, i can use with strReplace but what will i do with &chrw(0x00b7)& in my output, how will i convert em to ascii chars?

Fast Edit:

Ok, i've figured out it. But here is the problem ATM:

i got utf8 problem i think, because i got ÅŸ instead of i (without dot up on it (Latin 5 char ı))

Any suggestion ?

Edited May 31, 2011 by mistakilla

[aNewLyfe]

Okay, problem solved, if anyone want to know how:

Sorry for multiple posts, tnx 4 help.

[KaFu]

Ok, i've figured out it. But here is the problem ATM:

i got utf8 problem i think, because i got ÅŸ instead of i (without dot up on it (Latin 5 char ı))

Any suggestion ?

Parsing to the console (or file) should work fine with the above example. If you want to display the result in a GUI, make sure to select a unicode font capable of displaying the characters.

[guinness]

Regarding Unicode... I always search for posts containing the keyword and made by jchd ...

So I'm not the only one Edited May 31, 2011 by guinness

[jchd]

Please stop that

The thin skin I have in this area I built it the hard way, but it's still thin as encoding problems at large are a total nightmare, well beyond what I can embrace. Take a look at ICU or Big5 and you'll see what I mean!

[Maffe811]

i know that but its the long way, i have to add every unicode tag, there could be forgotten ones.

Okay, i didnt know you neede all of them.

Than this would be a bad way to go.

But if that works, couldnt someone write "unicode converter udf" wich converts the unicode characters to normal characters!

[jchd]

What exactly does "convert Unicode characters to normal characters" mean?

Unicode can only be converted reliably to ... Unicode. No choice here!

[aNewLyfe]

ok, solved it again. Forget about all

Maybe someone still searching for help about this so i have to write,

use the great HTML object, write text on it.

So, bill gates does conversion for you.

Here you go,

Func _HTML_StripTags($sHTML)
    If($sHTML=="")Then Return $sHTML
    If Not StringStripWS($sHTML, 8) Then Return SetError(1, 0, "")
    Local $oHTML = ObjCreate("HTMLFILE")
    If @error Then Return SetError(2, 0, "")
    $oHTML.Open()
    $oHTML.Write($sHTML)
    If Not $oHTML.Body.InnerText Then Return SetError(3, 0, "")
    Return SetError(0, 0, $oHTML.Body.InnerText)
EndFunc   ;==>_HTML_StripTags

writer of this function has just saved your life and its not me, thanks goes to its author

Edited August 18, 2011 by mistakilla

[guinness]

Author: