Forcing UTF8+BOM encoding for every file in SciTE?

[trancexx]

What I find strange is that I can paste Unicode e.g. 한국어 텍스트의 예 טקסט עברית ירושלים to the output console and it shows fine. ConsoleWrite is certainly not the culprit since is doesn't work either when launched with F5 (3.3.8.1), albeit it used to work fine with previous Scite4AutoIt3.

 

@Others,

Do you have any success with these settings?

SciTE interprets the input the way you tell it to or the way it makes sense to it. If you've set code.page=65001 then to print that string correctly (the way you expect it) you have to do something like this:

_ConsoleWrite("한국어 텍스트의 예 טקסט עברית ירושלים " & @CRLF)

Func _ConsoleWrite($sString)
    Return ConsoleWrite(BinaryToString(StringToBinary($sString, 4), 1))
EndFunc

[czardas]

Yeah but you'd have to find commonly spread/available font(s) covering more. I now realize you're likely using musical symbols, so no charmap is impotent.

But then how do you handle encoding with surrogates?

 

There are always more bridges to cross right? I will have to take this into consideration and do some testing. I have not yet tried passing strings with surrogates to these functions. I will have to try.

[jchd]

SciTE interprets the input the way you tell it to or the way it makes sense to it. If you've set code.page=65001 then to print that string correctly (the way you expect it) you have to do something like this:

_ConsoleWrite("한국어 텍스트의 예 טקסט עברית ירושלים " & @CRLF)

Func _ConsoleWrite($sString)
    Return ConsoleWrite(BinaryToString(StringToBinary($sString, 4), 1))
EndFunc

There is something strange here: I've been using flat ConsoleWrite with Unicode for years with repeatable success, just until recently.

[Jon]

ConsoleWrite definitely doesn't work with unicode. The API falls apart IIRC. I'd have to check the code for the details as I can't remember.

Edit: Strings are converted to ANSI. Binary is written directly.

Edited September 14, 2013 by Jon