Fullwidth Unicode forms display incorrectly

Mar 14, 2018
2
0
In TakeCommand, fullwidth Unicode forms (Halfwidth and Fullwidth Forms (Unicode block) - Wikipedia) are handled incorrectly. They appear to confuse some internal column tracker, and cause the console to wrap poorly.

The problem can be seen by executing "for /L %c in (65313,1,65338) do echo Fullwidth %c: %@CHAR[%c]" at the command line.

The problem appears to be associated with the underlying windowing code, as running the same command in TCC hosted in the new Windows Terminal does not exhibit the problem.

Use case: I regularly use fullwidth forms of characters which would otherwise be disallowed in filenames (\ / : * ? " < > |), because the fullwidth forms are legal.
 

rconn

Administrator
Staff member
May 14, 2008
12,404
152
I was hoping nobody would discover or want to use those characters! :rolleyes:

Take Command supports wide characters for Far East code pages, but I haven't enabled it for everybody else because it results in a performance hit while drawing text because Take Command has to check each character to see if it's either 2-columns or (worse) 0-columns.

I've enabled this for everybody in the next build.
 
  • Like
Reactions: banshee

samintz

Scott Mintz
May 20, 2008
1,514
18
Solon, OH, USA
Given that most people don't use wide characters, is there a way to enable or disable support with an INI directive?
 
May 30, 2008
235
2
If it's just an extra if-statement, how much difference can it make? And if most characters are one way, then shouldn't the branch predictor basically handle it for free?
 
Similar threads
Thread starter Title Forum Replies Date
Peter Murschall TEE cannot handle Unicode output Support 2
T @execstr unicode support Support 6
Peter Murschall TPIPE generate unicode on Piping or redirecting Support 3
D Pasting Unicode data has different behavior on TCC and CMD Support 2
vefatica TYPE goes crazy with no-BOM Unicode file Support 7
Charles Dye TCC smashing Unicode quotes Support 9
Peter Murschall UNICODE mixed with ANSI Code Support 11
Joe Caverly Unicode, Codepage 437, and line characters Support 3
B How to? Convert Unicode to ANSI Support 1
StarliteLemming Fileread fails on Unicode file Support 10
vefatica DO ... /P ... and Unicode? Support 3
vefatica Unicode ... I don't understand Support 1
jadaml Echo unicode characters from UTF-8 Batch files? Support 1
Charles Dye @ASCII vs. @UNICODE Support 5
A How to? Filter history list with unicode chars Support 0
vefatica TYPE, Unicode, installer Support 10
A WAD Limitations on display of unicode punctuation marks Support 11
A Include lists and Unicode Support 1
M How to? How do I read a Unicode file through standard-input? Support 4
M WAD A bit of strangeness related to Unicode-marked file not being Unicode Support 2
M @CHAR and UNICODE Support 4
D LIST command wierdness with empty Unicode file Support 1
B Unicode/dword issue in TCC12 Support 4
J dir failure with some unicode characters Support 6
M TCC Unicode support? Support 7
vefatica BOMs in [dir]history / TAIL with Unicode Support 2
vefatica Unicode screw-up in IDE Support 4
vefatica Unicode anomaly Support 0
vefatica Debugger now Unicode? Support 1
vefatica TYPE /X and Unicode files? Support 0
dcantor Convert ASCII to Unicode or vice versa? Support 6
H HISTORY and DIRHISTORY /R can't handle Unicode Support 0
R Reading an Unicode file with more than 8191 lines Support 1

Similar threads