BOMs in [dir]history / TAIL with Unicode

May 20, 2008
11,534
103
Syracuse, NY, USA
BOMs (apparently) show up in the history and dirhistory after reading from a Unicode file (like a shralias sav file). Note the "?" characters below.

Code:
v:\> list /x dhtest.txt
0000 0000 ff fe 78 00 3a 00 5c 00  66 00 6f 00 6f 00 0d 00  ? x : \ f o o .
0000 0010 0a 00                                             .

v:\> dirhistory /r dhtest.txt

v:\> history /r dhtest.txt

v:\> dirhistory | tail
G:\projects
D:\PowerPro
d:\
G:\Projects\pppmem\Release
e:\Users\vefatica\Desktop
g:\Projects\pppmem
c:\
D:\tc11
V:\
?x:\foo

v:\> history | tail
type /x dhtest.txt
echo %@unicode[%@line[0,dhtest.txt]]
echo %@unicode[%@line[dhtest.txt,0]]
dirhistory
list /x dhtest.txt
dirhistory /r dhtest.txt
history /r dhtest.txt
?x:\foo
dirhistory | tail
history | tail
And the shell below was started with /U. TAIL really messes up Unicode output.

Code:
d:\tc11> dirhistory | tail
????????????????????????????????????????????????????????????????????????????????
?????????????????????????????????????????
ica\Desktop
??????????????????????????????????????????????????????
???????????????????????????
?x:\foo
?????????
v:\
??
?

v:\> echo foo | tail
foo
??
?

v:\>
 
May 20, 2008
3,515
4
Elkridge, MD, USA
Vince Fatica:
| BOMs (apparently) show up in the history and dirhistory after
| reading from a Unicode file (like a shralias sav file). Note the
| "?" characters below.

Your example implied that the BOMs in the files were loaded into the
internal HISTORY and DIRHISTORY tables by the HISTORY/R and DIRHISTORY/R
commands. Does this happen with the other command which have similar /R
options, i.e., ALIAS, FUNCTION and SET, and their "UN" versions?

| ...
| And the shell below was started with /U. TAIL really messes up
| Unicode output.
| ...

Does TAIL mess up when you TYPE a file (e.g., executing "type file | tail"
when _unicode=1)?
--
Steve
 
May 20, 2008
11,534
103
Syracuse, NY, USA
history / TAIL with Unicode

On Thu, 04 Mar 2010 08:08:13 -0500, Steve Fábián <> wrote:

|Vince Fatica:
|| BOMs (apparently) show up in the history and dirhistory after
|| reading from a Unicode file (like a shralias sav file). Note the
|| "?" characters below.
|
|Your example implied that the BOMs in the files were loaded into the
|internal HISTORY and DIRHISTORY tables by the HISTORY/R and DIRHISTORY/R
|commands. Does this happen with the other command which have similar /R
|options, i.e., ALIAS, FUNCTION and SET, and their "UN" versions?

Apparently not.

|| ...
|| And the shell below was started with /U. TAIL really messes up
|| Unicode output.
|| ...
|
|Does TAIL mess up when you TYPE a file (e.g., executing "type file | tail"
|when _unicode=1)?

Yes.

v:\> echo %_unicode
1

v:\> type dhtest.txt
x:\foo

v:\> type dhtest.txt | tail
x:\foo
oo



v:\>
--
- Vince
 
Similar threads
Thread starter Title Forum Replies Date
E Fixed Bug with DIR /Z displaying descriptions Support 8
J Paths shown in DIR /B Support 2
K Fixed Prompt display will be shifted after use dir to display a filename with Chinese. (v25.00.28 x64) Support 18
Jesse Heines How to? How to display picture creation date with dir command Support 6
vefatica WAD DIR.BTM? Support 11
DrusTheAxe DIR reports meaningless SYMLINK information Support 14
C show file description? with dir? Support 8
vefatica DIR /F and streams? Support 7
rps Multi-column DIR /v not displaying all files. Support 5
R How to? Dir specific file search patterns with spaces in the pathnames? Support 6
rps Dir /Nfv -> Alt-F2 Support 2
rps @FILESIZE[....,a] allocated size not matching Dir results Support 8
A TCMD - Dir Command puts out blank lines? Support 16
S Problems with dir command in the debugger Support 5
M TCC incorrect dir output since Windows 1803 Support 6
x13 Problem listing repository files using DIR http(s)://... Support 8
cxxl dir /s works in mysterious ways :( Support 4
vefatica Help nit (FFIND and DIR with /S) Support 0
N Fixed Strange dir behavior Support 6
JohnQSmith Weird DIR output (missing lines) Support 1
C 7zip with date range .vs. filelist created with dir and daterange Support 0
D Towards shared (dir-)history lists Support 3
vefatica WAD DIR /HL still gets names wrong Support 16
vefatica DIR /S /HL? Support 4
H Fixed DIR /G returns wrong sizes Support 2
nickles WAD dir.htm Support 2
vefatica DO dir in /s /a:+d /d"g:\" * ( ... ) Support 26
vefatica DIR \\.\...? Support 4
M Fixed DIR /S /B1 ignores "/S" Support 5
C tcmd.ini not loading from program dir? Support 5
D Fixed Dir /Nm:n has changed Support 1
rps How to? dir /s unexpected results Support 10
vefatica Update to current install dir? Support 8
cgunhouse Problem with "dir /=" Support 4
T dir /h error in empty directory Support 22
P WAD TC 15.0.1.58 x64 crasches with a simple dir command Support 18
CWBillow dir /4 strange Support 2
samintz WAD DIR /B1 and /X Support 2
nickles dir behaves inconsistently Support 5
vefatica DIR, streams, and wildcards? Support 1
vefatica DIR /: /u ... streams not counted? Support 7
vefatica Documentation DIR /B /S /: Support 2
samintz How to? DIR listing for exact match Support 1
dcantor WAD dir "ftp:// ..." fails in TCC 15 Support 7
T How to? dir/pdir - 2nd level down only Support 7
MikeBaas How to? DIR: supress extensions? Support 5
old coot dir /s dies on my C: drive Support 2
A WAD Dir daterange + multiple path wildcards crashes tcc Support 2
old coot TC DIR command has trouble on my SSD Support 2
M Fixed character set in dir/copy Support 3

Similar threads