TAIL buggy in build 16

[vefatica]

Here's a much simpler test (than in my other recent thread).

d:\data\tcclibrary> (do i=1 to 1000 ( echo %i )) | tail
റ㈊਍ള㐊਍വ㘊਍ഷ㠊਍ഹㄊരㄊറㄊലㄊളㄊഴㄊവㄊശㄊഷㄊസㄊഹ㈊ര㈊റ㈊ല㈊ള㈊ഴ㈊വ㈊ശ㈊ഷ㈊സ㈊ഹ㌊ര㌊റ㌊ല㌊ള㌊ഴ㌊വ㌊ശ㌊ഷ㌊സ㌊ഹ㐊ര㐊റ㐊ല㐊ള㐊ഴ㐊വ㐊ശ㐊ഷ㐊സ㐊ഹ㔊ര㔊റ㔊ല㔊ള㔊ഴ㔊വ㔊ശ㔊ഷ㔊സ㔊ഹ㘊ര㘊റ㘊ല㘊ള㘊ഴ㘊വ㘊ശ㘊ഷ㘊സ㘊ഹ㜊ര㜊റ㜊ല㜊ള㜊ഴ㜊വ㜊ശ㜊ഷ㜊സ㜊ഹ㠊ര㠊റ㠊ല㠊ള㠊ഴ㠊വ㠊ശ㠊ഷ㠊സ㠊ഹ㤊ര㤊റ㤊ല㤊ള㤊ഴ㤊വ㤊ശ㤊ഷ㤊സ㤊ഹㄊ〰਍〱റㄊ㈰਍〱ളㄊ㐰਍〱വㄊ㘰਍〱ഷㄊ㠰਍〱ഹㄊ〱਍ㄱറㄊ㈱਍ㄱളㄊ㐱਍ㄱവㄊ㘱਍ㄱഷㄊ㠱਍ㄱഹㄊ〲਍㈱റㄊ㈲਍㈱ള ㄊ㐲਍㈱വㄊ㘲਍㈱ഷㄊ㠲਍㈱ഹㄊ〳਍㌱റㄊ㈳਍㌱ളㄊ㐳਍㌱വㄊ㘳਍㌱ഷㄊ㠳਍㌱ഹㄊ〴਍㐱റㄊ㈴਍㐱ളㄊ㐴਍㐱വㄊ㘴਍㐱ഷㄊ㠴਍㐱ഹㄊ〵਍㔱റㄊ㈵਍㔱ളㄊ㐵਍㔱വㄊ㘵਍㔱ഷㄊ㠵਍㔱ഹㄊ〶਍㘱റㄊ㈶਍㘱ളㄊ㐶਍㘱വㄊ㘶਍㘱ഷㄊ㠶਍㘱ഹㄊ〷਍㜱റㄊ㈷਍㜱ളㄊ㐷਍㜱വㄊ㘷਍㜱ഷㄊ㠷਍㜱ഹㄊ〸਍㠱റㄊ㈸਍㠱ളㄊ㐸਍㠱വㄊ㘸਍㠱ഷㄊ㠸਍㠱ഹㄊ〹਍㤱റㄊ㈹਍㤱ളㄊ㐹਍㤱വㄊ㘹਍㤱ഷㄊ㠹਍㤱ഹ㈊〰਍〲റ㈊㈰਍〲ള㈊㐰਍〲വ㈊㘰਍〲ഷ㈊㠰਍〲ഹ㈊〱਍ㄲറ㈊㈱਍ㄲള㈊㐱਍ㄲവ㈊㘱਍ㄲഷ㈊㠱਍ㄲഹ㈊〲਍㈲റ㈊㈲਍㈲ള㈊㐲਍㈲വ㈊㘲਍㈲ഷ㈊㠲਍㈲ഹ㈊〳਍㌲റ㈊㈳਍㌲ള㈊㐳਍㌲വ㈊㘳਍㌲ഷ㈊㠳਍㌲ഹ㈊〴਍㐲റ㈊㈴਍㐲ള㈊㐴਍㐲വ㈊㘴਍㐲ഷ㈊㠴਍㐲ഹ㈊〵਍㔲റ㈊㈵਍㔲ള㈊㐵਍㔲വ㈊㘵਍㔲ഷ㈊㠵਍㔲ഹ㈊〶਍㘲റ㈊㈶਍㘲ള㈊㐶਍㘲വ㈊㘶਍㘲ഷ㈊㠶਍㘲ഹ㈊〷਍㜲റ㈊㈷਍㜲ള㈊㐷਍㜲വ㈊㘷਍㜲ഷ㈊㠷਍㜲ഹ㈊〸਍㠲റ㈊㈸਍㠲ള㈊㐸਍㠲വ㈊㘸਍㠲ഷ㈊㠸਍㠲ഹ㈊〹਍㤲റ㈊㈹਍㤲ള㈊㐹਍㤲വ㈊㘹਍㤲ഷ㈊㠹਍㤲ഹ㌊〰਍〳റ㌊㈰਍〳ള㌊㐰਍〳വ㌊㘰਍〳ഷ㌊㠰਍〳ഹ㌊〱਍ㄳറ㌊㈱਍ㄳള㌊㐱਍ㄳവ㌊㘱਍ㄳഷ㌊㠱਍ㄳഹ㌊〲਍㈳റ㌊㈲਍㈳ള㌊㐲਍㈳വ㌊㘲਍㈳ഷ㌊㠲਍㈳ഹ㌊〳਍㌳റ㌊㈳਍㌳ള㌊㐳਍㌳വ㌊㘳਍㌳ഷ㌊㠳਍㌳ഹ㌊〴਍㐳റ㌊㈴਍㐳ള㌊㐴਍㐳വ㌊㘴਍㐳ഷ㌊㠴਍㐳ഹ㌊〵਍㔳റ㌊㈵਍㔳ള㌊㐵਍㔳വ㌊㘵਍㔳ഷ㌊㠵਍㔳ഹ㌊〶਍㘳റ㌊㈶਍㘳ള㌊㐶਍㘳വ㌊㘶਍㘳ഷ㌊㠶਍㘳ഹ㌊〷਍㜳റ㌊㈷਍㜳ള㌊㐷਍㜳വ㌊㘷਍㜳ഷ㌊㠷਍㜳ഹ㌊〸਍㠳റ㌊㈸਍㠳ള㌊㐸਍㠳വ㌊㘸਍㠳ഷ㌊㠸਍㠳ഹ㌊〹਍㤳റ㌊㈹਍㤳ള㌊㐹਍㤳വ㌊㘹਍㤳ഷ㌊㠹਍㤳ഹ㐊〰਍〴റ㐊㈰਍〴ള㐊㐰਍〴വ㐊㘰਍〴ഷ㐊㠰਍〴ഹ㐊〱਍ㄴറ㐊㈱਍ㄴള㐊㐱਍ㄴവ㐊㘱਍ㄴഷ㐊㠱਍ㄴഹ㐊〲਍㈴റ㐊㈲਍㈴ള㐊㐲਍㈴വ㐊㘲਍㈴ഷ㐊㠲਍㈴ഹ㐊〳਍㌴റ㐊㈳਍㌴ള㐊㐳਍㌴വ㐊㘳਍㌴ഷ㐊㠳਍㌴ഹ㐊〴਍㐴റ㐊㈴਍㐴ള㐊㐴਍㐴വ㐊㘴਍㐴ഷ㐊㠴਍㐴ഹ㐊〵਍㔴റ㐊㈵਍㔴ള㐊㐵਍㔴വ㐊㘵਍㔴ഷ㐊㠵਍㔴ഹ㐊〶਍㘴റ㐊㈶਍㘴ള㐊㐶਍㘴വ㐊㘶਍㘴ഷ㐊㠶਍㘴ഹ㐊〷਍㜴റ㐊㈷਍㜴ള㐊㐷਍㜴വ㐊㘷਍㜴ഷ㐊㠷਍㜴ഹ㐊〸਍㠴റ㐊㈸਍㠴ള㐊㐸਍㠴വ㐊㘸਍㠴ഷ㐊㠸਍㠴ഹ㐊〹਍㤴റ㐊㈹਍㤴ള㐊㐹਍㤴വ㐊㘹਍㤴ഷ㐊㠹਍㤴ഹ㔊〰਍〵റ㔊㈰਍〵ള㔊㐰਍〵വ㔊㘰਍〵ഷ㔊㠰਍〵ഹ㔊〱਍ㄵറ㔊㈱਍ㄵള㔊㐱਍ㄵവ㔊㘱਍ㄵഷ㔊㠱਍ㄵഹ㔊〲਍㈵റ㔊㈲਍㈵ള㔊㐲਍㈵വ㔊㘲਍㈵ഷ㔊㠲਍㈵ഹ㔊〳਍㌵റ㔊㈳਍㌵ള㔊㐳਍㌵വ㔊㘳਍㌵ഷ㔊㠳਍㌵ഹ㔊〴਍㐵റ㔊㈴਍㐵ള㔊㐴਍㐵വ㔊㘴਍㐵ഷ㔊㠴਍㐵ഹ㔊〵਍㔵റ㔊㈵਍㔵ള㔊㐵਍㔵വ㔊㘵਍㔵ഷ㔊㠵਍㔵ഹ㔊〶਍㘵റ㔊㈶਍㘵ള㔊㐶਍㘵വ㔊㘶਍㘵ഷ㔊㠶਍㘵ഹ㔊〷਍㜵റ㔊㈷਍㜵ള㔊㐷਍㜵വ㔊㘷਍㜵ഷ㔊㠷਍㜵ഹ㔊〸਍㠵റ㔊㈸਍㠵ള㔊㐸਍㠵വ㔊㘸਍㠵ഷ㔊㠸਍㠵ഹ㔊〹਍㤵റ㔊㈹਍㤵ള㔊㐹਍㤵വ㔊㘹਍㤵ഷ㔊㠹਍㤵ഹ㘊〰਍〶റ㘊㈰਍〶ള㘊㐰਍〶വ㘊㘰਍〶ഷ㘊㠰਍〶ഹ㘊〱਍ㄶറ㘊㈱਍ㄶള㘊㐱਍ㄶവ㘊㘱਍ㄶഷ㘊㠱਍ㄶഹ㘊〲਍㈶റ㘊㈲਍㈶ള㘊㐲਍㈶വ㘊㘲਍㈶ഷ㘊㠲਍㈶ഹ㘊〳਍㌶റ㘊㈳਍㌶ള㘊㐳਍㌶വ㘊㘳਍㌶ഷ㘊㠳਍㌶ഹ㘊〴਍㐶റ㘊㈴਍㐶ള㘊㐴਍㐶വ㘊㘴਍㐶ഷ㘊㠴਍㐶ഹ㘊〵਍㔶റ㘊㈵਍㔶ള㘊㐵਍㔶വ㘊㘵਍㔶ഷ㘊㠵਍㔶ഹ㘊〶਍㘶റ㘊㈶਍㘶ള㘊㐶਍㘶വ㘊㘶਍㘶ഷ㘊㠶਍㘶ഹ㘊〷਍㜶റ㘊㈷਍㜶ള㘊㐷਍㜶വ㘊㘷਍㜶ഷ㘊㠷਍㜶ഹ㘊〸਍㠶റ㘊㈸਍㠶ള㘊㐸਍㠶വ㘊㘸਍㠶ഷ㘊㠸਍㠶ഹ㘊〹਍㤶റ㘊㈹਍㤶ള㘊㐹਍㤶വ㘊㘹਍㤶ഷ㘊㠹਍㤶ഹ㜊〰਍〷റ㜊㈰਍〷ള㜊㐰਍〷വ㜊㘰਍〷ഷ㜊㠰਍〷ഹ㜊〱਍ㄷറ㜊㈱਍ㄷള㜊㐱਍ㄷവ㜊㘱਍ㄷഷ㜊㠱਍ㄷഹ㜊〲਍㈷റ㜊㈲਍㈷ള㜊㐲਍㈷വ㜊㘲਍㈷ഷ㜊㠲਍㈷ഹ㜊〳਍㌷റ㜊㈳਍㌷ള㜊㐳਍㌷വ㜊㘳਍㌷ഷ㜊㠳਍㌷ഹ㜊〴਍㐷റ㜊㈴਍㐷ള㜊㐴਍㐷വ㜊㘴਍㐷ഷ㜊㠴਍㐷ഹ㜊〵਍㔷റ㜊㈵਍㔷ള㜊㐵਍㔷വ㜊㘵਍㔷ഷ㜊㠵਍㔷ഹ㜊〶਍㘷റ㜊㈶਍㘷ള㜊㐶਍㘷വ㜊㘶਍㘷ഷ㜊㠶਍㘷ഹ㜊〷਍㜷റ㜊㈷਍㜷ള㜊㐷਍㜷വ㜊㘷਍㜷ഷ㜊㠷਍㜷ഹ㜊〸਍㠷റ㜊㈸਍㠷ള㜊㐸਍㠷വ㜊㘸਍㠷ഷ㜊㠸਍㠷ഹ㜊〹਍㤷റ㜊㈹਍㤷ള㜊㐹਍㤷വ㜊㘹਍㤷ഷ㜊㠹਍㤷ഹ㠊〰਍〸റ㠊㈰਍〸ള㠊㐰਍〸വ㠊㘰਍〸ഷ㠊㠰਍〸ഹ㠊〱਍ㄸറ㠊㈱਍ㄸള㠊㐱਍ㄸവ㠊㘱਍ㄸഷ㠊㠱਍ㄸഹ㠊〲਍㈸റ㠊㈲਍㈸ള㠊㐲਍㈸വ㠊㘲਍㈸ഷ㠊㠲਍㈸ഹ㠊〳਍㌸റ㠊㈳਍㌸ള㠊㐳਍㌸വ㠊㘳਍㌸ഷ㠊㠳਍㌸ഹ㠊〴਍㐸റ㠊㈴਍㐸ള㠊㐴਍㐸വ㠊㘴਍㐸ഷ㠊㠴਍㐸ഹ㠊〵਍㔸റ㠊㈵਍㔸ള㠊㐵਍㔸വ㠊㘵਍㔸ഷ㠊㠵਍㔸ഹ㠊〶਍㘸റ㠊㈶਍㘸ള㠊㐶਍㘸വ㠊㘶਍㘸ഷ㠊㠶਍㘸ഹ㠊〷਍㜸റ㠊㈷਍㜸ള㠊㐷਍㜸വ㠊㘷਍㜸ഷ㠊㠷਍㜸ഹ㠊〸਍㠸റ㠊㈸਍㠸ള㠊㐸਍㠸വ㠊㘸਍㠸ഷ㠊㠸਍㠸ഹ㠊〹਍㤸റ㠊㈹਍㤸ള㠊㐹਍㤸വ㠊㘹਍㤸ഷ㠊㠹਍㤸ഹ㤊〰਍〹റ㤊㈰਍〹ള㤊㐰਍〹വ㤊㘰਍〹ഷ㤊㠰਍〹ഹ㤊〱਍ㄹറ㤊㈱਍ㄹള㤊㐱਍ㄹവ㤊㘱਍ㄹഷ㤊㠱਍ㄹഹ㤊〲਍㈹റ㤊㈲਍㈹ള㤊㐲਍㈹വ㤊㘲਍㈹ഷ㤊㠲਍㈹ഹ㤊〳਍㌹റ㤊㈳਍㌹ള㤊㐳਍㌹വ㤊㘳਍㌹ഷ㤊㠳਍㌹ഹ㤊〴਍㐹റ㤊㈴਍㐹ള㤊㐴਍㐹വ㤊㘴਍㐹ഷ㤊㠴਍㐹ഹ㤊〵਍㔹റ㤊㈵਍㔹ള㤊㐵਍㔹വ㤊㘵਍㔹ഷ㤊㠵਍㔹ഹ㤊〶਍㘹റ㤊㈶਍㘹ള㤊㐶਍㘹വ㤊㘶਍㘹ഷ㤊㠶਍㘹ഹ㤊〷਍㜹റ㤊㈷਍㜹ള㤊㐷਍㜹വ㤊㘷਍㜹ഷ㤊㠷਍㜹ഹ㤊〸਍㠹റ㤊㈸਍㠹ള㤊㐸਍㠹വ㤊㘸਍㠹ഷ㤊㠸਍㠹ഹ㤊〹਍㤹റ㤊㈹਍㤹ള㤊㐹਍㤹വ㤊㘹਍㤹ഷ㤊㠹਍㤹ഹㄊ〰ര

 

[vefatica]

Even simpler:

d:\data\tcclibrary> echo foo^r^nbar | tail
潦൯戊牡਍

 

[Charles Dye]

Looks like TAIL is not correctly detecting the text encoding. Try doing option //unicodeoutput=yes first.

 

[Alpengreis]

Same problem here too and YES, with option //unicodeoutput=yes it works.

But why is that necessary now?

 

[Charles Dye]

I don't know, but I can guess wildly. This may be an attempt to address an obscure issue with @EXECSTR which I brought up recently. From brief testing, that issue seems to be... not fixed, but less bad, in build 16.

If that is what's going on, Rex, I appreciate the attempt. But the medicine may be worse than the disease.

 

[Alpengreis]

Ok, thank you. Then we'll have to wait till Rex explains it ...

 

[vefatica]

Same problem here too and YES, with option //unicodeoutput=yes it works.

But why is that necessary now?

I don't think that was intended to be a fix ... more as simply evidence of what's going on. No doubt, UnicodeOutput would screw up any external programs in a pipeline

 

[Alpengreis]

Ok, I understand.

No doubt, UnicodeOutput would screw up any external programs in a pipeline

Yes, that would be really bad.

 

[Charles Dye]

I'm not seeing this behavior in build 18.

 

[Alpengreis]

Yes, works again with build 18, thank you, Rex!