tpipe questions

Apr 2, 2011
1,462
10
54
North Carolina, USA
TCC 15.01.40 x64 Windows 7 [Version 6.1.7601]
TCC Build 40 Windows 7 Build 7601 Service Pack 1
Registered to Charles S Galloway - 5 System License
I would like to remove duplicates from a file -

TPIPE /input=input.txt /output=output.txt /dup=

For the /DUP I am not clear about the :

Length and IncludeOne verbs or whatever they are called. I would like to remove duplicates based on the length of each line.....

===========================================================

/split=2,

Since I want to split based on number of lines = the the file size to split at, the charachter to split at, splitchatpos, splitcharcount - they would not have valuses so:

/Split=2,,,,%@eval[%@lines[all.all] / 4]

would give me all.all.000 to all.all.003 and they would contain all the lines of all.all.

============================================================

Also be great is tpipe would have a sort filter....
===========================================================

thank you in advance...
 

rconn

Administrator
Staff member
May 14, 2008
12,404
152
I would like to remove duplicates from a file -

TPIPE /input=input.txt /output=output.txt /dup=

For the /DUP I am not clear about the :

Length and IncludeOne verbs or whatever they are called. I would like to remove duplicates based on the length of each line.....

I don't know what you mean by "based on the length of each line". The Length option just specifies the number of characters you want to compare; you cannot compare based solely on the length of the line (at least, not with the /DUP option).
 
Jan 19, 2011
605
15
Norman, OK
Code:
/dup=0,1,0,99999,0
or in English
Code:
/dup=RemoveDups,CaseSensitive,StartAtZeroColumn,Match99999CharactersOnTheLine,DontIncludeLinesOfCount1
You may need to adjust the 99999 depending if you have lines longer than that.
 
Apr 2, 2011
1,462
10
54
North Carolina, USA
I think I am doing the /split operation correctly?

[C:\TCMD\AFT]tpipe /input=all.txt /log=tpipe.log /split=2,,,,,%@eval[( %@lines[all.txt] / 2) + 1]
TPIPE: The parameter is incorrect.
"/split=2,,,,,13280246.5"

[C:\TCMD\AFT]tpipe /input=all.txt /log=tpipe.log /split=2,,,,,%@int[%@eval[( %@lines[all.txt] / 4) + 1]]
TPIPE: The parameter is incorrect.
"/split=2,,,,,6640123"

[C:\TCMD\AFT]tpipe /input=all.txt /log=tpipe.log /split=2,,,,,%@int[%@eval[( %@lines[all.txt] / 4) + 1]],
TPIPE: The parameter is incorrect.
"/split=2,,,,,6640123,"
 
May 20, 2008
11,538
103
Syracuse, NY, USA
It would seem you can't give empty arguments. This worked:
Code:
tpipe /input=12345.txt /split=2,0,0,0,0,5
And this didn't:
Code:
tpipe /input=12345.txt /split=2,,,,,5
It also seems, at least in many cases, you must supply **meaningful** data for args that aren't used. For example, putting a non-numeric string where a number is expected (even if not used) causes an error.
 
Similar threads
Thread starter Title Forum Replies Date
C TPIPE questions.... Support 5
samintz How to? TPIPE /simple=61 Support 6
R Bug TPIPE's pdf to text conversions don't work Support 2
Kachupp How to? tpipe Support 4
H TPIPE /simple=4 Support 12
D TPIPE produces unwanted logs. Support 1
Kachupp How to? tpipe Support 8
vefatica Documentation TPIPE, /perl, DotMatchesNewLines Support 1
vefatica Stop TPIPE /EOL removing bad EOLs (and TPIPE changine EOLs)? Support 2
vefatica TPIPE in an alias? Support 2
C How to? TPIPE ?'s Support 2
H History and TPipe Oddness Support 3
Jay Sage Baffling Behavior With TPIPE Support 5
vefatica TPIPE: unbalanced escaped quotes in a regex? Support 5
Joe Caverly Multiple Text Searches at once using FFIND or TPIPE Support 4
Kachupp FFIND TPIPE Support 9
vefatica TPIPE and avarice? Support 5
Peter Murschall TPIPE generate unicode on Piping or redirecting Support 3
x13 TPIPE /REPLACE - Remove line (including EOL) Support 3
Charles Dye Documentation TPIPE /REPLACELIST Support 0
Joe Caverly TPIPE and /inputstring Support 3
vefatica How to? Add real <ESC> characters with TPIPE Support 2
vefatica How to? TPIPE ... see output right away? Support 4
vefatica TPIPE.EXE crashes on Ctrl-C Support 9
O TPIPE: Error -Can´t access textpipeengine.dll Support 24
vefatica Extract fields with TPIPE? Support 10
vefatica TPIPE, crash and question Support 1
MickeyF Another TPIPE question Support 6
MickeyF Can't get my TPIPE /replace to work Support 4
Joe Caverly Printing TPIPE documentation Support 3
C WAD tpipe /simple=28 Support 8
vefatica Remove double-quotes with TPIPE Support 4
vefatica TPIPE crashes on Ctrl-C Support 1
C How to? Add date/time to custom tpipe based BTM Support 1
C tpipe /simple=28 error Support 5
C TPipe /dup Support 5
T TPipe: Replacing String with Double Quotes Support 3
C tpipe and extract email addresses Support 1
vefatica How do I do this with TPIPE? Support 1
vefatica TPIPE's /perl option? Support 1
D TPIPE help typo Support 0
vefatica TPIPE access violations are back Support 2
Joe Caverly Word Count using TPIPE Support 10
Dan Glynhampton TPIPE in Build 41 Support 4
Phileosophos TPIPE doesn't work at all with v16 Support 3
vefatica TPIPE access violation again Support 1
David McClelland TPIPE matching problem Support 3
vefatica TPIPE: Access violation Support 5
jbanaszczyk TCMD 16 - TPIPE Support 4
P TPipe relaunches TCC window and 4start, etc Support 7

Similar threads