Questions tagged [duplicate]
This tag is ambiguous. Please use a more precise tag instead.
88 questions
0
votes
1
answer
445
views
iptables duplicate port traffic
I want to clone/duplicate all udp traffic incoming on port 8500 to port 8600. It is important that the source address is not modified. Also both ports must be accessible by applications (the packets ...
- 43
0
votes
0
answers
31
views
Linux home dir has a "duplicate" under /home/music but when anything is deleted from one it disappears from both -- how can I delete 2nd home dir?
I don't know where the 2nd "phantom" home dir came from. Properties folder shows it's 4K. The "real" home directory is 128,000+ files and 208GB.
User10489 had the answer: a symlink ...
0
votes
3
answers
57
views
Filter duplicated based on values of another column
I have the following example of a dataframe.Where you see that elements of 3nd column could be duplicated.I want to keep the entry which has the highest value in column 5
Meaning that for AGCCCGGGG I ...
0
votes
3
answers
125
views
Need assistance with awk/sed to identify/mark duplicate IP addresses
Good day.
I have a text file which contains pod/node names and associated IPv6 addresses of which two pods have the same IP address, first pod k8-worker0001c-cif-9d86d6dd4-vf9b9 and last pod k8-...
- 59
0
votes
2
answers
174
views
awk is automatically duplicating some lines. Can someone explain?
My data looks like:
A 4 G 1 G 1
C 4 C 2 C 2
T 6 T 5 T 5
A 6 T 2 T 2
C 6 T 2 T 2
T 6 G 2 G 2
I am trying the command:
awk -F " " '$1==$3 {$7=$6; print $0;}
$1==$5 {$7=$4; print $...
1
vote
1
answer
1k
views
Find duplicate IPs for different MACs
Using arp-scan to get a list of returned duplicate IP address. However, arp-scan will list duplicate IP with the same MAC address. I get a sorted output of asx.txt (shortened for brevity)
arp-scan 172....
user552826
0
votes
0
answers
208
views
Removing duplicate values based on two columns
I have a file that would like to filter duplicate values based column 1 and 6
ID,sample,NAME,reference,app_name,appession_id,workflow,execution_status,status,date_created
1,ABC,XYZ,DOP,2022-08-18 13:...
- 113
1
vote
1
answer
350
views
How to sort a list of strings that contain a combination of letters and numbers
I want to sort following strings by the number and remove duplication in a file
cat311
celine434
celine434
celine5
jimmy12
john44
john41
to be
celine5
jimmy12
john41
john44
cat311
celine434
- 11
0
votes
0
answers
79
views
Delete duplicated contents from files
I have many backups of a same file. Is there a way to transform that into incremental backup?
Those files aren't exactly the same (not same timestamps sometimes, sometimes new data appended here and ...
- 145
-1
votes
1
answer
124
views
Skip line from console if equal than line before, adding count (in realtime)
Using uniq it is possible to filter out sequential duplicate lines.
while (true) do echo 1; echo 2; echo 2; echo 1; sleep 1; done | uniq
becomes:
1
2
1
Is there a way to have duplicated sequential ...
- 101
-1
votes
1
answer
2k
views
remove duplicate lines across multiple txt files [closed]
I have 12 text files all in one folder, each with about 5 million lines, each file has no duplicate line on its own but there are duplicated across multiple files, I want to remove the duplicate lines ...
1
vote
2
answers
994
views
Remove duplicates of specific line keeping only the first appearance of each without touching other unspecified duplicates
I'm trying to edit a text file containing several duplicates. The goal is to keep only the first match of a string and remove the rest duplicate lines of the same string.
In the example file
* Title 1
...
- 13
2
votes
1
answer
2k
views
ZSH - PATH Duplication : Directory added at end of PATH keeps duplicating when re-opening Terminal Session
I have recently installed PIPX on MAC running Big Sur and ZSH shell. During the install it prompted for the following to be added to the .zshrc file....
# Created by `pipx` on 2021-03-20 14:22:23
...
- 39
0
votes
0
answers
184
views
I have a `raspivid` stream, which I'm piping to `ffmpeg`, now i'd like to also stream a raw version of it to a socket?
I have a process outputing an MJPEG video stream, which I pipe into ffmpeg to reduce framerate and then to a socket.
raspivid -t 999999 -cd MJPEG -w 1920 -h 1080 -o - | ffmpeg -i - -f mjpeg -r 2 - | ...
- 151
1
vote
1
answer
871
views
How to use rmlint to merge two large folders?
In exploring options to merge two folders, I've come across a very powerful tool known as rmlint. It has some useful documentation (and Gentle Guide).
I have a scenario that I previously mentioned and ...
- 706