Compare 2 Tab Delimited files and output differences with Column Header and No Primary Key in File

Question

I am trying to compare 2 Tab Delimited files and output differences with Column Header and No Primary Key in File.

I am very near to it but what I am facing the problem is the Snippet i have reached into is working if and only if it has a Primary Key-

awk '
NR==1 { 
  for (i=1; i<=NF; i++)
    header[i] = $i
}
NR==FNR {
  for (i=1; i<=NF; i++) {
    A[i,NR] = $i
  }
  next
}
{
  for (i=1; i<=NF; i++)
    if (A[i,FNR] != $i)
      print "ID#-" $1 ": " header[i] "- " ARGV[1] " value= ", A[i,FNR]" / " ARGV[2] " value= "$i
}' t1.csv t2.csv

Can anyone please help me how to achive it

1. When I don't have any primary key in it
2. When Number of Rows are not same and one file has missing records

t1.csv

Month   ClientSegment   ClientType  IssuerClientSegment NetworkID   VD
2020-12 COMMUNITY   EXEMPT  COMMUNITY   0   OTHER   
2020-12 COMMUNITY   EXEMPT  COMMUNITY   2   OTHER   
2020-12 COMMUNITY   EXEMPT  COMMUNITY   5   OTHER

t2.csv

Month   ClientSegment   ClientType  IssuerClientSegment NetworkID   VD  
2020-12 COMMUNITY   EXEMPT  COMMUNITY   0   OTHER
2020-12 COMMUNITY   EXEMPT  COMMUNITY   2   OTHER1
2020-13 COMMUNITY   EXEMPT  COMMUNITY   2   PUSH
2020-13 COMMUNITY   EXEMPT  COMMUNITY   3   OTHER

Expecting Output Like:

Row 2, Column: VD- t1.csv value=  OTHER / t2.csv value= OTHER1

Missing in t2.csv
Month   Client Segment  Client Type Issuer Client Segment   Network ID  VD
2020-12 COMMUNITY   EXEMPT  COMMUNITY   5   OTHER

Missing in t1.csv
Month   Client Segment  Client Type Issuer Client Segment   Network ID  VD 
2020-13 COMMUNITY   EXEMPT  COMMUNITY   2   PUSH
2020-13 COMMUNITY   EXEMPT  COMMUNITY   3   OTHER

Answer 1

Use daff:

daff --input-format tsv t1.csv t2.csv
@@  Month   ClientSegment   ClientType  IssuerClientSegment NetworkID   VD
    2020-12 COMMUNITY       EXEMPT      COMMUNITY           0           OTHER
→   2020-12 COMMUNITY       EXEMPT      COMMUNITY           2           OTHER→OTHER1
+++ 2020-13 COMMUNITY       EXEMPT      COMMUNITY           2           PUSH
+++ 2020-13 COMMUNITY       EXEMPT      COMMUNITY           3           OTHER
--- 2020-12 COMMUNITY       EXEMPT      COMMUNITY           5           OTHER

Install using pip install daff (you migh also need sudo apt install python-pip).

Answer 2

awk '
{ key = $1 OFS $2 OFS $3 OFS $4 OFS $5 }
! secondInput {
        file1[key] = $6
        NRfile1[key] = NR
        next
}
(key in file1) {
        if (file1[key] != $NF) { print "diff-line#:", NRfile1[key] "|" FNR, $0 }
        delete file1[key]
        next
}
{ print "missing in file1: ", $0 }
END {
        for (key in file1) {
                print "missing in file2: ", key, file1[key]
        }
}' file1 secondInput=1 file2

Outputs:

diff-line#: 3|3 2020-12 COMMUNITY   EXEMPT  COMMUNITY   2   OTHER1
missing in file1:  2020-13 COMMUNITY   EXEMPT  COMMUNITY   2   PUSH
missing in file1:  2020-13 COMMUNITY   EXEMPT  COMMUNITY   3   OTHER
missing in file2:  2020-12 COMMUNITY EXEMPT COMMUNITY 5 OTHER