| 1 | 2 | 3 | 4 | 5 | 6 | 
| value | index | ||||
| value | value | index | 
日前拿到一份log,一个完整数据集被写在两条log里,通过索引字段排序后,呈现出如上表样式的csv格式。为了方便统计,利用awk对数据进行了聚合,把同一索引值的log两两合并在一起:
#!/bin/bashawk -F',' 'BEGIN{FS=OFS=","}{                                                                                                                                                                                                                                              if (NR == 1) { # print first line directlyprint $0} else {if (prev != $6) { if (prev != "") { print line}prev = $6merge_data = $3} else { # Repace $3 with the value of prev line$3 = merge_dataline = $0}}
} END { 
}' input.csv > output.csv