Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Thanks, was trying to remember that first trick just last week. For log files I had to make a slight adjustment to filter the time at the front:

  !seen[gensub($1, "", "g", $0)]++
For anyone wondering, it filters out duplicates by storing the first occurrence of the line and skipping subsequent ones.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: