Link Search Menu Expand Document

awk Cheat Sheet

Matching

Match lines

awk '$1 ~ /pattern/ { ... }' infile

Matching for Conditions

awk '{if($1 ~ /pattern) { ... }}' infile

Blocks

BEGIN { print("only run at start") }

{ print("run for each line") }

END { print("only run at end") }

When using multiple files

BEGINFILE {print "--- " FILENAME " ---"}
ENDFILE { }

Control Flow

if (condition) { print("do something") } else { print("something else") }

# Ternary operator
print(a == b ? "equal":"more than equal")

# Loops
for(i=0; i<100; i+=1) { print(i) }

next          # skip to next line
nextfile      # skip to next file
exit          # terminate 
exit(1)       # with exit code

Variables

NameMeaningDescription
NFnumber of fieldsalways givens the number of fields in current line based on IFS
ARGVlike in Call extra CLI params not consumed by awk
ARGClike in Cnr of extra CLI params not consumed by awk

Input/Output Control Variables

NameMeaningDescription
ORSOutput Record SeparatorString added after each print output (can be a regex).
RS(Input) Record SeparatorDecides how input lines will be split (can be a regex).
IFSInput Field SeparatorDecides how input fields will be split.
FSField SeparatorDecides how output fieds will be joined.

You usually use those variables by either setting them in the BEGIN block or using -v.

Examples

awk -v ORS='\r\n' '{ print }'                # Use \r\n line endings instead of \n
find -print0 | awk -v RS='\0' '{ print }'    # Safe filename processing by using \0 as input separator
awk -v IFS=, '{ print $3 }' my.csv           # Process CSV by splitting fields on comma
awk 'BEGIN { FS="," } '{ print $1, $3 }'     # Produce CSV from whitespace separated input

Passing shell variables

Use -v <key>=<value> or ENVIRON["<variable>"]

awk -v HOME="$HOME" 'BEGIN { print(HOME) }'

awk 'BEGIN { print ENVIRON["SHELL"] }'

Advanced Use of awk

Negative Indizes

awk '{print $(NF - 1)}'