a feeling of slight anger [= irritation]:
A look of annoyance crossed her face.
to somebody's annoyance
To his annoyance, he discovered they hadn't waited.
Kelly shook her head in annoyance.
something that makes you slightly angry:
Alan found the constant noise of the traffic an annoyance.