The urge to tidy everything on the first mild weekend of the year is strong, and it costs more gardens a season of flower than any frost does. Anything that carries its flowering wood from last year should be left well alone until it has finished.
Seed heads on grasses and rudbeckia are worth leaving up for the structure and for the birds. Cut them at the base once the new growth is an inch clear of the crown, not before.