How do I close tasks that are no longer relevant?

Two options:

Mark as completed — if the task is actually done. Stays in history.

Delete — if the task should never have existed (duplicate entry, wrong client). Gone in Senly and GHL.

Use delete sparingly — for administrative clarity, "completed" is almost always better.