To delete a matter, go to the Matters page, then click on the matter. At the bottom of the page there is a button that says Delete or Archive. Click that to remove the matter.
You can't delete matters if they already have time entries created. In that situation, you can just archive them.