Add a way to stop getting notifications for things you are no longer working on

Can you add an option to stop getting notifications for line items that you used to work on. Currently if you were ever tagged or added in a person column on a line item you will continue to get notifications after you are no longer tagged on that item.