I saw an interview with Jane Fonda where she said "Never make a decision just after a break up". I think the best thing to do is to take a few days (weeks) to let the emotional part calm. Then return items that are heirlooms or loaned. After that, any gifts that were given can be either stored, sold, thrown out or donated.
I find rituals such as burning letters overly dramatic, but that's just me.