You can remove individual songs from your search history or favorites by scrolling down to them in your list of discoveries, swiping them to the left, and tapping "Delete".
To completely clear these lists, go into the app settings, and you'll see the options to "Clear Search History" or "Clear My Favorites".