At the moment, it is not possible to keep an athlete on the leaderboard but withdraw them from the heat schedule for future events.

However, you do have the ability to delete an athlete from the competition altogether, which will remove them from the leaderboard, heat schedule, and score entry page. Check out this article for more information on removing an athlete from the competition.