Individual seahorses getting tired the more you race them is a neat mechanic to try to govern the number of races you can complete in one visit to the Sea People's village, but it takes so long for them to recover that it feels more efficient to just cycle in new seahorses instead of growing attached to any one horse, somewhat defeating that idea.
And yes: I am going to eat the losers.