Offer hay as much as possible, break it into small meals throughout the day as necessary because having hay helps buffer the stomach. Alfalfa has calcium which is helpful.
Feeding omeprazole (Ulcergard or Gastroguard) as directed by your vet is the only drug I know of that actively heals...