We had a great time at the Jardin des Plantes, which is located across from the train station. There is a small area with goats waiting to be fed and they will eat anything you present to them, including your clothes, gloves, bags etc!
For more information: Click here