Perhaps botanically it's a vegetable, but that doesn't stop it from being a vegetable.

A vegetable is anything edible that doesn't respond to stimulus while it's alive. Like a coma patient, or tomatoes.

It grows on a tree, so it's no less a fruit than a peach or an apple.