Dove hunting was something I grew up with and my son did just fine at my side at that age... it's a great learning experience for kids and birds are the perfect into to hunting. Once he could handle a 4.10 he went through safety training and shot his first bird at 11.
I wouldn't think twice about it... great experience for both of you and you'll get to teach him even more about gun safety, That stuff really sinks in the yournger they are..