Were our ape ancestors continually stoned?

If Australopithecus clans ate psychedelic mushrooms every day for say... a million years, surely that may of had an impact, on, well,... just about everything?!