'Guardians of the Galaxy' director James Gunn says he's been warning people about James Toback for decades