Shiloh Jolie-Pitt leaves for college to avoid seeing his mother, Angelina Jolie