A student was caught with a handgun at the start of the school day at William Penn High School in New Castle Tuesday.