State liability laws differ so it will depend upon those laws as to what your liability as a parent will be when your adult child away at college drives someone else's car. Normally when driving someone's car, with permission, the vehicle's insurance (held by the owner) is primary and if that exceeds the owner's policy limits the driver's insurance would be used.
Since your son is no longer a minor if he was in an accident that required insurance he would likely be held responsible himself and not his parents but since state laws do vary I would recommend speaking with a lawyer to find out exactly what your parental liability might be in this situation. You may also want to talk to your insurance agent to see if your current auto insurance would cover your son at all, as secondary insurance, if he drives their vehicle while away at college.
If your son needs his own insurance policy on himself while away at college, he can get a quick car insurance quote here with us.