Understanding intramolecular and intermolecular contributions to energy relaxation