I have found that Warmbac 'paddling shorts' (neoprene pants) make excellent caving underwear, providing that little extra comfort where it matters. Probably the thing for this sort of trip.
Which reminds me, I need to get a new pair as mine now have a hole where it matters!