I think Ian Bishop (Keyhole caving club) wrote an engish guide to Solvenia.
(Alt Tab - google)
ah - yes - here it is = http://www.keyhole.org.uk/sloveniabook.asp
The thing to do caving wise would be to stop at the speleocamp at Laze.
Be aware that you need to pre book - and not just turn up out the blue like we did. (Frank albeit a bit confused was kind enough to just let us (me an't missus) stay a few nights though).
Good bases for Triglav based activities are the Soca valley to the north - we stayed in Bovec ( small town with most amenities and a handfull off outdoor activities outfits, (mainly rafting and canyoning but offering via ferrata and climbing too)
For ascents of Triglav and good access to the mountians awesome refugios/huts (called Doms in Slov) Try lake Bohinj)
Lake Bled is really quite touristy - but very nice all the same. Ljubljana the capital is of couse and uber cool, chilled out laid back small city. Think prague but smaller and cosier.
(god - I sound like Im on one of those travel programs).