I think Ian Bishop (Keyhole caving club) wrote an engish guide to Solvenia.
(Alt Tab - google)
ah - yes - here it is = http://www.keyhole.org.uk/sloveniabook.asp
The thing to do caving wise would be to stop at the speleocamp at Laze.
http://www.speleocamp.com/
Be aware that you need to pre book - and not just turn up out the blue like we did. (Frank albeit a bit confused was kind enough to just let us (me an't missus) stay a few nights though).
Good bases for Triglav based activities are the Soca valley to the north - we stayed in Bovec ( small town with most amenities and a handfull off outdoor activities outfits, (mainly rafting and canyoning but offering via ferrata and climbing too)
http://maps.google.co.uk/?ie=UTF8&ll=46.332588,13.559103&spn=0.027558,0.05785&t=k&z=14&om=1
For ascents of Triglav and good access to the mountians awesome refugios/huts (called Doms in Slov) Try lake Bohinj)
http://maps.google.co.uk/?ie=UTF8&ll=46.278275,13.862514&spn=0.05517,0.1157&t=k&z=13&om=1
Lake Bled is really quite touristy - but very nice all the same. Ljubljana the capital is of couse and uber cool, chilled out laid back small city. Think prague but smaller and cosier.
(god - I sound like Im on one of those travel programs).