Just got back from there, funnily enough! There are a number of excellent Palaeolithic decorated caves, but these have typical French Fuck Off stainless steel gates and very limited access. Some are open to the public, Niaux, Bedheillac, and are worth a visit.
There are other show caves in the area and I know there are some wild caves. When the wife finds the relevant reference I'll post it.