Making survey data available

graham

New member
To clarify, what I believe Rhys wanted to do and what I know Andrew wanted to do was to set up a simple repository where data could be archived so as to ensure that all the hard work of cave surveyors would not be lost, as has happened so often before.

The operative word is "simple". If someone else wishes to take that data and build it into a most fantastic whizzy system that'll tell you everything you wished to know about a given cave/passage/formation/caver/stream etc then good luck to them, but claiming that such a system needs to be designed and built first, before any data can be accepted and stored is a pointless waste of time and only serves to discourage those who do not have the particular skill set needed to do that.
 

Rhys

Moderator
graham said:
To clarify, what I believe Rhys wanted to do and what I know Andrew wanted to do was to set up a simple repository where data could be archived so as to ensure that all the hard work of cave surveyors would not be lost, as has happened so often before.

Graham

You understood me correctly.

Rhys
 

TheBitterEnd

Well-known member
graham said:
but claiming that such a system needs to be designed and built first, before any data can be accepted and stored

Where was that claim made? Why all the hostility and negativity?

graham said:
It's all very well having these airy fairy ideas but unless you are prepared to put the work in and produce a system

Who said I wouldn't be prepared to do the work?

Just to clarify, what I posted was a suggestion for organising and indexing information, it would apply equally well to a paper based library.

 
A common standard - together with translation tool to and from individual application formats for the survey data (Survex,Tunnel,Therion,Compass, etc) - is certainly a noble aim.

There have been previous stabs at something similar, such as the CaveXML proposal of a decade ago which foundered under a mixture of too much descent into detail and ill-conceived attempts to plan and manage 'tasks', which seemed to kill off all enthusiasm.  Nevertheless, there may still be something to be salvaged from the website at http://www.cavexml.uis-speleo.org/

Best of luck and, if of use, I'ld be happy to help (but, please, no Vision and Mission statements!).

 

TheBitterEnd

Well-known member
Martin - interesting but as you say seems to have got bogged down in the detail. What I was proposing deliberately tried to avoid that by just putting a bit of a wrapper around whatever information is available. The one significant step I did propose - referencing information from the POV of individual voids - is a big ask and I fully realise is very unlikely to get anywhere (as backed up by some of the petulant replies above).

Anyway I must stop now before the thought police come round again. Apparently even kicking a few ideas around is a heresy so foul it must be shouted down at all cost.
 

TheBitterEnd

Well-known member
At risk of getting a flaming for resurrecting an old thread, whilst looking for something else I just came across the fact that the NASA SWEET ontology uses the term "cavity" where I proposed "void" above. I like cavity better because it shares a root with cave and is not as overloaded as void.

See cave in http://sweet.jpl.nasa.gov/2.2/realmLandFluvial.owl
And cavity in  http://sweet.jpl.nasa.gov/2.2/reprSpaceGeometry3D.owl#Cavity

Hence this post really, not that anyone is likely to stumble across the above but if they do I'd suggest cavity is better than void?
 

Pitlamp

Well-known member
Sorry to chip in - and I hope you all accept that this contribution is in the spirit of helpfulness rather than by any way of criticism - but I've just read the whole of this topic in one go and, being a normal caver - I don't understamd 80% of it. If I was asked to submit data and was faced with this kind of technical approach, I doubt I'd be enthusiastic. So here are a few remarks which may or may not help:

1. It's an absolutely superb idea and it should be supported by all cavers.

2. BUT - it's got to be user friendly and easily understood by the ordinary caver in the pub.

3. The word "data" is plural (so, for example, "there is data" is wrong and "there are data" is right). The singular of course is "datum".

4. I remember having quite long discussions with the likes of Wookey about this initiative back in the 1990s. I even went so far as to advertise the fact it was likely to be happening in my own club journal, to help launch the project and do what I could to encourage other cavers to support it. Unfortunately it never really seems to have got off the ground - but, happily, it clearly hasn't gone away, hence this discussion.

5. Juan's question about whether there are reasons not to support such an initiative is too simplistic. There are many good reasons, which I could go into but which wouldn't serve any real purpose here. The point is that anyone who feels they do have a reason not to submit their data will not support the scheme - so this point needs to be addressed from the outset. When Wookey was working towards setting something up I suggested that there could be various levels of access to different tranches of data. If reluctant submitters of survey information could be reassured that these data would be kept secure until they personally release them (or at least agree the circumstances whereby the data would be released for public use) then coverage by the proposed repository would be much more comprehensive. (A useful analogy here is the "CDG Secret File" - cave divers are encouraged to submit (unpublished) sensitive dive logs to it, so that these aren't lost on the understanding that they will not be released until the originator has given permission. To my knowledge this arrangement has always been honoured ever since Oliver Lloyd started it. It works well because if the holder of the secret file receives a query about a site which (s)he knows is in there, (s)he usually asks the originator if they object to the person who asked having the info, or being encouraged to contact the originator directly to discuss the site. This system works really well - thank you Oliver!)

6. As with all projects of this nature, uptake may not be fast at first but when people start to discover how useful it is they'll then become more enthusiastic about submitting their own numbers. Eventually a tipping point will be reached whereby it becomes the norm to make sure that all data are automatically submitted. The key thing is to set it up right in the first place so that dummies like me - or (perhaps more accurately) cavers who would really rather not spend their time discussing the minutiae of computing intricacies - find it easy to use.

I'm delighted that this is obviously being taken seriously and I'll certainly do my best to support it - if I can understand it!

Well done all.
 

TheBitterEnd

Well-known member
Thanks for taking the time, Pitlamp. I really hadn't intended to resurrect this thread; merely to add a note for my own use so that I could find those SWEET references again if I wanted them (and as I said on the very remote chance that someone else stumbled across it in the future).

I think it was Churchill who said "As simple as possible but no simpler". To post this message (and for you to post your message) I have used, amongst other things, Internet Protocol, Transport Control Protocol and Hypertext Transfer Protocol and I am sitting here looking at two fat books on these topics and they probably don't cover it all. The thing is that at some point some people had to sit down and design these protocols and that process probably wasn't pretty. But once they had done that they packaged it all up into operating systems and web browsers and I can now sit a keyboard and type this message into a website without even knowing about what is underneath.  Of course the end result needs to be simple to use, but that doesn't mean that the nitty-gritty will be.

But as is so often the case the technical aspects are fairly straight forward, as you observe the real issues are about people and politics.
 

Cookie

New member
Hi Pitlamp,

a cue to plug the BCA's Cave Registry Data Archive again. See www.cave-registry.org.uk.

If you have survey data, a copy should be here.

I'm not sure it says it on the website but it can do the secrecy thing you mentioned. It can control who has access to what.

It is also simple. It side-steps the format and standards issue by accepting pretty much any kind of file that the surveyor thinks is of value.

 

Pitlamp

Well-known member
You're absolutely right Cookie & Graham - and for a while I've been conscious of the need to find some time to get together the many miles of survey notes which are dotted about around this house. I've got several pressing things to attend to in the short to medium term but I promise it'll happen!

You're right as well TheBitterEnd - regarding all the work that's gone into creating a situation where we can enjoy using a forum like this - but I was of course referring to good reasons, not "politics"!
 
Top