• Northern Caving Issue 19 - July 2026 - Out Now

    A compilation of all CNCC's work spanning conservation, anchors, training and more since the December issue, plus some bespoke articles too…

    ..and thanks for the kind words about the forum!!

    Click here for details of this edition

BCRA Online Archive - Software Agent Abuse Protection Implemented

langcliffe

Well-known member
I have developed a function in the BCRA Online Archive Software that generates a probability for the requesting software being a rogue bot. If the probability is high enough, the request is prematurely terminated with an Error 404 (file not found). It is intended to be yet another layer of protection from web scraping.

I have set the bar pretty high, so it should never affect bone fide access. However, if you do encounter a funny, please report it as soon as possible, and I will investigate.
 
Many thanks to Langcliffe for adding the volume numbers to the thumbnails for the BSA/Simpson collection on the BCRA Online Archive. Brilliant!
If you use the heirarchical index as well, this makes it much easier to find your way around a very complex and extensive collection of records.
 
Many thanks to Langcliffe for adding the volume numbers to the thumbnails for the BSA/Simpson collection on the BCRA Online Archive. Brilliant!
If you use the heirarchical index as well, this makes it much easier to find your way around a very complex and extensive collection of records.

My pleasure.

It is a complex and extensive collection, and unfortunately we only received a fraction of the metadata that was created when the images were scanned in Edinburgh, which means that we have been limited in our ability to provide indexing and cross-referencing to make finding an image a little easier. Anybody fancy going through the 40,000+ images, and recreating the metadata?
 
Know any Network Rail staff cavers? They get 5 volunteer days a year, so they could register it as a volunteer task and get a couple days on it.
 
I have, hopefully, improved the headless browser detection in the BCRA Online Archive software. It works fine on all the browsers I have on my Windows machine and on my Android portable telephone, but if someone could check it out on Apple equipment I would be grateful. It'll either work, or throw you off straight away.

https://archives.bcra.org.uk/

Thank you.
 
Know any Network Rail staff cavers? They get 5 volunteer days a year, so they could register it as a volunteer task and get a couple days on it.
I know of one Mendip caver who works for Network Rail and they do indeed volunteer on occasions on Mendip assisting with projects that will benefit the caving community in general.
Well done Network Rail and those employees that do in fact volunteer.

In addition to volunteer help, a lot of companies have a 'Charity Budget'. Many years ago when I was treasurer for a local horse show, I contacted Thermos and asked if they could possibly donate some stainless steel flasks for tea & coffee for the BHS judges (The BHS judges, who could be very fussy needed to be looked after or they wouldn't return the following year). I was pleasantly surprised by the response. We received 24 1L s/steel flasks. Previously we used to ask the committee members to loan their flasks.

Maj.
 
I have, hopefully, improved the headless browser detection in the BCRA Online Archive software. It works fine on all the browsers I have on my Windows machine and on my Android portable telephone, but if someone could check it out on Apple equipment I would be grateful. It'll either work, or throw you off straight away.

https://archives.bcra.org.uk/

Thank you.
Works for me OK on mac OS Ventura 13.7.8

The Online Archives are a brilliant resource - more fascinating as you explore them in depth - and Langcliffe's improvements have made them so much easier to investigate now.
 
Back
Top