There is bulk data available: download.companieshouse.gov.uk/en_output.html - although admittedly it doesn't contain everything that's available through the API
Posts by David Kane
If you use something like uv you might be able to convert it into a one-liner command line command docs.astral.sh/uv/guides/sc...
requests-html in python will give you a list of links, something like:
from requests_html import HTMLSession
session = HTMLSession()
r = session.get(url)
print(r.html.absolute_links)
One of the low moments of lockdown was when my daughter (then 5ish) got worms. We found them in a fairly disgusting way and then the pharmacist could tell exactly what medicine I needed when I walked in at 11pm without me needing to tell her. I think they're fairly common.
On the topic of the Bank Holidays API, it may well be the most quintessentially British API in existence, with a boolean (true/false) value for "bunting".
And, in case you were wondering, every bank holiday is a good day for bunting unless someone died for our sins! www.api.gov.uk/gds/bank-hol...
Are you an API person? Are there some APIs that you ❤️ and others that drive you 😠?
If yes to any of the above, please take a minute to respond to (and share!) this quick anonymous survey.
You're also welcome to share your thoughts and ideas on this thread...
An excellent part of this, which is often missing from big data releases, is a small set of sample data in the same format.
Let's you see and test the data without needing to manage huge files.
Not quite the same, but there is a "show me only the people who don't post much" feed: bsky.app/profile/did:...
Thanks for your posting today - I've found it really useful
New long, technical blog post - why django is my tool of choice for data pipelines dkane.net/2024/why-pos...
An image - bright pink dots on light pink background, with dark grey text reading data bites https://public.digital/data-bites-series
Some news about Data Bites…
After 5 years, 49 events, 199 presenters, five PMs, 10 Cabinet ministers for data in govt & more bad jokes than any of us would care to remember, Data Bites is leaving @instituteforgov.bsky.social
I’m delighted to say it has a new home at… @publicdigital.bsky.social!
Eg this project from London Sport, which extends the Open Active data standard to apply to community clubs: londonsport.org/our-work/spo... - similarities to how 360Giving standard was extended to add DEI data.
Some key learning from the evaluation on how to fund this stuff:
- make use of existing data standards (extend them if necessary)
- develop and maintain infrastructure (fix the plumbing)
- try to turn "available" data into "accessible" outputs
At the London Civic Data Innovation showcase - great insights from James Bowles based on the evaluation of the projects
Looks like you're right: findthatcharity.uk/dashboard/ge... - difference in hourly mean pay is 10.7% for <250 employees, compared to 11%+ in all the other bands.
Although charities only have to pay the tier 1 fee no matter how big they are.
Interestingly the gender pay gap data only records company numbers for organisations, so there's no way to definitively identify charities (unless also registered companies) or other types of organisations.
ICO could also theoretically do this with the Charity register - charities with over £500k income area required to report the number of staff. Around 930 of these have over 250 employees.
Interesting use of linking data from different sources. Although there's a small number of organisations on the gender pay gap list that give their employee numbers as "Less than 250" (presumably reporting voluntarily?)
Some text reading: "So while we know that manufacturing accounts for 8% of the UK workforce and agriculture accounts for 0.6% gross value added to the UK economy – we have no equivalent ONS figures for the social economy and volunteering sector. Similarly, we have no idea what proportion of different industries, like education or health & social care, are made up of non-profit organisations, nor how much of the employment in each industry depends on a thriving non-profit sector. And we have little grasp of how much value volunteering brings to our economy each year."
Been doing some digging into charity data today and the gaps are quite something. We have no reliable mesaures for the contribution volunteering makes or for its significance in various sectors. h/t @dkane.net for sharing this link. 1/
www.probonoeconomics.com/taking-accou...
I've still got the terrible new one rather than the awful old one
Somerset House?
I'm passionate about open data, and I run a couple of websites that help people get the most out of this data:
findthatcharity.uk - brings together data on 000s of charities and nonprofits into one place in a standard format
findthatpostcode.uk - navigate the weird world of UK geodata
Thought I should do an intro...
Hi, I'm David and I help people use and improve data about charities. I'm a freelance researcher, developer, analyst, working with charities, govt and other companies. There's more about my work on kanedata.co.uk
Sounds like a "world cup of databites" might be needed
I'd like to chat with a few people working in local public bodies eg local authorities, NHS trusts, academy trusts, police forces, about working with local communities around data/digital stuff, and what kind of support would be helpful.
Is that you or can you recommend someone?
Bluesky hive mind!
Does anyone know of a decent, free or *very* cheap venue:
- In SW1 (Whitehall/Westminster)
- Fits c.40 people
- Either A/V or good wifi
(Idea is a monthly evening meet-up for people into public sector reform, UKGovCamp-y/OneTeamGov-y vibes, a couple of talks, chat, pizza etc)
I still have the homemade dalek from my profile pic, which I think I've used for 10+ years. It's deteriorated since the pic was taken though.
I am - mainly as it gives me access to a co-working space in London which is v useful for freelancing, plus they have some free collaborative meeting space. I've been less involved in the networking side of things.