jayelbe · HackerTrans

As somebody who works in local government IT, consistent scraping of our data like this is the bane of our life. We get hit by thousands of these, many with no rate limiting, making hugely intensive requests, that cause downtime and knock-on effects for actual customers and citizens. We block IPs, add captchas, and yet it persists.

If you really want the data, just FOI it for goodness' sake.

I get the distinct impression that many of these outfits aren't really advocating for impoved transparency but are simply trying to exploit and monetise illicitly obtained government data to make a quick buck.

jayelbe

2 mesi fadiscuss

Waste disposal and planning for quarrying and mineral extraction are different functions, decided at a higher tier of local government, and are not directly comparable to development management/planning.

jayelbe

10 mesi fadiscuss

Cools pics! They should show it behind a pencil for scale.

jayelbe

10 mesi fadiscuss

Websites usually link to their RSS feed using a <link> attribute in the head of the page.

Browsers used to detect this and show an RSS icon near the address bar if the website you were viewing had a feed - and you could click the icon to see more details and subscribe.

I use this Firefox addon which replicates that functionality: https://addons.mozilla.org/en-GB/firefox/addon/feed-preview/

FreshRSS is a good self-hosted RSS feed reader, and you can configure it to scrape non-RSS webpages for updates too: https://danq.me/2022/09/27/freshrss-xpath/

jayelbe

5 anni fadiscuss

This is dead easy to do in Home Assistant if you use a jinja-based template as the automation trigger. Any template that will evaluate to true will trigger the automation. Templates are re-evaluated every time the state of the object changes or (if you use a time function, or don't reference any objects) every minute.

Here's a simple example that would send a notification if I left my kitchen LEDs on 200 brightness or more for longer than two hours.

  alias: Kitchen
  description: ''
  trigger:
  - platform: template
    value_template: ' {{ state_attr('light.kitchen_led', 'brightness')|int >= 200 and as_timestamp(states.light.kitchen_led.last_updated) + 3600 < as_timestamp(now()) }} '
  condition: []
  action:
  - service: notify.my_phone
    data:
      title: Kitchen lights still on
      message: The kitchen LEDs have been on very bright for more than 2 hours. 
  mode: single

comments