HackerTrans
TopNewTrendsCommentsPastAskShowJobs

dannyfraser

no profile record

Submissions

The Analytics Development Lifecycle

getdbt.com
3 points·by dannyfraser·2년 전·0 comments

comments

dannyfraser
·10개월 전·discuss
This is correct. What's important for industry is understanding the energy balance, i.e. entries and exits to and from the grid. "Generation" is a catch-all term for grid entries.
dannyfraser
·10개월 전·discuss
Generation in this instance means power generation to meet consumption demand. Typically withdrawals from storage are counted as a source of supply to meet that demand regardless of the original source of the power in storage.
dannyfraser
·10개월 전·discuss
A bit of digging in the T&Cs, Companies House, and LinkedIn pointed me to an individual working for the NHS who has put this together as a side project.

I work in this space (https://www.woodmac.com/), mostly with natural gas data but have worked on power in the past so I'm always interested to see if it's anyone I know (in this case it isn't).

Building something like this isn't really that difficult - all of the data is publicly accessible and if you can transform it and pull it into a database and build a front-end app then you're pretty much there. The developer has stated that the main source for this is https://bmrs.elexon.co.uk/, but other good sources of energy data (across Europe) are https://transparency.entsoe.eu/ for power and https://transparency.entsog.eu/ for gas. Also useful are https://alsi.gie.eu/ for LNG imports and https://agsi.gie.eu/ for gas storage.
dannyfraser
·2년 전·discuss
I find it really weird that a discussion on the state of SQL right now doesn't include any mention of Snowflake or dbt. SQL is _everywhere_ in the data engineering world right now.
dannyfraser
·2년 전·discuss
The Open University runs a Master's program in systems thinking (which I'm currently studying). There's a free primer course called 'Mastering systems Thinking in Practice' that gives a good overview and is full of references for further reading in the field: https://www.open.edu/openlearn/science-maths-technology/mast...

There's also a developing community at https://www.systemsinnovation.network/, where there are also many (subscription) resources.

The articles, books, and guides available (free) at https://thesystemsthinker.com/ are also worth a look. This mostly pertains to system dynamics rather than any other traditions, but it's a great resource for understanding complexity.