HackerTrans
TopNewTrendsCommentsPastAskShowJobs

dannyfraser

no profile record

Submissions

The Analytics Development Lifecycle

getdbt.com
3 points·by dannyfraser·2 năm trước·0 comments

comments

dannyfraser
·10 tháng trước·discuss
This is correct. What's important for industry is understanding the energy balance, i.e. entries and exits to and from the grid. "Generation" is a catch-all term for grid entries.
dannyfraser
·10 tháng trước·discuss
Generation in this instance means power generation to meet consumption demand. Typically withdrawals from storage are counted as a source of supply to meet that demand regardless of the original source of the power in storage.
dannyfraser
·10 tháng trước·discuss
A bit of digging in the T&Cs, Companies House, and LinkedIn pointed me to an individual working for the NHS who has put this together as a side project.

I work in this space (https://www.woodmac.com/), mostly with natural gas data but have worked on power in the past so I'm always interested to see if it's anyone I know (in this case it isn't).

Building something like this isn't really that difficult - all of the data is publicly accessible and if you can transform it and pull it into a database and build a front-end app then you're pretty much there. The developer has stated that the main source for this is https://bmrs.elexon.co.uk/, but other good sources of energy data (across Europe) are https://transparency.entsoe.eu/ for power and https://transparency.entsog.eu/ for gas. Also useful are https://alsi.gie.eu/ for LNG imports and https://agsi.gie.eu/ for gas storage.
dannyfraser
·2 năm trước·discuss
I find it really weird that a discussion on the state of SQL right now doesn't include any mention of Snowflake or dbt. SQL is _everywhere_ in the data engineering world right now.
dannyfraser
·2 năm trước·discuss
The Open University runs a Master's program in systems thinking (which I'm currently studying). There's a free primer course called 'Mastering systems Thinking in Practice' that gives a good overview and is full of references for further reading in the field: https://www.open.edu/openlearn/science-maths-technology/mast...

There's also a developing community at https://www.systemsinnovation.network/, where there are also many (subscription) resources.

The articles, books, and guides available (free) at https://thesystemsthinker.com/ are also worth a look. This mostly pertains to system dynamics rather than any other traditions, but it's a great resource for understanding complexity.