Regional Energy Information in High Resolution

Collecting, analyzing and visualizing energy policy data from Swiss communities

#15

Demo

National energy policy goals are known and monitored, but how is the progress of the Swiss energy transition on regional level?

Working on our challenges will contributing to the current, highly relevant discussion on security of energy supply in Switzerland. You will support us to develop cutting-edge energy policy design.

Challenge slides

Step 1: Web scraping energy policy goals

Find and gather information about energy policy goals and activities of municipalities. Identify ambitious and less ambitious municipalities Optional: Cluster municipalities that follow same/close goals and benchmark

Step 2: regionalize renewable energy production

How much production in Swiss municipalities? Data wrangling and fusion

🧑🏽‍🏫 GeoImpact/BfE Digital Office


Project Team

Who has which skills and is in which team - policy (P), data (D), scraping (S)

Project Team

Challenge Team

Team 1 - Policy and Data

Which energy policy keywords and categories are relevant?

Step 1 - Brainstorming Keywords

Relevant Keywords

Step 2 - Structuring Keywords

Clustering brainstorming results mind map and converting to a structured table

Structured Keywords Table

Team 2 - Web Scraping

Finding energy policy information on Swiss municipality websites.

 Step 1 - Manual Samples

Manually retrieving text data from few sample municipalities

Community Text

Step 2 - Building a Scraper

As some research revealed, there is no service or implementation which could be used out of the box, so it was decided to go for a simple prototype implementation:

Semi automatic information gathering:

  • Loop over 64 municipalities as test set
  • For every municipality initiate a google search with municipality name and keywords «Energie Umwelt»
  • Take top 3 google results
  • Pick sentences where keywords from team 1 appear
  • Run sentiment analysis over retrieved sentences

Screen Scraper

Scraper result set

Scraper Result Set

Scraper result set - sentences and sentiment analysis detail

Scraper Results Sentences

Reconciliation and Validation

Bringing the pieces together, checking if it makes sense...

Results Visualization

Visualize results on map (interactive map)

Result Visualisation on Map

Showing municipalities by keywords on map (interactive)

Keywords on Map

Sample Municipality Aadorf

Validating Sentences

Sentences analysis

Aadorf sentences analysis

Map Visualization

Analyzing details (interactive map)

  • Thermal network - green
  • High solar capacity (kW/cap) - red
  • Energy city - blue

Details Aadorf

Final Pitch

By Jan-Philipp Sasse (with assistance of Thilo Weber)

Final Pitch

Challenge Data and Code

See links below for Github repository (click on «Source» icon).

Energy Hackdays 2022 - Regional Energy Information

Code and project files of challenge 15 about Regional Energy Information.

Information about the challenge and documentation: https://hack.opendata.ch/project/848

This content is a preview from an external site.
 

Repository updated

2 years ago ~ loleg

Share

Visualizations are part of documentation

2 years ago ~ PeterJanes

Data and code published on Github, link added as project information

2 years ago ~ PeterJanes

Launch

Edited (version 107)

2 years ago ~ PeterJanes

Prototype

Edited (version 105)

2 years ago ~ PeterJanes

Documentation completed, challenge pitched, documentation finalised

2 years ago ~ PeterJanes

Edited (version 101)

2 years ago ~ PeterJanes

Sketching

Edited (version 99)

2 years ago ~ PeterJanes

Edited (version 97)

2 years ago ~ PeterJanes

Edited (version 95)

2 years ago ~ PeterJanes

Event finish

Edited (version 92)

2 years ago ~ PeterJanes

Research

Edited (version 90)

2 years ago ~ PeterJanes

Edited (version 88)

2 years ago ~ PeterJanes

Edited (version 86)

2 years ago ~ PeterJanes

Edited (version 84)

2 years ago ~ PeterJanes

Documentation mostly completed - hack portal, pitch deck

2 years ago ~ PeterJanes

Edited (version 80)

2 years ago ~ PeterJanes

Edited (version 78)

2 years ago ~ PeterJanes

Edited (version 76)

2 years ago ~ PeterJanes

Edited (version 74)

2 years ago ~ PeterJanes

Edited (version 72)

2 years ago ~ PeterJanes

Edited (version 70)

2 years ago ~ PeterJanes

Edited (version 68)

2 years ago ~ PeterJanes

Edited (version 66)

2 years ago ~ PeterJanes

Edited (version 64)

2 years ago ~ PeterJanes

Edited (version 62)

2 years ago ~ PeterJanes

Edited (version 60)

2 years ago ~ PeterJanes

Edited (version 58)

2 years ago ~ PeterJanes

Edited (version 56)

2 years ago ~ PeterJanes

Edited (version 54)

2 years ago ~ PeterJanes

Working plan for day 2 coordinated - approach for findings and documentation

2 years ago ~ PeterJanes

Edited (version 50)

2 years ago ~ lukas_oberholzer

Edited (version 48)

2 years ago ~ PeterJanes

Collaboration space set up, first cut project documentation completed

2 years ago ~ PeterJanes

Edited (version 44)

2 years ago ~ PeterJanes

Project

Edited (version 42)

2 years ago ~ PeterJanes

Edited (version 40)

2 years ago ~ PeterJanes

Edited (version 38)

2 years ago ~ PeterJanes

Edited (version 36)

2 years ago ~ PeterJanes

Edited (version 34)

2 years ago ~ PeterJanes

Edited (version 32)

2 years ago ~ PeterJanes

Edited (version 30)

2 years ago ~ PeterJanes

Edited (version 28)

2 years ago ~ PeterJanes

Edited (version 26)

2 years ago ~ PeterJanes

Edited (version 24)

2 years ago ~ PeterJanes

Edited (version 22)

2 years ago ~ PeterJanes

Two teams - web scraping (to collect data), analysis (verify first examples manually)

2 years ago ~ PeterJanes

Edited (version 17)

2 years ago ~ PeterJanes

Edited (version 15)

2 years ago ~ PeterJanes

Joined the team

2 years ago ~ lucas_tochtermann_bfe

Start

 
All attendees, sponsors, partners, volunteers and staff at our hackathon are required to agree with the Hack Code of Conduct. Organisers will enforce this code throughout the event. We expect cooperation from all participants to ensure a safe environment for everybody.

Creative Commons LicenceThe contents of this website, unless otherwise stated, are licensed under a Creative Commons Attribution 4.0 International License.