Machine Learning Techniques for the Smart Grid – Modeling of Solar Energy using AI Networked and Embedded Systems

Professor Dr. Wilfried ElmenreichDr. Tamer Khatib

Overview

• Scope of this tutorial• Meta-heuristic search algorithms• Artificial neural networks• Modeling of solar radiation

Modeling extraterrestrial and terrestrial solar radiation Clear sky model Satellite based models Sky transmittance-based models Ground meteorological measurement based model ANN-based modeling of solar radiation

• Automated planning and scheduling• Machine learning• Natural language processing• Perception• Robotics• Social intelligence• Creativity• Artificial general intelligence

Artificial Intelligence Areas

Image soruce: Creative Commons, Wikipedia

• Automated planning and scheduling• Machine learning• Natural language processing• Perception• Robotics• Social intelligence• Creativity• Artificial general intelligence

Artificial Intelligence Techniques

Image soruce: Creative Commons, Wikipedia

• Metaheuristic search algorithms

PART I

• For optimization problems• Etymology:

– Meta – upper level– Heuristic – to find– Heuristic = deterministic– Meta-heuristic = utilizing randomization in search

• So it is “only” for search problems ?Every engineering or design challenges can be formulated into a search

problem over a solution space

• Solution space can be particular large and multi-dimensional– Standard optimization algorithms don’t finish in acceptable time– Need for meta-heuristic

Meta-heuristic search algorithms

Overview on Search Techniques

• Metaheuristics = Guided random search techniques

• Metaheuristics are strategies that guide the search process• Goal is to efficiently explore the search space to find

(near-)optimal solutions• No single technique• Metaheuristic algorithms are approximate and typically

non-deterministic• Metaheuristic algorithms might fail by getting trapped in

confined and deceptive areas of the search space• Metaheuristics are typically not problem-specific

Properties of Meta-heuristic Search Algorithms

• Trajectory methods– Basic Idea: Iterative improvement– Simulated annealing (Scott Kirkpatrick, C. Daniel Gelatt and Mario P. Vecchi, 1983)

– Tabu search (Fred Glover, 1986)

– Variable neighborhood search (Mladenovic, Hansen, 1997)

Meta-heuristic Search Algorithms (1)

x1

x2 x3

X4

X5

• Population-based methods– Genetic algorithm (John Holland 1975)

– Evolutionary algorithms– Genetic programming (Fogel 1964)

– Swarm Algorithms

Meta-heuristic Search Algorithms (2)

Evolutionary Algorithm

Searching for Rules

• Simulation of target system as playground

• Evolvable model of local behavior (e.g., fuzzy rules, ANN)

• Define goal via fitness function (e.g., maximize throughput in a network)

• Run evolutionary algorithm to derive local rules that fulfill the given goal

System modelGoals (fitness function)

Simulation

System modelGoals (fitness function)

Simulation

Explore solutions

Explore solutions

Evaluate & Iterate

Evaluate & Iterate

Analyze resultsAnalyze results

Building Self-Organizing Systems 13

System architecture

Wilfried Elmenreich

6 major components: task description, simulation setup, interaction interface, evolvable decision unit, objective function, search algorithm

Agent behavior to be evolved

• Controls the agents of the SOS• Processes inputs (from sensors) and produces output (to

actuators)• Must be evolvable

– Mutation– Recombination

• We cannot easily do this with an algorithm represented in C code…

Agent

Control System„Agent‘s Brain“

Artificial Neural Networks

• Each neuron sums up theweighted outputs of the other connected neurons

• The output of the neuronis the result of an activation function (e.g. step, sigmoid function) applied to this sum

• Neural networks are distinguished by their connection structure– Feed forward connections (layered)– Recursive (Ouput neurons feed back to input layer)– Fully meshed

Evolving Neural Networks

3.2 -1.2

3.2

3.2

-0.1

-4.2

0.20.0

3.5 -1.2

3.2

3.2

-0.1

-4.2

0.20.0

Mutation

0.0 -1.2

1.2

3.2

-0.1

1.2

1.20.0

3.5 2.2

3.2

3.2

-0.1

-4.2

0.20.5

Recombination

3.2 -1.2

3.2

3.2

-0.1

-4.2

0.20.0

Framework for Evolutionary Design

• FREVO (Framework for Evolutionary Design)• Modular Java tool allowing fast simulation and evolution• FREVO defines flexible components for

– Controller representation– Problem specification– Optimizer

Giving FREVO a Problem• Basically, we need a simulation of the problem• Interface for input/output connections to the agents

– E.g. for the public goods game:– Your input last round– Your revenue

• Feedback from a simulation run -> fitness value• FREVO source code and simple tutorial for a new problem at

http://frevo.sourceforge.net

PART II

• Modeling of solar radiation

Application example

• Modeling of solar radiationModeling extraterrestrial and terrestrial solar radiationClear sky modelSatellite based modelsSky transmittance-based modelsGround meteorological measurement based modelANN Based modeling of solar radiation

• Solar energy is part of the sun’s energy which falls at the earth’s surface. It can be harnessed, to heat water or to move electrons in a solar cell.

• Solar radiation data provide information on sun’s potential in a specific location. These data are very important for designing solar energy systems.

• Due to the high cost and installation difficulties in measuring devices, these data aren't always available. thus, alternative prediction ways are needed.

Preface: Solar energy

How big is solar energy ?

Source: Boyle, G. 2004. Renewable Energy. OXFORD..

Modeling of extraterrestrial solar radiation

• The Sun emits radiant energy in an amount that is a function of its temperature. Blackbody model can be used to describe how much radiation the sun emits. A blackbody is defined to be a perfect emitter as well as a perfect absorber

• The wavelengths emitted by a blackbody depend on its temperature as described by Planck’s law:

Where, Eλ is the emissive power per area (W/m2 μm), T is the absolute temperature of the body (K), λ is the wavelength (μm).

Modeling of extraterrestrial solar radiation

• To calculate the daily extraterrestrial solar radiation on the top of the atmosphere, the path that the earth rotates around the sun must be considered.

• The eccentricity of the ellipse is small and the orbit is, in fact, quite nearly circular. Therefore, the extraterrestrial solar radiation in W/m2 can be described as,

where Rav is the mean sun-earth distance R is the actual sun-earth distance depending on the day of the year

• After all, the daily extraterrestrial solar radiation can be given as follows,

Modeling of terrestrial solar radiation

• Attenuation of incoming radiation is a function of the distance that the beam has to travel through the atmosphere, which is easily calculable, as well as factors such as dust, air pollution, atmospheric water vapor, clouds, and turbidity

Modeling of terrestrial solar radiation

• There are many theories for modeling terrestrial solar radiation, Clear sky model Satellite based model Environmental measurement based model Ground meteorological measurement based model

Clear sky model

• Beam radiation at the surface can exceed 70% of the extraterrestrial flux• Constant and uniform attenuation factor is assumed• Isotropic model is assumed

Clear sky model

29

Satellite based models

Sky transmittance-based models

Ground meteorological measurement based model

Ground meteorological measurement based model

Ground meteorological measurement based model

34

Sensitivity of data

0 10000 20000 30000 40000 500000

100

200

300

400

500

600

700

800

900

0 10000 20000 30000 40000 50000 600000

100

200

300

400

500

600

700

800

900

1000

0 10000 20000 30000 40000 500000

100

200

300

400

500

600

700

800

900

Model type and configuration and inputs

Number of neurons in the hidden layer• If a low number of hidden neurons are used, under fitting may occur and this will cause high training and generalization error while over fitting and high variance may occur when the hidden layer consist of a large number of hidden neurons.

• Usually the number of hidden nodes can be obtained by using some rules of thumb. For example,

• the hidden layer’s neurons have to be somewhere between the input layer size and the output layer size.

• the hidden layer will never require more than twice the number of the inputs.

• the number of hidden nodes are 2/3 or (70%-90%) of the number of input nodes.

• In addition, it has been recommended that by adding the number of the input to the number of the output and multiply the result by (2/3), the number of the hidden nodes can be achieved.

Modeling results using GRNN

Summary

• Artificial Intelligence algorithms are complex algorithms to handle complex problems

• Simple, deconstructable problems (given network, linear composable power flows) -> standard algorithms

• Complex problems (many variables, open questions such as network structure) -> complex algorithms

• We covered:– Evolutionary algorithms– Artificial neural networks– Neural network application for modeling of solar radiation

Einführung in Smart Grids 39

Thank you Welcome any

question

Wilfried Elmenreich

Further Links

• Video: 6 minute introduction to FREVO: http://youtu.be/1wTyozYGG4I• Download FREVO (open source): http://frevo.sourceforge.net• A. Sobe, I. Fehérvári, and W. Elmenreich.

FREVO: A tool for evolving and evaluating self-organizing systems. In Proceedings of the 1st International Workshop on Evaluation for Self-Adaptive and Self-Organizing Systems, Lyon, France, September 2012.

• I. Fehervari and W. Elmenreich. Evolution as a tool to design self-organizing systems. In Self-Organizing Systems, volume LNCS 8221, pages 139–144. Springer Verlag, 2014.

• T. Khatib, A Mohamed, K Sopian. A review of solar energy modeling techniques. J. of Renewable & Sustainable Energy Reviews. 2012.16(5): 2864-2869.

• T. Khatib, A. Mohamed, K. Sopian, M. Mahmoud. Assessment of Artificial Neural Networks for Hourly Solar Radiation Prediction. J. of Photoenergy. 2012. 2012(ID 946890):1-7.