CFProposal AISB2018

  The Society for the Study of Artificial Intelligence and Simulation for Behaviour (AISB) is soliciting proposals for symposia to be held at the AISB 2018 convention.The longest running convention on Artificial Intelligence, A...


Insurance AI Analy...

Insurance AI Analytics Summit, October 9-10, London Join us for Europe’s only AI event dedicated to insurance where 300 attendees will unite from analytics, pricing, marketing, claims and underwriting. You’ll find out how advan...


AISB 2018 Convention

  The longest running convention on Artificial Intelligence, AISB 2018 will be held at the University of Liverpool, chaired by Floriana Grasso and Louise Dennis. As in the past years, AISB 2018 will provide a unique forum for p...


AI Summit London

     The AI Summit London: The World’s Number One AI Event for Business  Date: 9-10 May 2017 Venue: Business Design Centre, London. The AI Summit is the world’s first and largest/number one conference exhibition dedicated to t...


AISB Wired Health

    AISB and WIRED events have partnered to bring together inspirational high-profile speakers. Join hundreds of healthcare, pharmaceutical and technology influencers and leaders at the 4th Annual WIRED Health event, taking pl...


Hugh Gene Loebner

  The AISB were sad to learn last week of the passing of philanthropist and inventor Hugh Gene Loebner PhD, who died peacefully in his home in New York at the age of 74.  Hugh was founder and sponsor of The Loebner Prize, an an...


AI Europe 2016

  Partnership between AISB and AI Europe 2016: Next December 5th and 6th in London, AI Europe will bring together the European AI eco-system by gathering new tools and future technologies appearing in professional fields for th...


AISB convention 2017

  In the run up to AISB2017 convention (, I've asked Joanna Bryson, from the organising team, to answer few questions about the convention and what comes with it. Mohammad Majid...


Harold Cohen

Harold Cohen, tireless computer art pioneer dies at 87   Harold Cohen at the Tate (1983) Aaron image in background   Harold Cohen died at 87 in his studio on 27th April 2016 in Encintias California, USA.The first time I hear...


Dancing with Pixies?...

At TEDx Tottenham, London Mark Bishop (the former chair of the Society) demonstrates that if the ongoing EU flagship science project - the 1.6 billion dollar "Human Brain Project” - ultimately succeeds in understanding all as...



AISB miscellaneous Bulletin Item

CFP: IEEE Trans SMC-B Special Issue on ADP and RL for Control

IEEE Trans SMC-B Special Issue on Approximate Dynamic Programming and Reinforcement Learning for Control

New deadline for paper submission: September 1, 2007

Neural networks and fuzzy logic systems possess highly attractive mathematical
and adaptive learning properties that have been exploited in numerous fields
including signal processing, sensor fusion, decision-making and
classification, pattern recognition and clustering, multimedia processing, and

Man-made feedback controllers are responsible for many of the recent
developments in engineered systems including aerospace, ship, vehicle,
industrial, robotic, and process control systems.  Applications of neural
networks and fuzzy logic in feedback control systems are intriguing because
they potentially allow the control of complex engineered systems whose
dynamics are unknown a priori.

Most applications of neural networks for feedback purposes explored by the
Control Systems Community have been to extend the capabilities of controllers
designed via traditional tools by augmenting them with neural networks
employed as nonlinear function approximators for unknown system dynamics.  So
far, these applications have not focused on optimal or efficient control.

In nature, biological and ecological systems operate on various principles of
optimality, efficiency, or economy, based on constrained resources.  It is
known that the solution of various optimal and inverse optimal controller
design equations can potentially provide optimal controllers for any form of
nonlinear system.  Problems related to determining a control input that
minimizes various prescribed cost or value functionals can be confronted by
solving so-called Hamilton-Jacobi-Bellman equations.  These HJB equations are
generally nonlinear and impossible to solve analytically.

A large and highly successful body of work exists in reinforcement learning
and Adaptive Dynamic Programming (ADP), also called Neurodynamic Programming
(NDP), which approximately solves the HJB equations using efficient
forward-in-time techniques based on using neural networks for value functional
approximation.  Much work has been done in this area to develop various ADP
algorithms, prove convergence, determine effective solution procedures, and
design practical control systems for aerospace systems and elsewhere.

ADP holds out the promise of providing a new class of Adaptive Controllers
that directly converge to optimal control designs.  

The purpose of this Special Issue is to showcase the state-of-the-art in ADP,
NDP, and reinforcement learning for feedback control applications.

Topics of Coverage: Including but not limited to
- Adaptive dynamic programming
- Reinforcement learning for system control
- Approximately optimal control
- Value function approximation for control systems design
- Q learning (action-dependent learning)
- Neural network applications in dynamic programming for feedback systems
- Fuzzy logic systems and fuzzy-neural systems for dynamic programming
- Direct policy search
- Actor-critic methods
- Learning rules and architectures for ADP
- Partially observable Markov decision processes
- Approximate solutions to nonlinear controller design equations
- Approximation-based optimal control systems
- Applications of ADP

Guest Editors
F.L. Lewis, Univ. of Texas at Arlington, Texas
George G. Lendaris, Portland State University, Portland, Oregon
Derong Liu, University of Illinois at Chicago

Papers for the special issue must be submitted electronically through
Manuscript Central at 
Information regarding electronic submission can be found at
Each submitted paper must indicate that the paper is submitted to the special
issue on ADP.  Submitted manuscripts will be screened for topical relevance,
and those relevant to the special issue will undergo IEEE SMC-B standard
review procedures.

The paper submission deadline is: 1st September 2007