## In Situ Adaptive Tabulation (ISAT)

## Projects.InSituAdaptiveTabulation History

Hide minor edits - Show changes to output

Added lines 10-13:

(:html:)

<iframe width="560" height="315" src="https://www.youtube.com/embed/XEKRh_dSoE4" frameborder="0" allowfullscreen></iframe>

(:htmlend:)

Added lines 18-21:

(:html:)

<iframe width="560" height="315" src="https://www.youtube.com/embed/pOpNLQ9BilQ" frameborder="0" allowfullscreen></iframe>

(:htmlend:)

Changed lines 17-19 from:

Attach:download.png [[isat_f90.zip|Download ISAT Source Code (Fortran 90)]]

Attach:download.png [[isat_matlab.zip|Download ISAT Source Code (MATLAB)]]

Attach:download.png [[isat_matlab.zip|Download ISAT Source Code (MATLAB)]]

to:

Attach:download.png [[Attach:isat_f90.zip|Download ISAT Source Code (Fortran 90)]]

Attach:download.png [[Attach:isat_matlab.zip|Download ISAT Source Code (MATLAB)]]

Attach:download.png [[Attach:isat_matlab.zip|Download ISAT Source Code (MATLAB)]]

Changed line 11 from:

* [[Additional information (PDF)~~|isat_details.pdf~~]]

to:

* [[Attach:isat_details.pdf|Additional information (PDF)]]

Changed lines 17-19 from:

to:

Attach:download.png [[isat_f90.zip|Download ISAT Source Code (Fortran 90)]]

Attach:download.png [[isat_matlab.zip|Download ISAT Source Code (MATLAB)]]

Attach:download.png [[isat_matlab.zip|Download ISAT Source Code (MATLAB)]]

Changed lines 7-9 from:

* Nonlinear function

to:

* Nonlinear system: ''y=f(x), xєR'^n^', yєR'^p^'''

Added lines 11-14:

* [[Additional information (PDF)|isat_details.pdf]]

ISAT approximates nonlinear function of dependent variables, ''y'', as a function of independent variables, ''x''. This is accomplished by dynamically constructing local linear approximations that are stored in a lookup database.

ISAT approximates nonlinear function of dependent variables, ''y'', as a function of independent variables, ''x''. This is accomplished by dynamically constructing local linear approximations that are stored in a lookup database.

Added lines 16-19:

* Attach:download.png [[isat_f90.zip|Download ISAT Source Code (Fortran 90)]]

* Attach:download.png [[isat_matlab.zip|Download ISAT Source Code (MATLAB)]]

Added lines 8-9:

* Nonlinear function: ''y=f(x), xєR'^n^', yєR'^p^'''

Changed lines 11-13 from:

ISAT approximation: ''y=A'_1_'x, y=A'_2_'x, y=A'_3_'x,'' etc.

to:

* ISAT approximation: ''y=A'_1_'x, y=A'_2_'x, y=A'_3_'x,'' etc.

!!!! Download Source Code

!!!! Download Source Code

Changed lines 43-48 from:

# Hedengren, J. D. and Edgar, T. F., Approximate Nonlinear Model Predictive Control with In Situ Adaptive Tabulation, Computers and Chemical Engineering, Volume 32, pp. 706-714, 2008. [[http://dx.doi.org/10.1016/j.compchemeng.2007.02.010|~~Abstract~~]]

# Hedengren, J. D. and Edgar, T. F., In Situ Adaptive Tabulation for Real-Time Control, Industrial & Engineering Chemistry Research, Ind. Eng. Chem. Res., Volume 44, Issue 8, pp. 2716 -2724, 2005. [[http://pubs.acs.org/cgi-bin/abstract.cgi/iecred/asap/abs/ie049322s.html|~~Abstract~~]]

# Hedengren, J. D. and Edgar, T. F., In Situ Adaptive Tabulation for Real-time Control, Proceedings of the American Control Conference (ACC), Boston, MA, pp. 2222-2227, July 2004.~~ [[Attach:hedengren_acc04.pdf|Preprint]] | [[Attach:hedengren_acc04_ppt.pdf|Presentation]]~~

# Hedengren, J. D. and Edgar, T. F., In Situ Adaptive Tabulation for Real-Time Control, Industrial & Engineering Chemistry Research, Ind. Eng. Chem. Res., Volume 44, Issue 8, pp. 2716 -2724, 2005. [[http://pubs.acs.org/cgi-bin/abstract.cgi/iecred/asap/abs/ie049322s.html|

# Hedengren, J. D. and Edgar, T. F., In Situ Adaptive Tabulation for Real-time Control, Proceedings of the American Control Conference (ACC), Boston, MA, pp. 2222-2227, July 2004.

to:

# Hedengren, J. D. and Edgar, T. F., Approximate Nonlinear Model Predictive Control with In Situ Adaptive Tabulation, Computers and Chemical Engineering, Volume 32, pp. 706-714, 2008. [[http://dx.doi.org/10.1016/j.compchemeng.2007.02.010|Article]]

# Hedengren, J. D. and Edgar, T. F., In Situ Adaptive Tabulation for Real-Time Control, Industrial & Engineering Chemistry Research, Ind. Eng. Chem. Res., Volume 44, Issue 8, pp. 2716 -2724, 2005. [[http://pubs.acs.org/cgi-bin/abstract.cgi/iecred/asap/abs/ie049322s.html|Article]]

# Hedengren, J. D. and Edgar, T. F., In Situ Adaptive Tabulation for Real-time Control, Proceedings of the American Control Conference (ACC), Boston, MA, pp. 2222-2227, July 2004.

# Hedengren, J. D. and Edgar, T. F., In Situ Adaptive Tabulation for Real-Time Control, Industrial & Engineering Chemistry Research, Ind. Eng. Chem. Res., Volume 44, Issue 8, pp. 2716 -2724, 2005. [[http://pubs.acs.org/cgi-bin/abstract.cgi/iecred/asap/abs/ie049322s.html|Article]]

# Hedengren, J. D. and Edgar, T. F., In Situ Adaptive Tabulation for Real-time Control, Proceedings of the American Control Conference (ACC), Boston, MA, pp. 2222-2227, July 2004.

Changed lines 36-45 from:

to:

!!!! References

# Pope, S. B., "Computationally Efficient Implementation of Combustion Chemistry Using In Situ Adaptive Tabulation", Combustion Theory Modelling, 1997, 1, pp. 41-63.

# Hedengren, J. D. and Edgar, T. F., Approximate Nonlinear Model Predictive Control with In Situ Adaptive Tabulation, Computers and Chemical Engineering, Volume 32, pp. 706-714, 2008. [[http://dx.doi.org/10.1016/j.compchemeng.2007.02.010|Abstract]]

# Hedengren, J. D. and Edgar, T. F., In Situ Adaptive Tabulation for Real-Time Control, Industrial & Engineering Chemistry Research, Ind. Eng. Chem. Res., Volume 44, Issue 8, pp. 2716 -2724, 2005. [[http://pubs.acs.org/cgi-bin/abstract.cgi/iecred/asap/abs/ie049322s.html|Abstract]]

# Hedengren, J. D. and Edgar, T. F., In Situ Adaptive Tabulation for Real-time Control, Proceedings of the American Control Conference (ACC), Boston, MA, pp. 2222-2227, July 2004. [[Attach:hedengren_acc04.pdf|Preprint]] | [[Attach:hedengren_acc04_ppt.pdf|Presentation]]

Changed line 1 from:

(:title In Situ Adaptive Tabulation (ISAT)~~ for Nonlinear Modeling~~:)

to:

(:title In Situ Adaptive Tabulation (ISAT):)

Added lines 1-37:

(:title In Situ Adaptive Tabulation (ISAT) for Nonlinear Modeling:)

(:keywords artificial neural network, isat, adaptive, error checking, function approximation, tensor flow:)

(:description ISAT is a nonlinear empirical modeling approach that adaptively builds models as new information is requested.:)

ISAT is a nonlinear empirical modeling approach that adaptively builds models as new information is requested. ISAT has been applied to simulations of turbulent reacting flows as well as nonlinear model predictive control (NMPC) to make real-time applications feasible. Like artificial neural networks, ISAT is a storage and retrieval method. Unlike neural nets, ISAT is adaptive to extrapolation. In addition, ISAT learns as it goes so there is no specified amount of training data before it starts performing.

ISAT approximates nonlinear function of dependent variables, ''y'', as a function of independent variables, ''x''. This is accomplished by dynamically constructing local linear approximations that are stored in a lookup database.

Nonlinear function: ''y=f(x), xєR'^n^', yєR'^p^'''

ISAT approximation: ''y=A'_1_'x, y=A'_2_'x, y=A'_3_'x,'' etc.

The animated graphic is an example with 2 independent variables (''x'' and ''y'' as horizontal axes) and the 1 dependent variable (''z'' as the vertical axis). ISAT approximates the function with multiple local linear regions. As the error tolerance increases, the approximation becomes increasingly granular to the point that individual linear regions can be observed.

Attach:animate_isat.gif

The animation shows an ISAT approximation to the first eigenfunction of an L-shaped membrane. The error tolerance for ''z'' is steadily ramped from 0.01 to 0.99. The error tolerance of the current frame is indicated on the figure. Initially at a low error tolerance of 0.01, the approximation is nearly exact but requires 206 ISAT records. When the error tolerance is increased to 0.1, 48 ISAT records are stored. At an error tolerance of 0.5, only 12 ISAT records are required to meet the relaxed error bound.

Explicit error control of the approximation of ''y'' is maintained by defining a region where the linear approximation is considered accurate. For ''n''=1, this is a range on the value of ''x''. For ''n''=2, the estimate of the region of accuracy is an ellipse. For higher dimensional ''n'', the estimate of the region of accuracy is a hyper-ellipsoid. For very nonlinear functions many linear approximations are required. For linear functions one record is required.

ISAT takes a fundamentally different approach to nonlinear function approximation. Most other function approximation approaches attempt to fit the entire nonlinear surface with one functional form. By using multiple local approximations, the functional form adapts to the nonlinear function. With this free functional form, ISAT is ideally suited for nonlinear functions with discontinuities or non-continuously differentiable points.

!!!! Scenario 1: Retrieval

Attach:isat_retrieval.png

!!!! Scenario 2: Growth

Attach:isat_growth.png

!!!! Scenario 3: Addition

Attach:isat_addition.png

ISAT is suited to large-scale problems with O(n'^2^'+np) scaling, can approximate functions with discontinuities, explicitly limits approximation error, limits function approximation derivatives, and is adaptive to new data training without re-optimization.

(:keywords artificial neural network, isat, adaptive, error checking, function approximation, tensor flow:)

(:description ISAT is a nonlinear empirical modeling approach that adaptively builds models as new information is requested.:)

ISAT is a nonlinear empirical modeling approach that adaptively builds models as new information is requested. ISAT has been applied to simulations of turbulent reacting flows as well as nonlinear model predictive control (NMPC) to make real-time applications feasible. Like artificial neural networks, ISAT is a storage and retrieval method. Unlike neural nets, ISAT is adaptive to extrapolation. In addition, ISAT learns as it goes so there is no specified amount of training data before it starts performing.

ISAT approximates nonlinear function of dependent variables, ''y'', as a function of independent variables, ''x''. This is accomplished by dynamically constructing local linear approximations that are stored in a lookup database.

Nonlinear function: ''y=f(x), xєR'^n^', yєR'^p^'''

ISAT approximation: ''y=A'_1_'x, y=A'_2_'x, y=A'_3_'x,'' etc.

The animated graphic is an example with 2 independent variables (''x'' and ''y'' as horizontal axes) and the 1 dependent variable (''z'' as the vertical axis). ISAT approximates the function with multiple local linear regions. As the error tolerance increases, the approximation becomes increasingly granular to the point that individual linear regions can be observed.

Attach:animate_isat.gif

The animation shows an ISAT approximation to the first eigenfunction of an L-shaped membrane. The error tolerance for ''z'' is steadily ramped from 0.01 to 0.99. The error tolerance of the current frame is indicated on the figure. Initially at a low error tolerance of 0.01, the approximation is nearly exact but requires 206 ISAT records. When the error tolerance is increased to 0.1, 48 ISAT records are stored. At an error tolerance of 0.5, only 12 ISAT records are required to meet the relaxed error bound.

Explicit error control of the approximation of ''y'' is maintained by defining a region where the linear approximation is considered accurate. For ''n''=1, this is a range on the value of ''x''. For ''n''=2, the estimate of the region of accuracy is an ellipse. For higher dimensional ''n'', the estimate of the region of accuracy is a hyper-ellipsoid. For very nonlinear functions many linear approximations are required. For linear functions one record is required.

ISAT takes a fundamentally different approach to nonlinear function approximation. Most other function approximation approaches attempt to fit the entire nonlinear surface with one functional form. By using multiple local approximations, the functional form adapts to the nonlinear function. With this free functional form, ISAT is ideally suited for nonlinear functions with discontinuities or non-continuously differentiable points.

!!!! Scenario 1: Retrieval

Attach:isat_retrieval.png

!!!! Scenario 2: Growth

Attach:isat_growth.png

!!!! Scenario 3: Addition

Attach:isat_addition.png

ISAT is suited to large-scale problems with O(n'^2^'+np) scaling, can approximate functions with discontinuities, explicitly limits approximation error, limits function approximation derivatives, and is adaptive to new data training without re-optimization.