Optimizing Vitrification of Nuclear Waste
Projects.VitrificationNuclearWaste History
Show minor edits - Show changes to output
Added lines 9-14:
(:html:)
<iframe width="560" height="315" src="https://www.youtube.com/embed/NOcpthpN3g0?si=6evvkpTJOyCS7zQO" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" allowfullscreen></iframe>
(:htmlend:)
This project utilizes machine learning models to optimize the properties of waste glass currently produced by the Pacific Northwest National Laboratory’s (PNNL) vitrification site in Hanford, Washington. Vitrification is the process of combining nuclear waste with glass-forming materials at extremely high temperatures to create a molten glass that is easily disposed of permanently and safely.
<iframe width="560" height="315" src="https://www.youtube.com/embed/NOcpthpN3g0?si=6evvkpTJOyCS7zQO" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" allowfullscreen></iframe>
(:htmlend:)
This project utilizes machine learning models to optimize the properties of waste glass currently produced by the Pacific Northwest National Laboratory’s (PNNL) vitrification site in Hanford, Washington. Vitrification is the process of combining nuclear waste with glass-forming materials at extremely high temperatures to create a molten glass that is easily disposed of permanently and safely.
Changed line 17 from:
to:
PNNL currently uses an optimization scheme with partial quadratic mixture (PQM) models to optimize properties of the waste glass with the help of additives - this might include maximizing waste loading and ensuring that safety constraints are met. Because real-world behavior does not directly match simulation, constraints such as prediction uncertainties that affect optimization must be taken into account to ensure that decisions are made with confidence.
Changed line 33 from:
->Gunnell, L., Manwaring, K., Lu, X., Reynolds, J., Vienna, J., Hedengren, J.D., Machine Learning with Gradient-based Optimization of Nuclear Waste Vitrification with Uncertainties and Constraints, Processes, 10(11), 2365, Nov 2022, DOI: 10.3390/pr10112365. [[https://www.mdpi.com/2227-9717/10/11/2365/htm|Article (Open Access)]]
to:
->Gunnell, L., Manwaring, K., Lu, X., Reynolds, J., Vienna, J., Hedengren, J.D., Machine Learning with Gradient-based Optimization of Nuclear Waste Vitrification with Uncertainties and Constraints, Processes, 10(11), 2365, Nov 2022, DOI: 10.3390/pr10112365. [[https://www.mdpi.com/2227-9717/10/11/2365/htm|Article (Open Access)]] | [[https://gekko.readthedocs.io/en/latest/ml.html|Documentation]]
Changed line 33 from:
->Gunnell, L., Manwaring, K., Lu, X., Reynolds, J., Vienna, J., Hedengren, J.D., Machine Learning with Gradient-based Optimization of Nuclear Waste Vitrification with Uncertainties and Constraints, 2022.
to:
->Gunnell, L., Manwaring, K., Lu, X., Reynolds, J., Vienna, J., Hedengren, J.D., Machine Learning with Gradient-based Optimization of Nuclear Waste Vitrification with Uncertainties and Constraints, Processes, 10(11), 2365, Nov 2022, DOI: 10.3390/pr10112365. [[https://www.mdpi.com/2227-9717/10/11/2365/htm|Article (Open Access)]]
Changed line 23 from:
to:
%width=550px%Attach:pnnl_4.png
Added lines 23-24:
->%width=500px%Attach:pnnl_4.png
Changed line 35 from:
->%width=500px%Attach:pnnl_4.png
to:
->%width=500px%Attach:pnnl_5.png
Changed line 31 from:
->Gunnell, L., Manwaring, K., Lu, X., Reynolds, J., Vienna, J., Hedengren, J.D., Machine Learning with Gradient-based Optimization of Nuclear Waste Vitrification with Uncertainties and Constraints, in preparation, 2022.
to:
->Gunnell, L., Manwaring, K., Lu, X., Reynolds, J., Vienna, J., Hedengren, J.D., Machine Learning with Gradient-based Optimization of Nuclear Waste Vitrification with Uncertainties and Constraints, 2022.
Changed line 35 from:
-> '''Abstract:''' Gekko is an optimization suite in Python that solves dynamic optimization problems involving mixed-integer, nonlinear, and differential equations. Codes from other packages, like those with machine learning (ML) algorithms, have not been implemented or interfaced into Gekko. The purpose of this effort is to integrate common ML algorithms like Gaussian Process Regression (GPR), Support Vector Regression (SVR), and Artificial Neural Network (ANN) models into Gekko, allowing it to solve optimization problems where data-based models are used. In addition, the inclusion of uncertainty quantification (UQ) within an optimization framework with ML algorithms has not been thoroughly explored, so compatible models and UQ methods are investigated in this endeavor. These methods include Ensemble methods, model-specific methods, conformal predictions, and the Delta method. A simplified optimization problem involving Nuclear Waste Vitrification at Hanford to maximize waste loading is presented for demonstration and model comparison purposes. ML models are compared against the current Partial Quadratic Mixture (PQM) model in an optimization problem in Gekko, and higher performance is observed in the ML models. The example problem shows that these tools can be used in similar industry settings where easier use and better performance is needed over classical approaches.
to:
-> '''Abstract:''' Gekko is an optimization suite in Python that solves optimization problems involving mixed-integer, nonlinear, and differential equations. The purpose of this study is to integrate common ML algorithms such as Gaussian Process Regression (GPR), support vector regression (SVR), and artificial neural network (ANN) models into Gekko to solve data based optimization problems. Uncertainty quantification (UQ) is used alongside ML for better decision making. These methods include ensemble methods, model-specific methods, conformal predictions, and the Delta method. An optimization problem involving nuclear waste vitrification is presented to demonstrate the benefit of ML in this field. ML models are compared against the current Partial Quadratic Mixture (PQM) model in an optimization problem in Gekko. GPR with Conformal uncertainty was chosen as the best substitute model as it had a lower mean squared error of 0.0025 compared to 0.018 and more confidently predicted a higher waste loading of 37.5 wt% compared to 34 wt%. The example problem shows that these tools can be used in similar industry settings where easier use and better performance is needed over classical approaches. Future works with these tools include expanding them with other regression models and UQ methods, and exploration into other optimization problems or dynamic control.
Added lines 1-38:
(:title Optimizing Vitrification of Nuclear Waste:)
(:keywords research, dispatch, gaussian processes, optimization, nuclear, waste:)
(:description Optimization of Nuclear Waste with Machine Learning Models and Gradient-based Optimizers:)
One of the countless challenges facing the international community is the question of what to do with the radioactive waste produced from nuclear plants each year. In the United States alone, more than 2,000 metric tons of highly radioactive waste are produced yearly. While such waste can be stored in a pool on-site for several years, a permanent solution is necessary to protect human health and the environment in the long run.
%width=550px%Attach:pnnl_1.png
This project utilizes machine learning models to optimize the properties of waste glass currently produced by the Pacific Northwest National Laboratory’s (PNNL) vitrification site in Hanford, Washington. Vitrification is the process of combining nuclear waste with glass-forming materials at extremely high temperatures to create a molten glass that is easily disposed of permanently and safely. PNNL currently uses an optimization scheme with partial quadratic mixture (PQM) models to optimize properties of the waste glass with the help of additives - this might include maximizing waste loading and ensuring that safety constraints are met. Because real-world behavior does not directly match simulation, constraints such as prediction uncertainties that affect optimization must be taken into account to ensure that decisions are made with confidence.
%width=550px%Attach:pnnl_2.png
In replacing or refining the models currently used in the optimization scheme with machine learning models, we hope to offer improvements that have the same prediction performance, provide a prediction uncertainty that affects optimization, run as fast as current PQM models, and are retained easily for new datasets. These models are used for the properties of the glass, including electrical conductivity, viscosity, and certain component solubilities. In this case, the models are used as a constraint of an optimization problem in order to replicate physics-based behavior.
%width=550px%Attach:pnnl_3.png
Following is a more detailed explanation of the project logistics by project lead [[https://www.linkedin.com/in/lagrande-gunnell-715a2b194/|LaGrande Gunnell]]:
-> The optimization is done in the Gekko Optimization Suite, with IPOPT as the solver. These models need to be interfaced to Gekko and have second derivative information available to work with the gradient optimization method. So far, we have looked at Gaussian Process Regression (GPR), Support Vector Regression (SVR), and Neural Networks (NN) with packages like Sklearn, Tensorflow, and GPFlow. GPR uses Gaussian principles and Kernel functions to predict a solution by generating every possible function that could match the data and then taking the average of those functions. SVR draws a hyperplane between the data with kernel functions and tries to maximize the margins in order to be able to regress the data. NN uses different numbers of layers, neurons, weights, and biases to predict the value. Some of these methods, like GPR and some NN, have Gaussian uncertainties built in and can readily provide confidence intervals on the predictions; other models need to be retrained multiple times through bootstrapping, and used together to predict an ensemble prediction and uncertainty.”
!!!! Project Support
The authors are grateful for the support by the U.S. Department of Energy (DOE), Office of River Protection Waste Treatment and Immobilization Plant (WTP) Project. Pacific Northwest National Laboratory is a multi-program national laboratory operated for the U.S. Department of Energy by Battelle Memorial Institute under Contract DE-AC06-76RL01830. This project was funded as a subcontract to Brigham Young University to develop machine learning methods for Gekko Optimization Suite in support of nuclear waste modeling and loading optimization.
!!!! Publications
'''Machine Learning in Gekko'''
->Gunnell, L., Manwaring, K., Lu, X., Reynolds, J., Vienna, J., Hedengren, J.D., Machine Learning with Gradient-based Optimization of Nuclear Waste Vitrification with Uncertainties and Constraints, in preparation, 2022.
->%width=500px%Attach:pnnl_4.png
-> '''Abstract:''' Gekko is an optimization suite in Python that solves dynamic optimization problems involving mixed-integer, nonlinear, and differential equations. Codes from other packages, like those with machine learning (ML) algorithms, have not been implemented or interfaced into Gekko. The purpose of this effort is to integrate common ML algorithms like Gaussian Process Regression (GPR), Support Vector Regression (SVR), and Artificial Neural Network (ANN) models into Gekko, allowing it to solve optimization problems where data-based models are used. In addition, the inclusion of uncertainty quantification (UQ) within an optimization framework with ML algorithms has not been thoroughly explored, so compatible models and UQ methods are investigated in this endeavor. These methods include Ensemble methods, model-specific methods, conformal predictions, and the Delta method. A simplified optimization problem involving Nuclear Waste Vitrification at Hanford to maximize waste loading is presented for demonstration and model comparison purposes. ML models are compared against the current Partial Quadratic Mixture (PQM) model in an optimization problem in Gekko, and higher performance is observed in the ML models. The example problem shows that these tools can be used in similar industry settings where easier use and better performance is needed over classical approaches.
(:divend:)
----
(:keywords research, dispatch, gaussian processes, optimization, nuclear, waste:)
(:description Optimization of Nuclear Waste with Machine Learning Models and Gradient-based Optimizers:)
One of the countless challenges facing the international community is the question of what to do with the radioactive waste produced from nuclear plants each year. In the United States alone, more than 2,000 metric tons of highly radioactive waste are produced yearly. While such waste can be stored in a pool on-site for several years, a permanent solution is necessary to protect human health and the environment in the long run.
%width=550px%Attach:pnnl_1.png
This project utilizes machine learning models to optimize the properties of waste glass currently produced by the Pacific Northwest National Laboratory’s (PNNL) vitrification site in Hanford, Washington. Vitrification is the process of combining nuclear waste with glass-forming materials at extremely high temperatures to create a molten glass that is easily disposed of permanently and safely. PNNL currently uses an optimization scheme with partial quadratic mixture (PQM) models to optimize properties of the waste glass with the help of additives - this might include maximizing waste loading and ensuring that safety constraints are met. Because real-world behavior does not directly match simulation, constraints such as prediction uncertainties that affect optimization must be taken into account to ensure that decisions are made with confidence.
%width=550px%Attach:pnnl_2.png
In replacing or refining the models currently used in the optimization scheme with machine learning models, we hope to offer improvements that have the same prediction performance, provide a prediction uncertainty that affects optimization, run as fast as current PQM models, and are retained easily for new datasets. These models are used for the properties of the glass, including electrical conductivity, viscosity, and certain component solubilities. In this case, the models are used as a constraint of an optimization problem in order to replicate physics-based behavior.
%width=550px%Attach:pnnl_3.png
Following is a more detailed explanation of the project logistics by project lead [[https://www.linkedin.com/in/lagrande-gunnell-715a2b194/|LaGrande Gunnell]]:
-> The optimization is done in the Gekko Optimization Suite, with IPOPT as the solver. These models need to be interfaced to Gekko and have second derivative information available to work with the gradient optimization method. So far, we have looked at Gaussian Process Regression (GPR), Support Vector Regression (SVR), and Neural Networks (NN) with packages like Sklearn, Tensorflow, and GPFlow. GPR uses Gaussian principles and Kernel functions to predict a solution by generating every possible function that could match the data and then taking the average of those functions. SVR draws a hyperplane between the data with kernel functions and tries to maximize the margins in order to be able to regress the data. NN uses different numbers of layers, neurons, weights, and biases to predict the value. Some of these methods, like GPR and some NN, have Gaussian uncertainties built in and can readily provide confidence intervals on the predictions; other models need to be retrained multiple times through bootstrapping, and used together to predict an ensemble prediction and uncertainty.”
!!!! Project Support
The authors are grateful for the support by the U.S. Department of Energy (DOE), Office of River Protection Waste Treatment and Immobilization Plant (WTP) Project. Pacific Northwest National Laboratory is a multi-program national laboratory operated for the U.S. Department of Energy by Battelle Memorial Institute under Contract DE-AC06-76RL01830. This project was funded as a subcontract to Brigham Young University to develop machine learning methods for Gekko Optimization Suite in support of nuclear waste modeling and loading optimization.
!!!! Publications
'''Machine Learning in Gekko'''
->Gunnell, L., Manwaring, K., Lu, X., Reynolds, J., Vienna, J., Hedengren, J.D., Machine Learning with Gradient-based Optimization of Nuclear Waste Vitrification with Uncertainties and Constraints, in preparation, 2022.
->%width=500px%Attach:pnnl_4.png
-> '''Abstract:''' Gekko is an optimization suite in Python that solves dynamic optimization problems involving mixed-integer, nonlinear, and differential equations. Codes from other packages, like those with machine learning (ML) algorithms, have not been implemented or interfaced into Gekko. The purpose of this effort is to integrate common ML algorithms like Gaussian Process Regression (GPR), Support Vector Regression (SVR), and Artificial Neural Network (ANN) models into Gekko, allowing it to solve optimization problems where data-based models are used. In addition, the inclusion of uncertainty quantification (UQ) within an optimization framework with ML algorithms has not been thoroughly explored, so compatible models and UQ methods are investigated in this endeavor. These methods include Ensemble methods, model-specific methods, conformal predictions, and the Delta method. A simplified optimization problem involving Nuclear Waste Vitrification at Hanford to maximize waste loading is presented for demonstration and model comparison purposes. ML models are compared against the current Partial Quadratic Mixture (PQM) model in an optimization problem in Gekko, and higher performance is observed in the ML models. The example problem shows that these tools can be used in similar industry settings where easier use and better performance is needed over classical approaches.
(:divend:)
----
