A Framework to Establish a Blind Validation Challenge for ECLSS Modeling and Simulation
Conference Proceeding
Overview
abstract
Environmental Control and Life Support Systems (ECLSS) are; complex systems of systems designed to meet the metabolic; needs of the crew. Several ECLSS modeling and simulation; tools have been developed, however they have limited; utility as the models have not been fully validated, in; part due to the lack of publicly available experimental; data to do so. Thus, this paper poses a challenge with; principal goal to promote and improve model development for; the prediction of ECLSS performance, whether of; flight-proven technologies or those at low technology; readiness levels. To achieve this goal, models will be; verified – Was the model coded correctly? and validated for; accuracy of results – Does the model correctly simulate the; ECLSS? We will identify and describe suitable test cases; for model simulations by challenge participants, however; ‘truth’ performance data (to the extent known) will be; withheld until simulation results have been submitted. The; purpose being to make this a blind challenge. Metrics for; assessment include the lines of code, computational cost,; the level of empiricism in model development, the accuracy; of system- and subsystem-level results, and the estimated; uncertainty on results. Through this challenge, we expect; to identify shortcomings in experimental data for; validation. Model verification and validation will instill; confidence in application of the ECLSS modeling and; simulation capabilities for space habitat design and; analysis.
