 
Last updated on July 20, 2021. This conference program is tentative and subject to change
Technical Program for Tuesday July 13, 2021

TuMi01 
Session room 1 
Identification for Control 
Regular Session 
Chair: Eschmann, Hannes  University of Stuttgart 
CoChair: Tacx, Paul  Eindhoven University of Technology 

15:3015:50, Paper TuMi01.1  
Model Order Selection in RobustControlRelevant System Identification 

Tacx, Paul  Eindhoven University of Technology 
de Rozario, Robin  Eindhoven University of Technology 
Oomen, Tom  Eindhoven University of Technology 
Keywords: Identification for Control, Frequency Domain Identification, Mechanical and Aerospace
Abstract: Robust control allows for guaranteed performance for a range of candidate models. The aim of this paper is to investigate the role of model complexity in the identification of model sets for robust control. A key point is that model quality and model complexity should be evaluated with respect to the control goal. Regularization using a worstcase control criterion in conjunction with a specific model uncertainty structure allows robust control of multivariable systems using accurate models with low complexity. Simulations confirm that the model order should be selected in view of the control objectives. Overall, the framework allows for systematic identification of model sets for robust control.


15:5016:10, Paper TuMi01.2  
Learning Models of Model Predictive Controllers Using Gradient Data 

Winqvist, Rebecka  KTH Royal Institute of Technology 
Venkitaraman, Arun  KTH Royal Institute of Technology 
Wahlberg, Bo  KTH Royal Institute of Technology 
Keywords: Identification for Control, Neural Networks, Datadriven Control
Abstract: This paper investigates the problem of controller identification given the data from a linear quadratic Model Predictive Controller (MPC) with constraints. We propose an approach for learning MPC that explicitly uses the gradient information in the training process. This is motivated by the observation that recent differentiable convex optimization MPC solvers can provide both the optimal feedback law from the state to control input as well as the corresponding gradient. As a proof of concept, we apply this approach to explicit MPC (eMPC), for which the feedback law is a piecewise affine function of the state, but the number of pieces grows rapidly with the state dimension. Controller identification can here be used to find an approximate low complexity functional approximation of the controller. The eMPC is modelled using a Neural Network (NN) with Rectified Linear Units (ReLUs), since such NNs can represent any piecewise affine function. A key motivation is to replace online solvers with neural networks to implement MPC and to simplify the evaluation of the function in larger input dimensions. We also study experimental design and model evaluation in this framework, and propose a hitandrun sampling algorithm for input design. The proposed algorithms are illustrated and numerically evaluated on a second order MPC problem.


16:1016:30, Paper TuMi01.3  
DataBased Model of an Omnidirectional Mobile Robot Using Gaussian Processes 

Eschmann, Hannes  University of Stuttgart 
Ebel, Henrik  University of Stuttgart 
Eberhard, Peter  University of Stuttgart 
Keywords: Identification for Control, Nonparametric Methods, Mechanical and Aerospace
Abstract: Mobile robots become increasingly important for many industrial and logistics applications. Especially omnidirectional mobile robots are interesting due to their flexibility as they are able to move in any direction regardless of their orientation. In this context, we developed a robot platform for research on said types of robot. It turns out that this robot shows interesting behavior, which simple first principle models commonly used in the field fail to reproduce. Additionally, different robots of the same platform show different behavior although they should be identical, necessitating adaptive modeling techniques. As the sources of the mismatches are unknown, we opt for nonparametric Gaussian process regression to train a model of our robots based on carefully selected inputoutput data, which shows promising results. With an accurate prediction of the robot's future position and orientation, it is possible to plan the trajectory of the robot several time steps ahead allowing for a good openloop performance. This can be useful, e.g., if in industrial applications not the entire warehouse is covered with optical position feedback. We then proceed to develop an optimizationbased ancillary controller, that drives the initially unknown system dynamics to the nominal one.


16:3016:50, Paper TuMi01.4  
Cooperative System Identification Via Correctional Learning 

Lourenco, Ines  KTH Royal Institute of Technology 
Mattila, Robert  KTH Royal Institute of Technology 
Rojas, Cristian R.  KTH Royal Institute of Technology 
Wahlberg, Bo  KTH Royal Institute of Technology 
Keywords: Parameter Estimation, Identification for Control, Bounded Error Identification
Abstract: We consider a cooperative system identification scenario in which an expert agent (teacher) knows a correct, or at least a good, model of the system and aims to assist a learneragent (student), but cannot directly transfer its knowledge to the student. For example, the teacher’s knowledge of the system might be abstract or the teacher and student might be employing different model classes, which renders the teacher’s parameters uninformative to the student. In this paper, we propose correctional learning as an approach to the above problem: suppose that in order to assist the student, the teacher can intercept the observations collected from the system and modify them to maximize the amount of information the student receives about the system. We formulate a general solution as an optimization problem, which for a multinomial system instantiates itself as an integer program. Furthermore, we obtain finitesample results on the improvement that the assistance from the teacher results in (as measured by the reduction in the variance of the estimator) for a binomial system. In numerical experiments, we illustrate the proposed algorithms and verify the theoretical results that have been derived in the paper.


16:5017:10, Paper TuMi01.5  
Identification of OutputError Models and an Iterative Optimization Algorithm to Size Fast Ancillary Services for Grid Frequency Control 

Rapizza, Marco Raffaele  Ricerca Sul Sistema Energetico  RSE S.p.A 
Canevese, Silvia  RSE S.p.A 
Keywords: Process Control, Identification for Control, Nonlinear System Identification
Abstract: The increasing displacement of conventional power generation with renewable generation, typically nonprogrammable and endowed with very small or even no rotating inertia, is being accompanied by an increase of the amplitude and speed of grid frequency fluctuations. New control actions are therefore being introduced by grid operators, in the form of fast ancillary services for frequency regulation. An iterative procedure, based on the GaussNewton approach, is proposed here to compute the needed quantities of two fast innovative controls, namely fast primary frequency control and synthetic inertia support. In particular, by means of the identification of an outputerror model, nonlinear behaviours are effectively considered in the computation: dead bands on the frequency measures feeding the controllers; for renewable power plants, downward modulation schemes; for conventional ones, limits on the available control power and limitations on the maximum gradient (time derivative) of the power. The approach is tested by means of simulations in a 2030 predicted scenario for the Sardinian power system.


17:1017:30, Paper TuMi01.6  
On the Identification of Social Cognitive Theory Models and ClosedLoop Intervention Simulations Using Hybrid Model Predictive Control 

Freigoun, Mohammad T.  Arizona State University 
Tsakalis, Kostas  Arizona State University 
Raupp, Gregory  Arizona State University 
Keywords: Grey Box Modelling, Datadriven Control, Identification for Control
Abstract: This paper presents closedloop intervention simulations for an identified, datavalidated model of Social Cognitive Theory (SCT). A reducedcomplexity SCT model structure consisting of dynamic operant conditioning and selfefficacy loops is considered for the prediction of physical activity behavior. Consistent with realworld requirements, including the need for hybrid decision rules policies, the proposed closedloop intervention design follows a Hybrid Model Predictive Control formulation. The prime goal of this paper is to reinforce the viability of the system identification and control engineering frameworks in the design of optimized and perpetually adaptive behavioral health interventions.


TuMi02 
Session room 2 
Dynamic Networks 
Regular Session 
Chair: Materassi, Donatello  University of Minnesota 
CoChair: Bazanella, Alexandre S.  Univ. Federal Do Rio Grande Do Sul 

15:3015:50, Paper TuMi02.1  
Exploiting Unmeasured Disturbance Signals in Identifiability of Linear Dynamic Networks with Partial Measurement and Partial Excitation 

Shi, Shengling  Eindhoven University of Technology 
Cheng, Xiaodong  Eindhoven University of Technology 
Van den Hof, Paul M.J.  Eindhoven University of Technology 
Keywords: Dynamic Network Identification, Identifiability
Abstract: Identifiability conditions for networks of transfer functions require a sufficient number of external excitation signals, which are typically measured reference signals. In this abstract, we introduce an equivalent network model structure to address the contribution of unmeasured noises to identifiability analysis in the setting with partial excitation and partial measurement. With this model structure, unmeasured disturbance signals can be exploited as excitation sources, which leads to less conservative identifiability conditions.


15:5016:10, Paper TuMi02.2  
Identifiability of Linear Dynamic Networks through Switching Modules 

Dreef, H.J. (Mannes)  Eindhoven University of Technology 
Donkers, M.C.F. (Tijs)  Eindhoven University of Technology 
Van den Hof, Paul M.J.  Eindhoven University of Technology 
Keywords: Dynamic Network Identification, Identifiability, Hybrid and Distributed System Identification
Abstract: Identifiability of linear dynamic networks typically depends on the presence and location of external (excitation or disturbance) signals, in relation to the topology of the parametrized network model set. For closedloop identification, it is known that switching (nonparameterized) controllers can also provide excitation, thereby rendering the model set identifiable. In this paper, we derive verifiable conditions for network identifiability of the nonswitching modules in presence of (nonparameterized) switching modules. These conditions generalize the classical result in closedloop identification towards network identification. Furthermore, verifiable pathbased conditions for identifiability in a generic sense are developed on the graph of the network model set.


16:1016:30, Paper TuMi02.3  
Optimal Allocation of Excitation and Measurement for Identification of Dynamic Networks 

Mapurunga, Eduardo  Universidade Federal Do Rio Grande Do Sul 
Bazanella, Alexandre S.  Univ. Federal Do Rio Grande Do Sul 
Keywords: Dynamic Network Identification, Experiment Design, Closed Loop Identification
Abstract: The problem of choosing the best allocation of excitations and measurements for the identification of a dynamic network is formally stated and analyzed. The best choice will be one that achieves the most accurate identification with the least costly experiment. Accuracy is assessed by the trace of the asymptotic covariance matrix of the parameters estimates, whereas the cost criterion is the number of excitations and measurements. Analytical and numerical results are presented for two classes of dynamic networks in state space form: branches and cycles. From these results, a number of guidelines for the choice emerge, which are based either on the topology of the network or on the relative magnitude of the modules being identified.


16:3016:50, Paper TuMi02.4  
An Efficient Network Reconstruction Method and Applications 

Dimovska, Mihaela  University of Minnesota 
Materassi, Donatello  University of Minnesota 
Keywords: Time Series, Blind Estimation, Other Applications
Abstract: Identifying the interconnections among modules in a dynamic network from observed data poses a significant challenge in many scientific disciplines. Many methods for network reconstruction from observational data significantly limit the type of systems they are considering. For example, Granger causality considers only networks with strictly causal dynamics, and methods from the graphical models literature are focused on reconstructing networks with static relationships. In this article, we focus on a novel network reconstruction method, called MixedDelay (MD) that can consistently reconstruct a wide class of linear dynamic networks that do not contain any algebraic loops. However, the steps in the MD algorithm are of combinatorial complexity. In this article, we propose an optimization to the MD method that yields the method more informative and polynomial for sparse networks, while preserving the theoretical guarantees of the method. We demonstrate the optimized MD method on simulated and real data. The first realdata application aims to reconstruct networks that show the spread of COVID19 in the US. Then we apply the method on monthly average temperature data and reconstruct temperature relationships among states in the US, as well as European and SouthEast Asian countries.


16:5017:10, Paper TuMi02.5  
Identifiability of Dynamic Networks from Structure 

Mapurunga, Eduardo  Universidade Federal Do Rio Grande Do Sul 
Bazanella, Alexandre S.  Univ. Federal Do Rio Grande Do Sul 
Keywords: Identifiability, Dynamic Network Identification
Abstract: In this paper we determine under which additional requirements a dynamic network is generically identifiable when some structures within it are known to be generically identifiable. We derive a set of necessary or sufficient conditions to determine generic identifiability of the whole network. The conditions take form as rank conditions of these specific structures and also in the topology of the network. Necessary and sufficient conditions for generic identifiability are given for classes of networks with parallel paths among the nodes. For the quite general case of networks whose graph is acyclic, we present necessary and sufficient conditions to determine whether a particular node needs to be excited and/or measured.


TuMi03 
Session room 3 
Fault Detection 1 
Regular Session 
Chair: McKelvey, Tomas  Chalmers University of Technology 
CoChair: Rampazzo, Mirco  Universita Degli Studi Di Padova 

15:3015:50, Paper TuMi03.1  
ModulationFunctionBased FiniteHorizon Sensor Fault Detection for SalientPole PMSM Using ParitySpace Residuals 

Jahn, Benjamin  TU Ilmenau 
Shardt, Yuri A.W.  Technical University of Ilmenau 
Keywords: Fault Detection and Diagnosis, Filtering and Smoothing, Automotive Systems
Abstract: An online modelbased fault detection and isolation method for salientpole permanent magnet synchronous motors over a finite horizon is proposed. The proposed approach combines parityspacebased residual generation and modulation functionbased filtering. Given the polynomial model equations, the unknown variables (i.e. the states, unmeasured inputs) are eliminated resulting in analytic redundancy relations used for residual generation. Furthermore, in order to avoid needing the derivatives of measured signals required by such analytic redundancy relations, a modulationfunctionbased evaluation is proposed. This results in a finitehorizon filtered version of the original residual. The fault detection and isolation method is demonstrated using simulation of various fault scenarios for a speed controlled salient motor showing the effectiveness of the presented approach.


15:5016:10, Paper TuMi03.2  
Elastic Shape Analysis for Anomaly Detection in Fabric Images 

Ferro, Fabiana Federica  University of Padova 
Rampazzo, Mirco  Universita Degli Studi Di Padova 
Beghi, Alessandro  Università Di Padova 
Keywords: Fault Detection and Diagnosis, Monitoring, Other Applications
Abstract: In this paper, the problem of quality control in the textile industrial field is addressed. Because of the general unavailability of labelled data from real production plants and the imbalanced nature of the problem, this task is faced with novelty detection methods that monitor the behaviour of the system and identify whether shifts from the nominal conditions arise. In particular, we utilize techniques from Elastic Shape Analysis to analyse the shapes created by the yarns intersections of the fabrics and to extract features used to define distance metrics that quantify the shapes variability. The proposed approach is applied to images of four different textiles, where only some defect free images are needed for the training phase. The results of this preliminary study confirm the effectiveness of the proposed approach.


16:1016:30, Paper TuMi03.3  
Hankel MatrixBased Mahalanobis Distance for Fault Detection Robust towards Changes in Process Noise Covariance 

Gres, Szymon  INRIA 
Döhler, Michael  Inria 
Mevel, Laurent  INRIA 
Keywords: Fault Detection and Diagnosis, Subspace Methods, Vibration and Modal Analysis
Abstract: Statistical subspacebased change detection residuals have been developed to infer a change in the eigenstructure of linear systems. Their statistical properties have been properly evaluated in the case of a known reference and constant noise properties. Previous residuals have favored the family of null spacebased approaches, whereas the possibility of using other metrics such as the Mahalanobis distance has been omitted. This paper investigates the development and study of such a norm under the premise of a varying noise covariance. Its statistical properties have been studied and tested on a numerical example of a mechanical system.


16:3016:50, Paper TuMi03.4  
A Multivariate Local Rational Modeling Approach for Detection of StructuralChanges in Test Vehicles 

McKelvey, Tomas  Chalmers University of Technology 
McKelvey, Daniel  Volvo Cars 
Nordberg, Patrik  Volvo Cars 
Keywords: Fault Detection and Diagnosis, Nonparametric Methods, Monitoring
Abstract: A data driven structural change detection method is described and evaluated where the data are acceleration and force measurements from a mechanical structure in the form of a vehicle. By grouping the measured signals as inputs and outputs an hypothesized MIMO linear dynamic relation between the inputs and outputs is assumed. It is assumed that baseline data are available to build statistical models for the estimated frequency function of the baseline system at selected frequencies. When new data is available, the monitoring algorithm reestimates the nonparametric frequency function and uses a test statistic based on the statistical distance to detect possible change. To generate the frequency function estimates a nonparametric MIMO frequency function estimator based on the local rational model (LRM) method is developed. A statistical analysis of the proposed test statistic shows that it has an Fdistribution for data from the baseline case. The method is evaluated on simulated data from a high fidelity full scale vehicle simulation generating both baseline data and data from a structurally changed vehicle. In the evaluation, the frequency response functions were estimated by the nonparametric LRM method, the parametric ARX estimate and the nonparametric ETFE. The results show that all three methods can detect the structural change while the LRM method is more robust with respect to the selection of the hyperparameters.


16:5017:10, Paper TuMi03.5  
Anomaly Detection Via Distributed Sensing: A VAR Modeling Approach 

Abbracciavento, Francesco  Politecnico Di Milano 
Formentin, Simone  Politecnico Di Milano 
Balocco, Jacopo  Tenaris Dalmine 
Rota, Andrea  Tenaris Dalmine 
Manzoni, Vincenzo  TenarisDalmine 
Savaresi, Sergio  Politecnico Di Milano 
Keywords: Fault Detection and Diagnosis, Time Series, Monitoring
Abstract: In modern manufacturing, each stage of industrial processes is accurately measured via multiple sensors and, consequently, a large amount of data is made available for analytics, monitoring and control purposes. A possible use of such data is to detect anomalies in order to prevent potential damages and hazards. In this paper, we will consider a sensor setup returning distributed time series measurements that can be used for failure identification. In particular, an anomaly detection strategy based on Vector Autoregressive (VAR) modeling for multivariate time series will be presented and analyzed in detail. The effectiveness of the proposed methodology will be assessed on experimental data from a real industrial case study.


17:1017:30, Paper TuMi03.6  
Adaptive Dynamic Predictive Monitoring Scheme Based on DLV Models 

Dong, Yining  City University of Hong Kong 
Qin, S. Joe  City University of Hong Kong 


TuMi04 
Session room 4 
Parameter Estimation 1 
Regular Session 
Chair: Zhu, Bin  Sun YatSen University 
CoChair: Ribeiro, Antonio H.  Universidade Federal De Minas Gerais 

15:3015:50, Paper TuMi04.1  
Beyond Occam's Razor in System Identification: DoubleDescent When Modeling Dynamics 

Ribeiro, Antonio H.  Universidade Federal De Minas Gerais 
Hendriks, Johannes  University of Newcastle 
Wills, Adrian  University of Newcastle 
Schön, Thomas Bo  Uppsala University 
Keywords: Parameter Estimation, Regularization and Kernel Methods, Machine Learning and Data Mining
Abstract: System identification aims to build models of dynamical systems from data. Traditionally, choosing the model requires the designer to balance between two goals of conflicting nature; the model must be rich enough to capture the system dynamics, but not so flexible that it learns spurious random effects from the dataset. It is typically observed that the model validation performance follows a Ushaped curve as the model complexity increases. Recent developments in machine learning and statistics, however, have observed situations where a ``doubledescent'' curve subsumes this Ushaped modelperformance curve. With a second decrease in performance occurring beyond the point where the model has reached the capacity of interpolatingi.e., (near) perfectly fittingthe training data. To the best of our knowledge, such phenomena have not been studied within the context of dynamic systems. The present paper aims to answer the question: ``Can such a phenomenon also be observed when estimating parameters of dynamic systems?'' We show that the answer is yes, verifying such behavior experimentally both for artificially generated and realworld datasets.


15:5016:10, Paper TuMi04.2  
Common Dynamic Estimation Via Structured LowRank Approximation with Multiple Rank Constraints 

Fazzi, Antonio  Vrije Universiteit Brussel 
Guglielmi, Nicola  Univ of L'Aquila 
Markovsky, Ivan  Vrije Universiteit Brussel 
Usevich, Konstantin  Université De Lorraine and CNRS 
Keywords: Parameter Estimation, Algorithms, Time Series
Abstract: We consider the problem of detecting the common dynamic among several observed signals. It has been shown in (Markovsky et al., 2019) that the problem is equivalent to a generalization of the classical Hankel lowrank approximation to the case of multiple rank constraints. We propose an optimization method based on the integration of ordinary differential equations describing a descent dynamic for a suitable functional to be minimized. We show how the proposed algorithm improves the numerical solutions computed by existing subspace methods which solve the same problem.


16:1016:30, Paper TuMi04.3  
Bayesian Frequency Estimation on Narrow Bands 

Picci, Giorgio  University of Padova 
Zhu, Bin  Sun YatSen University 
Keywords: Parameter Estimation, Bayesian Methods, Subspace Methods
Abstract: In some recent works, the authors have proposed and developed an Empirical Bayes framework for frequency estimation. The unknown frequencies in a noisy oscillatory signal are modeled as uniform random variables supported on narrow frequency bands. The bandwidth and the relative band centers are known as hyperparameters which can be efficiently estimated using techniques from subspace identification. In the current paper, we examine carefully how the estimated frequency prior can be used to produce a Bayesian estimate of the unknown frequencies based on the same data (for hyperparameter estimation). To this end, we formulate the Bayesian Maximum A Posteriori (MAP) optimization problem and propose an iterative algorithm to compute its solution. Then, we do extensive simulations under various parameter configurations, showing that the MAP estimate of the frequencies are asymptotically close to the band centers of the frequency priors. These results provide an attractive link between the conventional Bayesian method and the Empirical Bayes method for frequency estimation, and in retrospect justify the use of the latter.


16:3016:50, Paper TuMi04.4  
Recursive System Identification for ContinuousTime Fractional Order Systems 

Duhé, JeanFrançois  Université De Bordeaux, IMS, CNRS UMR 5218 
Victor, Stephane  Université De Bordeaux, IMS 
Melchior, Pierre  Université De Bordeaux  Bordeaux INP/ENSEIRBMATMECA 
Youssef, Abdelmoumen  IHU Liryc, Electrophysiology and Heart Modeling Institute, INSER 
Roubertie, François  IHU Liryc, Electrophysiology and Heart Modeling Institute, INSER 
Keywords: Recursive Identification, Parameter Estimation, Continuous Time System Estimation
Abstract: Fractionalorder calculus has already proven to be effective in order to model diffusive phenomena, such as heat transfer or anomalous mass transfer. This has led to developments of fractionalorder transfer function models and, as a consequence, identification algorithms have been developed to identify the parameters for this type of structures. However, it may be necessary to perform realtime system identification in which the parameters evolve over time while more and more data is acquired. Extensions to recursive identification algorithms are presented for fractionalorder transfer functions. Two methods are proposed for the recursive estimation of the coefficients of continuoustime fractional order systems: the recursive least squares with state variable filters and the Predictionerror method. These two methods are compared with different signal to noise ratio levels through Monte Carlo simulations.


16:5017:10, Paper TuMi04.5  
Adaptive Observer for Systems with Distributed Output Delay 

Lailler, Manon  Laboratoire d'Automatique De Caen 
Giri, Fouad  University of Caen Normandie 
AhmedAli, Tarek  Université De Caen Normandie 
Keywords: Parameter Estimation, Continuous Time System Estimation
Abstract: We are considering the problem of sampleddata observer design for nonlinear timevarying delay systems that are state and parameteraffine. The novelty is that the system is subject to both distributed delay and parameter uncertainty. A Kalmanlike observer is developed to deal with both state and parameter estimation. Its main components are: (i) a timevaryinggain stateestimator involving both output and parameter rate injections; (ii) a distributednature adaptive outputpredictor that compensate for delay and output sampling delay; (iii) an optimized parameterestimator that copes with parameter uncertainty, the optimization feature is intended in the sense that we make use of all available information, unlike previous estimators. The resulting observer is shown to be exponentially convergent, for small delays and sampling intervals, provided the input signal is sufficiently exciting. The analysis is performed using a LyapunovKrasovskii functional, Halanay’s lemma, Wirtinger’s inequality and other tools.


17:1017:30, Paper TuMi04.6  
Convergence Analysis of Weighted SPSABased Consensus Algorithm in Distributed Parameter Estimation Problem 

Sergeenko, Anna  IPME RAS 
Erofeeva, Victoria  Saint Petersburg State University 
Granichin, Oleg  Saint Petersburg State University 
Granichina, Olga  St. Petersburg State University 
Proskurnikov, Anton V.  Politecnico Di Torino 
Keywords: Parameter Estimation
Abstract: We study the distributed parameter estimation problem in largescale sensor networks. The goal of the sensors is to find the global estimate of an unknown parameter minimizing the aggregate cost via only local communication with their neighbors. A large number of sensors can estimate the unknown parameter more accurately than small sensor networks. However, the larger the network, the more problems it possesses. We impose the communication constraints to avoid network overload since the sensors may flood the communication channels during message exchange. The optimization problem is solved using the weighted SPSAbased consensus algorithm. Usually, each sensor estimates the unknown parameter based on noisy measurements. Most existing methods, however, assume that some statistical characteristics of the noise are known. The SPSAbased method allows us to relax this assumption. We assume that the noise is unknownbutbounded, which is more practically reasonable. In this paper, we provide the convergence analysis of the weighted SPSAbased consensus algorithm in stationary case and show its efficacy based on simulation.


TuMi05 
Session room 5 
Biological, Biomedical, and Biochemical Systems 
Regular Session 
Chair: Cinquemani, Eugenio  INRIA Grenoble  RhôneAlpes 
CoChair: Stigter, Johannes Daniel  Wageningen University 

15:3015:50, Paper TuMi05.1  
Identification of a Cell Population Model for Algae Growth Processes 

Atzori, Federico  Università Degli Studi Di Cagliari 
Jerono, Pascal  Chair of Automatic Control, Kiel University 
Schaum, Alexander  Kiel University 
Baratti, Roberto  Universita' Degli Studi Di Cagliari 
Tronci, Stefania  Università Degli Studi Di Cagliari 
Meurer, Thomas  ChristianAlbrechtsUniversity Kiel 
Keywords: Biological Systems, Process Control
Abstract: The growth process of a Chlamydomonas reinhardtii cell population is modelled with experimental data obtained in a batch reactor. To describe the growth process of this culture, the Droop model, extended by cell population balance model, is considered. On the basis of available measurements and the mathematical model, an optimization problem is defined in order to determine the kinetic parameter values for the growth functions of the Droop model and the cell division parameters of the cell population balance model.


15:5016:10, Paper TuMi05.2  
Computing Measures of Identifiability, Observability, and Controllability for a Dynamic System Model with the StrucID App 

Stigter, Johannes Daniel  Wageningen University 
Joubert, Dominique  Wageningen University & Research 
Keywords: Identifiability, Algorithms, Nonlinear System Identification
Abstract: Identifiability, observability, and controllability are important structural properties of a dynamic system model. Our interest lies in the detection of a lack of identifiability/observability and/or controllability through the computation and subsequent analysis of the exact nullspace of the gramian for nonlinear systems. For this analysis we have developed a userfriendly application with the name StrucID which runs in Matlab. The StrucID App requires as input a model definition in (possibly nonlinear) state space format. In addition, an output equation that may also be nonlinear is required. Through a rank test (SVD) on an associated sensitivity matrix, socalled signature graphs are produced. These represent a model's singular values and nullspace vectors and provide a visual summary. The results can now be used in a substantially reduced symbolic computation (not included yet in the current version of StrucID) that computes a Fliess series expansion of the output signal to arrive at the nullspace of an associated Jacobi matrix. Solving an underlying partial differential equation then completes the structural analysis and generates a reparametrisation and/or state transformation that allows for model reduction in an exact manner. A few examples will be presented.


16:1016:30, Paper TuMi05.3  
Parameter Identification of a Yeast Batch Cell Population Balance Model 

Jerono, Pascal  Chair of Automatic Control, Kiel University 
Schaum, Alexander  Kiel University 
Meurer, Thomas  ChristianAlbrechtsUniversity Kiel 
Keywords: Biological Systems, Process Control, Parameter Estimation
Abstract: The parameter identification problem of cell population balance models in a yeast batch process is addressed. The model is described by a partial integrodifferential equation coupled with a set of ordinary differential equations. Based on the solution equivalence of the mass balance model and the first moment of the cell population balance model, the identification process is carried out in two steps. The growth related parameters are identified by only taking mass balancebased measurements into account. The growth parameters are then utilized to identify the parameters related to cell division in the cell population balance model by means of optimization. The results are verified with an R2 analysis.


16:3016:50, Paper TuMi05.4  
Identification of Stochastic Gene Expression Models Over Lineage Trees 

Marguet, Aline  Inria Grenoble  RhôneAlpes 
Cinquemani, Eugenio  INRIA Grenoble  RhôneAlpes 
Keywords: Biological Systems, Parameter Estimation, Maximum Likelihood Methods
Abstract: In previous work, we have developed an autoregressive MixedEffects model of the evolution of the kinetic gene expression parameters along cell generations, and an identification method simultaneously exploiting singlecell gene expression profiles and known parental relationships among cells (lineage tree data). Here, we extend our modelling and identification approach to explicitly account for stochasticity of promoter activation, and demonstrate via simulation the performance of the method and the improvement relative to the original approach where this source of noise is not accounted for.


16:5017:10, Paper TuMi05.5  
Correcting Esophageal Pressure Measurements for Patients Undergoing Mechanical Ventilation 

Xia, Yu Hao  Instituto Tecnológico De Aeronáutica 
Victor, Marcus  Instituto Tecnologico De Aeronautica 
Keywords: Biomedical Systems, Grey Box Modelling, Parameter Estimation
Abstract: During invasive mechanical ventilation, knowledge of the patient's respiratory effort is valuable in guiding the clinical team to perform a personalized therapy. The same adjustment of the ventilator can produce excessive transpulmonary pressures for different patients, capable of generating or aggravating preexisting lung injuries. The measurement of transpulmonary pressure (the difference between airway and pleural pressures) is not easily performed in practice. Although airway pressure measurement is available on most current mechanical ventilators, pleural pressure measurement is indirectly performed using an esophageal balloon. In many cases, esophageal pressure reading takes other phenomena into account and is not a reliable measure of pleural pressure. This work will study system identification techniques to obtain reliable pleural pressures based on esophageal pressure readings, aiming to provide the clinical team with information about the patient's ventilatory therapy's real status. By estimating transfer function models, autoregressive with external input (ARX) and output error (OE) polynomial models, waveforms were adjusted in two different patients' occlusion maneuver data. Different metrics were used to assess the quality of the models obtained. The analysis results showed that the estimation methods used provided plausible representations of the underlying dynamic system. Therefore, there are indications that the system identification techniques presented in this work can be used in general, in a clinical environment, to provide reliable estimates of pleural pressure based on esophageal pressure measurements.


TuMi06 
Session room 6 
PhysicsInformed Learning for Dynamic Systems 
Invited Session 
Chair: Schoukens, Maarten  Eindhoven University of Technology 
CoChair: Cross, Elizabeth  The University of Sheffield 

15:3015:50, Paper TuMi06.1  
DataDriven System Identification of Thermal Systems Using Machine Learning (I) 

Nechita, StefanCristian  Eindhoven University of Technology 
Tóth, Roland  Eindhoven University of Technology 
Berkel, Koos  ASML 
Keywords: Machine Learning and Data Mining, Other Applications, Multivariable System Identification
Abstract: The paper addresses the identification of spatialtemporal mirror surface deformations as a result of laserbased heat load within the lithography process of integrated circuit production. The thermal diffusion and surface deformation are modeled by separation of the spatialtemporal effects using datadriven orthogonal decomposition. A novel tree adjoining grammar (TAG) and sparsity enhanced symbolicregressionbased learning methods are deployed to discover temporal dynamics that connect the spatial variation. The resulting datadriven procedure is applied to automatically synthetise a compact model representation of synthetic thermal effects induced mirror surface deformations.


15:5016:10, Paper TuMi06.2  
PhysicsDerived Covariance Functions for Machine Learning in Structural Dynamics (I) 

Cross, Elizabeth  The University of Sheffield 
Rogers, Timothy J.  The University of Sheffield 
Keywords: Grey Box Modelling, Bayesian Methods, Machine Learning and Data Mining
Abstract: This paper attempts to bridge the gap between standard engineering practice and machine learning when modelling stochastic processes. For a number of physical processes of interest, derivation of the (auto)covariance is achievable. This paper suggests their use as priors in a standard Gaussian process regression as a means of enhancing predictive capability in situations where they are reflective of the process of interest. A covariance function of a linear oscillator under random load is derived and used in a regression context to predict the displacements of a vibratory system. A simulation case study is used to demonstrate the enhancement over a standard Gaussian process regression model.


16:1016:30, Paper TuMi06.3  
Nonlinear Finite Impulse Response Estimation Using Regularized Neural Networks (I) 

RamírezChavarría, Roberto Giovanni  Universidad Nacional Autónoma De México 
Schoukens, Maarten  Eindhoven University of Technology 
Keywords: Nonlinear System Identification, Neural Networks
Abstract: This work presents a new regularization scheme for identifying nonlinear finite impulse response (NFIR) models using artificial neural networks (ANN). Prior knowledge, such as the exponentially decaying nature of an impulse response, is included during the identification using a regularization approach inspired on the wellknown regularized linear finite impulse response identification literature. More specifically the sensitivity of the modeled output with respect to the delayed input of the NFIR model is penalized to provide an exponentially decaying prior. The proposed method is illustrated and compared to other ANN regularization schemes on a simulation example.


16:3016:50, Paper TuMi06.4  
Statistical Finite Elements for PhysicsInformed Digital Twins (I) 

Girolami, Mark  University of Cambridge 
Febrianto, Eky Valentian  The Alan Turing Institute, University of Cambridge 
Cirak, Fehmi  University of Cambridge 
Keywords: Bayesian Methods, Machine Learning and Data Mining, Uncertainty Quantification
Abstract: The increased availability of observation data from engineering systems in operation poses the question of how to integrate this data into digital twins. To this end, we propose a novel statistical construction of the finite element method, dubbed as statFEM, which provides the means of synthesising measurement data and finite element models. The Bayesian statistical framework is adopted to treat all the uncertainties present in the data, the mathematical model and its finite element discretisation. From the outset, we postulate a statistical generating model which additively decomposes data into a finite element, a model misspecification and a noise component. Each of the components may be uncertain and is considered as a random variable with a respective prior probability density. The prior of the finite element component is given by a conventional stochastic forward problem. The prior probabilities of the model misspecification and measurement noise, without loss of generality, are assumed to have zeromean and known covariance structure. We use the Bayes rule to infer the posterior densities of the three random components and the hyperparameters from their known prior densities and a datadependent likelihood function. The posterior densities of the finite element component and the true system response are determined using the prior finite element density given by the forward problem and the data likelihood. Approximating the prior finite element density with a multivariate Gaussian distribution allows us to obtain a closedform expression for the posterior. We demonstrate the accuracy and versatility of statFEM with a onedimensional PoissonDirichlet example and illustrate its use in creating a physicsinformed digital twin of an operational railway bridge.


16:5017:10, Paper TuMi06.5  
SemiParametric Regression Based on Machine Learning Methods for UAS Stall Identification 

Guibert, Vincent  ENAC (French Civil Aviation School) 
Brunot, Mathieu  ONERA 
Bronz, Murat  ENAC 
Condomines, Jean Philippe  ENAC (French Civil Aviation School) 
Keywords: Nonlinear System Identification, Grey Box Modelling, Mechanical and Aerospace
Abstract: A semiparametric regression methodology is formulated to identify the unsteady lift characteristics of a small UAS undergoing dynamic stall. Based on the trailing edge separation model of Leishmann and Beddoes, the nonlinear evolution of the separation point is formulated so that it can be estimated by nonparametric Machine Learning methods. Validation of the methodology is presented with the identification of the lift coefficient based on quasisteady wind tunnel tests.


17:1017:30, Paper TuMi06.6  
A Novel Deep Neural Network Architecture for NonLinear System Identification 

Zancato, Luca  University of Padova 
Chiuso, Alessandro  University of Padova 
Keywords: Nonlinear System Identification, Neural Networks, Grey Box Modelling
Abstract: We present a novel Deep Neural Network (DNN) architecture for nonlinear system identification. We foster generalization by constraining DNN representational power. To do so, inspired by fading memory systems, we introduce inductive bias (on the architecture) and regularization (on the loss function). This architecture allows for automatic complexity selection based solely on available data, in this way the number of hyperparameters that must be chosen by the user is reduced. Exploiting the highly parallelizable DNN framework (based on Stochastic optimization methods) we successfully apply our method to large scale datasets.

 