Open access peer-reviewed chapter - ONLINE FIRST

A Type-2 Fuzzy State Observer Model for Non-Stationary Dynamic System Identification: An Incremental Learning Method with Noise Handling

Written By

Anderson Pablo Freitas Evangelista and Ginalber Luiz de Oliveira Serra

Submitted: 14 February 2024 Reviewed: 17 February 2024 Published: 22 May 2024

DOI: 10.5772/intechopen.1004751

Nonlinear Systems and Matrix Analysis - Recent Advances in theory and Applications IntechOpen
Nonlinear Systems and Matrix Analysis - Recent Advances in theory... Edited by Peter Chen

From the Edited Volume

Nonlinear Systems and Matrix Analysis - Recent Advances in theory and Applications [Working Title]

Dr. Peter Chen, Dr. Victor Eduardo Martinez-Luaces and Associate Prof. Muhammad Shahzad Nazir

Chapter metrics overview

12 Chapter Downloads

View Full Metrics

Abstract

Real-world identification involves dealing with challenges such as system complexity, noise, and uncertainties. In this context, a method for incremental learning is suggested, utilizing an evolving type-2 state observer fuzzy model. The process involves structure learning through an evolving type-2 multiscaling clustering approach, eliminating the need for data normalization. The estimation of linear state observer models for each rule is achieved using observer Markov parameters computed via a Type-2 Instrumental Variable (T2-IV) algorithm. For obtaining the instruments for the T2-IV algorithm, a recursive moving-average filter is used. Benchmark and online identification tasks are conducted to demonstrate the practicality and robustness of the proposed methodology, with performance comparisons against existing methodologies.

Keywords

  • type-2 fuzzy state-space modeling
  • incremental type-2 fuzzy learning
  • multidimensional learning approach
  • markov parameters
  • type-2 instrumental variables

1. Introduction

Machine learning-based identification system is a relevant approach for modeling nonlinear, uncertain, multivariable, and complex systems. This approach aims to estimate a model that represents accurately the dynamic behavior of a real plant [1]. In these terms, fuzzy identification arises as a relevant method for obtaining models which represent nonlinear systems. These techniques are shown a powerful tool in practical problems such as uncertainty, unpredictable dynamics, and noisy measurements. One reason is that fuzzy logic systems (FLS) have the ability to integrate information from different sources, such as physical laws, empirical models, or measurements [2]. For identification of problems with white noise signals, the classical fuzzy sets (type-1) present satisfactory results. However, when colored noise is considered, type-1 fuzzy sets are not able to mitigate the noise effects. In this case, type-2 fuzzy systems were proposed. The first mention of type-2 fuzzy sets as an extention of classical fuzzy sets was made by Zadeh [3], where theoretical concepts were addressed in the 1990s by Karnik [4]. In practical application, the interval type-2 fuzzy sets gained prominence in problems such as control [5] and modeling [6], as it presents less computational load. However, the development of methodologies for the experimental data analysis in order to obtain the rule-base for an interval type-2 fuzzy model in order to use the advantages of type-2 fuzzy sets described in the literature is still an open research field. In the literature, approaches such as heuristic methods [7] and incremental learning [8] have been used for this purpose. In Aissa Bencherif and Fatima Chouireb’s work [9], an incremental learning algorithm for type-2 recurrent Takagi-Sugeno neural-fuzzy network is proposed. For structure learning, the rule firing strength-based approach is used. For a new data, the type-2 firing strength is computed for each rule, where the rule with the highest firing strength is considered for creation rule mechanism. The parameter update is perfomed by gradient descent algorithm. The mobile robot trajectory tracking problem is used to show the applicability of the methodology. In [10], Morteza Montazeri-Gh and Shabnam Yazdani introduce the use of interval type-2 fuzzy logic systems for gas turbine fault diagnosis, aiming to reduce maintenance costs and downtime. Fuzzy Rule Base is estimated using Interval Type-2 Fuzzy C-Means clustering, and parameters of the IT2FLSs are optimized with a metaheuristic algorithm. The performance of the IT2FL-based FDI system is compared to other classification techniques, showing promising results in terms of online applicability, accuracy, and robustness.

In literature, linear models are commonly used in consequent part in Takagi-Sugeno models, such as vector auto-regressive and state-space models. The state-space models present an interesting feature: a compact formula that that shows the relationship between internal variables and the experimental data (output and input signals) [11]. In this context, methodologies based on fuzzy state-space models have been proposed [12, 13]. In Gil et al.’s work [14], a recurrent state-space neural-fuzzy network is introduced. For parameter adjustment of the antecedent/consequent parts, a recursive learning method based on the constrained unscented Kalman filter is employed. The applicability of this methodology is demonstrated through the online identification of a three-tank system. In Yancho et al.’s work [15], a fuzzy state-space model predictive control approach is proposed. The learning algorithm is founded on gradient descent, which is used to fit the modeling structure parameters. The trained model is subsequently applied in model-based predictive control. The applicability of this methodology is demonstrated through computational experiments.

In identification problems, efficiency in mitigating the effects of noise to adjust the consequent parameters must be ensured. In a noisy environment, the Instrumental Variable (IV) method is considered a relevant tool for system modeling [11]. When compared to other identification methods, it is noted that, in the IV method, the requirement for an accurate noise model is not essential [16]. According to literature, the accuracy of the IV method relies on the selection of an appropriate instrument, which must guarantee non-polarized estimation [11]. The fuzzy version of the IV method was introduced by Yancho. Therefore, with the aim of integrating the type-2 state-space fuzzy modeling and non-polarized consequent estimation, in this paper, an incremental learning for evolving interval type-2 state observer fuzzy model based on instrumental variables approach is proposed. For estimating the consequent-part, fuzzy observer Markov parameters are computed via type-2 fuzzy version of instrumental variable (T2-IV) identification algorithm. The observer Markov parameters are then used to compute the local system states at the current instant, which are subsequently used to compute the matrices of the local linear state observer model.

1.1 Contributions

The proposed methodology presents the following main contributions:

  • Proposal of an evolving interval type-2 fuzzy state observer modeling approach with non-polarizing consequent estimation.

  • Proposal for a novel composition of type-2 fuzzy rules for estimating an uncertain region. The adjustment of the uncertain region is accomplished through a proportional-integral-based adaptation rule.

  • Structure learning based on the multiscale approach, where the data normalization is not required in clustering algorithm.

  • Novel state-space online nonlinear identification based on interval type-2 fuzzy observer Markov parameters.

Advertisement

2. Overview of interval type-2 state observer fuzzy model

The proposed methodology is based on an evolving interval type-2 state observer fuzzy model (eIT2-SOFM), where its rules can be described as follows:

Rulei:IFz1,kisZ˜1iANDANDznz,kisZ˜nziTHENxk+1i=Aixki+Biuk+Kiekyki=Cixki+DiukE1

where i = 1, 2…, c represents the rule number, and z1,k,z2,k,,znz,k correspond to the antecedent input variables, where nz is the number of antecedent variables. Additionally, Ain×n, Bin×m, Cip×n, Dip×m, and Kin×p represent the state-space matrices of the local linear model for each rule. The local state vector for the i-th rule is denoted as xki=x1,kix2,kixn,kin, and the local output vector is yki=y1,kiy2,kiyp,kip. The input signal vector is represented by uk=u1ku2,kum,km, and ekp is the error vector given by

ek=ykŷkE2

where ŷk is the type-0 eIT2-SOFM output estimation in the eIT2-SOFM. An interval type-2 Gaussian membership function is adopted, represented as μ˜ji=μ¯jiμ¯ji, with uncertain dispersion denoted as σ˜=σ¯iσ¯i, described by

μ¯jizj,k=exp12zji,zjσ¯ji2E3
μ¯jizj,k=exp12zji,zjσ¯ji2E4

where μ¯ji and μ¯ji are the upper and lower membership functions, respectively, σ¯ji is the upper dispersion, σ¯ji is the lower dispersion, and zji, is the center of i-th cluster and j-th input axis. The proposed eIT2-SOFM adopts interval output estimation y˜k=y¯ky¯k as the output model. To compute the eIT2-SOFM output, first, the interval firing strength f¯kif¯ki is computed as follows:

f¯ki=j=1nzμ¯jizj,kE5
f¯ki=j=1nzμ¯jizj,kE6

and from interval firing strength, the upper and lower normalized firing strength γ¯kiγ¯ki is computed as follows:

γ¯ki=f¯kij=1ckf¯kjE7
γ¯ki=f¯kij=1ckf¯kjE8

and ykrykl is computed as follows:

ykr=i=1ckγ¯ikykiE9
ykl=i=1ckγi¯kykiE10

Thus, in the function of ykrykl, the upper and lower outputs are computed using the following equations:

y¯k=maxykrykl+ẏkE11
y¯k=minykryklẏkE12

where ẏk is the adaptive output degree of uncertainty, which is adjusted based on the digital PI control algorithm, given by

ẏk=ẏkfffory¯kykfy¯kẏk+gpek+gij=kwkekotherwiseE13

such that

ek=yky¯k+y¯k2E14

where 1ff0.90 is a adjustment factor, gp and gi are the proportional gain and integral gain, respectively, w is the window size, and ykf is the filtered output in instant k computed in the filtering process (Section 3). The proposed incremental learning is performed by the following steps: 1) filtering process, 2) structure learning via evolving method, and 3) submodels updating via type-2 state observer fuzzy identification. In Figure 1, the block diagram of the proposed methodology is shown, where ykr is the corrupted output data in instant k. In the next sections, the mathematical formulation of each step is presented.

Figure 1.

Block diagram of the proposed methodology. From the dynamic system, output ykr and input uk data are obtained and filtered. For the evolving process, the antecedent input vector zk is generated from the filtered input and/or output, that is, zk=yk1fyklfuk1fjklf. From vector zk, the evolving mechanism (creation, type-2 adaptation and merging) performs the structure learning, which chances the number of rules in each incoming data. In the sequel, the submodel of each rule is updated by a type-2 fuzzy state observer identification algorithm.

Advertisement

3. Filtering process

Consider a dynamic system where its experimental data are corrupted by correlated noise. For a data-driven learning algorithm, the noise in the database is a problem, once inconsistent cluster (fuzzy partition) and polarized submodel parameter can be computed. Therefore, in the proposed methodology, a filtering process is performed in order to compute data highly correlated with system dynamic and independent of noise. In this step, a recursive moving-average filter are used, where

ykf=1af4ykr+4afyk1f6af2yk2f+4af3yk3faf4yk4fE15

where af01 is the filtering coefficient chosen by the user. For input data, the filtering process is similar, as follows:

ukf=1af4ukr+4afuk1f6af2uk2f+4af3uk3faf4uk4fE16

From ykf and ukf, the vector zk is generated, which is used in structure learning, and the regressor vector δk, which is used for consequent estimation.

Advertisement

4. Structure learning via evolving type-2 fuzzy clustering method

The structure of the eIT2-SOFM is updated with each new incoming dataset, and the adopted learning method does not necessitate prior knowledge. In other words, the rule base initializes with zero rules. The structure learning relies on an evolving type-2 fuzzy clustering (eT2FC), which is employed to create a fuzzy partition in the input variable space. This clustering method projects an interval type-2 fuzzy set onto each input space axis, characterized by interval type-2 Gaussian membership functions with uncertain dispersion. The eT2FC algorithm is based on a multidimensional scaling approach, eliminating the need for data normalization and providing improved handling of non-stationary problems [17].

Initially, for instant k = 1 and the number of rules ck=0, the antecedent input vector zk=z1,kz2,kznz,knz becomes the center of the first cluster, with an initial type-1 dispersion σ0 defined by the user. The dispersions σ¯ji and σ¯ji are computed as a function of σi as follows:

σ¯ji=σ+ζσE17
σ¯ji=σζσE18

For k>1, the interval type-2 membership values μ˜ji=μ¯jiμ¯ji are computed using Eqs. (3) and (4), and the interval firing strengths f¯kif¯ki are calculated using Eqs. (5) and (6). The mean between f¯i and f¯i is computed by

fki=f¯ki+f¯ki2E19

and it is used for the cluster creation (rule creation) mechanism, which described in the sequel.

4.1 Cluster creation rule

To determine the necessity of creating a new cluster, initially, examine the cluster χ with the highest membership value, that is,

χ=argmaxi1ckfkiE20

Therefore, the condition for rule creation is defined as follows:

IFfkχ<TfTHENzck+1=zkE21

where Tf represents the firing strength threshold. When the condition for rule creation is satisfied, the vector zk becomes the center of a new cluster (cluster ck+1). The type-1 dispersion for the new cluster is determined by

σjck+1=αzj,kzj,kε,E22

where dispersion σ¯ji and σ¯ji are computed by Eqs. (17) and (18), respectively.

4.2 Merging mechanism

Once the creation rule (21) is satisfied, the merging condition is checked. This mechanism verifies if the new membership function μ˜jck+1 is redundant. First, it determines the closest membership function to μ˜jck+1, i.e.,

ε=argmaxi1ckexp12zji,zjσji2E23

where ick+1 and ε is the index of the closest membership function. Therefore, for the membership functions ck+1 and ε along the j-th axis, the similarity degree is verified as follows:

Szjck+1,zjε,=maxμjck+1zjε,μjεzjck+1,E24

where μjck+1zjχ, and μjχzjck+1, are computed as follows:

μjck+1zjε,=exp12zjε,zjck+1,σjε2E25
μjεzjck+1,=exp12zjck+1,zjε,σjck+12E26

From a upper threshold Tu and lower threshold Tl defined by user, the following conditions are verified:

  1. If S>Tu, the new membership function is replaced by μjck+1zjε,.

  2. If Tl<S<Tu, the two membership function must be merged.

  3. If S<Tl, The new membership function is maintained

If condition 2 is satisfied, the following equations are used for computing the new center and new dispersion

znew=zjck+1+Npizji1+NpiE27
σnew=σjck+1+σjiπE28

where Npi is the number of points (z) associated with the cluster i.

4.3 Cluster adaptation mechanism

In the antecedent parameters adaptation, the approach adopted is to update the cluster center with the highest membership value when the new cluster condition is not satisfied. Thus, the updating of the center zχ, is given by

Δz=zj,kχ,NpχNpχ+1+zj,kNpχ+1E29
zj,k+1χ,=zj,kχ,+ρΔzzj,kχ,E30

where ρ is a learning rate defined by user and Δz is the center adjustment.

Advertisement

5. Submodels updating via IV-based type-2 fuzzy state observer identification

The state-space equations are regarded as the consequent part in the proposed eIT2-SOFM. The estimation of the matrices Ai,Bi,Ci,Di, and Ki is based on the fuzzy observer Markov parameters, where its mathematical foundations for the type-1 version are detailed in the works of [13, 18, 19]. This paper presents a type-2 state-space fuzzy modeling approach that utilizes the observer Markov parameters estimated through the IV fuzzy method. The subspace approach is employed to estimate the matrices Ai,Bi,Ci,Di, and Ki from the observer Markov parameters of each rule.

5.1 Mathematical definition of type-2 fuzzy observer markov parameters

Considering a vector auto-regressive model to estimate the local state-space model, as follows:

yki=j=0qpΞ̇kji,uukj+j=1qpΞ̇kji,yykjiE31

According to [20], if the local state-space model is asymptotically stable, the matrices Ξ̇kji,u and Ξ̇kji,y in Eq. (31) are the observer Markov parameters of i-th local state-space model, being

Ξ̇kji,u=Diifj=0CiAij1Biifj>0E32
Ξ̇kji,y=CiAij1KiE33

where Kin×p is the local observer matrix [13]. Thus, the matrix composed by the observer Markov parameters matrix is given by

Ξ̇i=Ξ̇kqpi,uΞ̇ki,uΞ̇kqpi,yΞ̇k1i,yE34

and Eq. (31) is rewritten in matrix form as follows:

ykiT=δkiTΞ̇iT+ξkE35

with δkiT=ukqpTukTykqpiT, such that

ukqp=ukqpukqp+1uk1ykqpi=ykqpiykqp1iyk1iE36

Assuming k samples, where qp is the past time-window and k>qp, from Eq. (35), the following batch equation is derived:

Yki=ΔkiΞ̇iTE37

where

Yki=yqp+1iTyqp+2iTykiT,Δki=δqp+1iTδqp+2iTδkiTE38

Thus, considering the TSK fuzzy theory, the batch computation fuzzy model output history is given by

Yk=i=1cΓ˜kiΔkiΞ̇iTE39

where Γ˜ki=diagγqp+1iγ˜qp+2iγ˜ki, so that γ˜qp+1i is type-2 normalized firing strength computed by

γ˜ki=f¯ki+f¯kij=1ckf¯kj+f¯kjE40

Thus, from the batch estimation approach, the outputs from instant qp to k can be computed by:

Γ˜kiYk=Γ˜kiΔkΞ̇iTE41

where

Yk=yqp+1Tyq+2TykTE42

5.2 Fuzzy observer markov parameters estimation via IV approach

Assuming experimental data are corrupted by correlated noise, the vector δk presents noisy data, that is,

δkr=δki+υkE43

where υk is the correlated noise vector related to δk.

According to literature [21, 22], from an instrument vector δkfT, which is highly correlated with output and/or input data and not correlated with the noise, the following solution for Ξ̇i, from Eq. (41), is derived:

Ξ̇iT=ΔkfΓ˜kiΔkr1ΔkfΓ˜kiYkfE44

where Δkfkqp1×qpm+p+m is the batch instruments matrix. Extended the recursive type-1 fuzzy IV algorithm presented in [21, 22] for the type-2 case, the updation of the interval type-2 fuzzy observer Markov parameters is performed by following equations:

Lk+1i=γ˜kiPkiδkfγ˜ki+δkrTPkiδkrE45
Ξ̇k+1i=Ξ̇ki+γ˜kiekLk+1iE46
Pk+1i=1βILk+1iδkrTPkiE47

where 1β0.9 is the forgetting factor, L is the IV gain matrix, and P is the IV variance matrix.

5.3 Computation of space state matrices

According to [23, 24], the local state vector xki can be computed by the following close-formula:

xki=SΛkiu¯kqpf+ϒkiy¯kqpfE48

where Sn×mfn is a positive-defined matrix, and Λki and ϒki are formed by the observer Markov parameters, such that

Λki=Ξ̇kqi,uΞ̇kqp+1i,uΞ̇kqp+qf1i,uΞ̇k1i,u0Ξ̇kqpi,uΞ̇kqp+qf2i,uΞ̇k2i,u00Ξ̇kqpi,uΞ̇kqfi,uE49

and

ϒki=Ξ̇kqi,yΞ̇kqp+1i,yΞ̇kqp+qf1i,yΞ̇k1i,y0Ξ̇kqpi,yΞ̇kqp+qf2i,yΞ̇k2i,y00Ξ̇kqpi,yΞ̇kqfi,yE50

Once the local state vectors xki are computed, the fuzzy state vector x˜k is obtained as follows:

x˜k=i=1ckγ˜kixkiE51

From Eq. (51), the matrices AkiBkiKki can be estimated using the QR solution. Thus, the state equation is formulated as follows:

xkiT=xk1iTuk1Tek1TAkiTBkiTKkiT=νk1x,iTΘki,xTE52

Let the least square solution of Eq. (52), given by:

Θki,xT=VkΓ˜kiVk1VkΓ˜kiXkE53
Θki,xT=(PkΘxiνν)1PkΘxiνyfE54

where

Xk=xkqpTxkqp+1TxkTE55

Rewritten Eq. (53), it has

PkΘxiννΘi,xT=PkΘxiνyfE56

where the following recursion is derived:

PkΘxiνν=Pk1Θxiνν+γ˜kiνk1νk1x,iTE57
PkΘxiνy=Pk1Θxiνy+γ˜kiνk1x,iyk1fTE58

Thus, by applying QR factorization to PΘxikνν, it has

RΘi,xT=QTPkΘxiνyfE59

The matrix Θi,x is computed through the backward substitution method in Eq. (59) [21]. To compute the CkiDki matrices, the output equation can be formulated as follows:

ykiT=xkiTukTCkiTDkiT=νk1y,iTΘki,yTE60

Using the same steps for computing Θki,xT, it has

PkΘyiννΘi,yT=PkΘyiνyfE61

such that

PkΘyiνν=Pk1Θyiνν+γ˜kiνk1y,iνk1y,iTE62
PkΘyiνy=Pk1Θyiνy+γ˜kiνk1y,iyk1fTE63

where Θki,y can be computed by applying QR factorization to PΘyikνν, such that

RΘi,yT=QTPkΘyiνyfE64

followed by backward substitution applied in Eq. (64).

Advertisement

6. Computational results

Considering the mathematical formulation of the proposed algorithm described in Sections 4 and 5, two case studies are presented: the identification of a SISO nonlinear system and online identification of a time-varying MIMO dynamic system. To validate the results, the following metrics were used:

  • Non-dimensional error index (NDEI):

    NDEI=1Nk=1Ne˜r,k2stdyE65

    where std is the standard deviation.

  • Variance accounted for (VAF%):

    VAF%=1e˜rvary×100E66

    where var is the variance.

    where e˜k is the confidence region error for interval type-2 estimation, which is described as follows:

e˜k=0ify¯k<yk<y¯̂kyky¯̂kife¯k<e¯kyky¯kotherwiseE67

such that

e¯k=ykŷ¯k,e¯k=ykŷ¯kE68

6.1 Nonlinear dynamic system

The identification problem under consideration is a SISO nonlinear dynamic system, commonly utilized as a benchmark in the type-2 fuzzy modeling literature. It is described by the following equation:

yk=yk1yk2yk1+0.51+yk12+yk22+uk1E69

where the input signal is given by uk=sin225. For the identification process, a dataset consisting of 1300 samples was generated. Among these samples, 1000 were allocated for the training step, while 300 were used for the validation step. The algorithm parameters were configured with the following values: af=0; Tf=0.002; Tu=0.7; Tl=0.5; qp=11; qf=6; n=2; w=5; gp=102; ff=0.99; and gi=103. The rule structure adopted in this experiment is

Rulei:IFz1,kisZ˜1iANDz2,kisZ˜2iTHENxk+1i=Aixki+Biuk+Kiekyki=Cixki+DiukE70

where z1,k=uk and z2,k=yk.

For comparative analysis, the models eTS [25], xTS (cited in [26]), DENFIS [27], eTF [28], eMG [29], and RIV-NFM [22] are considered. The performances, as assessed by the NDEI metric, are presented in Table 1. Figure 2 illustrates the uncertain region estimated by eIT2-SOFM for the validation dataset.

ModelRulesNDEI
eTS [25]70.1038
xTS cited in [26]70.0936
DENFIS [27]70.0842
eFT [28]70.0653
eMG [29]70.0501
RIV-NFM [22]60.0413
Proposed30.0203

Table 1.

Comparative analysis of the proposed methodology with other relevant methodologies for the nonlinear dynamic system problem.

Figure 2.

Uncertain region estimation for nonlinear dynamic system identification.

6.2 Time-varying MIMO dynamic system

A time-varying nonlinear MIMO dynamic system is considered to demonstrate the adaptability of the proposed methodology for time-varying dynamic systems. The nonlinear MIMO dynamic system is described by the following equations:

vk=v1,k+1=v1,k1v1,k2+1+1v2,k2+5+u1,k3v2,k+1=0.1v2,kv1,k10.2v2,ku2,kE71
yk=GkvkE72

where

Gk=1112fork<14003215otherwiseE73

and uk=u1,ku2,kT, where u1,k is a multistep signal with a uniform distribution between [−2, 2], u2,k is a multistep signal with a uniform distribution between [−1 1], and vk=v1,kv2,kT represents the vector of intermediate signals. The outputs signals were corrupted by correlated noises, which are given by

νky1=1+0.2z11+0.6z1+0.2z2ekE74
νky2=1+0.2z11+0.3z1+0.1z2ekE75

where ek represents white noise with a mean of zero and a variance of σe2. The dataset comprises 2800 samples, with 500 used for initializing the eIT2-SOFM and 2400 samples used for online identification.

The algorithm parameters were set to the following values: af=0.9; Tf=0.001; Tu=0.7; Tl=0.5; qp=12; qf=7; n=4; w=1; gp=5×103; ff=0.985; and gi=3×105. The rule structure adopted in this experiment is

Rulei:IFz1,kisZ˜1iANDz2,kisZ˜2iANDz3,kisZ˜3iANDz4,kisZ˜4iTHENxk+1i=Aixki+Biuk+Kiekyki=Cixki+DiukE76

where z1,k=u1,k1, z2,k=u2,k1, z3,k=y1,k1, and z4,k=y2,k1.

In this case, the Monte Carlo method was employed, involving 50 experiment realizations to compute the means of the VAF% and NDEI criteria. The interval estimations of y1 and y2 according to the SNR variation, are shown in Table 2. The online estimations of the time-varying nonlinear MIMO dynamic system outputs, are shown in Figure 3, with an SNR of 10 dB.

VAF% (±stda)NDEI
SNRy1y2y1y2
1095.83 (±1.34%)95.10 (±1.91%)0.2100.202
1596.34 (±0.86%)95.61 (±0.92%)0.2020.191
2096.62 (±0.57%)95.80 (±0.58%)0.1930.188
2597.01 (±0.41%)95.93 (±0.53%)0.1860.181
3097.27 (±0.23%)96.16 (±0.44%)0.1790.169

Table 2.

Estimation performance of the proposed methodology for different levels of noise for VAF and NDEI metrics in time-varying nolinear MIMO dynamic system modeling.

astd: standard deviation.

Figure 3.

Upper and lower estimation of time-varying nonlinear MIMO dynamic system: (a) y1 and b) y2. The SNR for this experiment was 10 dB. It is noted that the estimation accuracy of the proposed methodology even in noise environments. The purple region was estimated by the eIT2-SOFM based on the experimental data.

Advertisement

7. Discussions

In this paper, aspects of the proposed methodology were presented. The application of eIT2-SOFM for the nonlinear identification of SISO and MIMO dynamic systems was discussed. In Section 6.1, a modeling benchmark problem was used to compare the performance of eIT2-SOFM with other methodologies presented in the literature. Upon reviewing Table 1, it becomes evident that significantly improved results are achieved by the proposed methodology. Additionally, it is noteworthy that only three rules were created by eIT2-SOFM during the identification process, making it the model with the fewest number of rules among the compared methodologies. This result highlights the methodology’s ability to track the nonlinear behavior of dynamic systems.

In Section 6.2, a case study involving a nonlinear MIMO system was presented to demonstrate the tracking capabilities of the proposed methodology in dealing with time-varying problems. The performance results, as shown in Table 2, indicate that the eIT2-SOFM achieved a performance exceeding 95% for each SNR value. This underlines the adaptability of the proposed learning algorithm, even in the presence of correlated noise within the dataset.

Advertisement

8. Conclusions

Considering the experimental results and the methodological aspects of the proposed modeling approach based on eIT2-SOFM, the following concluding remarks are made:

  • The proposed method demonstrates robustness to outliers and noise through the incorporation of a filtering process, type-2 fuzzy sets, and the T2-IV algorithm. The filtering process precedes the structure learning step to prevent the creation of nonrelevant rules, while the T2-IV algorithm provides a nonpolarized estimation of the local state observer model parameters.

  • Numerical robustness is ensured, as the QR-decomposition is applied to compute the local state observer models.

  • The computational results have demonstrated that the proposed methodology is effective for modeling complex dynamic systems characterized by uncertainty, nonlinearity, and both single and multivariable aspects, even in the presence of colored noise.

Among practical projects and problems that can be solved by the algorithm, the following has been widely considered for research:

  • Black-box model-based control, where the plant presents nonlinearity, uncertain behavior, and correlated noise, as satellite positioning [30], multimobile manipulator, and induction motor.

  • Computational modeling of experimental data, where the data are nonlinear, uncertain, and/or corrupted by correlated noise, such as parameter estimation of vehicle dynamics, mechatronic systems, mobile robot navigation, and nonstationary processes [31].

References

  1. 1. Serra G, Bottura C. An IV-QR algorithm for neuro-fuzzy multivariable online identification. IEEE Transactions on Fuzzy Systems. 2007;15(2):200-210
  2. 2. Babuska R. Fuzzy Modeling for Control. Netherlands: Springer; 2012
  3. 3. Zadeh LA. The concept of a linguistic variable and its application to approximate reasoning. Information Sciences. 1975;8x:199-249
  4. 4. Karnik NN, Mendel JM, Liang Q. Type-2 fuzzy logic systems. IEEE Transactions on Fuzzy Systems. 1999;7(6):643-658
  5. 5. Zhang D, Zhang L, Yu Z, Shu L, Swain AK. A sum-based discrete event-triggered dynamic output feedback control for interval type-2 fuzzy systems. ISA Transactions. Oct 2022;129(Pt A):44-55. DOI: 10.1016/j.isatra.2021.12.031. Epub 2021 December 28. PMID: 35016801
  6. 6. Zhao Z, Li J. Identification of continuous stirred tank reactor based on PCA-interval type-2 fuzzy logic system method. Procedia Computer Science. 2021;183:230-236
  7. 7. Antonelli M, Bernardo D, Hagras H, Marcelloni F. Multiobjective evolutionary optimization of type-2 fuzzy rule-based systems for financial data classification. IEEE Transactions on Fuzzy Systems. 2017;25(2):249-264
  8. 8. Luo C, Tan C, Wang X, Zheng Y. An evolving recurrent interval type-2 intuitionistic fuzzy neural network for online learning and time series prediction. Applied Soft Computing. 2019;78:150-163
  9. 9. Bencherif A, Chouireb F. A recurrent TSK interval type-2 fuzzy neural networks control with online structure and parameter learning for mobile robot trajectory tracking. Applied Intelligence. 2019;49(11):3881-3893
  10. 10. Montazeri-Gh M, Yazdani S. Application of interval type-2 fuzzy logic systems to gas turbine fault diagnosis. Applied Soft Computing. 2020;96:106703
  11. 11. Ljung L. System Identification: Theory for the User. 2nd ed. Upper Saddle River: Prentice Hall PTR; 1999
  12. 12. Han D. A study on application of fuzzy adaptive unscented Kalman filter to nonlinear turbojet engine control. International Journal of Aeronautical and Space Sciences. 2018;19(2):399-410
  13. 13. Torres LMM, Serra GLO. State-space recursive fuzzy modeling approach based on evolving data clustering. Journal of Control, Automation and Electrical Systems. 2018;29(4):426-440
  14. 14. Gil P, Oliveira T, Brito Palma L. Online non-affine nonlinear system identification based on state-space neuro-fuzzy models. Soft Computing. 2018;23(16):7425-7438
  15. 15. Todorov YV, Terziyska MN, Petrov MG. NEO-fuzzy state-space predictive control. IFAC-PapersOnLine. 2015;48(24):99-104
  16. 16. Soderstrom T, Stoica P. Instrumental variable methods for system identification. Circuits, Systems, and Signal Processing. 2002;21(1):1-9
  17. 17. Ashrafi M, Prasad DK, Quek C. IT2-GSETSK: An evolving interval type-II TSK fuzzy neural system for online modeling of noisy data. Neurocomputing. 2020;407:1-11
  18. 18. Pires DS, De Oliveira Serra GL. Nonlinear dynamic system identification based on fuzzy Kalman filter. In: 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE); Vancouver, BC, Canada. 2016. pp. 17-23. DOI: 10.1109/FUZZ-IEEE.2016.7737662
  19. 19. Pires D, Serra G. An approach for fuzzy Kalman filter modeling based on evolving clustering of experimental data. Journal of Intelligent & Fuzzy Systems. 2018;35(2):1819-1834
  20. 20. Chiuso A, Picci G. Consistency analysis of some closed-loop subspace identification methods. Automatica. 2005;41(3):377-391
  21. 21. Serra GLO, Bottura CP. Fuzzy instrumental variable approach for nonlinear discrete-time systems identification in a noisy environment. Fuzzy Sets and Systems. 2009;160(4):500-520
  22. 22. Filho ODR, Serra GLO. Recursive fuzzy instrumental variable based evolving neuro-fuzzy identification for non-stationary dynamic system in a noisy environment. Fuzzy Sets and Systems. 2018;338:50-89
  23. 23. Ni Z, Liu J, Wu Z, Shen X. Identification of the state-space model and payload mass parameter of a flexible space manipulator using a recursive subspace tracking method. Chinese Journal of Aeronautics. 2019;32(2):513-530. DOI: 10.1016/j.cja.2018.05.005. ISSN 1000-9361
  24. 24. Ni Z, Liu J, Wu Z. Identification of the time-varying modal parameters of a spacecraft with flexible appendages using a recursive predictor-based subspace identification algorithm. Proceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering. 2019;233(6):2032-2050. DOI: 10.1177/0954410018770560
  25. 25. Angelov P, Filev D. Simpl_eTS: A simplified method for learning evolving Takagi-Sugeno fuzzy models. In: Proceedings of the 2005 IEEE International Conference on Fuzzy Systems FUZZ-IEEE – 2005. Reno; 2005. pp. 1068-1073
  26. 26. Angelov P, Zhou X. Evolving fuzzy systems from data streams in real-time. In: 2006 International Symposium on Evolving Fuzzy Systems. IEEE; 2006
  27. 27. Kasabov NK, Song Q. DENFIS: Dynamic evolving neural-fuzzy inference system and its application for time-series prediction. IEEE Transactions on Fuzzy Systems. 2002;10(2):144-154
  28. 28. Angelov P, Lughofer E, Klement EP. Two approaches to data-driven design of evolving fuzzy systems: eTS and FLEXFIS. In: NAFIPS 2005 – 2005 Annual Meeting of the North American Fuzzy Information Processing Society. IEEE; 2005
  29. 29. Lemos A, Caminhas W, Gomide F. Multivariable gaussian evolving fuzzy modeling system. IEEE Transactions on Fuzzy Systems. 2011;19(1):91-104
  30. 30. Juang J-N, Phan MQ. Identification and Control of Mechanical Systems. Cambridge, UK: Cambridge University Press; 2001. 334 p
  31. 31. de Oliveira Serra GL. Kalman Filters – Theory for Advanced Applications. London, UK: IntechOpen; 2018

Written By

Anderson Pablo Freitas Evangelista and Ginalber Luiz de Oliveira Serra

Submitted: 14 February 2024 Reviewed: 17 February 2024 Published: 22 May 2024