The growing interest in high dimensional data contributes to the development of new statistical techniques aimed at reducing dimensionality when data are influenced by deviating points. An extreme observation or outlier deviates from the model assumption and severely affects the estimates; as the data quality plays an important role in terms of feasible results, it is thus preferable underweights extremeness. In this context, the Candecomp/Parafac model, a decomposition techniques for high dimensional arrays, is not exempted to be sensible to the presence of extreme observations. The algorithm at the base of the model (Alternating Least Square - ALS) is extremely sensitive to the influence of extremeness reproducing flaw results in the analysis. In this context a robust COMedian algorithm (COMALS) is proposed. The algorithm is based on an incredible fast and accurate procedure able to manage the high dimensionality of the data reporting efficient results at any contamination level.

Dealing with outliers in high dimensional data: a COMALS procedure

Di Palma M. A.;Gallo M.
2019-01-01

Abstract

The growing interest in high dimensional data contributes to the development of new statistical techniques aimed at reducing dimensionality when data are influenced by deviating points. An extreme observation or outlier deviates from the model assumption and severely affects the estimates; as the data quality plays an important role in terms of feasible results, it is thus preferable underweights extremeness. In this context, the Candecomp/Parafac model, a decomposition techniques for high dimensional arrays, is not exempted to be sensible to the presence of extreme observations. The algorithm at the base of the model (Alternating Least Square - ALS) is extremely sensitive to the influence of extremeness reproducing flaw results in the analysis. In this context a robust COMedian algorithm (COMALS) is proposed. The algorithm is based on an incredible fast and accurate procedure able to manage the high dimensionality of the data reporting efficient results at any contamination level.
2019
Inglese
Bini Matilde, Amenta Pietro, D'Ambra Antonello, Camminatiello Ida
Statistical Methods for Service Quality Evaluation
contributo
9th International Conference IES 2019 - Innovation & Society - Book of short papers Statistical evaluation systems at 360°: techniques, technologies and new frontiers
1
1
369
372
4
978-88-86638-65-4
CUZZOLIN
Napoli
ITALIA
Esperti anonimi
no
3-5 July 2019
Roma
Internazionale
Outliers, robust algoritms, robust ALS, CP model
no
2
Di Palma, M. A.; Gallo, M.
open
273
info:eu-repo/semantics/conferenceObject
4 Contributo in Atti di Convegno (Proceeding)::4.1 Contributo in Atti di convegno
File in questo prodotto:
File Dimensione Formato  
IES 2019_DG.pdf

accesso aperto

Tipologia: Documento in Post-print
Licenza: PUBBLICO - Pubblico con Copyright
Dimensione 1.64 MB
Formato Adobe PDF
1.64 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11574/188598
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
social impact