10–12 Dec 2024
Physics Dept and INFN, Catania
Europe/Rome timezone

Towards virtual painting recolouring using Vision Transformer on X-Ray Fluorescence datacubes

Not scheduled
20m
Conference Room (Physics Dept and INFN, Catania)

Conference Room

Physics Dept and INFN, Catania

Cittadella Universitaria Edificio 6, Università degli Studi di Catania Via S. Sofia, 64, 95123 Catania CT https://infn-it.zoom.us/j/86952341946?pwd=ER9LlLZ9X9IRzx7Ym64QzCA5ExXYuo.1
WP6

Speaker

Alessandro Bombini (Istituto Nazionale di Fisica Nucleare)

Description

In this contribution, we define (and test) a pipeline to perform virtual painting recolouring using raw data of X-Ray Fluorescence (XRF) analysis on pictorial artworks. To circumvent the small dataset size, we generate a synthetic dataset, starting from a database of XRF spectra; furthermore, to ensure a better generalisation capacity (and to tackle the issue of in-memory size and inference time), we define a Deep Variational Embedding network to embed the XRF spectra into a lower dimensional, K-Means friendly, metric space.
We thus train a set of models to assign coloured images to embedded XRF images. We report here the devised pipeline performances in terms of visual quality metrics, and we close on a discussion on the results.

Primary author

Alessandro Bombini (Istituto Nazionale di Fisica Nucleare)

Presentation materials