TD-Magic: From Pictures of Timing Diagrams To Formal Specifications

We introduce TD-Magic, the first neuro-symbolic approach for translating an image of a timing-diagram (TD) to a formal specification. We overcome the lack of labelled data for supervised learning, by first developing a synthetic data generator of labelled TDs. We then use object detection techniques...

Full description

Saved in:
Bibliographic Details
Published in2023 60th ACM/IEEE Design Automation Conference (DAC) pp. 1 - 6
Main Authors He, Jie, Nickovic, Dejan, Bartocci, Ezio, Grosu, Radu
Format Conference Proceeding
LanguageEnglish
Published IEEE 09.07.2023
Subjects
Computer Vision
Feature extraction
Formal Specification
Generators
Object detection
Optical character recognition
Requirements Engineering
Semantics
Text recognition
Timing Diagram
Training
Online AccessGet full text
DOI10.1109/DAC56929.2023.10247685

Cover

More Information
Summary:We introduce TD-Magic, the first neuro-symbolic approach for translating an image of a timing-diagram (TD) to a formal specification. We overcome the lack of labelled data for supervised learning, by first developing a synthetic data generator of labelled TDs. We then use object detection techniques to identify rising and failing edges, OCR to recognise the text, and image processing algorithms to capture synchronisation patterns. Finally, we use semantic interpretation to analyse the extracted features and generate the associated formal specification. Our experiments on industrial TDs show high translation accuracy opening the way to more sophisticated requirements-extraction algorithms from pictures.
DOI:10.1109/DAC56929.2023.10247685