Diploma in Multimodal Pipelines and Synchronization
Online postgraduate diploma of 800 hours in multimodal pipelines and synchronisation: 8 modules covering multimodal data, time synchronisation with IEEE 1588 (PTP) and IEEE 802.1AS (gPTP), capture and logging, processing pipelines, dataset preparation and real-time multimodal inference, with an assigned technical tutor.
Take the controls.
Run a real engineering trade-off from this field. Move the sliders, watch the model react in real time and beat the challenge.
What you will be able to do
Characterise data from different modalities and their requirements.
Synchronise sensors using precision time protocols.
Log multi-sensor data reliably and reproducibly.
Build batch and streaming multimodal processing pipelines.
Prepare coherent multimodal datasets for machine learning.
Deploy multimodal inference that meets latency requirements.
Operate and govern pipelines with quality and security.
Who it's for
- Multimodal data engineers building capture and processing chains.
- Embedded systems engineers working with synchronised sensors.
- MLOps engineers deploying multimodal models in production.
- Perception engineers combining cameras, LiDAR, audio and other signals.
- Data pipeline architects who need precise time alignment across sources.
- Robotics engineers logging and replaying multi-sensor data.
- Engineering or science graduates looking to move into the automotive sector.
What you'll work with
- IEEE 1588-2019 (PTP) (Precision Time Protocol for networked clock synchronisation)
- IEEE 802.1AS-2020 (gPTP) (generalised PTP for time-sensitive networks)
- ASAM MDF 4.2 (measurement data format for logged sensor and bus data)
- ISO 23150:2023 (data communication between sensors and data fusion unit in vehicles)
- ISO/IEC 5259-2:2024 (data quality measures for analytics and machine learning)
- Regulation (EU) 2016/679 (GDPR) (General Data Protection Regulation)
- SMPTE ST 2059-2 (PTP profile for professional broadcast applications)
- ROS 2
- GStreamer
- NVIDIA DeepStream
- Apache Kafka
- Foxglove
8 modules
1.1Image, audio, text and signal modalities1.2Characteristics of each modality1.3Heterogeneous sampling rates1.4Sensor data and event logs1.5Multimodal storage formats1.6Storage volume and cost1.7Quality according to ISO/IEC 52591.8Metadata and context1.9Privacy in multimodal data1.10Workshop: inventory of the data sources of an industrial plant
2.1Clocks, drift and jitter2.2The NTP protocol and its limits2.3Precision Time Protocol IEEE 15882.4gPTP according to IEEE 802.1AS2.5Hardware timestamping2.6Hardware triggering and synchronisation2.7Post-hoc alignment by correlation2.8Interpolation and resampling2.9Measuring synchronisation errors2.10Lab: camera synchronisation with PTP
3.1ROS 2 and DDS middleware3.2Recording with rosbag2 and MCAP3.3The ASAM MDF 4 format3.4Logging in vehicles and robots3.5Compression of video and point clouds3.6Data loss and buffers3.7On-board bandwidth and storage3.8Deterministic replay of recordings3.9Foxglove visualisation tools3.10Practical: multi-sensor logging with rosbag2
4.1Batch and streaming architectures4.2Apache Kafka and Flink4.3Processing with GStreamer4.4Pipelines with NVIDIA DeepStream4.5Feature extraction and transformation4.6Time-window alignment4.7Joins between asynchronous streams4.8Backpressure and latency4.9Orchestration with Airflow4.10Lab: video and audio pipeline with GStreamer
5.1Multimodal datasets and their organisation5.2Synchronised labelling across modalities5.3Efficient loaders in PyTorch5.4WebDataset and sharded formats5.5Consistent data augmentation across modalities5.6Handling missing modalities5.7Splits without temporal leakage5.8Dataset versioning5.9Scene catalogues5.10Practical: synchronised multimodal dataloader
6.1End-to-end latency requirements6.2Edge inference with Jetson6.3Optimisation with TensorRT6.4Concurrent execution of models6.5GPU resource scheduling6.6Synchronisation during inference6.7Tolerance to source failures6.8Monitoring latency and quality6.9Deployment with containers6.10Case study: industrial inspection with video and vibration
7.1Validating synchronisation in production7.2Drift detection per modality7.3Observability of multimodal streams7.4Automated data testing7.5Incident management7.6Stream security and encryption7.7Data protection requirements7.8Pipeline documentation7.9Operating costs7.10Case study: audit of an instrumented-vehicle pipeline
8.1Definition of sources and requirements8.2Synchronisation design8.3Data capture and logging8.4Processing pipeline8.5Dataset preparation8.6Real-time inference8.7Measurement of latencies and errors8.8Conclusions and scaling of the pipeline8.9Report and presentation8.10Final project: final review with the tutor
How you'll learn
100% online training on the SEIUM campus, with downloadable material, recorded classes and an assigned technical tutor. There are no fixed timetables: you progress at your own pace within the intake, so you can combine it with your job.
Each module combines theory, guided reading of the original standard and applied exercises. The working software is ROS 2, GStreamer, NVIDIA DeepStream, Apache Kafka and Foxglove, in free, academic or evaluation versions. Practical work is based on real procedures for synchronising cameras and sensors with PTP, multi-sensor logging in vehicles and robots, and real-time multimodal inference on edge devices. Assessment is continuous by module, plus the final project.
Standards covered: IEEE 1588-2019 (PTP), IEEE 802.1AS-2020 (gPTP), ASAM MDF 4.2, ISO 23150:2023, ISO/IEC 5259-2:2024, Regulation (EU) 2016/679 (GDPR), SMPTE ST 2059-2.
Build it end to end
Your final project follows the real engineering workflow, step by step, reviewed by your tutor.
Where this takes you
Requirements
- Prior technical training or professional experience in the sector. No university degree is required.
- An internet connection and a computer capable of running the programme software.
- English sufficient to read technical standards.
Ready to start?
Send your application today. Our admissions team replies within 72 hours with your study plan and funding options.
Frequently asked questions
The programme totals 800 hours over 6–8 months. You set your own pace within each intake, and your tutor helps you plan the workload around your job.
You work with ROS 2, GStreamer, NVIDIA DeepStream, Apache Kafka and Foxglove, using free, academic or evaluation versions. Your tutor indicates the free alternative wherever one exists.
A SEIUM Institute diploma, awarded on passing the continuous assessment and the final project. It is SEIUM's own qualification, not an official state degree; its recognition depends on the programme completed and the regulations of each country.
Yes. Modules passed are recognised in a higher programme in the same area (postgraduate diploma or master's). Ask about the recognition policy when you enrol.
Prior technical training or professional experience in the sector (no university degree required), a computer able to run the programme software and English sufficient to read technical standards.
Start dates are set by SEIUM's faculty for each intake. Our admissions team will confirm the next available date when you apply.
Related programmes
Diploma in Robust and Stochastic Optimization
Online postgraduate diploma of 800 hours in robust and stochastic optimisation. 8 modules covering uncertainty modelling, two-stage and multi-stage stochastic programming, chance constraints and CVaR, robust…
Diploma in Partial Twins and Degradation Assessment
Online postgraduate diploma of 800 hours in partial twins and degradation assessment. 8 modules covering physical, reduced-order and hybrid degradation models, Bayesian data assimilation, remaining useful…
Diploma in Value Metrics and Data Monetization
Online postgraduate diploma of 800 hours in data value metrics and monetisation, with 8 modules covering data economics, data value metrics, causal impact measurement, monetisation models,…
More in Data, AI, Simulation & Analytics
All Data, AI, Simulation & Analytics programmes → · How to apply · Fees & financing · Scholarships