Sensor fusion in software-defined vehicles

  • SDVs put software at the center and combine data from multiple sensors for reliable real-time decisions.
  • Architectures with HPC, zonal controllers, and service-oriented middleware enable OTA, ADAS, and monetization.
  • Sensor fusion supports safety and autonomy with AI, edge computing, and techniques such as Kalman and Bayesian models.
  • Challenges remain: cybersecurity, data, costs, talent, regulations, and rigorous management of updates.

sensor fusion in software-defined vehicles

Combining sensor fusion Software-defined vehicles (SDVs) are revolutionizing how cars are designed, updated, and driven. We're talking about an evolution where the software rulesIt orchestrates multiple sensors and actuators, and allows for improved performance without touching the hardware.

This approach, which is increasingly common in the sector, integrates cameras, radars, LiDAR and inertial sensors to understand the environment in real time, while a centralized and connected architecture enables OTA updates, remote services, new business models and advanced driver assistance systems (ADAS) and even automated driving functions.

What is a Software-Defined Vehicle?

A VDS is a vehicle whose functionality is defined and governed by softwareUnlike traditional cars, where each electronic and mechanical system operates rigidly and in isolation, SDVs coordinate all functions through powerful computing platforms, internal and external communications, and an application layer that evolves over time.

This concept did not arise from scratch; its impetus comes from the leap in sensors, actuators, high-performance hardware and algorithms (including AI and control engineering) that already allow deep interrelationships between traction, braking, steering, perception, navigation and user experience.

Differences compared to traditional vehicles

In a conventional car, most functions depend on specific hardware and inflexible. In a VDS, the core is the software, which increases the interrelation between subsystems and simplifies the evolution of functionalities throughout the vehicle's life cycle.

Upgrades no longer require replacing parts: they are delivered by remote updates These are fast, reducing costs and time, although they involve functional security and cybersecurity challenges. This continuous update capability allows for the incorporation of cutting-edge technologies and security enhancements with agility.

In addition, SDVs can collect data in real time to optimize performance, nurture future versions, and accelerate innovation in new features and services.

SDV Architecture

The physical base consists of high performance processorsinternal networks, storage, multiple sensors, and distributed actuators. This platform of robust hardware It executes real-time software, connects components, and synchronizes commands to brakes, steering, or propulsion.

Based on that, the software is organized in layers: a operating system manages cybersecurity, memory, and I/O; a layer of virtualization or middleware It intermediates and standardizes communications; and a layer of enforcement It implements functions (traction, braking, steering, etc.) without depending on details of the underlying hardware.

The architecture is completed with external connectivity: Internet, 5G, V2X and cloud for remote services, diagnostics, analytics and deployment of OTA updates in vehicles and fleets.

Development platforms and ecosystems

Standardization and collaboration are key. AUTOSAR, in its profiles Classic (real-time, security and high reliability) and Adaptive (dynamic environments, OTA updates and connectivity), has become a cornerstone of interoperability in the automotive industry.

Tools and systems with specific approaches are also gaining ground: the Rust language for its security and memory efficiency; and RTOS as FreeRTOS (open source, resource-constrained devices) and SAFERTOS (certified for functional safety), suitable for critical components.

Silicon and software vendors offer stable environments for SDVs with scalable processors that facilitate code reuseProduction quality controllers and safety-oriented MCAL. They also offer OS options such as FreeRTOS, Linux, QNX and SafeRTOSand compatibility with AUTOSAR to simplify integration with a diverse ecosystem.

History and evolution

Since the 70s, the first electronic systems controlled engine and emissionsIn the 90s, microprocessors enabled traction control and ABS, and with the new millennium came connectivity, digitalization, and... ADAS, increasing safety and comfort.

Today, advanced assistance and automation features combine sensors, cameras, and real-time processing algorithms, bringing the various levels of autonomous driving with a comprehensive view of the vehicle as a system.

Sensor fusion in SDVs

Sensor fusion integrates data from multiple sources to provide a more comprehensive view accurate, robust and useful of the environment and the vehicle itself. It allows overcoming the limitations of an isolated sensor by combining visual, distance and motion signals with mathematical and AI models.

Its essential components include: the capture using cameras, LiDAR, radar, ultrasonic and inertial sensors; the preprocessed (cleaning, synchronization, and normalization); the fusion algorithms that unify the signals; and a stage of decision making that feeds control and planning.

How it works

First, heterogeneous data is collected, then synchronized and filtered to reduce noise and bias, and finally combined with techniques that return a coherent state of the environment. This representation is interpreted to trigger functions such as obstacle detection, tracking of objects or maneuvers.

Among the most widespread techniques are the Kalman filter To estimate noisy states, Bayesian approaches to updating probabilities with new evidence and Deep learning-based fusionwhere neural networks learn to combine multimodal signals.

Technical challenges

La temporal synchronization Between sensors with different frequencies and timestamps, robust alignment and temporary sealing strategies are required.

El noise and uncertainty They are unavoidable: filters, probabilistic models, and frequent calibrations are needed to maintain data quality.

La computational complexity It is high, especially in real time; edge computing and hardware acceleration help to contain latencies.

design the complementarity Avoiding conflicting redundancies and resolving discrepancies between sensors is a key architectural challenge.

Applications

In autonomous vehicles and ADAS, fusion supports the navigation360° perception and path planning. In robotics, it facilitates manipulation and location; in smart cities, it integrates IoT signals for mobility and energy; in healthcare, wearable devices combine multiple metrics; and in industry, it drives Predictive Maintenance and quality control.

Benefits and connectivity

Security is reinforced by the ADASThese systems reduce risks through advanced perception and distributed control. They execute coordinated responses in braking, steering, and acceleration with reaction times impossible for a human.

  • Adaptive cruise control: adjust the speed to maintain the distance.
  • parking assistance: assistance in maneuvers with sensors and cameras.
  • automatic emergency braking: act in the event of a collision risk.
  • Lane maintenance/change: avoids deviations and supports the maneuver.
  • blind spot detection: alert about hidden areas.

In terms of operational efficiency, SDVs allow continuous optimization Based on vehicle and environmental data, with remote monitoring, predictive diagnostics and fewer workshop stops.

In personalization, users activate on-demand features and receive upgrades. OTAHowever, it was carefully designed to comply with security restrictions and avoid risks during the update.

Advanced connectivity enables services such as real-time navigation, fleet management, entertainment, and V2Xtransforming the onboard experience and the relationship between vehicle, infrastructure and cloud.

Market overview and business models

The transition to centralized computing and quasi-zonal architectures is driving up value. These platforms are estimated to generate around 755.000 million in hardware revenue by 2029, while SDV functions will grow at a rate of 30–34% per year until 2035 thanks to the monetization of connected and autonomous services.

SDVs can be classified into five levels, from designs focused on walkways and domains to fully integrated vehicles. software-centricAt the center are the HPC, zonal controllers and service-oriented middleware, enabling hardware-software separation and functional scaling.

The business is being reconfigured with features such as service, in-vehicle commerce and a digital cockpit where on-device AI (with players like Qualcomm, Nvidia or Unity) enables adaptive experiences: full-width screens, AI avatars and customizable “skins”.

La V2X connectivity (C-V2X, DSRC, and 5G) is key for security and coordination; its adoption depends on spectrum and policies by region (China, EU, US, Japan, Korea). The integration of OBUs, RSUs, and chipsets aligns with SDV platforms to accelerate deployments.

Challenges beyond the technical

Subscription-based payment models can generate consumer rejection if they are applied to functions perceived as standard, affecting brand perception.

Greater connectivity brings cybersecurity risks Regarding vehicle control, privacy, and cloud services, advanced frameworks and continuous monitoring are required.

La ownership and data protection It requires clear policies for storage, use and sharing, as well as consent and regulatory compliance.

The development, validation, and maintenance of SDV platforms involves high costsespecially in critical functions and infrastructure for secure OTA updates.

The complexity shifts to millions of lines of code, multiple layers, and vendors, increasing the risk of integration errors and failures.

There talent shortage in software, AI, and cybersecurity within manufacturers with a strong mechanical culture; many do not expect to complete in-house capabilities before the next decade.

Arise regulatory challenges Regarding responsibility, software behavior updates, and evolving security, especially with automated functions.

AI raises questions about explainability and predictability, as well as the management of cancellations or edge cases in automated driving.

La fragmentation Platforms, operating systems, and clouds complicate compatibility and scalability between models and regions.

Although OTAs are convenient, one poor update management This can trigger system failures and user frustration; governance and testing are essential.

Alliances and industrial roadmaps

Bosch and Cariad are strengthening their cooperation in Level 2 and 3 assisted and automated driving functions with a software package based on IAThey develop all components independently, seeking behaviors as natural as those of a human driver and superior safety.

The first features are already being tested in pilot fleets and trained with large volumes of data. The goal is to have a package applicable to production from mid-2026, integrable into the new SDV architecture of the Volkswagen Group and scalable for other manufacturers.

AI is applied throughout the entire chain: perception, fusion of cameras and radarsDecision-making and safe control of the powertrain, steering, and brakes. Looking ahead, multimodal approaches are being explored. Vision-Language-Action to reason about complex scenarios and detect hidden risks.

Full control of the source code and intellectual property allows for the imposition of high standards of data protection, security and transparencywith traceable and explainable AI decisions. The engineering is supported by a scalable hardware strategy for all ranges.

The tests are being carried out on public roads in Europe, Japan and the USA, with vehicles such as ID Buzz y Listen Q8This year, hundreds of vehicles equipped with complete sensor suites are being added to capture edge cases; the development is data-drivenwith daily improvements.

Resources and readings

For more information on core controllers that enable SDV, it's helpful to review the Aptiv technical document. Direct access: download PDF, where it is described how a centralized architecture enhances the high performance computing, zoning and continuous updating.

Works and reference sources on sensor fusion and estimation: Durrant-Whyte and Bailey (SLAM), Thrun/Burgard/Fox (probabilistic robotics), Bar-Shalom et al. (tracking and navigation); in addition to educational resources from NVIDIA about sensor fusion for autonomous and Intel in edge computing applied to this topic.

Looking at the whole picture, the combination of SDV and sensor fusion enables a leap in safety, efficiency and experienceA living platform that learns from data, updates without changing hardware, and opens up connected business models, provided that cybersecurity, software quality, and trust in AI are rigorously governed.

LSM9DS1
Related article:
Complete guide to the LSM9DS1 sensor with Arduino: accelerometer, gyroscope and magnetometer