Traffic signs are an important part of our road infrastructure because it provides critical information for road users, which in turn requires them to adjust their driving behavior to make sure they comply with road regulation enforced on the road sector.
Traffic sign recognition is a multi-category classification problem with unbalanced class frequencies. It is a challenging real-world computer vision problem of high practical relevance, which has been a research topic for several decades. Many studies have been published on this subject and multiple systems, which often restrict themselves to a subset of relevant signs, are already commercially available in new high- and mid-range vehicles. Nevertheless, there has been little systematic unbiased comparison of approaches and comprehensive benchmark datasets are not publicly available.
Related work
It is difficult to compare the published work on traffic sign recognition. Studies are based on different data and either consider the complete task chain of detection, classification and tracking or focus on the classification part only. Some articles concentrate on subclasses of signs, for example on speed limit signs and digit recognition.
How Does TSR Work?
Traffic-sign recognition is a safety tech system that recognizes traffic signs and relays the information displayed on the sign to the driver through the instrument cluster, infotainment screen, or head-up display. Most TSR systems can identify speed limit, stop, and “do not enter” signs. More sophisticated systems may be able to recognize other types of signs.
The primary purpose of TSR is to increase driver focus. If a driver misses a sign, TSR can make them aware of it so they can react accordingly. The idea is simple: TSR identifies road signs the driver might have missed and alerts them of their presence.
This technology uses advanced forward-facing cameras positioned high on the windshield, generally adjacent to the rearview mirror housing. Aimed to “see” traffic signs, the cameras scan the side of the road relative to the car.
Once the camera captures a sign, the system’s software processes the image to establish its classification and meaning. The system then relays this information to the driver almost instantaneously in the form of an icon or graphic representation of the sign. However, TSR’s ability to accurately identify a sign depends on the speed of the vehicle and its distance to the sign.
Some TSR systems also work in conjunction with advanced cruise control, which is set to maintain a speed above or below the scanned signs. For example, if TSR detects a 40-mph speed limit, it updates the cruise set speed to 40 mph unless the driver sets the parameters above or below the detected speed limit.
Aside from cruise control-related functionalities, TSR may use the same forward-facing ADAS camera that tracks lane markings to inform the vehicle’s lane-departure warning system or distracted driver alert system. So, it’s common for these features to come with TSR in the same ADAS package.
The Limits of TSR
Current TSR technology cannot determine all traffic signs or operate in all conditions. Several circumstances limit the performance of TSR systems, including:
- Low visibility due to poor weather (fog, snow, heavy rain, etc.)
- Dirty or improperly adjusted headlights
- Foggy or blocked windshield
- Warped, twisted, or bent signs
- Abnormal tire or wheel conditions
- A tilted vehicle due to a heavy load or modified suspension
While TSR and similar camera- and sensor-based technologies are potentially significant to moving us toward an autonomous driving future, there is still a long way to go. At this point, TSR is still primarily a driver-assistance system meant only to assist. Drivers cannot rely solely on this system to make steering or braking maneuvers/adjustments.
TSR Calibration
Forward-sensing cameras are not self-calibrating. Professional calibration is necessary for most ADAS to work correctly following an accident, windshield replacement, suspension work, or alignment changes. During calibrations, technicians realign forward-facing cameras to the proper position.
Which Car Brands Offer TSR?
Because of how new this innovative safety technology is, not many auto brands include TSR as standard or optional equipment on their models. Premium brands like Audi, BMW, and Mercedes-Benz commonly offer TSR on their models, while safety stalwart Volvo provides the technology on every model in its lineup. While it is less common among mainstream brands, several of them, including Ford, Honda, and Mazda, also offer TSR as part of their higher-level ADAS packages on specific models.
Bibliography:
- https://www.sciencedirect.com/science/article/abs/pii/S0893608012000457?casa_token=UpuxUSiXtowAAAAA%3AG3VtKs2vaA7qfaCd118GBHQyCyDWtYYPYHvY56Yno3YxYC_KkZXSKRO0J9o6a18VKwQ8qEB-gDU
- https://www.researchgate.net/publication/346250677_Automatic_Traffic_Sign_Recognition_Artificial_Inteligence_-_Deep_Learning_Algorithm
- https://www.jdpower.com/cars/shopping-guides/what-is-traffic-sign-recognition#:~:text=Traffic%2Dsign%20recognition%20is%20a,%E2%80%9Cdo%20not%20enter%E2%80%9D%20signs