As technology continues to evolve, the concept of the intelligent cockpit is progressively reshaping our driving experience. Particularly, intelligent cockpits equipped with Driver Monitoring Systems (DMS) and TOF 3D gesture recognition technology are introducing unprecedented levels of convenience and security to our journeys. In this article, we will delve deeply into the core technology of the TOF camera in the intelligent cockpit and the revolutionary changes it brings about.
1 Introduction to 3D TOF Technology:
TOF (Time of Flight) cameras work by utilizing the speed of light to measure the distance between an object and the camera. Then we can use the 3D point cloud to interprete and understand facial expressions, eye movements, and gestures through the analysis of this distance data. Drivers can now control the functions of their intelligent cockpit with just a wave of their finger or a swipe of their hand, adjusting volume, answering calls, and more, all without the need to touch a screen or press a physical button. Experience the future of driving with this touchless, intuitive technology.
2 3D TOF Automotive Applications 1: 3D Dynamic/Static Gesture Control
Why Opt for 3D Gesture Control and What are the Technical Challenges?
Traditional 2D image-based gesture recognition often suffers from low accuracy due to the influence of the vehicle's interior environment, not to mention the high computational power it requires. 3D TOF cameras, however, offer a solution to these issues. They not only reduce the impact of complex in-cabin environments, thereby enhancing the accuracy and reliability of in-vehicle gesture recognition but also ensure the privacy of passengers. Experience the future of driving with this advanced, privacy-conscious technology.
The quality of 3D point clouds is a critical factor limiting the high accuracy of gesture recognition and positioning, especially in the case of the back seats where the distance is longer, making the quality of 3D point clouds even more vital.
Point Spread Technology has developed a proprietary 3D TOF gesture recognition system, which includes the high-performance Okulo A1 automotive TOF camera and a matching self-developed neural network algorithm, offering automotive manufacturers a 'one-stop' solution. The Okulo A1 TOF camera, equipped with DotYun's exclusive technology, not only captures high-precision 3D point clouds but also supports Power over Coax(PoC), making its deployment in smart cars more convenient.
3 3D TOF Automotive Application 2: Privacy-Protected Driver Monitoring System (DMS):
The Driver Monitoring System (DMS) is a crucial component of the intelligent cockpit, and the NCAP safety organization is now mandating the installation of DMS to detect driver fatigue. Fatigued and distracted driving can easily lead to significant road traffic accidents, making real-time monitoring of a driver's attention level, position, and movements critically important.
Point Spread Technology's proprietary DMS based on 3D TOF uses TOF cameras and artificial intelligence algorithms to monitor driver distractions, fatigue, and 3D gaze in real-time. It also provides corresponding warnings and suggestions to prevent potential accident risks.
Advantages of 3D TOF DMS system compared to traditional DMS systems:
- Privacy Protection
- Improved Eye Tracking: High accuracy in detecting eye state and gaze direction.
- Greater Flexibility: 3D head position detection allows for more flexible camera installation.
- Extended Head Direction Range: Broadens the monitoring range for head movements.
- Stable Operation: Works reliably under low light, complex lighting, or strong light (up to 120 klux).
- Supports Secure Face Unlock: Adds an extra layer of security for the vehicle.
In addition, Point Spread Technology also offers a low-cost 2D DMS solution with a built-in AI engine. Automotive OEMs and Tier 1 suppliers are welcome to discuss cooperation."
4 Point Spread Technology Okulo A1 Camera:
