[ad_1]
KUALA LUMPUR, May 14 – Sony image sensors are well known in the technology industry, with applications in smartphones, DSLRs, and various industrial uses. Now, the Japanese company has announced a pair of new image sensors, which are calling it “the world’s first intelligent vision sensors with AI processing.”
The Sony IMX500 and IMX 501 sensors feature built-in AI-based processing, which means machine learning computing tasks can be handled by the sensor alone. As a result, external processors and memory hardware are not required, which could result in the potential for faster and more secure AI cameras.
Both models are 12.3MP 1 / 2.3 “sensors, with IMX500 sample shipments starting in April 2020, and Sony is slated to begin shipping for the IMX501 in June 2020. It is worth noting that we are unlikely to see any of the new sensors appear on smartphones or mobile cameras anytime soon. Instead, Sony says the sensors will have a wide range of applications in the cloud-based retail and industrial industries.
“The spread of IoT has resulted in all types of devices connecting to the cloud, making it common to use information processing systems where information obtained from such devices is processed through AI in the cloud. On the other hand, the increasing volume of information handled in the cloud poses several problems: the increase in data transmission latency makes it difficult to process information in real time; user security issues associated with storing personally identifiable data in the cloud; and other problems such as increased energy consumption and communication costs associated with cloud services. “
So what are the benefits?
Sony explains that the sensors’ high-speed AI processing addresses the problem of data transmission latency. When recording a video with a conventional sensor, each frame is processed individually by AI; this can result in latency and poor performance in real time.
Instead, the new sensors will handle ISP and AI processing on their own, with the entire process done in a single video frame. As a result, AI-based real-time tracking of recorded video can be done with “high precision”, opening up potential use for retail and industrial applications.
For example, cameras with the new sensors can be installed at store entrances to detect the number of participants within a certain period of time, while applications even extend to inventory counting. Sony says the camera’s AI models can be rewritten to suit customer needs, whether it’s to track participants, identify customer behavior, and more.
And with the continued development of self-service, ATM-less stores, Sony says its new sensors will continue to enable such services.
“The AI capability makes it possible to offer various functions for versatile applications, such as real-time object tracking with high-speed AI processing. Different AI models can also be chosen by rewriting internal memory according to user requirements or the conditions of the location where the system is used. “
Additionally, Sony says the sensors’ onboard ISP and AI processing capabilities help address security and privacy concerns. If the image data is sent to the cloud or external hardware for processing, this could leave the data susceptible to malicious third parties. When everything is handled on board the sensor, only the metadata is emitted, reducing the security risk.
As mentioned, samples from the IMX500 are already shipping for JPY10,000 (~ RM405) while the IMX501 will ship in June for JPY20,000 (~ RM811). We don’t have any official word on when we’ll see sensors appear on actual products, though we might see them appear sometime in 2020 or 2021.
For more details, read Sony’s full statement here. – SoyaCincau
