Sony has announced new Image sensor with AI hardware embedded to it, which can perform high image recognition.
Also recall that Sony was the first company to release image sensor with on-chip RAM, which enabled slow motion video capture at very high frame rates, this was few years ago.
The Intelligent Vision Sensor, IMX500, has a stacked design, consisting of a pixel chip (1/2.3”, 12.3MP resolution, 1.55µm pixels) and a logic chip that has a Sony-developed DSP and memory for the AI models.
The sensor can capture 4K video at 60fps, but more importantly it needs only 3.1 milliseconds to analyze the image. This makes it the first image sensor with AI.
According to Sony, the AI processing functionality on the image sensor enables high-speed edge AI processing and extraction of only the necessary data, which, when using cloud services, reduces data transmission latency, addresses privacy concerns, and reduces power consumption and communication costs.
Also, these products expand the opportunities to develop AI-equipped cameras, enabling a diverse range of applications in the retail and industrial equipment industries as well.
It is worth to note that different AI models can also be chosen by rewriting internal memory in accordance with user requirements