The Sony IMX678 is an 8.29-megapixel 1/1.8-inch STARVIS 2 sensor delivering high-sensitivity 4K imaging, dual-exposure HDR and superior low-noise performance for machine vision, robotics, AI edge systems and industrial inspection. As a next-generation successor to earlier STARVIS sensors such as IMX327, IMX385 and IMX415, the IMX678 introduces meaningful improvements in dynamic range, pixel efficiency and real-world usability across challenging lighting environments.

1. What Makes IMX678 a STARVIS 2 Sensor

Sony’s STARVIS 2 architecture is built around three goals:

1. Higher sensitivity per pixel through improved photodiode structure.
2. Wider dynamic range without compromising shadow detail.
3. Lower noise floor in high-gain scenarios.

The IMX678 achieves these with a redesigned pixel featuring:

• 2.0 µm effective pixel pitch, optimizing light collection.
• Back-illuminated structure with deep photodiode wells for stronger signal response.
• Improved microlens efficiency, boosting quantum efficiency particularly in near-infrared.
• Lower read noise, benefiting low-light industrial and robotics applications.

Compared with classic STARVIS sensors like IMX327 or IMX291, IMX678 captures much finer detail at 4K resolution without sacrificing sensitivity. It is designed not as a tiny-pixel sensor like IMX415 but rather a balanced platform that supports professional-grade imaging.

2. Image Quality Characteristics

2.1 High resolution with practical pixel size

IMX678 delivers 3840×2160 full 4K at 8.29 MP.
Its 2.0 µm pixels strike a middle ground—large enough for strong low-light response, but small enough to enable high-density imaging for OCR, defect detection, text reading and AOI.

2.2 Dual-Exposure HDR (No Ghosting)

One of its most valuable features is dual-exposure HDR, a method that captures two exposures in immediate sequence and merges them into a single frame.
Advantages:

• Retains highlights (e.g., reflective metal, welding, outdoor sunlight).
• Preserves shadows (factory interiors, warehouse corners).
• Avoids the motion ghosting common in older multi-frame HDR.

For robotics and AGV systems moving through mixed lighting, this HDR behavior significantly improves perception stability.

2.3 Low-light excellence

The STARVIS 2 pixel structure improves near-infrared sensitivity and color fidelity under low illumination.
This makes the sensor ideal for:

• 24/7 warehouse automation
• Semiconductor inspection
• Night-shift industrial operations
• Smart city edge deployments

Core Parameters of the IMX678

Parameter Category	Specification	Notes / Advantages
Resolution	8.29 Effective Megapixels (3840 x 2160)	True 4K UHD resolution, providing exceptionally rich image detail.
Sensor Size (Diagonal)	8.86 mm (Type 1/1.8)	A large 1/1.8-inch format, which is sizable for its class and provides the physical foundation for low-light performance.
Pixel Size	2.0 µm x 2.0 µm	A larger pixel size, combined with a back-illuminated structure, ensures excellent photon capture capability.
Core Technology	STARVIS 2	This is the most critical technological identifier for the IMX678.
Dynamic Range	High Dynamic Range in a single exposure	Officially stated to be over 8dB higher than the first-generation STARVIS in a single exposure.
Sensitivity	High sensitivity, with enhanced Near-Infrared (NIR) reception	Capable of outputting clear color images even in extremely low-light conditions (0.01 Lux or lower).
Max Frame Rate	- 4K (3840x2160) @ 60fps - Higher rates at lower resolutions	Supports high-speed 4K@60fps recording, enabling the capture of fast-moving objects with smooth motion.
ADC Resolution	10-bit / 12-bit	Supports high bit-depth ADC, contributing to smoother color and brightness gradations.
Shutter Type	Rolling Shutter	A mainstream choice for consumer and security applications.
Interface	MIPI CSI-2	A high-speed, low-power serial interface widely used in embedded vision systems.
Package	LGA (Land Grid Array)	A common sensor packaging format.

 

Analysis of the IMX678's Core Competitiveness

The competitive strength of the IMX678 is not derived from a single leading parameter but is a comprehensive advantage built on three pillars: STARVIS 2 technology, a large sensor format with large pixels, and true 4K high frame rate capabilities.

1. Unparalleled Night Vision Performance (The Power of STARVIS 2)

This is the most outstanding and core competitive advantage of the IMX678.

• Wider Dynamic Range: In scenes with complex lighting, such as city streets at night or tunnel entrances/exits, the IMX678 can simultaneously capture details in both the brightest areas (like license plates) and the darkest parts of the environment (surroundings). This solves the "either/or" dilemma of traditional sensors. This single-exposure HDR capability far surpasses conventional WDR technologies that rely on multi-frame synthesis, resulting in more natural images without motion artifacts.
• Extreme Low-Light Sensitivity: In "starlight" conditions with almost no visible light, many sensors can only switch to black-and-white mode or produce images filled with noise. Leveraging its high photoelectric conversion efficiency and enhanced NIR sensitivity, the IMX678 can still output full-color images with low noise. This is a decisive advantage in the security surveillance field, where color is critical for identifying targets (e.g., vehicle or clothing color).

 

2. Superior Image Quality Foundation (1/1.8" Sensor + 4K Resolution)

• The "Bigger is Better" Principle: A 1/1.8-inch sensor size is considered "large format" in the fields of security and high-end dashcams. A larger photosensitive area means more photons can be collected, which fundamentally improves the signal-to-noise ratio and dynamic range, establishing a higher baseline for image quality.
• True 4K Ultra-HD Detail: The 8-megapixel 4K resolution delivers astounding detail. In security monitoring, this means clearer views of faces and license plate numbers from a greater distance. For dashcams, it means capturing crucial details at an accident scene. The advantage of 4K resolution becomes obvious when the footage needs to be digitally zoomed.

 

3. Smooth Capture of Dynamic Moments (4K@60fps)

In many scenarios, high resolution alone is not enough. For instance, when filming fast-moving vehicles or people, a lower frame rate (like 30fps) can lead to motion blur and ghosting. The IMX678's ability to record at 4K@60fps ensures that even in dynamic scenes, every frame is clear and smooth, significantly increasing the probability of capturing useful information.

 

4. Precise Market Positioning and Mature Ecosystem

• Clear Target Market: The IMX678 precisely targets markets with extremely high demands for night vision and image quality, such as high-end security surveillance (smart cities, critical infrastructure), premium dashcams, and industrial machine vision.
• Sony Brand Endorsement: As a Sony Semiconductor product, its stability and performance are well-regarded. Downstream manufacturers (like Hikvision, Dahua, and premium dashcam brands) are more inclined to choose such a market-proven, flagship-level sensor, which in turn fosters a strong application ecosystem.

 

Deep Dive: How STARVIS 2 Eliminates Motion Artifacts (Ghosting)

One of the biggest pain points in traditional HDR is "Ghosting" when objects move.

• The Old Way (DOL-HDR): Older sensors capture a Long Exposure frame followed by a Short Exposure frame with a significant time gap. If a car moves during that gap, the fused image shows two cars (a ghost).

• The IMX678 Way (Clear HDR): Sony STARVIS 2 architecture allows for simultaneous readout of the long and short exposures. By significantly reducing the time lag between the two captures, the IMX678 ensures that moving objects—like a speeding car or a robotic arm—remain sharp and singular, even in high-contrast lighting.

Summary

The core competitiveness of the IMX678 can be summarized as follows: With STARVIS 2 technology as its soul, a 1/1.8-inch large-format sensor and 4K resolution as its solid body, and complemented by 60fps high-speed motion capabilities, it stands as an "all-around performer" with exceptional imaging performance in low-light and complex lighting conditions.

It does not merely stack up parameters. Instead, through technological innovation (STARVIS 2), it perfectly solves a core industry pain point (nighttime imaging), making it a benchmark presence in the high-end vision application market and a technological high ground that is difficult for competitors to surpass in the short term.

3. IMX678 vs Other Popular Sensors

3.1 IMX678 vs IMX415

Feature	IMX678	IMX415
Pixel Size	2.0 µm	1.45 µm
HDR	Dual-Exposure	Limited HDR
Low-Light	Excellent	Moderate
Detail	Higher usable detail	Very high resolution but noisier

Conclusion: IMX415 is higher density but weaker in low light. IMX678 is more balanced and robust for real-world industrial tasks.

3.2 IMX678 vs IMX585

IMX585 (1/1.2 inch) has a larger area and higher light-gathering capability but does not integrate STARVIS 2 architecture in the same way.
In high-contrast scenes, IMX678’s HDR output is more stable, while IMX585 excels in ultra-low-light long-exposure environments.

 

Sensor Model	Resolution	Optical Format	Pixel Size	Technology	SNR1s (Low Light Index)	Dynamic Range	Performance Verdict
Sony IMX678	8.3 MP (4K)	1/1.8"	2.00 µm	STARVIS 2	0.13 lx	~83 dB	⭐⭐⭐⭐⭐ (Best 4K)
Sony IMX415	8.3 MP (4K)	1/2.8"	1.45 µm	STARVIS 1	0.23 lx	~72 dB	⭐⭐⭐ (Entry 4K)
Sony IMX585	8.3 MP (4K)	1/1.2"	2.90 µm	STARVIS 2	0.05 lx	~88 dB	⭐⭐⭐⭐⭐+ (Flagship)
Sony IMX335	5.0 MP	1/2.8"	2.00 µm	STARVIS 1	0.59 lx	~72 dB	⭐⭐⭐ (Standard 5MP)

Theory is good, but testing is better. To validate the IMX678's low-light performance in your own facility without complex driver development, we recommend starting with our calibrated Sony STARVIS 2 IMX678 4K USB Camera Module. It features a tuned ISP that preserves the sensor's 83dB dynamic range, ready for immediate evaluation on Windows or Linux

Note on SNR1s: SNR1s (Signal-to-Noise Ratio 1) is a proprietary index by Sony specifically for security camera sensors. It measures the luminous flux required to achieve a specific signal-to-noise ratio.

• Lower Value = Better Low Light Performance.

• As shown in the table, the IMX678 (0.13 lx) requires nearly half the light of the IMX415 (0.23 lx) to produce a clear image, making it superior for night-time robotics and unlit surveillance.

3.3 IMX678 vs IMX327 / IMX291

IMX327/IMX291 are 1080p sensors known for legendary low-light performance.
IMX678 brings:

• 4× more resolution
• Wider dynamic range
• Higher pixel efficiency
• Better color accuracy in artificial lighting

Sensor Model	Resolution	Optical Format	Pixel Size	Tech Gen.	SNR1s (Low Light Index)	Dynamic Range	Engineering Verdict
Sony IMX678	8.3 MP (4K)	1/1.8"	2.00 µm	STARVIS 2	0.13 lx	~83 dB	Best 4K for AI (Balances Detail & Night Vision)
Sony IMX462	2.1 MP (1080p)	1/2.8"	2.90 µm	STARVIS 1	0.18 lx	~80 dB	⭐⭐⭐⭐+ 1080p NIR King (Enhanced Infrared)
Sony IMX327	2.1 MP (1080p)	1/2.8"	2.90 µm	STARVIS 1	0.18 lx	~80 dB	⭐⭐⭐⭐ Cost-Effective Night Vision Standard
Sony IMX291	2.1 MP (1080p)	1/2.8"	2.90 µm	STARVIS 1	0.23 lx	~72 dB	⭐⭐⭐ High FPS Legacy Alternative

IMX327 still wins in extreme darkness, but IMX678 is the modern 4K evolution suitable for industry.

Finding the Right 1080p Alternative?

While the IMX678 defines the 4K future, many industrial applications are constrained by USB 2.0 bandwidth or cost. We have ready-to-ship solutions for specific 1080p needs:

• Need Extreme Night Vision (NIR)? If your application involves invisible IR lighting (850nm/940nm), the Sony IMX462 USB Camera Module is the "NIR King," offering significantly higher sensitivity than standard sensors in absolute darkness.

• Need High-Speed Motion Capture? For conveyor belts or fast-moving object tracking where 60fps+ fluidity is non-negotiable, the classic Sony IMX291 USB Camera Module remains the industry's best price-to-performance workhorse.

4. Why IMX678 Fits Industrial 4K Machine Vision

4.1 Robotic Perception and Mapping

4K resolution with HDR allows robots to capture:

• Textures
• Labels
• Rims and edges
• Floor patterns
• Distant objects

This is essential for SLAM, VIO and object recognition pipelines in AMRs, humanoids and inspection robots.

4.2 Automated Optical Inspection (AOI)

Manufacturing inspection often requires cameras to detect extremely small variations in:

• PCB solder patterns
• Micro-scratches on metal
• Label misprints
• Barcode deformation

The IMX678’s clean 4K signal and robust pixel response are ideal for AOI systems replacing older 1080p setups.

4.3 Retail, Kiosk and ID Verification

In kiosk environments, lighting may fluctuate due to backlight, bright screens or daylight from storefront windows.
Dual-exposure HDR ensures facial recognition and OCR remain stable.

4.4 Smart City & Traffic Systems

High pixel density and wide dynamic range support:

• License-plate recognition
• Intersection monitoring
• Tunnel entrances
• Parking automation

5. Why IMX678 Works Well Over USB2.0 UVC Modules

A key practical advantage is that IMX678 supports MJPG/YUY2 compression, allowing real-time 4K @ 30fps through USB2.0.
This matters for integrators because:

• Many industrial PCs still rely on USB2.0
• Migration to USB3.0 hardware may not be feasible
• UVC compatibility avoids driver development
• Jetson and Raspberry Pi platforms work out-of-box

For embedded engineers, this drastically reduces integration friction.

6. IMX678 Module Variants and Lens Options

A sensor alone cannot deliver usable vision without appropriate optics. The IMX678 is frequently paired with M12 lenses due to:

• Low distortion options
• Ultra-wide to telephoto flexibility
• Lower cost relative to C-mount
• Compact size for embedded boards

Depending on the application, recommended FOVs include:

• 90°–120° for robotics
• 60°–80° for document scanning
• 30°–50° for industrial inspection
• 150°+ for panoramic applications

7. Ideal Use Cases for IMX678-Based USB Modules

• 4K quality inspection and AOI
• High-resolution robot vision
• Industrial AI edge devices
• Document/OCR scanning kiosks
• Medical imaging front-ends
• Smart city edge nodes
• Factory line monitoring
• Warehouse and logistics robots

The pairing of 4K detail + HDR stability makes IMX678 one of the most practical sensors for machines operating in uncontrolled lighting.

8.   Hardware Compatibility: Powering the IMX678

To fully leverage the 4K resolution and HDR capabilities of the IMX678, matching it with the right Edge AI processor is critical. Here is our engineering breakdown:

• NVIDIA Jetson Orin / Nano / Xavier:

  • Status: Highly Recommended.

  • Why: The ISP (Image Signal Processor) in the Orin series can easily handle the IMX678's 4K@60fps throughput. Novel Electronics provides V4L2 drivers and GStreamer pipelines specifically tuned for JetPack 5.x/6.x, enabling seamless hardware-accelerated JPEG encoding and AI inference (YOLOv8/v10).

• Rockchip RK3588:

  • Status: Excellent for Multi-Camera Setups.

  • Why: The RK3588's powerful NPU (6 TOPS) and massive bandwidth allow for connecting up to 4x IMX678 modules simultaneously for 360-degree robot vision. We offer specific DTS (Device Tree Source) overlays for this platform.

• Raspberry Pi 5:

  • Status: Compatible (ISP Tuning Required).

  • Why: While the Pi 5 has improved MIPI throughput, its ISP is open-source based (libcamera). We provide a pre-tuned libcamera tuning file (JSON) to correct color and lens shading for the IMX678, ensuring you get professional image quality on a budget platform.

For developers looking to deploy Vision AI applications quickly on Edge boxes or Industrial PCs, the Goobuy UC-678 USB 3.0 Module offers a plug-and-play route. Unlike raw MIPI sensors that require custom driver integration, this USB version delivers uncompressed 4K video compliant with standard UVC protocols, allowing you to focus on your AI algorithms rather than kernel debugging.

Frequently Asked Questions 
FAQ 1 How does the IMX678 improve low-light and HDR performance compared to sensors like IMX415 or IMX585?

Answer:
IMX678 uses Sony’s STARVIS 2 stacked BSI pixel architecture with higher full-well capacity and lower read noise, giving it significantly better low-light clarity than IMX415 and more stable HDR performance than IMX585. This allows industrial USB cameras and embedded AI systems to maintain detail in both bright and dark regions simultaneously, especially in warehouses, retail spaces, and mixed-lighting factories.

FAQ 2 Is the IMX678 suitable for high-speed robotics vision or AMR navigation?

Answer:
Yes. IMX678 supports up to 60fps at full 12MP resolution and 120fps at 4K, giving robots and AMRs faster detection cycles, lower motion blur, and more stable tracking. The sensor’s low-noise output and fast readout pipeline reduce latency, which is critical for navigation, SLAM, obstacle avoidance, and dynamic object detection.

FAQ 3 What advantages does IMX678 offer for industrial USB3 camera modules used in machine vision?

Answer:
IMX678 12MP resolution, STARVIS 2 sensitivity, and high frame rates make it ideal for industrial USB3 cameras used in inspection, alignment, and quality control. Its stacked CMOS architecture reduces noise at high frame rates, while its HDR pipeline improves defect detection under harsh factory lighting. It outperforms IMX415/IMX485 in detail retention and stability.

FAQ 4 Is IMX678 a good choice for AI edge devices and smart retail systems?

Answer:
Yes. The 12MP resolution improves people detection, pose estimation, gaze tracking, and product recognition. STARVIS 2 low-light capability ensures stable performance in indoor retail environments, while HDR prevents overexposure from LED displays and storefront lighting. IMX678 is now one of the preferred sensors for AI smart retail cameras and embedded AI boxes.

FAQ5 Can the IMX678 maintain image quality when running at high frame rates for video analytics?

Answer:
Yes. IMX678 is engineered for high-speed readout with low read noise, preserving clarity at 60fps (12MP) and 120fps (4K). Even in reduced-resolution high-fps modes, the sensor maintains stable SNR and minimal rolling-shu