Industrial & hardwareStatus: Prototype
Vision-based inspection with a camera gantry
Challenge
Stock had to be reconciled with the target state in the system on a regular basis. Counting and scanning by hand was slow and error-prone, especially across large areas.
Technology
- Python
- FastAPI
- Kotlin
- CameraX
- ESP32
- Feldorientierte Regelung (FOC)
- WebSocket
- Bilderkennung
Requirements
- Automatic capture of barcodes and QR codes across an entire area
- Target/actual reconciliation against ERP data
- Two-axis camera positioning
- Safe behaviour with uncalibrated axes
- Live dashboard for the results
Approach
- 01Camera gantry with a field-oriented-control BLDC axis and a stepper axis
- 02ESP32 firmware for positioning, connected via Wi-Fi WebSocket
- 03Android app as camera and control node
- 04Server for orchestration, image recognition, reconciliation and dashboard
- 05Interface contracts as the single source for all subsystems; third generation of a solution developed since 2023