Augmented reality to support parcel handling in last-mile logistics

Abstract

We have developed an augmented reality (AR) based system which keeps track of events during the parcel handling process for last-mile logistics. The system can retrieve and highlight the location of parcels in large piles with AR on the user's smartphone. A camera array automatically detects the parcels laid down manually by an operator. New parcels are scanned and parcel fingerprints are generated semi-automatically. The system can detect and track the known parcels by fingerprint and can further highlight the location of the parcel using 3D visual clues, directly on the smartphone of the operator.