A software service for the garbage type recognition based on the mobile computing devices with graphical data input

Abstract

The article describes problems of determining the type and automatic sorting of household waste using mobile computing devices. All of the required hardware and partially software, required for implementation of this service, are already present in modern smartphones. iOS and Apple products were selected as the base for the service, due to such advantages over competitors: dual or triple depth camera (TDCS), powerful GPU, Neural Engine coprocessor, high autonomy (2750 mAh battery size), sensors that allow for user positioning and navigation in space (GPS, Glonass, Gyroscope) and most important feature is possibility of cross-platform designing, suitable for iOS and macOS (Project Catalina). The recognition process consists of several phases, including capturing of graphic image and detecting the object shape, shape analysis, computing the results, and saving new associations to the database. The analysis itself is implemented using a neural network that is able to learn during its operation. Initially, the algorithm is driven by the selection of photographs with a certain type for the base set of associations, each subsequent scan improves accuracy. Cross-platforming plays a very important role - it allows us to develop a single software service that is initially run on a macOS-based computer for faster learning and then can be easily used on an iOS mobile device. After identifying a particular type of garbage, the route to the nearest recycling point of such type of garbage will be proposed for user or user’s clarification will be requested. User can also manually browse categories and related items, manually search by name of item, and view locations for sorting and recycling in appropriate city. When a completely unknown object arrives, it is possible to refine the information in order to help further learning of the network.