The plugin comes with a local material library and a cloud material database once it is installed into the application. The local material library stores the fundamental materials with their texture data as well as the specific vibrating patterns for the gloves. The plugin is designed to cultivate the customized material library based on individual preferences and usage frequency. Users can update this material library with the latest material data which users discover in the daily life.
The Cloud Material Database
The Cloud Material Database is built on the Google Cloud Vision API (GCV), and we have our own image catalog based on different materials of physical objects. We collect a variety of images of different objects, and classify them by materials. The Cloud Material Database includes a variety of specific categories, such as glass, iron, aluminium, steel and so on. We use our own Cloud Material Database to identify materials of a diversity of objects. When the local material library could not detect or find the materials of the captured object in its own library, the plugin will access the cloud Material Database Service to match the materials in its cloud database. The GCV-based cloud Material Database collects all kinds of material data from existing sources online as well as users’ uploads and then trains them with a deep neural network through machine learning. The database can also store users' materials when the local library reaches capacity.
Each side of the True Sense Glove is constructed with three linear coin-shaped actuators placed on the back of each finger to form an array of 14 actuators in total (Figure 1). Based on this, True Sense Gloves map small the actuators as their surface area as same to each region on a human finger. For example, if the index finger is flexed on the glove, the user will feel the vibration from the three actuators on the index finger of the glove, simulating the human haptic sensation of the physical object. The actuators employ lateral force in order to display 2.5 dimensional geometrical shape, which is the texture of material in the plugin material library. By combining gloves and the haptic illusion, the True Sense system presents virtual bump illusions.