Research
Home  >  Research

Service Robot

Robot Town Project

We are conducting the research project named Robot Town Project. The aim of this research is to develop a management system for distributed sensors such as cameras, laser range finders, and IC tags, and service robots so that service robots can provide service tasks for humans in a daily life environment.


Tracking of multiple targets Tracking of 11 people by singe particle filter Tracking humans in a house
photo
Movie
photo
Movie
photo
Movie

Human motion capturing by distributed cameras Robot control by gesture
photo
Movie
photo
Movie
Papers

ROS-TMS (ROS - Town Management System)

We have been developing an informationally structured room for supporting the daily life activities of elderly or disabled people. This room integrates different sensor modalities in a natural and non-invasive way by embedding sensors in the environment. To connect and operate various robots and sensors appropriately, we also have been developing an operating system which manages various sensor/robot modules and database named ROS-TMS (ROS - Town Management System).


Overview ROS-TMS architecture
photo photo
Intelligent refrigerator Intelligent cabinet
photo
Movie
photophoto
Movie
Object recommendation using smart glass Object recommendation using smartphone
photo
Movie
photo
Movie
Immersive VR Interface Service robot with Velodyne Lidar
photo
Movie
photo
Movie
Fetch task by service robot (simulation) Fetch task by service robot (real)
photo
Movie
photo
Movie
Fetch task by service robot (simulation) Fetch task by service robot (real)
photo
Movie
photo
Movie
Papers

Voice control system for ROS-TMS

Robot control system using voice is being developed with ROS-TMS.


Service robot Robotic bed
photo
Movie
photo
Movie
Light control Object search
photo
Movie
photo
Movie
Weather forecast Knowledge retrieval
photo
Movie
photo
Movie

Big Sensor Box (B-Sen)

Big Sensor Box (B-Sen) is a experimental house for human and robot coexistence developed by IoRT (Internet of Robots and Things) technology. Big Sensor Box is placed in COI building in Ito Campus, Kyushu University. Big Sensor Box has a living room, a bed room, a kitchen, and a bathroom, and is a habitable space. ROS-TMS (ROS - Town Management System) is a control system of robots and sensors in this facility.


COI innovation faculty Big Sensor Box
photo
Movie
photo
Movie
Big Sensor Box Big Sensor Box
photo photo
Big Sensor Box (3D model) Big Sensor Box (3D model)
photo photo

Elderly care and monitoring system

We are developing a nursing care monitoring system for the elderly using distributed sensors under the control of ROS-TMS.


Noninvasive heartbeat and positon sensor (Kinect, LRF) Noninvasive heartbeat and positon sensor (Kinect, LRF)
photo photo
Heartbeat rate Walking detection
photo
Movie
photo
Movie
Wearable heartbeat and position sensor Heartbeat measurement with accurate positioning
photo photo
Movie
Fall detection High precise and small wearable position sensor
photo
Movie
photo
Movie