WEBVTT 00:00:00.000 --> 00:00:00.960 align:middle line:90% 00:00:00.960 --> 00:00:04.430 align:middle line:84% Hello, in this video, we will look at mobile technologies 00:00:04.430 --> 00:00:08.750 align:middle line:84% for studying music and body motion. 00:00:08.750 --> 00:00:10.310 align:middle line:84% In the laboratory setting, we are 00:00:10.310 --> 00:00:15.240 align:middle line:84% able to use highly advanced infrared optical motion capture 00:00:15.240 --> 00:00:17.930 align:middle line:84% systems to study, very precisely, 00:00:17.930 --> 00:00:20.310 align:middle line:90% how people move to music. 00:00:20.310 --> 00:00:23.660 align:middle line:84% But, sometimes, we need to go outside the lab 00:00:23.660 --> 00:00:26.790 align:middle line:84% and study how people move in the real world, 00:00:26.790 --> 00:00:31.330 align:middle line:84% how people move while listening to music on the metro, 00:00:31.330 --> 00:00:34.900 align:middle line:84% on the bus, or in the dance club. 00:00:34.900 --> 00:00:37.430 align:middle line:84% For this reason, we need to have some sort 00:00:37.430 --> 00:00:43.360 align:middle line:84% of mobile technology for studying music and body motion. 00:00:43.360 --> 00:00:45.270 align:middle line:84% In front of me, I have a couple of examples 00:00:45.270 --> 00:00:47.270 align:middle line:90% of such technologies. 00:00:47.270 --> 00:00:49.060 align:middle line:84% One of the advantages of this system 00:00:49.060 --> 00:00:51.680 align:middle line:84% is that it can be very, very small, 00:00:51.680 --> 00:00:54.520 align:middle line:90% such as this accelerometer. 00:00:54.520 --> 00:00:58.270 align:middle line:84% Imagine studying body motion in a dance club 00:00:58.270 --> 00:01:00.930 align:middle line:84% where you can put this in the pocket of every dancer 00:01:00.930 --> 00:01:04.180 align:middle line:84% in the club, and you get some data on how they move 00:01:04.180 --> 00:01:07.400 align:middle line:84% and can see how this relates to the music 00:01:07.400 --> 00:01:11.730 align:middle line:84% and how they compare to each other. 00:01:11.730 --> 00:01:16.010 align:middle line:84% Accelerometers and gyroscopes and also magnetometers 00:01:16.010 --> 00:01:19.200 align:middle line:84% are inside every-- basically, at least 00:01:19.200 --> 00:01:22.170 align:middle line:90% every mobile phone these days. 00:01:22.170 --> 00:01:26.920 align:middle line:84% So everybody, in practise, has their own motion capture 00:01:26.920 --> 00:01:31.460 align:middle line:84% technology that they carry around. 00:01:31.460 --> 00:01:33.580 align:middle line:84% More specialised systems also exist, 00:01:33.580 --> 00:01:39.500 align:middle line:84% such as this bracelet which contains a sensor that measure 00:01:39.500 --> 00:01:44.270 align:middle line:84% muscle tension, in addition to the accelerometer and gyroscope 00:01:44.270 --> 00:01:49.450 align:middle line:84% that lets you measure the direction of the bracelet 00:01:49.450 --> 00:01:55.570 align:middle line:84% and also how fast it accelerates, like this. 00:01:55.570 --> 00:01:58.660 align:middle line:84% So it will tell you which direction I point 00:01:58.660 --> 00:02:02.610 align:middle line:84% and how I turned my hand because of the muscle sensors. 00:02:02.610 --> 00:02:06.730 align:middle line:90% 00:02:06.730 --> 00:02:11.780 align:middle line:84% This suit is a motion capture suit from Accents Technologies. 00:02:11.780 --> 00:02:17.040 align:middle line:84% It contains 17 of these orange sensors 00:02:17.040 --> 00:02:19.310 align:middle line:84% and, inside each of these, there's 00:02:19.310 --> 00:02:25.280 align:middle line:84% a magnetometer and gyroscope and accelerometer, 00:02:25.280 --> 00:02:28.360 align:middle line:84% which measures inertia and acceleration 00:02:28.360 --> 00:02:34.350 align:middle line:84% and the magnetic flux, or basically a compass. 00:02:34.350 --> 00:02:39.530 align:middle line:84% Combining 17 of the sensors with a model of a human body, 00:02:39.530 --> 00:02:43.310 align:middle line:84% saying that, for instance, this sensor and this sensor 00:02:43.310 --> 00:02:47.170 align:middle line:84% can't move further apart than this and this sensor 00:02:47.170 --> 00:02:50.940 align:middle line:84% and this sensor can only move in this angle, 00:02:50.940 --> 00:02:54.690 align:middle line:84% it's possible to get an estimation of how 00:02:54.690 --> 00:03:00.380 align:middle line:84% the pose of the person is at any time. 00:03:00.380 --> 00:03:04.160 align:middle line:84% And the result you get is quite good, actually, 00:03:04.160 --> 00:03:07.060 align:middle line:84% from thinking that this is-- this type of technology, 00:03:07.060 --> 00:03:09.660 align:middle line:90% there are no cameras involved. 00:03:09.660 --> 00:03:13.980 align:middle line:84% The system is portable with two cylinders, like this. 00:03:13.980 --> 00:03:17.850 align:middle line:84% And it's possible to move quite far 00:03:17.850 --> 00:03:23.300 align:middle line:84% away from the transmitter, which is right next to our computer. 00:03:23.300 --> 00:03:27.240 align:middle line:84% So looking at the screen now, my head is upright 00:03:27.240 --> 00:03:29.450 align:middle line:84% and the avatar is following my movements. 00:03:29.450 --> 00:03:32.550 align:middle line:84% We tested it up to 50 metres without problems. 00:03:32.550 --> 00:03:35.400 align:middle line:90% 00:03:35.400 --> 00:03:38.930 align:middle line:84% The one small problem with this system is that it's drifting, 00:03:38.930 --> 00:03:42.460 align:middle line:84% so if you move around a lot and go back to the same place, 00:03:42.460 --> 00:03:46.950 align:middle line:84% you will possibly have a result that diverges slightly. 00:03:46.950 --> 00:03:52.570 align:middle line:84% And also, it's not able to give you millimetre position, 00:03:52.570 --> 00:03:55.910 align:middle line:84% like you get in the optical systems. 00:03:55.910 --> 00:04:01.090 align:middle line:84% Still, it's remarkably good and absolutely a good way 00:04:01.090 --> 00:04:03.980 align:middle line:90% of measuring body movement. 00:04:03.980 --> 00:04:06.560 align:middle line:84% What you can see here is that there's quite a lot of cables, 00:04:06.560 --> 00:04:11.560 align:middle line:84% so using it in, for instance a stage performance, 00:04:11.560 --> 00:04:14.995 align:middle line:84% requires that you are aware of your system. 00:04:14.995 --> 00:04:17.310 align:middle line:84% And you will not be able to move as freely 00:04:17.310 --> 00:04:19.116 align:middle line:90% as without the system. 00:04:19.116 --> 00:04:22.029 align:middle line:84% But we've used it in several performances, 00:04:22.029 --> 00:04:26.160 align:middle line:84% and you can use it as a DJ to control DJ sets 00:04:26.160 --> 00:04:28.130 align:middle line:90% or as a musical instrument. 00:04:28.130 --> 00:04:30.580 align:middle line:90% [PLAYING GUITAR] 00:04:30.580 --> 00:04:47.595 align:middle line:90%