From snowboarding to motion, music, and robotics

Recently while browsing my favorite robotics magazine I started reading an interview with Travis Rice, previously unknown to me, promoting his recent film The Fourth Phase. It’s usual that athletes mention issues interesting to robotics when talking about their body and the challenges involved in particular stunts, which is the reason why RB in fact is my fav’ed robotics mag in the first place. What struck me about this interview, though, is that Travis just didn’t stop dropping major agreeable insights about motion and environments and possible responses of an agent. Sorry for the german text, here’s the english version of the interview which seems nicer in the formulations anyway ;)

Snowboarding and music

This is about adaptive rhythms which play with the topographic situation and the transitions between local configurations, the result being a combination of the influences of the environment and the individual response. The same evaluation criteria seem to apply for music and motion in terms of the groove. Would be nice if we could capture that as a loss criterion for learning motions, like, what is a nice dance for a given song.

Topography, saliency, navigation

First we need errors to do any actual learning, no problem. Then this is about picking salient features of the topography, landmarks, as reference points to attach triggers for specific action sequences.

Flow, reaction speed and mental simulation

Adequate reaction speed requires a flow-state which means very little or zero conscious participation in the motion control. Not sure about the fear stuff in the context of robotics. Finally, mental simulation is being used for finding an action sequence that copes with some topographic situation and is being pushed down during the simulations into low-level action control.

Search objectives, exploration

This is about search criteria where you are trying to find features that provoke motion solutions which are supposed to be rewarding in the musical sense, which provides inspiration for interesting exploration objectives for robots (“… geological oddities. We want weird. Weird is good”). Actively seek out environmental and perceptual challenges such that entirely new behaviour needs to be generated in response.

Motivations, objectives

Finding an answer to weird and unusual environmental stimuli that you have sought out earlier using the weirdness search objective.

Cheers, let’s move.


tag cloud

robotics music research sound jcl startups books audio models jetpack motivation micro intelligence funding feed ethology dsp computational brain algorithms AI testing test synthesis sonfication smp scope psychology principles organization musician motion mapping management gt generative exploration digital datadriven computing computer complexity aesthetics wyafinding visualization tools theory temporal sustainability stuff sonic-art sonic-ambience society signal-processing sequence self score robots robot-learning risk python pxp priors predictive policies philosophy perception organization-of-behavior open-world open-culture neuroscience networking network navigation minecraft midi measures math locomotion linux learning kpi internet init health hacker growth grounding-fail grounding graphical gaming games explanation event-representation epistemology embedding discrete development definitions decision cyberspace culture creativity computer-music compmus cognition business birds biology bio-inspiration android agents action