This turned out the quickest way to get it done, a graphical dump of my current picture related to the relationship of sound, music, sequences and search, based on a shared modeling approach. Incomplete but more or less consistent [claim]. Domain layer in black, modeling layer in green.

Graphical description of the scenery drawing

By combining coding, latent space state propagation, and hierarchical composition, most of the phenomena in sound, music, vocalization, spoken language, and written language can be modelled, all with the same few components.

Taking language as variable length sequences of actions, this can be extended straightforwardly to model navigation problems.

Music and robotics

(Merging previous standalone post from 2019-02-12, because it was only a mini-draft and relates to sequence models.)

The strong connection between robots and music is not so easily seen by surprisingly many people. Let’s try and tell the story in an accessible way and then provide high level of detail for those interested.

Comments

Footnotes

1fn.1

tag cloud

robotics music AI books research psychology intelligence feed ethology computational startups sound jcl audio brain organization motivation models micro management jetpack funding dsp testing test synthesis sonfication smp scope risk principles musician motion mapping language gt fail exploration evolution epistemology digital decision datadriven computing computer-music complexity algorithms aesthetics wayfinding visualization tools theory temporal sustainability supercollider stuff sonic-art sonic-ambience society signal-processing self score robots robot-learning robot python pxp priors predictive policies philosophy perception organization-of-behavior open-world open-culture neuroscience networking network navigation movies minecraft midi message-passing measures math locomotion linux learning kpi internet init health hacker growth grounding graphical generative gaming games explanation event-representation embedding economy discrete development definitions cyberspace culture creativity computer compmus cognition business birds biology bio-inspiration android ai agents action