This turned out the quickest way to get it done, a graphical dump of my current picture related to the relationship of sound, music, sequences and search, based on a shared modeling approach. Incomplete but more or less consistent [claim]. Domain layer in black, modeling layer in green.

Graphical description of the scenery drawing

By combining coding, latent space state propagation, and hierarchical composition, most of the phenomena in sound, music, vocalization, spoken language, and written language can be modelled, all with the same few components.

Taking language as variable length sequences of actions, this can be extended straightforwardly to model navigation problems.

Music and robotics

(Merging previous standalone post from 2019-02-12, because it was only a mini-draft and relates to sequence models.)

The strong connection between robots and music is not so easily seen by surprisingly many people. Let’s try and tell the story in an accessible way and then provide high level of detail for those interested.

Comments

Footnotes

1fn.1

tag cloud

robotics music AI books research psychology intelligence feed ethology computational startups sound jcl brain audio organization motivation models micro management jetpack funding dsp testing test synthesis sonfication smp scope risk principles musician motion mapping language gt fail exploration evolution epistemology digital decision datadriven culture computing computer-music complexity algorithms ai aesthetics action wayfinding visualization tools thinking theory temporal sustainability supercollider stuff sonic-art sonic-ambience society slop signal-processing self score robots robot-learning robot python pxp priors predictive policies philosophy perception organization-of-behavior open-world open-culture neuroscience networking network navigation movies minecraft midi message-passing measures math locomotion llms linux learning kpi internet init health hacker growth grounding graphical generative gaming games explanation event-representation embedding economy discrete development definitions cyberspace criticism creativity computer compmus cognition coding-agents business birds biology bio-inspiration benchmarks android agents