<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:content="http://purl.org/rss/1.0/modules/content/">
  <channel>
    <title>Software on Sebastian Spicker</title>
    <link>https://sebastianspicker.github.io/tags/software/</link>
    <description>Recent content in Software on Sebastian Spicker</description>
    <image>
      <title>Sebastian Spicker</title>
      <url>https://sebastianspicker.github.io/og-image.png</url>
      <link>https://sebastianspicker.github.io/og-image.png</link>
    </image>
    <generator>Hugo -- 0.160.0</generator>
    <language>en</language>
    <lastBuildDate>Tue, 13 Feb 2024 00:00:00 +0000</lastBuildDate>
    <atom:link href="https://sebastianspicker.github.io/tags/software/index.xml" rel="self" type="application/rss+xml" />
    <item>
      <title>What the Videography Manual Didn&#39;t Cover: Filming Music Education</title>
      <link>https://sebastianspicker.github.io/posts/filming-music-education/</link>
      <pubDate>Tue, 13 Feb 2024 00:00:00 +0000</pubDate>
      <guid>https://sebastianspicker.github.io/posts/filming-music-education/</guid>
      <description>The classroom videography manual we published in 2023 was about filming teaching. Music education has the same word in it — teaching — but it is a fundamentally different recording challenge. Sound is the subject matter. The lesson is often one person, in a practice room. And the feedback cycle the teacher needs to reach is mostly the one that happens when no camera is present. A reflection on what the manual missed, and a software prototype that tries to address part of it.</description>
      <content:encoded><![CDATA[<p><em>This post follows from the <a href="/posts/villa-videography-manual/">May 2023 post on the classroom videography
manual</a>. Read that one first if you want
the baseline.</em></p>
<hr>
<h2 id="the-assumption-underneath-the-manual">The Assumption Underneath the Manual</h2>
<p>The manual we published — Kramer, Spicker, and Kaspar, 2023, open access at
<a href="https://kups.ub.uni-koeln.de/65599/">kups.ub.uni-koeln.de/65599</a> — is a
good document for what it is. It covers a classroom. It assumes a teacher
in front of twenty to thirty students, a forty-five minute lesson, a room
with windows that create backlighting problems, a consent process that
involves four institutional levels, and two static cameras facing each other
as the baseline configuration.</p>
<p>All of that is correct for the context it addresses. The context is
school-based subject teaching: physics, mathematics, German, history. The
University of Cologne teacher education programme we developed the manual
for is primarily about preparing people for exactly that context.</p>
<p>When I moved to the Cologne University of Music, I brought the same assumptions
with me. It took a while for me to notice how much the new context violated
them.</p>
<hr>
<h2 id="sound-is-not-the-same-problem">Sound Is Not the Same Problem</h2>
<p>In the manual, the section on audio equipment is focused on speech capture.
The recommendation — lavalier microphones for the teacher, boundary
microphones at the cameras for student audio — is correct for a lesson where
the subject matter is communicated through talking. The teacher talks. The
students talk back. The quality criterion for the audio is: can we understand
what is being said?</p>
<p>In music education, the subject matter <em>is</em> sound. What the student
produces acoustically is not background noise supporting verbal instruction —
it is the object of the lesson. And it is produced by instruments that
have almost nothing in common acoustically with a human voice.</p>
<p>A lavalier microphone clipped to a teacher&rsquo;s collar, positioned to capture
speech from thirty centimetres away, will record a student&rsquo;s piano playing
through the back of the teacher&rsquo;s head, through the air, through a
directional capsule aimed at the wrong thing. The resulting audio is
technically present and analytically useless.</p>
<p>Instruments have frequency ranges, dynamic ranges, and directional patterns
that require completely different microphone selection and placement. A
violin at fortissimo in a small practice room will clip every speech-grade
microphone in the room. A pianissimo pianists&rsquo; breath-controlled passage
that a skilled listener can hear clearly will barely register on a distant
boundary microphone designed to capture &ldquo;the general acoustic environment.&rdquo;
The distinction between a correctly produced tone and an incorrectly produced
tone — which is the actual content of the lesson — may or may not be
audible in the captured audio depending on whether anyone thought about
microphone choice before walking through the door.</p>
<p>The manual&rsquo;s principle of &ldquo;as much as necessary, as little as possible&rdquo;
still applies, but &ldquo;necessary&rdquo; is a completely different specification
here.</p>
<hr>
<h2 id="the-one-to-one-lesson-problem">The One-to-One Lesson Problem</h2>
<p>The classroom videography framework — including the manual — is built around
a structural assumption: there is a teacher, and there is a class.
The teacher stands or moves at the front; the students are arrayed in rows
or groups. Two cameras can cover this because the spatial structure is
relatively stable and the relevant action is roughly predictable.</p>
<p>A university instrumental lesson is typically one-to-one, in a small
practice room, for sixty minutes. The spatial structure is two people
close together around an instrument. The relevant action includes:</p>
<ul>
<li>The teacher demonstrating a passage on their own instrument</li>
<li>The teacher making a physical correction — adjusting bow arm position,
repositioning the student&rsquo;s hand on the fingerboard, demonstrating
breath support by putting a hand on the student&rsquo;s diaphragm</li>
<li>The student playing and the teacher listening with their eyes closed</li>
<li>The teacher singing a melodic contour to show phrasing</li>
<li>Both of them playing at the same time (unison work, call and response)</li>
</ul>
<p>A standard two-camera classroom setup captures none of this usefully.
The standard framing — wide angle, teacher on one side, student on the
other — produces footage where &ldquo;something is happening near the piano&rdquo;
but where the analytically relevant detail (the finger position, the
bow angle, the postural correction) is invisible at normal viewing distance.</p>
<p>You need different framing. You probably need closer cameras. You might
need a third angle for body position. And you need to accept that this
raises the setup complexity substantially beyond what the manual recommends
as a baseline.</p>
<hr>
<h2 id="what-the-lesson-is-actually-about">What the Lesson Is Actually About</h2>
<p>There is a deeper structural difference that the equipment and setup
challenges are symptoms of.</p>
<p>In subject-matter teaching, the lesson is the unit of analysis. A
forty-five-minute lesson has a beginning, a development, a conclusion.
The teacher enters with a plan; the video captures how that plan was
executed and how the students responded. The analytical interest is in
the lesson as a coherent pedagogical event.</p>
<p>In instrumental music education, the lesson is a container for cycles.
A student plays a passage. The teacher identifies a problem — the
intonation at bar twelve, the tendency to rush the syncopated rhythm,
the bow pressure collapsing in the crescendo. The teacher says or
demonstrates something. The student tries again. The teacher listens
to what changed and what did not.</p>
<p>These cycles are the unit of analysis, and they happen dozens of times
in a single lesson. The lesson-level video is useful context, but the
analytically interesting question is inside the cycle: what did the
teacher identify, what intervention did they choose, what happened to
the student&rsquo;s playing afterward?</p>
<p>Capturing those cycles in usable form requires not just video of the
lesson but video that is indexed to them — where each attempt-and-response
pair can be located and compared. A continuous recording of a sixty-minute
lesson is not organised for this purpose. Timestamps help but do not
replace the work of finding and annotating each cycle.</p>
<hr>
<h2 id="the-absent-camera-problem">The Absent Camera Problem</h2>
<p>There is a more fundamental issue that no amount of improved equipment
configuration addresses.</p>
<p>The feedback cycle a teacher most wants to reach is the one that happens
in a student&rsquo;s practice session. Between lessons, the student is alone
in a practice room, working through the same passages, repeating the same
mistakes (or, occasionally, having the experience of something going right
for reasons they do not fully understand). The teacher&rsquo;s instructions from
the last lesson are present only in the student&rsquo;s memory of them, which is
fallible and partial.</p>
<p>The videography manual is about research documentation: a trained operator,
institutional consent, equipment brought in from outside. None of that is
available in a student&rsquo;s practice session at eleven o&rsquo;clock on a Wednesday
night. And even if you could film it — which you could, technically, with
a phone — the resulting footage would be unwatched, because no workflow
exists to get it from the student&rsquo;s device to the teacher&rsquo;s eyes in a form
that supports structured feedback.</p>
<p>The practical reality is that most music teachers receive feedback about a
student&rsquo;s practice only through the student&rsquo;s report of it (&ldquo;I practiced
every day&rdquo;) and through the evidence presented in the lesson (which may or
may not reflect what practice actually looked like). The gap between
practice and lesson feedback is a structural feature of music education,
and it is not something that research videography can address.</p>
<hr>
<h2 id="a-software-response">A Software Response</h2>
<p>The tool I built to think through this problem is called Resonance, and it
is available at <a href="https://github.com/sebastianspicker/resonance">github.com/sebastianspicker/resonance</a>.</p>
<p>The design is deliberately different from the research videography model.
Instead of an external camera operator documenting a lesson for later
analysis, Resonance puts the documentation instrument in the student&rsquo;s
hands. Students capture short audio or video clips of their own practice —
snippets of a passage they want the teacher to hear, a moment where
something went wrong, a phrase they are finally getting right — and submit
them to a course. The teacher reviews the queue and adds feedback with
timestamped annotations: &ldquo;at 0:23, the bow pressure drops — this is what
is generating the scratch.&rdquo;</p>
<p>The asymmetry is intentional. The student decides what to document.
The teacher provides structured, specific feedback. The cycle is
asynchronous — the student submits at eleven on a Wednesday night; the
teacher responds Thursday morning — which means it is independent of
the lesson schedule.</p>
<p>The technical decisions follow from the use context. Students practice in
rooms where connectivity is unreliable, so the app is offline-first:
recordings are captured locally and uploaded when a connection is available.
An iPad is the natural form factor for a music student — larger screen,
better camera, sits on a music stand. The backend is standard (Node.js,
Postgres, S3-compatible object storage) because the interesting problem here
is not the infrastructure but the workflow.</p>
<p>Resonance is a prototype and a proof of concept, not a production system.
The authentication is explicitly development-mode only. The goal was to
build enough of the thing to be able to think clearly about what it does
and does not solve.</p>
<hr>
<h2 id="what-it-does-not-solve">What It Does Not Solve</h2>
<p>Resonance addresses the absent-camera problem for the practice-to-feedback
loop. It does not address the research documentation problem that the
videography manual was written for.</p>
<p>If you want to study <em>how music teachers give feedback</em> — as a research
question about teaching practice, not just as a workflow tool — you still
need the full apparatus: controlled recording conditions, appropriate
microphones for instruments, multi-camera coverage of the lesson, consent
for the resulting footage to be used for research and teaching purposes,
and post-processing that produces an analytically usable document.</p>
<p>Resonance footage is not that. It is what a student chose to capture on an
iPad in a practice room, with whatever acoustic environment happened to be
present. It is useful for the practice-feedback cycle; it is not a research
record.</p>
<p>The challenges I described in the first two sections — appropriate
microphones, multi-angle coverage of one-to-one lessons, capture of
the practice cycle rather than the lesson arc — are still open problems
for anyone trying to do systematic observational research in music education.
The manual gives you the framework for thinking about them. It does not
give you solutions, because those solutions are context-specific and, in
several cases, not yet worked out by the field.</p>
<p>What I find interesting is that the two problems — research documentation
and practice-feedback — might look the same (filming music education)
but require almost entirely different responses. Getting clear on which
problem you are solving turns out to be most of the work.</p>
<hr>
<p><em>The full classroom videography manual is at
<a href="https://kups.ub.uni-koeln.de/65599/">kups.ub.uni-koeln.de/65599</a>.
The Resonance repository is at
<a href="https://github.com/sebastianspicker/resonance">github.com/sebastianspicker/resonance</a>.</em></p>
<hr>
<h2 id="references">References</h2>
<p>Kramer, C., Spicker, S. J., &amp; Kaspar, K. (2023). <em>Manual zur Erstellung
von Unterrichtsvideographien</em>. KUPS Open Access.
<a href="https://kups.ub.uni-koeln.de/65599/">https://kups.ub.uni-koeln.de/65599/</a></p>
<p>Lehmann, A. C., Sloboda, J. A., &amp; Woody, R. H. (2007). <em>Psychology for
Musicians: Understanding and Acquiring the Skills</em>. Oxford University Press.</p>
<p>Presland, C. (2005). Conservatoire student and instrumental professor:
The student perspective on a complex relationship. <em>British Journal of Music
Education</em>, 22(3), 237–248.
<a href="https://doi.org/10.1017/S0265051705006558">https://doi.org/10.1017/S0265051705006558</a></p>
<p>Creech, A., &amp; Hallam, S. (2011). Learning a musical instrument: The
influence of interpersonal interaction on outcomes for school-aged pupils.
<em>Psychology of Music</em>, 39(1), 102–122.
<a href="https://doi.org/10.1177/0305735610370222">https://doi.org/10.1177/0305735610370222</a></p>
]]></content:encoded>
    </item>
  </channel>
</rss>
