Thesis, in brief.
So it’s been a while since I went on about science per se, and longer since I went on about my own field of speech neuroscience.
Part of this has been my working on my thesis. I’ve been sort of buried in data and discussion and haven’t had an easy time breaking it down in my head, into a simpler form. And my thesis is looking more like a journal article than a thesis, so I’ve got plenty of work ahead of me.
For those of you who don’t know what I’m doing, here goes. This is at once more general, but much more descriptive, than my previous update.
I’ve got two imaging studies to work with, both older studies that were finished before I joined my current lab. In one, participants were put in an fMRI scanner while they viewed a picture, a word, or heard a word spoken. In each case it was an object, like “bread”. Half the time they just perceived the word passively. The other half of the time, they spoke the word aloud after perceiving it.
In the second study, participants were in the scanner while they watched a video of someone speaking a sentence. In some cases they saw a still image of the person’s face while the audio track played; in some cases the video track played silently; and in some cases they saw both together. Also, in some trials they had to decide if the speaker was angry or happy, and in others if the speaker was asking a question or saying a statement.
There’s a couple places I’m going with this. Firstly, I’m looking at how the brain activation during the listening condition in experiment #1 and all three modalities (auditory, visual, audiovisual) in experiment #2. Here, I’m trying to see if and how much perception activity overlaps with production activity, and whether it stays constant when you go from words to complete sentences. This is motivated partly by that motor theory of speech perception I talked about a while ago.
After that, I’m going to look at whether frontal or motor regions in the brain are more active for auditory, visual, or audiovisual perception. Another group of researchers has the idea that when you see someone talking, the visual information is sent on to motor regions involved in speech production. The brain then matches the gestures you’ve seen and the sounds you’d expect to come from those gestures if you’d made them yourself to the auditory speech information coming in your ears. This is known as hypothesis-and-test. And it predicts that speech that contains visual information should activate frontal and motor regions more than speech you just hear. So I’m also looking at that.
Lastly, if neither of those are confirmed, I’m going to look at activation for each modality in experiment #2 and try to explain how the activity we see is actually heavily dependent on both the task at hand and on the modality being used. A lot of motor theories suggest that activity during speech perception should be very general – that is, it shouldn’t matter much what sort of listening you’re doing, or what you’re thinking about doing while you’re listening. They often seem to say that there are certain regions which are always involved in speech perception, and part of my thesis will suggest that this is not, in fact, the case. Our lab generally thinks that activity is very dependent on the specifics of what the participant is being asked to do.
So far, that looks to be true.
