- After holding down the "Z" button on the N64 controller, an instruction is sent by the CPU to the VRU to begin recording analogue data inputted by the mic. This data is not capable of being stored in its current state, so this analogue data is converted into storable digital data.
- Now stored in the Work RAM should be two sets of digital voice date. One set being the synthesized word data provided by Hey You, Pikachu! And the other that was translated from the inputted analogue data via the mic. The operator data is compared one by one to each of the expected game words. Distance calculations are performed to rank the probably of a word match. The top two words ranked are converted back to "word code" and stored back in RAM54 (along with the calculated distance number that corresponds to the predicted "word code." The DSP also sets up a flag with the predicted word data in preparation for the N64's CPU response.
- Upon releasing the "Z" button, the N64's CPU sends a capturing signal to the DSP. In response, the DSP goes back into RAM54 to fetch the flagged data and sends the requested "code number" and "distance correlation value" to the N64's CPU awaiting processing by the video game. The flag in RAM54 is shut off by the DSP. This completes the general process of the Voice Recognition Unit.
- 3. The DSP now takes the "word code" originally sent by the N64's CPU (now stored in RAM54) and uses the general voice recognition data (the vowels and consonants stored in ROM53) to synthesize into digital word data. These are the words expected to be inputted by the game operator through the mic.
- The N64's CPU sends special "word code" data that is stored in RAM54 at the beginning of stage, level or section. I believe this only consists of enough data for 3 words. Remember, however, these are not digital words, instead, are "word codes" that are later used by the DSP to synthesize digital words.
I / F
- Nintendo 64 Console
- The A/D converter converts analogue date
into Digital Data that can be stored in the
- This portion stores "voice data"
used in voice synthesis. For
example: vowels & consonants.
- This portion is used in storing
"word code" sent by the N64's
CPU. This code is used by the
DSP to synthesize word data.
- This is where transcribed analogue
data (into storable voice data) is
stored in preparation for processing.
- This portion contains instructions
used by the DSP to perform
- Voice Recognition Unit