Cognable
Work with Loquendo and Character Server.
Still adding stuff....
Work from a project for students with complex needs which is using Media Semantics for an AIML based help system, static animations around some educational activities and dynamic generation of TTS using the wonderful Loquendo engine.
Page reading on demand using a PHP DOM Parser and Magpie RSS - from cache due to portage limits on the TTS engine.
- ToonSpeeka - Work in Progress - Text/HTML to avatar Demo
- BBC Homepage Dynamic Reader Demo
- BBC News RSS Feed Reader
Lansbury's main navigation console is modelled on a VOCA and using PCS Symbols to iconifiy the menu and major page elements such as headings.
Grids change dynamically by context and can be accessed directly by switch users - the interface optionally autoscans to allow single switch access or site navigation using only the spacebar.
All pages are read automatically by default using Loquendo TTS, although this option can be switched off with speech provided on demand via inline controls positioned next to headings.
For scripted content, such as help, elearning activities and page introductions, speech is captionned via bubble text in the avatar window of the console. Dynamic TTS is uncaptionned currently, although is simply reading page text.
Fallback html menus and options to remove or silence the Flash elements are provided for other users
New James Character
Revised James character based on Smith Micro James figure - rendered via Poser & the Character Builder Extensibility Kit. This is a really painless process if Jessi & James are used as base, but porting the mouth/facial morphs to other models is proving rather more time consuming.
Download CB files for New James Character (RAR)
Stock Avatar & Microsoft Mary TTS
Stock avatar using Media Semantic's interface to a Pandorabots (using Annotated ALICE).
The application at Lansbury is a more simple implementation using AIML (and autocorrection of text input with pspell) around a limited ruleset (and CS's built-in Program D) just to spruce up the help system.
AIML is interesting in this context since reductive syntactic analysis has a great deal in common with the way folk with significant communication disabilities handle language receptively. A large amount of work to leverage exists and chat bots in this context may actually prove both useful and engaging to students.