YUKAI and DoCoMo to Release ‘codama,’
a Developers’ Kit That Makes IoT Devices Voice-Operable
Built-in XMOS voice processor captures voice from afar and all directions
TOKYO (Dec. 3, 2018) – On Dec. 21, YUKAI Engineering Inc., a Tokyo-based robotics startup, and NTT DoCoMo, Japan’s largest mobile services provider, will jointly release codama, a voice interface development kit that can turn all kinds of electronic and IoT devices into voice-operable ones. Developers can integrate codama into their products to run them via NTT DoCoMo AI Agent API by using DoCoMo’s Raspberry Pi programming software. Featuring XMOS’s beamforming voice processor, codama enables devices to capture voice commands from distances, even in noisy environments, accurately interpret them, and respond.
The kit, which will be available on Amazon.co.jp and GitHub for 15,000 Japanese yen, will be demonstrated at DoCoMo Open House 2018 to be held at Tokyo Big Sight from Dec. 6-8, 2018.
Service- and Device-Agnostic Speech Interface
codama
High-Performance Voice Recognition
codama uses XMOS XVF3100 that features:
- Beamforming that detects the direction of the user’s voice and tracks it as the speaker moves around.
- Sophisticated algorithms that deliver acoustic echo cancellation, dereverberation and noise suppression that enables codama to capture the user’s voice even when spoken softly.
- “Barge-in” capability that enables the user to give a command while playing music on it.
Easy Steps to Create a Personalized Speech Dialogue Device
Users can go on YUKAI Engineering’s Website to create and register their own voice keywords for their devices. They may also opt to have codama devices respond to their personalized keywords only.
“Codama enables people to easily and inexpensively create their own, custom-designed voice-operable IoT devices. This is a game changer for businesses that are interested in tapping into the power of AI-supported speech communications to provide new services. This could not have been achieved without NTT DoCoMo’s forward vision to promote innovation through the initiative and XMOS’s cutting-edge technology,” YUKAI Engineering CEO Shunsuke Aoki said.
“NTT DoCoMo developed AI Agent API to ultimately provide end users with all-new speech AI experiences based on highly natural AI-supported communication. Today, we are very excited to introduce new speech development kit integrated with XMOS’s class-leading far-field voice interface technology working with Raspberry Pi and NTT DOCOMO AI Agent API seamlessly. This kit enables everybody to develop speech and dialog service “device” easily. We are very grateful to Yukai engineering and XMOS team collaboration to takes this major step forward for achieving our goal. We are expecting all users to enjoy new speech AI experiences,” Yoshikazu Akinaga, Manager of Innovation Management Department at NTT DoCoMo, said.
Key Features
- Measurement: 64mm(W) x 55mm(L) x 20mm (H). (H)20mm (Includes the pin header.)
- Connects to standard Raspberry Pi 40PIN.
- A separate microphone array board comprised of four (4) linear microphone arrays. The user can install the board in a desirable place by using cables.
- Includes a search engine for wake-words and keywords. The user may set up their own wake-words and keywords.
- Barge-in feature that enables the device to recognize the user’s voice while music is playing on it.
- Beamforming that enables the device to capture voice from all directions through the four microphones.
- Acoustic echo cancellation, dereverberation and noise suppression that enables codama to capture the user’s voice even in a noisey space.
- Automatic Gain Control (AGC)
- Direction of arrival (DOA) indication
About YUKAI
YUKAI Engineering is a robotics startup that develops and sells products befitting its slogan: “Make the world a fun place to live in with robotics technology.” YUKAI’s award-winning products include Necomimi, a headband with fake cat ears that move in sync with the user’s brain waves (selected for the Time magazine’s “The World’s 50 Best Innovations 2011” list), and BOCCO, a communication robot that keeps family members in touch with each other.
About NTT DoCoMo
NTT DoCoMo, Japan’s largest telecommunications company, provides innovative, convenient and secure mobile services that enable customers to realize smarter lives. A world-leading developer of 5G networks, NTT DoCoMo is also driving innovation in NFC infrastructure and services, emerging IoT solutions and many other mobile-related initiatives. Under its +d (pronounced plus d) initiatives, DOCOMO will create new added value with business partners to enrich people’s lives with all-new services and businesses.
About XMOS
XMOS is a leading supplier of voice interface solutions in the consumer electronics market. The company is an established brand in speech processing, biometrics and AI interface, which is achieved through a combination of XMOS’s unique silicon architecture and highly sophisticated software.