Difference between revisions of "BPI-R18-AI(Allwinner SoC-Only 3-Mic Far-Field Dev Kit)"

From Banana Pi Wiki
Jump to: navigation, search
(AVS quick start guide)
(kernel 4.4)
 
(38 intermediate revisions by the same user not shown)
Line 1: Line 1:
 +
[[zh:BPI-R18-AI 语音麦克风陈列开发套件(Allwinner SoC-Only 3-Mic Far-Field Dev Kit) ]]
 
=Introduction=
 
=Introduction=
  
Line 6: Line 7:
  
 
Allwinner SoC-Only 3-Mic Far-Field Dev Kit is Allwinner’s official development board targeting at audio recognition field, which is certified by Amazon.Powered by Allwinner R18 Quad-core CortexTM-A53, Its rich features and cost-effectiveness make audio intelligence further close to our daily life.  
 
Allwinner SoC-Only 3-Mic Far-Field Dev Kit is Allwinner’s official development board targeting at audio recognition field, which is certified by Amazon.Powered by Allwinner R18 Quad-core CortexTM-A53, Its rich features and cost-effectiveness make audio intelligence further close to our daily life.  
 +
 +
[[File:A_BPI-R18-AI_1.jpg]]
  
 
== Key Features ==
 
== Key Features ==
 
*Integrates all AVS features on a single SoC
 
*Integrates all AVS features on a single SoC
::Supports for either Linux or Android
+
::Supports Tina Linux
 
::High performance with low power consumption  
 
::High performance with low power consumption  
 
*Reserves application headroom for non-AVS applications
 
*Reserves application headroom for non-AVS applications
Line 19: Line 22:
 
The AVS Developer Kit is a qualified device enables Alexa Voice Service (AVS) that allows developer to interact with Alexa Voice Service hands-free. It includes a 6-mic array and one base board that provides various peripheral interfaces. Services to play music, ask questions, set alarms, play iHeartRadio, news, sports updates, weather and more are available on this kit. With Gmems’s front end algorithm, the developer kit is equipped with most advanced beamforming, noise reduction and echo cancellation technology so that your commands can be easily picked up even under noisy environment or during music is playing.
 
The AVS Developer Kit is a qualified device enables Alexa Voice Service (AVS) that allows developer to interact with Alexa Voice Service hands-free. It includes a 6-mic array and one base board that provides various peripheral interfaces. Services to play music, ask questions, set alarms, play iHeartRadio, news, sports updates, weather and more are available on this kit. With Gmems’s front end algorithm, the developer kit is equipped with most advanced beamforming, noise reduction and echo cancellation technology so that your commands can be easily picked up even under noisy environment or during music is playing.
  
== Hardware Spec==
+
==hardwares interface==
[[File:Bpi-r18-avs_SPEC.png]]
 
  
==Dimensions==
+
Button description:
[[File:Bpi-r18-avs_Maintop.jpg]]
 
  
== BPI-R18-AI Kit ==
+
On mic-board there are 4 buttons, the functionality of each is listed below:
Allwinner SoC-Only 3-Mic Far-Field Dev Kit comes with three components - mainboard,MIC board,Flexible interconnection ribbon cable and copper pillars, power adapter is not included.
 
  
[[File:BPI-r18-avs_kit.JPG]]
+
[[File:R18_pic_7.png]]
  
=Software=
+
*VOL- : voluome down;
 +
*VOL+ : volume up, force flash;
 +
*MUTE : Mute the microphone to enter private mode
 +
*POWER : power on/off
  
==AVS quick start guide==
+
Cable connection:
  
The AVS Developer Kit is a qualified device enables Alexa Voice Service (AVS) that allows developer to interact with Alexa Voice Service hands-free. It includes a 6-mic array and one base board that provides various peripheral interfaces. Services to play music, ask questions, set alarms, play iHeartRadio, news, sports updates, weather and more are available on this kit. With Gmems’s front end algorithm, the developer kit is equipped with most advanced beamforming, noise reduction and echo cancellation technology so that your commands can be easily picked up even under noisy environment or during music is playing.
+
[[File:R18_pic_8.png]]
  
[[File:Bpi-r18-avs_ai.png]]
+
micro-usb for adb and power supply:
  
*Get start with common tools
+
[[File:R18_pic_9.png]]
  
1.Via adb
+
serial comm with Allwinner TF-card uart debugger
  
adb is Android debug bridge. Typeadb shell in command line(windows) or Terminal(MacOS or Linux) to enter debug mode,developers can type commands here.:
+
== Hardware Spec==
 +
[[File:Bpi-r18-avs_SPEC.png]]
  
[[File:R18_pic_1.png]]
+
==Dimensions==
 +
[[File:Bpi-r18-avs_Maintop.jpg]]
  
2.Via serial Com
+
== BPI-R18-AI Kit ==
 +
Allwinner SoC-Only 3-Mic Far-Field Dev Kit comes with three components - mainboard,MIC board,Flexible interconnection ribbon cable and copper pillars, power adapter is not included.
  
on windows, you need tools like SecureCRT or putty or MobaXterm to use serial port. On Ubuntu, minicom is the most popular application to debug via serial comm. This is the setting on MobaXterm:
+
[[File:BPI-r18-avs_kit.JPG]]
  
[[File:R18_pic_2.png]]
+
=Software=
  
3.push and pull files
+
==AVS quick start guide==
 
 
adb push and adb pull commands can push data from PC to developer kit and pull data from developer kit to PC.
 
 
 
[[File:R18_pic_3.png]]
 
 
 
just drag the file to command line tool, it will display the directory automatically.
 
 
 
Connect to Internet:
 
 
 
Without internet, developer can’t enjoy the Alexa Voice Service. Type the command below to connect to Internet: wifi_connect_ap_test “ssid” “passwd” ssid and passwd are your network name and your password respectively.
 
 
 
[[File:R18_pic_4.png]]
 
 
 
'''Use SampleApp:'''
 
 
 
SampleApp is the application integrated with voice recording, Sensory’s wake word engine, Gmems’s front end algorithm and Alexa Voice Service. Developer can start hands-free experience with AVS Developer Kit by following commands:
 
 
 
TZ=UTC SampleApp /etc/avs/test.json /etc/avs/ DEBUG9
 
 
 
/etc/avs/test.json is the configuration file includes device registration information and user CA certificates.
 
 
 
[[File:R18_pic_5.png]]
 
 
 
Link SampleApp with your Amazon account:
 
 
 
1.adb pull /etc/avs/test.json /home/AVS
 
 
 
pull the default test.json file to /home/AVS/ directory.
 
 
 
The test.json layout is as follows:
 
 
 
`
 
{`
 
 
 
`“authDelegate":{`
 
 
 
`"clientSecret":"<Client Secret for your device from the Amazon Developer Portal>",`
 
 
 
`"deviceSerialNumber":"<A unique value that you create, similar to a SKU or UPC. E.g. "123456">",`
 
 
 
`"refreshToken":"${SDK_CONFIG_REFRESH_TOKEN}",`
 
 
 
`"clientId":"<Client ID for your device from the Amazon Developer Portal>",`
 
 
 
`"productId":"<Product ID for your device from the Amazon Developer Portal>"`
 
 
 
`},`
 
 
 
`"alertsCapabilityAgent":{`
 
 
 
`"databaseFilePath":"/<absolute-path-to-db-directory>/<db-file-name>",`
 
 
 
`"alarmSoundFilePath":"/<absolute-path-to-alarm-sound>/alarm_normal.mp3",`
 
  
`"alarmShortSoundFilePath":"/<absolute-path-to-short-alarm-sound>/alarm_short.wav",`
+
Please download the quick-start guide:[https://drive.google.com/open?id=1YDU25CNBP02z3xeKKHjBPgp_yxuRmWLr R18AVS-quick-start.pdf]
 
 
`"timerSoundFilePath":"/<absolute-path-to-timer-sound>/timer_normal.mp3",`
 
 
 
`"timerShortSoundFilePath":"/<absolute-path-to-short-timer-sound>/timer_short.wav"`
 
 
 
`},`
 
 
 
`"settings":{`
 
 
 
`"databaseFilePath":"/<absolute-path-to-db-directory>/<db-file-name>",`
 
 
 
`"defaultAVSClientSettings":{`
 
 
 
`"locale":"en-US"`
 
 
 
`}`
 
 
 
`},`
 
 
 
`"certifiedSender":{`
 
 
 
`"databaseFilePath":"/<absolute-path-to-db-directory>/<db-file-name>"`
 
 
 
`}`
 
 
 
`}`
 
  
 
==amazon AVS project==
 
==amazon AVS project==
Line 147: Line 74:
  
 
=Resources=
 
=Resources=
 +
*Allwinner SoC-Only 3-Mic Far-Field Dev Kit quick start document:https://drive.google.com/file/d/1boPCAomVinE7iYbUwB6gE50ry7JI6M0n/view?usp=sharing
 +
*R18 chip brief:http://www.allwinnertech.com/uploads/pdf/2017081109410263.pdf
 +
*AVS project on amazon : https://developer.amazon.com/alexa-voice-service/dev-kits/allwinner-3-mic
 +
*AVS project on allwinner official: http://www.allwinnertech.com/index.php?c=market&a=index&id=59
 +
*Alexa on Banana Pi R18-AI: Board to Demo:https://blog.emumba.com/alexa-on-banana-pi-r18-ai-board-to-demo-4f17c775ae99
 +
*BPI-R18-AVS MIC AVS A/V demo ,use ubuntu 16.04 linux kernel 4.4.89:https://www.youtube.com/watch?v=TN02Q1pWM0I&feature=youtu.be
 +
*[https://pt.aliexpress.com/store/product/Placa-de-desenvolvimento-com-Allwinner-SoC-Allwinner-oficial-Apenas-3-Mic-Far-Dev-Kit-de-Campo/302756_32848216408.html?spm=a2g03.12010612.0.0.32177559gDfJw5 Easy to buy sample from aliexpress]
 +
*BSP and schematics are under NDA terms, please write to [email protected] for them.
 +
 +
=Image Release=
 +
==zmazon AVS image ==
 +
 +
*Allwinner SoC-Only 3-Mic Far-Field Dev Kit image
 +
::how to use please see : [https://drive.google.com/open?id=1YDU25CNBP02z3xeKKHjBPgp_yxuRmWLr Quick Start Guide]
 +
::tina_tulip-noma_card0.img
 +
::google driver download link:https://drive.google.com/file/d/1UxebQCxEysPjUsDG85EN1H6_aH4WVXZy/view?usp=sharing
 +
::note:this image is to be flashed onto onboard eMMC
 +
 +
==Ubuntu==
 +
===kernel 4.4===
 +
*2018-4-17 update Ubuntu 16.04.4 with linux kernel 4.4.89
 +
::image name:2018-04-17-ubuntu-16.04-mate-desktop-demo3-k4.4.89-vdpau-3-mic-docker-bpi-r18-avs-aarch64-sd-emmc.img.zip
 +
::Google Drive: https://drive.google.com/open?id=1dlfo9LGNcrc-_cpKd1uJnrNx0PdonBnK
 +
::MD5: 4b7e163d260e58a39ba8905e7ed39943
 +
::Forum pthread:http://forum.banana-pi.org/t/bpi-r18-avs-new-image-ubuntu-16-04-4-with-linux-kernel-4-4-89-2018-4-17/5435
 +
::Note:this image doesn't support Alex.

Latest revision as of 20:07, 22 December 2019

Introduction

Overview

BPI-R18-AI Allwinner SoC-Only 3-Mic Far-Field Dev Kit for Amazon AVS with allwnner R18 chip design

Allwinner SoC-Only 3-Mic Far-Field Dev Kit is Allwinner’s official development board targeting at audio recognition field, which is certified by Amazon.Powered by Allwinner R18 Quad-core CortexTM-A53, Its rich features and cost-effectiveness make audio intelligence further close to our daily life.

A BPI-R18-AI 1.jpg

Key Features

  • Integrates all AVS features on a single SoC
Supports Tina Linux
High performance with low power consumption
  • Reserves application headroom for non-AVS applications
Built-in battery-operated designs.
Supports 6 MICs both-side placement,configurable to 6/4/3/2 MICs

Hardware

The AVS Developer Kit is a qualified device enables Alexa Voice Service (AVS) that allows developer to interact with Alexa Voice Service hands-free. It includes a 6-mic array and one base board that provides various peripheral interfaces. Services to play music, ask questions, set alarms, play iHeartRadio, news, sports updates, weather and more are available on this kit. With Gmems’s front end algorithm, the developer kit is equipped with most advanced beamforming, noise reduction and echo cancellation technology so that your commands can be easily picked up even under noisy environment or during music is playing.

hardwares interface

Button description:

On mic-board there are 4 buttons, the functionality of each is listed below:

R18 pic 7.png

  • VOL- : voluome down;
  • VOL+ : volume up, force flash;
  • MUTE : Mute the microphone to enter private mode
  • POWER : power on/off

Cable connection:

R18 pic 8.png

micro-usb for adb and power supply:

R18 pic 9.png

serial comm with Allwinner TF-card uart debugger

Hardware Spec

Bpi-r18-avs SPEC.png

Dimensions

Bpi-r18-avs Maintop.jpg

BPI-R18-AI Kit

Allwinner SoC-Only 3-Mic Far-Field Dev Kit comes with three components - mainboard,MIC board,Flexible interconnection ribbon cable and copper pillars, power adapter is not included.

BPI-r18-avs kit.JPG

Software

AVS quick start guide

Please download the quick-start guide:R18AVS-quick-start.pdf

amazon AVS project

BPI-R18-AVS 10.jpg

https://developer.amazon.com/alexa-voice-service/dev-kits/allwinner-3-mic

Allwinner

Allwinner.png

http://allwinnertech.com/index.php?c=market&a=index&id=59

Resources

Image Release

zmazon AVS image

  • Allwinner SoC-Only 3-Mic Far-Field Dev Kit image
how to use please see : Quick Start Guide
tina_tulip-noma_card0.img
google driver download link:https://drive.google.com/file/d/1UxebQCxEysPjUsDG85EN1H6_aH4WVXZy/view?usp=sharing
note:this image is to be flashed onto onboard eMMC

Ubuntu

kernel 4.4

  • 2018-4-17 update Ubuntu 16.04.4 with linux kernel 4.4.89
image name:2018-04-17-ubuntu-16.04-mate-desktop-demo3-k4.4.89-vdpau-3-mic-docker-bpi-r18-avs-aarch64-sd-emmc.img.zip
Google Drive: https://drive.google.com/open?id=1dlfo9LGNcrc-_cpKd1uJnrNx0PdonBnK
MD5: 4b7e163d260e58a39ba8905e7ed39943
Forum pthread:http://forum.banana-pi.org/t/bpi-r18-avs-new-image-ubuntu-16-04-4-with-linux-kernel-4-4-89-2018-4-17/5435
Note:this image doesn't support Alex.