BPI-R18-AI 语音麦克风陈列开发套件(Allwinner SoC-Only 3-Mic Far-Field Dev Kit)
Contents
介绍
BPI-R18-AI Allwinner SoC-Only 3-Mic Far-Field Dev Kit for Amazon AVS with allwnner R18 chip design
Allwinner SoC-Only 3-Mic Far-Field Dev Kit is Allwinner’s official development board targeting at audio recognition field, which is certified by Amazon.Powered by Allwinner R18 Quad-core CortexTM-A53, Its rich features and cost-effectiveness make audio intelligence further close to our daily life.
关键特性
- 集成在全志R18单一芯片上支持所有AVS特性
- Supports for either Linux or Android
- High performance with low power consumption
- Reserves application headroom for non-AVS applications
- Built-in battery-operated designs.
- Supports 6 MICs both-side placement,configurable to 6/4/3/2 MICs
硬件
The AVS Developer Kit is a qualified device enables Alexa Voice Service (AVS) that allows developer to interact with Alexa Voice Service hands-free. It includes a 6-mic array and one base board that provides various peripheral interfaces. Services to play music, ask questions, set alarms, play iHeartRadio, news, sports updates, weather and more are available on this kit. With Gmems’s front end algorithm, the developer kit is equipped with most advanced beamforming, noise reduction and echo cancellation technology so that your commands can be easily picked up even under noisy environment or during music is playing.
硬件接口示意
Button description:
On mic-board there are 4 buttons, the functionality of each is listed below:
- VOL- : voluome down;
- VOL+ : volume up, force flash;
- MUTE : Mute the microphone to enter private mode
- POWER : power on/off
Cable connection:
micro-usb for adb and power supply:
serial comm with Allwinner TF-card uart debugger
硬件规格
板型结构
BPI-R18-AI Kit
Allwinner SoC-Only 3-Mic Far-Field Dev Kit comes with three components - mainboard,MIC board,Flexible interconnection ribbon cable and copper pillars, power adapter is not included.
软件
Amazon AVS 快速上手说明
The AVS Developer Kit is a qualified device enables Alexa Voice Service (AVS) that allows developer to interact with Alexa Voice Service hands-free. It includes a 6-mic array and one base board that provides various peripheral interfaces. Services to play music, ask questions, set alarms, play iHeartRadio, news, sports updates, weather and more are available on this kit. With Gmems’s front end algorithm, the developer kit is equipped with most advanced beamforming, noise reduction and echo cancellation technology so that your commands can be easily picked up even under noisy environment or during music is playing.
- Get start with common tools
1.Via adb
adb is Android debug bridge. Typeadb shell in command line(windows) or Terminal(MacOS or Linux) to enter debug mode,developers can type commands here.:
2.Via serial Com
on windows, you need tools like SecureCRT or putty or MobaXterm to use serial port. On Ubuntu, minicom is the most popular application to debug via serial comm. This is the setting on MobaXterm:
3.push and pull files
adb push and adb pull commands can push data from PC to developer kit and pull data from developer kit to PC.
just drag the file to command line tool, it will display the directory automatically.
Connect to Internet:
Without internet, developer can’t enjoy the Alexa Voice Service. Type the command below to connect to Internet: wifi_connect_ap_test “ssid” “passwd” ssid and passwd are your network name and your password respectively.
Use SampleApp:
SampleApp is the application integrated with voice recording, Sensory’s wake word engine, Gmems’s front end algorithm and Alexa Voice Service. Developer can start hands-free experience with AVS Developer Kit by following commands:
TZ=UTC SampleApp /etc/avs/test.json /etc/avs/ DEBUG9
/etc/avs/test.json is the configuration file includes device registration information and user CA certificates.
Link SampleApp with your Amazon account:
1.adb pull /etc/avs/test.json /home/AVS
pull the default test.json file to /home/AVS/ directory.
The test.json layout is as follows:
{ "authDelegate":{ "clientSecret":"<Client Secret for your device from the Amazon Developer Portal>", "deviceSerialNumber":"<A unique value that you create, similar to a SKU or UPC. E.g. "123456">", "refreshToken":"${SDK_CONFIG_REFRESH_TOKEN}", "clientId":"<Client ID for your device from the Amazon Developer Portal>", "productId":"<Product ID for your device from the Amazon Developer Portal>" }, "alertsCapabilityAgent":{ "databaseFilePath":"/<absolute-path-to-db-directory>/<db-file-name>", "alarmSoundFilePath":"/<absolute-path-to-alarm-sound>/alarm_normal.mp3", "alarmShortSoundFilePath":"/<absolute-path-to-short-alarm-sound>/alarm_short.wav", "timerSoundFilePath":"/<absolute-path-to-timer-sound>/timer_normal.mp3", "timerShortSoundFilePath":"/<absolute-path-to-short-timer-sound>/timer_short.wav" }, "settings":{ "databaseFilePath":"/<absolute-path-to-db-directory>/<db-file-name>", "defaultAVSClientSettings":{ "locale":"en-US" } }, "certifiedSender":{ "databaseFilePath":"/<absolute-path-to-db-directory>/<db-file-name>" } }
NOTE: The deviceSerialNumber is a unique identifier that you create. It is not provided by Amazon or Allwinner.
The refreshToken is the only parameter related to your own account, please follow below steps to create your own refreshToken. You can keep other parameters same as the default test.json.
- 1. You can keep other parameters same as the default test.json.
- 2. install python and pip on your Linux environment, then install Flask and requests: pip install flask requests if there is any other missing python packages.please install them in the similar way.
- 3. Keep the same product ID, client ID and client secret in the default test.json, put the test.json under the same directory of AuthServer.py
- 4. start AuthServer by running: python AuthServer.py, You should see a message that indicates the server is running.
- 5. Open your favorite browser and navigate to: [1](http://localhost:3000)
- 6. Follow the on-screen instructions.
- 7. After you've entered your credentials, the server should terminate itself, and test.json will be populated with your refresh toke
- 8. adb push C:\test.json /etc/avs/ push the new test.json to reference kit.
- 9. run SampleApp again and enjoy your iHeartRadio or Kindle or Amazon music.
Offline quick test tools:
sample-wakeup is an offline tool to test wake-up rate for “Alexa” wake word. The purpose of this tool is to avoid network issue for Chinese developers. Developers can quickly test the performance of front end algorithm and Sensory’s Alexa wake word engine without connecting to Internet. Alexa Voice Service is not supported under offline mode. To use it, simply type the following commands:
sample-wakeup /etc/avs
Flash the recovery image:
Necessary tools:
1.PhoenixSuit--------Flash tool on windows
1.LiveSuit-------------Flsh tool on Ubuntu
2.adb driver
3.mini-USB cable
4.recovery.iso------------firmware image
Steps:
1.install the software, please see Livesuit.doc and PhoenixSuitUserManualV1.0.doc for more information.
2.download the image from our website, select the image in PhoenixSuit and Livesuit.
3.Unplug power cable and mini-USB from the board, press the VOL+ button and hold it until plug in the mini-USB cable to PC, release the button, it should ask if format the device is necessary before start flashing.
Note: documents, configuration file, software, scripts, drivers mentioned in this guide are shipped with the User guide.
amazon AVS 智能语音AI项目
https://developer.amazon.com/alexa-voice-service/dev-kits/allwinner-3-mic
全智科技Amazon AVS 项目
http://allwinnertech.com/index.php?c=market&a=index&id=59
资源
- Allwinner SoC-Only 3-Mic Far-Field Dev Kit quick start document:https://drive.google.com/file/d/1boPCAomVinE7iYbUwB6gE50ry7JI6M0n/view?usp=sharing
- R18 chip brief:http://www.allwinnertech.com/uploads/pdf/2017081109410263.pdf
- AVS project on amazon : https://developer.amazon.com/alexa-voice-service/dev-kits/allwinner-3-mic
- AVS project on allwinner official: http://www.allwinnertech.com/index.php?c=market&a=index&id=59
Alexa on Banana Pi R18-AI: Board to Demo :https://blog.emumba.com/alexa-on-banana-pi-r18-ai-board-to-demo-4f17c775ae99
- BPI-R18-AVS MIC AVS A/V demo ,use ubuntu 16.04 linux kernel 4.4.89:https://www.youtube.com/watch?v=TN02Q1pWM0I&feature=youtu.be
- Easy to buy sample from aliexpress
系统镜像
zmazon AVS image
- 2018-05-17 update Allwinner SoC-Only 3-Mic Far-Field Dev Kit image
- how to use please see : 3.1 AVS quick start guide
- tina_tulip-noma_card0 2018-05-17.img
- google driver download link:https://drive.google.com/file/d/1ApEv0g1fD7n3kZh6j_m2Skb8WcEd5sKO/view?usp=sharing
- baidu cloud download link:https://pan.baidu.com/s/1s8rPzzxnTTE0BlS7Z9I0xA
- forum pthread:http://forum.banana-pi.org/t/bpi-r18-new-image-allwinner-soc-only-3-mic-far-field-dev-kit-image-20180206/4860
- 2018-02-06 update Allwinner SoC-Only 3-Mic Far-Field Dev Kit image
- how to use please see : 3.1 AVS quick start guide
- R18 tina_tulip-noma_uart0_wufan_camera_20180206
- google driver download link:https://drive.google.com/file/d/1yugHTuX2OXHQkggb52FQfHOVUVrtjKDH/view?usp=sharing
- baidu cloud download link:https://pan.baidu.com/s/1ghjcQsV
- forum pthread:http://forum.banana-pi.org/t/bpi-r18-new-image-allwinner-soc-only-3-mic-far-field-dev-kit-image-20180206/4860
Ubuntu
kernel 4.4
- 2018-4-17 update Ubuntu 16.04.4 with linux kernel 4.4.89
- image name:2018-04-17-ubuntu-16.04-mate-desktop-demo3-k4.4.89-vdpau-3-mic-docker-bpi-r18-avs-aarch64-sd-emmc.img.zip
- Google Drive: https://drive.google.com/open?id=1dlfo9LGNcrc-_cpKd1uJnrNx0PdonBnK
- MD5: 4b7e163d260e58a39ba8905e7ed39943
- Forum pthread:http://forum.banana-pi.org/t/bpi-r18-avs-new-image-ubuntu-16-04-4-with-linux-kernel-4-4-89-2018-4-17/5435