A library for real-time voice processing in React Native.
npm install @picovoice/react-native-voice-processor


Made in Vancouver, Canada by Picovoice


The React Native Voice Processor is an asynchronous audio capture library designed for real-time audio
processing on mobile devices. Given some specifications, the library delivers frames of raw audio
data to the user via listeners.
- React Native Voice Processor
- Table of Contents
- Requirements
- Compatibility
- Installation
- Permissions
- Usage
- Capturing with Multiple Listeners
- Example
- Node.js (16+)
- Android SDK (21+)
- JDK (8+)
- Xcode (11+)
- CocoaPods
- React Native 0.68.7+
- Android 5.0+ (API 21+)
- iOS 13.0+
React Native Voice Processor is available via npm.
To import it into your React Native project install with npm or yarn:
``console`
yarn add @picovoice/react-native-voice-processor`
orconsole`
npm i @picovoice/react-native-voice-processor --save
To enable recording with the hardware's microphone, you must first ensure that you have enabled the proper permission on both iOS and Android.
On iOS, open the Info.plist file and add the following line:`xml`
On Android, open the AndroidManifest.xml and add the following line:`xml`
See our example app for how to properly request this permission from your users.
Access the singleton instance of VoiceProcessor:
`typescript
import {
VoiceProcessor,
VoiceProcessorError
} from '@picovoice/react-native-voice-processor';
let voiceProcessor = VoiceProcessor.instance;
`
Add listeners for audio frames and errors:
`typescript`
voiceProcessor.addFrameListener((frame: number[]) => {
// use audio frame
});
voiceProcessor.addErrorListener((error: VoiceProcessorError) => {
// handle error
});
Ask for audio record permission and start recording with the desired frame length and audio sample rate:
`typescript
const frameLength = 512;
const sampleRate = 16000;
try {
if (await voiceProcessor.hasRecordAudioPermission()) {
await voiceProcessor.start(frameLength, sampleRate);
} else {
// user did not grant permission
}
} catch (e) {
// handle start error
}
`
Stop audio capture:
`typescript`
try {
await this._voiceProcessor.stop();
} catch (e) {
// handle stop error
}
Once audio capture has started successfully, any frame listeners assigned to the VoiceProcessor will start receiving audio frames with the given frameLength and sampleRate.
Any number of listeners can be added to and removed from the VoiceProcessor instance. However,frameLength
the instance can only record audio with a single audio configuration ( and sampleRate),start()
which all listeners will receive once a call to has been made. To add multiple listeners:`typescript
const listener1 = (frame) => { };
const listener2 = (frame) => { };
const listeners = [listener1, listener2];
voiceProcessor.addFrameListeners(listeners);
voiceProcessor.removeFrameListeners(listeners);
// or
voiceProcessor.clearFrameListeners();
`
The React Native Voice Processor app demonstrates how to ask for user permissions and capture output from the VoiceProcessor.
To launch the demo, run:
`console``
yarn bootstrap
yarn example iosor
yarn example android