[FREE] AzSpeech plugin: Text-to-Speech, Speech-to-Text and more with Microsoft Azure Cognitive Services

Pre-Release

Created a pre-release on GitHub to allow testing the next update before it launches: AzSpeech v1.2.0-pre2 (github.com)

What’s Changed

Pull Request: v1.2.0 by @lucoiso in v5.2.0 by lucoiso · Pull Request #39 · lucoiso/UEAzSpeech · GitHub

  • Viseme
  • Continuous Recognition
  • Fixed Function: Stop AzSpeech Task
  • Adjust existing functions
  • Add new function: SSML to Sound Wave
  • Add new function: Text to Sound Wave
  • Rename some functions (with Core Redirects!)
  • Adjust folders
  • Update Azure Speech SDK to 1.24.1
  • Add more delegates
  • Fix issue: Engine freezing after stopping a synthesizer task
  • Fix issue: Stop task not working more than one time on synthesizers
  • New Settings
  • […]

Settings


Note: I’ll update the documentation soon

1 Like

Answered by email! : )

AzSpeech v1.2.0

Release: AzSpeech v1.2.0
Marketplace: AzSpeech

Features:

  • Viseme
  • Continuous Recognition
  • Fixed Function: Stop AzSpeech Task
  • Adjust existing functions
  • Add new function: SSML to Sound Wave
  • Add new function: Text to Sound Wave
  • Rename some functions (with Core Redirects!)
  • Adjust folders
  • Update Azure Speech SDK to 1.24.1
  • Add more delegates
  • Fix issue: Engine freezing after stopping a synthesizer task
  • Fix issue: Stop task not working more than one time on synthesizers
  • Fix issue: Engine process not allowing use the generated .wav file
  • Fix issue: Engine crashing when try to stop .wav synthesizer due to existing signal bindings
  • New Settings
  • […]

New settings

1 Like

AzSpeech v1.2.1

Release: AzSpeech v1.2.1
Marketplace: UE Marketplace

Pull Request: v1.2.1 by @lucoiso in v1.2.1 by lucoiso · Pull Request #42 · lucoiso/UEAzSpeech · GitHub

What’s Changed

  • Changed VersionName to 1.2.1: Resolve wrong version management (finally xd)
  • Adjust log default verbosity

Full Changelog: Comparing v5.2.0...v1.2.1 · lucoiso/UEAzSpeech · GitHub


Additional information

:white_check_mark: Working with both UE4.27, UE5.0 and UE5.1


Note about version: Changed the version name to 1.2.1 from 5.2.0? Yes! xD.
Strange, but I was bothered by the old bad version management I had and decided to force a fix by returning the name to 1.2.1

3 Likes

If you’re already using UE5.1, don’t have Visual Studio installed (to compile the plugin code) and don’t want to wait for the Marketplace approval:

Packaged plugin for UE5.1 (Win64): AzSpeech_UE51_PACKAGED.zip (github.com)

You can extract this .zip inside your project’s Plugins folder. : )

2 Likes

AzSpeech v1.2.2

What’s Changed

  • Fix voice and language input not working on synthesizers

Full Changelog: Comparing v1.2.1...v1.2.2 · lucoiso/UEAzSpeech · GitHub

1 Like

AzSpeech v1.2.3

Changes

Full Changelog: Comparing v1.2.2...v1.2.3 · lucoiso/UEAzSpeech · GitHub

1 Like

AzSpeech v1.2.4

Changes

  • Set config category to Plugins

Notes

  • Move your settings to DefaultPlugins.ini file

Full Changelog: Comparing v1.2.3...v1.2.4 · lucoiso/UEAzSpeech · GitHub

1 Like

AzSpeech v1.2.5

Changes

  • v1.2.5: Hotfix: Missing broadcast fix: Set Viseme data to broadcast only in GameThread

Full Changelog: Comparing v1.2.4...v1.2.5 · lucoiso/UEAzSpeech · GitHub

Notes

There are two packaged versions (for UE5.0 and UE5.1) in the release page, to allow using before Marketplace approval without the need of compiling the plugin’ code: AzSpeech_UE50_PACKAGED.zip and AzSpeech_UE51_PACKAGED.zip. You can put it into your Project’s Plugins folder.

1 Like

AzSpeech v1.3.0 pre-release 1

I’m sharing this pre-release version to allow other users test before sending this update to main branch & Marketplace


New Features

More Settings

Recognition Map

New Function

Runnable Threads

  • Instead using AsyncTasks directly inside the plugin’s UCLASSES, I’ve created separated Runnables to manage the recognition/synthesis work in NonBlocking threads and send the informations to the UCLASSES to call the delegates broadcasts.

Changes

  • Fix Viseme data broadcast delay
  • Fix cancellation log crash
  • Fix .wav file loading (In .wav File to Text)
  • Rename some functions & adjust some comments (Added core redirects)
  • Fix delegates and add a check to ensure that the plugin will broadcast only in game thread to avoid crashes in widgets calls
  • Added more logs & Debugging prints
  • Removed boolean bIsContinuous from recognizers, now they’re using only continuous: Continuous tasks are better to manage in the runnables, allow task cancellation/stop and work similar to the single recognition (if you stop talking, the recognition will stop too)
  • Fix thread blocking/game freezing when a task is activated/deactivated
  • Added new delegates: Synthesis Started and Recognition Started
  • Set the plugin settings to accept 10 candidate languages

Notes:

  1. More information about recognition map is coming.
  2. AzSpeech.zip is working in both UE4.27, UE5.0 and UE5.1

Full Changelog: Comparing v1.2.5...v1.3.0-pre-1 · lucoiso/UEAzSpeech · GitHub

1 Like

AzSpeech v1.3.0 pre-release 2

New features

Recognition Map Check adjustments

  1. The function is now a Async Task and run in a background thread
  2. Now this function will try to check the exact word instead only checking if the input string contains a substring by using String Delimiters to validate the word range

Phrase Lists Map

The plugin now supports inserting data into phrase list grammar at runtime!

About phrase lists: Improve recognition accuracy with phrase list - Azure Cognitive Services | Microsoft Learn

Changes

  • Set some functions from UAzSpeechHelper as BlueprintCallable instead BlueprintPure
  • Fix broadcast in thread exit
  • Adjust logs & prints
  • Add new properties to Recognition Map
  • Optimize includes
  • Update SDK to 1.24.2

Notes:

  • More information about recognition map is coming.
  • More information about phrase list map is coming.
  • AzSpeech.zip is working in both UE4.27, UE5.0 and UE5.1

Full Changelog: Comparing v1.3.0-pre-1...v1.3.0-pre-2 · lucoiso/UEAzSpeech · GitHub

3 Likes

thanks for job,this great plugin. Can you add examples for viseme for metahuman? thanks

AzSpeech v1.3.0

What’s Changed

More Settings

Recognition Map

Phrase Lists Map

The plugin now supports inserting data into phrase list grammar at runtime!

About phrase lists: Improve recognition accuracy with phrase list - Azure Cognitive Services | Microsoft Learn

Audio Input Device selection


More Changes

  • Move part of tasks to runnable classes
  • Fix Viseme data broadcast delay
  • Fix cancellation log crash
  • Fix .wav file loading (In .wav File to Text)
  • Rename some functions & adjust some comments
  • Fix delegates and add a check to ensure that the plugin will broadcast only in game thread to avoid crashes in widgets calls
  • Added more logs & debugging prints
  • Removed boolean bIsContinuous from recognizers, now they’re using only continuous: Continuous tasks are better to manage in the runnables, allow task cancellation/stop and work similar to the single recognition (if you stop talking, the recognition will stop too)
  • Fix thread blocking/game freezing when a task is activated/deactivated
  • Added new delegates: Synthesis Started and Recognition Started
  • Set the plugin settings to accept 10 candidate languages
  • Set some functions from UAzSpeechHelper as BlueprintCallable instead BlueprintPure
  • Fix broadcast in thread exit
  • Adjust existing logs & prints
  • Optimize includes
  • Add Core Redirects
  • Update SDK to 1.24.2

Full Changelog: Comparing v1.2.5...v1.3.0 · lucoiso/UEAzSpeech · GitHub

2 Likes

Hey, thank you for mantaining this excelent plugin! I am using the 1.3.1 version in Unreal 4.27 and I am trying to add auto candidate languages but nothing happens when I click to add an item. The only item that exists in the auto candidade languages array is the default language ID. Also, when using a speech to text node with an enable continuous recognition node right after that (on the first output exec pin - above Async Task), it causes a crash to the engine.

1 Like

Thanks for the info! I’ll be fixing this soon

1 Like

AzSpeech v1.3.2

What’s Changed

  • Move specific functions to determined classes
  • Set auto language candidates settings to remove empty strings only on initialization to avoid removals on new inserts
  • Add missing language set in recognition tasks

Full Changelog: Comparing v1.3.1...v1.3.2 · lucoiso/UEAzSpeech · GitHub

2 Likes

Pushed an new experimental branch, trying support for Linux, MacOS, iOS and HoloLens.

Unfortunately, I can’t guarantee that it will work, as I don’t have the equipment/environments to test these systems. But I hope it serves as an alternative to try and add custom implementations.

This branch has all the latest plugin updates and attempts to support all mentioned platforms.

Branch: experimental/MULTI-PLATFORM

Feel free to contact here or in their respective GitHub issues:

2 Likes

AzSpeech v1.3.3

What’s Changed

  • Set AzureWrapper as Public Dependency Module
  • Move Internal Functions header to public libraries folder

Fixes

  • Includes not working on C++ projects

Full Changelog: Comparing v1.3.2...v1.3.3 · lucoiso/UEAzSpeech · GitHub

2 Likes

AzSpeech v1.3.4

What’s Changed

  • Remove MinimalAPI e set base classes to implement AZSPEECH_API, allowing users to use the base classes and their members/functions.

Fixes

  • Resolve errors related to symbols not defined in existing functions from base classes

Full Changelog: Comparing v1.3.3...v1.3.4 · lucoiso/UEAzSpeech · GitHub

2 Likes

Hello!

Thanks for this amazing plugin, epic should hire you! I recently added it to my project and it works fine on windows. But not on steam deck it seems, no sound. I’m using the TTS function for voice. Any ideas what could be the cause? (the game: FlipScapes :slight_smile:
Thanks!

1 Like