BCI-UE4-Plugin - Brain-Computer-Interface for Unreal Engine 4

Dear Thauros Clan!
We are developing a game with this plugin for an exhibition. We don’t have much time left so I would be grateful for any help or information on the previous post.
We paid for the plugin, wich has no functionality yet. The information you provided is not enough for developing.
I understand you got other stuff to do, but please take responsibility for sold products too.
Thank you!

We were waiting for help about an error of the BCI plugin.
We almost run out of time.
I hope you can fix or help today when you reading this.
If not, then I must ask you for a refund.
Sorry.

@**LeeFX is this still available - I am keen to help out on macOS version as I am making a emotive app for **Mac and Windows.

@Anadin the plugin is only tested on windows, though it might be possible to compile it for macOS. Would you please write us a short message via our official contact address (see main post <.<)

Best
Lee

Hi,an off topic question,how did you make your links inside market place store page clickable(as hyper link)?is there a syntax,I’ve tried so many way but mine are always appear as plain text.
edit: ok,nerver mind,I found the add link button.

Hello,
We have bought Emotiv PRO licence to track RawEEG, and activated it in Emotiv SDK.
Unfortunately, we are still not able to get to RawEEG via your BCIPlugin in Unreal Engine 4.
We noticed, that you couldn’t include the third party software from Emotiv because of the Marketplace Rules.
Could you please give us access to precompiled version?

If we can be of any further assistance, or you would like to get some help with development, please let us know, we are eager to help.

Best Regards
Jacek Poblocki
NlightniN Production Sp. z o.o.
contact[at]nlightnin.com

The link to the precompiled SDK is also shown in the Output Log within the Plugin if a precompiled version is required!
To get precompiled versions manually by us, write us a short mail ✧ (contact is on the main post - a short receipt would be nice too)
Best :slight_smile:

(# to date Interaxion has stopped supporting their community SDK)
InteraXion Muse Support for Android is in the pipeline
www.choosemuse.com

Does the plugin now support Emotiv Epoc+?

You will connect your Epoc to either Neuromore, OpenVibe or BioEra, do your EEG-processing there and receive the data in UE4. We do not promote or grant support for the Emotiv SDK anymore, but in case you like to work with their Suits, there is a basic integration we can give you for testing.

@LeeFX I Just got the plugin and a Muse 2. Is there a way to get the plugin to read the data from the Muse since the sdk is gone? I’m able to detect the headset on my pc using BlueMuse but havent been able to get a reading from the plugin.

Hello @paingate

I am really not sure if it could work. Can you write to our email and tell which official resources you received for the Muse2?

Best
Lee

Hey @LeeFX

First, thanks for the answers on the marketplace page, much appreciated! :slight_smile:

https://forums.unrealengine.com/core/image/gif;base64,R0lGODlhAQABAPABAP///wAAACH5BAEKAAAALAAAAAABAAEAAAICRAEAOw==

I’m still evaluating things at the moment, but I’d like to get a Muse 2 because: a) it’s cheap! - b) it’s a great, sleek design.
I’ve done some research in order to get a deeper understanding and I might have found a solution,… not sure tho, so any feedback is welcome!

Assuming OpenVibe really works with LSL ( http://openvibe.inria.fr/how-to-use-…r-in-openvibe/ ), this little tool could help maybe? https://.com/kowalej/BlueMuse

LSL+OpenVibe+BlueMuse+BCIUE4 = WIN! :wink:

https://forums.unrealengine.com/core/image/gif;base64,R0lGODlhAQABAPABAP///wAAACH5BAEKAAAALAAAAAABAAEAAAICRAEAOw==

I found this too: https://.com/labstreaminglayer/plugin-UE4 - just not sure if it fits in the picture…

Cheers
Alex

Hello @Skan

amazing research. It looks like a promising workflow!

The LSL-ue4 plugin also looks very interesting, we should think about implementing it (wouldn’t provide preprocessing though by skipping openvibe).

You only need a TCP-Writer Box in openvibe and use the Port in our plugin and ready to go! Let us know how it went !

Best

Lee

Ps. Just watched your Amanitha Trailer, very mesmerizing

You’re welcome! :slight_smile:

https://forums.unrealengine.com/core/image/gif;base64,R0lGODlhAQABAPABAP///wAAACH5BAEKAAAALAAAAAABAAEAAAICRAEAOw==

I also found this https://.com/urish/muse-js …but i’m not much of a fan of web-based stuff honestly! :wink:

https://forums.unrealengine.com/core/image/gif;base64,R0lGODlhAQABAPABAP///wAAACH5BAEKAAAALAAAAAABAAEAAAICRAEAOw==

TCP_writer… you mean this? http://openvibe.inria.fr/documentati…TCPWriter.html

I need to elaborate the workflow a bit… In the end the chain would be something like this I suppose:

Muse 2 > PC n.1 (BlueMuse > OpenVibe > TCP Writer) > PC n.2 (UE4 app packaged with BCI Plugin - or UE4 editor project + BCI Plugin)

Oh, Amanitha… sweet memories back in 2015! It served as a playground for later experiments and performances, the last of which is “Orpheus’ Labyrinth”, a virtual-theater experiment we made in 2019… Next step would be this BCI-based live performance! :wink:

https://forums.unrealengine.com/core/image/gif;base64,R0lGODlhAQABAPABAP///wAAACH5BAEKAAAALAAAAAABAAEAAAICRAEAOw==

P.S.
What a pity Emotiv hardware can’t be used anymore… Epoc X and Insight are pretty toys!

@Skan

no, the TCP connection is within the computer.

Muse -> BlueMuse -> Openvibe ( LSLReader - Processing - TCPWriter ) -> UE4-BCI-Plugin (For ‘Connecting’ you can either use our GUI *or pull an Openvibe node from the BCI-plugin in Blueprint. Then you can rewire the signal in your game. The provided Plugin folder contains minimal setups.)

In Openvibe however you have to create the protocol / implement the question, ‘how to operationalize a biomarker / eeg-signal’, f.i. attention. Emotiv provided their own operationalizations in the non-pro version (and prohibited the raw-data). There are rare info on how their algorithms work and these are proprietary / closed-source / own-inventions nontheless, so not reproducable, though all algorithms should be closely related with prefrontal or cental-parietal Alpha or Beta bands. The Muse algorithms are also closed source if I remember correctly.

Epoc and Insight are really pretty. Though emotiv follows their subscription model, there might be reverse engineering projects trying to gain access to your physically bought hardware. For some reason the Muse company said that they do not want anyone to use or develop for their community SDK. So it’s a deal with the devil afterall.

Best

Lee
(Ps. feel free to give us a rating, if our plugin turns out to be useful! We don’t have a lot of customers and we collected some bad reviews from some frustrated emotiv users)

Thanks for the hint, things are indeed more straightforward like that! :slight_smile:

https://forums.unrealengine.com/core/image/gif;base64,R0lGODlhAQABAPABAP///wAAACH5BAEKAAAALAAAAAABAAEAAAICRAEAOw==


https://forums.unrealengine.com/core/image/gif;base64

https://forums.unrealengine.com/core/image/gif;base64,R0lGODlhAQABAPABAP///wAAACH5BAEKAAAALAAAAAABAAEAAAICRAEAOw==

​​

Yeah, I’m gathering info about this as we speak. While I can rely on the support of an artist who already made some performances with an Epoc, I think I’ll go for a more free and less scientific approach since the live performance allows a wide margin of improvisation for what concerns the visual approach. Anyway, some serious training / calibration is on the to-do list for sure!

Can you suggest any useful resources on how to do that in OpenVibe maybe?

Yeah and since it’s a matter of compromises in the end… the Muse is cheap at least! :wink:

https://forums.unrealengine.com/core/image/gif;base64,R0lGODlhAQABAPABAP///wAAACH5BAEKAAAALAAAAAABAAEAAAICRAEAOw==


https://forums.unrealengine.com/core/image/gif;base64

https://forums.unrealengine.com/core/image/gif;base64,R0lGODlhAQABAPABAP///wAAACH5BAEKAAAALAAAAAABAAEAAAICRAEAOw==

​​

Sure will do! As soon as the hardware is here and I manage to get the OpenVibe/BlueMuse workflow up and running… I will get the plugin and leave an handful of stars on the page! :wink:

https://forums.unrealengine.com/core/image/gif;base64,R0lGODlhAQABAPABAP///wAAACH5BAEKAAAALAAAAAABAAEAAAICRAEAOw==


https://forums.unrealengine.com/core/image/gif;base64

https://forums.unrealengine.com/core/image/gif;base64,R0lGODlhAQABAPABAP///wAAACH5BAEKAAAALAAAAAABAAEAAAICRAEAOw==

EDIT: I noticed just now that @paingate already mentioned the BlueMuse approach before… did it work in the end?

Just a quick update: I confirm the plugin works with Muse2 through BlueMuse and Openvibe, just started toying around with it and first impression is very positive indeed!
Got some issues trying to launch OpenVibe from the GUI (you always need to start the server manually before), but not a big deal 'cause I start everything by hand to double-check all steps anyway!

Next step: doing some proper EEG-driven realtime visuals in UE! :slight_smile:

P.S.
5 stars dropped! :wink:

Very great! Appreciating!!

Is this still working or is there a newer way? I’ve got Unreal and i’m just learning it. I have a Muse2 and would like to achieve something similar!

How easy is this from a non-developer POV? I can’t really code but i’m pretty good at piecing things together.