Accessing metadata of ONNX model with NeuralNetworkInference?

Development Programming & Scripting C++
,
1

Hi, I’m working on a plugin that runs inference on a NeuralNetwork and I have an .onnx model with some custom metadata that was added to the model in Python in the following way, before it was exported:

meta = model_onnx.metadata_props.add()
meta.key = "key_meta"
meta.value = "value_meta"
print(model_onnx.metadata_props[0])

Is there any way using the NNI plugin (or UE itself) that I can access this metadata again? Looking through the NNI api there seem to be no functions exposed for this purpose. I know it can be done with the onnx library but it would be ideal not having to add another onnx library in a ThirdParty folder of my plugin since it already exists in the editor. So if NNI doesn’t provide any function, is there some way that I can access the onnx library already available in UE?

2

Hey @viigeland, how did you add data to the model?
did you converted from pytorch?

3

Hi @alberto , yes data was added to the model as in the python code in the question. And yes, the model was converted using pytorch.

4

I did connected to Dream

My idea was to make a new technology for VFX,
based on the old but gold:

Then my project:

therottengod
therottengod755×675 71 KB

Looks like:

1Screenshot 2022-12-20 063146
1Screenshot 2022-12-20 0631461492×830 112 KB

I did ask to microsoft for support with the integration.
Then they made a special breakfast at 7 of the morning on holidays

And now is Microsoft technology :slight_smile:
Not worried because Is in the forums time ago

I have the model in huggin face and the code is open-source, not an expert in ONNX, can you share the script? I need kind of magenta model I guess

5

@viigeland the tutorials