Recommendations for using MLIR

Thank you for the information. I will look into whether we have devices with NPUs — this could really give us a boost, although the most problematic platforms are consoles and cloud instances for dedicated servers (in single-threaded mode). The user format is not a big issue and we should be able to implement it. However, I will still explore the possibility of exporting the model to MLIR from Torch. Last time I looked into this, I had trouble finding a suitable torch-mlir version, and compiling such projects did not always go smoothly. Thanks again for the information — we’ll keep experimenting.