When I use the node ‘Load Json from File’ of plugin VaRest to get the data in a 40,000 kb size of JSON file in real time, it had a lag. When I change a smaller JSON file, it works normally. So I want to know how to read a relatively large JSON file without delay?
Hey there @FunnyCharly! Larger JSON files always take a short delay while being read, how long is the delay?
The delay is obvious, about 1-2 seconds.
After some testing I’m seeing the same, took a rather large file to see a significant change, though it seems the read action speed is mostly immutable after testing. Unsure if there’s a way to speed it up besides breaking irrelevant data into other files, or preloading the file before it’s required.
Thanks for your reply, maybe I should try another way. I will tell you later if it works.
Great, let me know if your use case can support that, if not I can try to see if there’s a lighter weight JSON plugin around, though it’s doubtful as at that size I think any reader is going to need time.
I asked this question in this plugin’s ‘Questions’ page in EPIC, I got a reply told me ‘If it is a JSON file with a simple structure, the parsing speed using CPP will be much faster’. Do you know anything about this? What is using CPP?
I didn’t know the parsing speed would change running it from C++ directly myself. Though it’s absolutely true the less complex the dataset and cutting out any irrelevant data from the file beforehand would speed it up immensely usually.