derived cache data hell in 5.5.1 (ubuntu 22)

giluxx · December 17, 2024, 4:11am

so i had 5.3 working fine.
now with 5.5.1 i cant start it and even gpt can’t solve it.

in the end i deleted everything and used a fresh 5.5.1 zip.

it keeps saying there are no writable nodes:

Fatal error: [File:./Developer/DerivedDataCache/Private/DerivedDataBackends.cpp] [Line: 214] 
Unable to use default cache graph 'InstalledDerivedDataBackendGraph' because there are no writable nodes available.Add -DDC-ForceMemoryCache to the command line to bypass this if you need access to the editor settings to fix the cache configuration.

in the end i changed this in the main ini to put a hardcoded path but to no avail.

[InstalledDerivedDataBackendGraph]
...
;local=(Type=FileSystem, DeleteOnly=true, UnusedFileAge=8, Path="%ENGINEVERSIONAGNOSTICUSERDIR%DerivedDataCache", EnvPathOverride=UE-LocalDataCachePath, EditorOverrideSetting=LocalDerivedDataCache)

Local=(Type=FileSystem, DeleteOnly=true, UnusedFileAge=8, Path="/home/john/Unreal_DDC", EnvPathOverride=UE-LocalDataCachePath, EditorOverrideSetting=LocalDerivedDataCache)

that dir is writable no question.

i can start UE when i disable the cache in the execution line, but thats not really a solution:

/home/john/bin/UNREAL_5.5.1/Engine/Binaries/Linux/UnrealEditor -DDC-ForceMemoryCache -NoDerivedDataCacheBackend

so, i’ve been at it for several hairpulling hours and i am out of idea’s.

nande · December 17, 2024, 7:09am

imho gpt can’t solve almost anything of real importance.

nande · December 17, 2024, 7:11am

i have no idea what the issue might be. never heard of it.
but i’ll check permissions and i’d avoid paths that include symlinks and spaces.
(also to be sure, don’t run ue as root)

giluxx · December 17, 2024, 1:40pm

so it seems to ignore to global ini file anyway.
only when i started with

-DDC-ForceMemoryCache

and started a new project, and in that project changed the directory for the cache, it started using that directory. then it says it needs to restart and then in the log output after restart again it says it doing a writetest to that new directory succesfully and also creates files there and then right after it again complains about no writable nodes although itclearly does write into that directory. it doesnt crash.

[2024.12.17-13.33.59:464][  0]LogDerivedDataCache: FDerivedDataBackendGraph: Pak pak cache file ../../../../../.config/Epic/UnrealEngine/5.5/DerivedDataCache/DDC.ddp not found, will not use a pak cache.
[2024.12.17-13.33.59:464][  0]LogDerivedDataCache: Unable to find inner node Pak for hierarchy Hierarchy.
[2024.12.17-13.33.59:465][  0]LogDerivedDataCache: FDerivedDataBackendGraph: CompressedPak pak cache file ../../../../../.config/Epic/UnrealEngine/5.5/DerivedDataCache/Compressed.ddp not found, will not use a pak cache.
[2024.12.17-13.33.59:465][  0]LogDerivedDataCache: Unable to find inner node CompressedPak for hierarchy Hierarchy.
[2024.12.17-13.33.59:544][  0]LogDerivedDataCache: Display: ../../../Engine/DerivedDataCache/Compressed.ddp: Opened pak cache for reading. (1466 MiB)
[2024.12.17-13.33.59:544][  0]LogDerivedDataCache: FDerivedDataBackendGraph: EnterprisePak pak cache file ../../../Enterprise/DerivedDataCache/Compressed.ddp not found, will not use a pak cache.
[2024.12.17-13.33.59:544][  0]LogDerivedDataCache: Unable to find inner node EnterprisePak for hierarchy Hierarchy.
[2024.12.17-13.33.59:544][  0]LogZenServiceInstance: Found registry key GlobalDataCachePath UE-LocalDataCachePath=/home/john/Unreal_DDC/
[2024.12.17-13.33.59:544][  0]LogZenServiceInstance: Found registry key GlobalDataCachePath UE-LocalDataCachePath=/home/john/Unreal_DDC/
[2024.12.17-13.33.59:544][  0]LogZenServiceInstance: Found local data cache path=/home/john/Unreal_DDC/

the other error is it cant connect to zenserver, but it is up running.

[2024.12.17-13.33.59:544][  0]LogZenServiceInstance: InTree version at '/home/john/bin/UNREAL_5.5.1/Engine/Binaries/Linux/zenserver' is '5.5.7-202409112142-linux-x86_64-release-f523a01'
[2024.12.17-13.33.59:544][  0]LogZenServiceInstance: Installed version at '/home/john/.config/Epic/UnrealEngine/Common/Zen/Install/zenserver' is '5.5.7-202409112142-linux-x86_64-release-f523a01'
[2024.12.17-13.33.59:547][  0]LogZenServiceInstance: No current process using the data dir found, launching a new instance
[2024.12.17-13.33.59:547][  0]LogZenServiceInstance: Display: Launching executable '/home/john/.config/Epic/UnrealEngine/Common/Zen/Install/zenserver', working dir '/home/john/.config/Epic/UnrealEngine/Common/Zen/Install', data dir '/home/john/Unreal_DDC/Zen', args '--port 8558 --data-dir "/home/john/Unreal_DDC/Zen" --http asio --gc-cache-duration-seconds 1209600 --gc-interval-seconds 21600 --gc-low-diskspace-threshold 2147483648 --quiet --http-forceloopback --owner-pid 6547 --child-id Zen_6547_Startup'
[2024.12.17-13.33.59:556][  0]LogZenServiceInstance: Warning: Unable to reach Unreal Zen Storage Server HTTP service at [::1]:32885. Status: 0 . Response: 
[2024.12.17-13.33.59:556][  0]LogZenServiceInstance: Awaiting ZenServer readiness
[2024.12.17-13.33.59:993][  0]LogZenServiceInstance: Found existing instance running on port 8558 matching our settings, no actions needed
[2024.12.17-13.33.59:993][  0]LogZenServiceInstance: Warning: Unable to reach Unreal Zen Storage Server HTTP service at [::1]:32885. Status: 0 . Response: 
[2024.12.17-13.33.59:993][  0]LogZenServiceInstance: Awaiting ZenServer readiness
[2024.12.17-13.33.59:994][  0]LogTurnkeySupport: Completed SDK detection: ExitCode = 0
[2024.12.17-13.34.00:494][  0]LogZenServiceInstance: Found existing instance running on port 8558 matching our settings, no actions needed
[2024.12.17-13.34.00:494][  0]LogZenServiceInstance: Warning: Unable to reach Unreal Zen Storage Server HTTP service at [::1]:32885. Status: 0 . Response:

...


[2024.12.17-13.34.20:037][  0]LogZenServiceInstance: Warning: Unable to reach Unreal Zen Storage Server HTTP service at [::1]:32885. Status: 0 . Response: 
[2024.12.17-13.34.20:037][  0]LogZenServiceInstance: Warning: Local ZenServer AutoLaunch initialization timed out waiting for service to become healthy
[2024.12.17-13.34.20:037][  0]LogZenServiceInstance: Local ZenServer AutoLaunch initialization completed in 20.492 seconds
[2024.12.17-13.34.20:037][  0]LogDerivedDataCache: Display: ZenLocal: Unable to reach ZenServer HTTP service at http://[::1]:32885/ with namespace ue.ddc. Status: 0 . Response: 
[2024.12.17-13.34.20:037][  0]LogDerivedDataCache: Display: ZenLocal: Readiness check failed. It will be deactivated until responsiveness improves. If this is consistent, consider disabling this cache store through the use of the '-ddc=NoZenLocalFallback' or '-ddc=InstalledNoZenLocalFallback' commandline arguments.
[2024.12.17-13.34.20:037][  0]LogDerivedDataCache: Local: Found registry key GlobalDataCachePath UE-LocalDataCachePath=/home/john/Unreal_DDC/
[2024.12.17-13.34.20:043][  0]LogDerivedDataCache: /home/john/Unreal_DDC/: Speed tests took 0.01 seconds.
[2024.12.17-13.34.20:043][  0]LogDerivedDataCache: Display: /home/john/Unreal_DDC/: Performance: Latency=0.01ms. RandomReadSpeed=2699.75MBs, RandomWriteSpeed=181.37MBs. Assigned SpeedClass 'Local'
[2024.12.17-13.34.20:043][  0]LogDerivedDataCache: Local: Using data cache path /home/john/Unreal_DDC/: DeleteOnly
[2024.12.17-13.34.20:043][  0]LogDerivedDataCache: ZenShared: Disabled because Host is set to 'None'
[2024.12.17-13.34.20:043][  0]LogDerivedDataCache: Unable to find inner node ZenShared for hierarchy Hierarchy.
[2024.12.17-13.34.20:043][  0]LogDerivedDataCache: Shared: Disabled because no path is configured.
[2024.12.17-13.34.20:043][  0]LogDerivedDataCache: Unable to find inner node Shared for hierarchy Hierarchy.
[2024.12.17-13.34.20:043][  0]LogDerivedDataCache: Cloud: Disabled because Host is set to 'None'
[2024.12.17-13.34.20:043][  0]LogDerivedDataCache: Unable to find inner node Cloud for hierarchy Hierarchy.
Fatal error: [File:./Developer/DerivedDataCache/Private/DerivedDataBackends.cpp] [Line: 214] 
Unable to use default cache graph 'InstalledDerivedDataBackendGraph' because there are no writable nodes available.Add -DDC-ForceMemoryCache to the command line to bypass this if you need access to the editor settings to fix the cache configuration.
[2024.12.17-13.34.20:045][  0]LogCore: Error: appError called: Fatal error: [File:./Developer/DerivedDataCache/Private/DerivedDataBackends.cpp] [Line: 214] 
Unable to use default cache graph 'InstalledDerivedDataBackendGraph' because there are no writable nodes available.Add -DDC-ForceMemoryCache to the command line to bypass this if you need access to the editor settings to fix the cache configuration.
0x00007ff9f1040efb libUnrealEditor-DerivedDataCache.so!UE::DerivedData::FDerivedDataBackendGraph::FDerivedDataBackendGraph() [/mnt/horde/++UE5/Sync/Engine/Source/./Developer/DerivedDataCache/Private/DerivedDataBackends.cpp:208]
0x00007ff9f1044a03 libUnrealEditor-DerivedDataCache.so!UE::DerivedData::Private::FDerivedDataCache::FDerivedDataCache() [/mnt/horde/++UE5/Sync/Engine/Source/./Developer/DerivedDataCache/Private/DerivedDataBackends.cpp:1132]
0x00007ff9f1024478 libUnrealEditor-DerivedDataCache.so!UE::DerivedData::Private::CreateCache(FDerivedDataCacheInterface**) [/mnt/horde/++UE5/Sync/Engine/Source/./Developer/DerivedDataCache/Private/DerivedDataCache.cpp:1240]
0x00007ff9f102564f libUnrealEditor-DerivedDataCache.so!UE::DerivedData::GetCache() [/mnt/horde/++UE5/Sync/Engine/Source/./Developer/DerivedDataCache/Private/DerivedDataCacheModule.cpp:42]
Signal 11 caught.
0x000000000024b0ba UnrealEditor!FEngineLoop::PreInitPreStartupScreen(char16_t const*) [/mnt/horde/++UE5/Sync/Engine/Source/./Runtime/Launch/Private/LaunchEngineLoop.cpp:3332]
0x0000000000241fe2 UnrealEditor!GuardedMain(char16_t const*) [/mnt/horde/++UE5/Sync/Engine/Source/./Runtime/Launch/Private/LaunchEngineLoop.cpp:4429]
0x00007ff9ee0efbca libUnrealEditor-UnixCommonStartup.so!CommonUnixMain(int, char**, int (*)(char16_t const*), void (*)()) [/mnt/horde/++UE5/Sync/Engine/Source/./Runtime/Unix/UnixCommonStartup/Private/UnixCommonStartup.cpp:323]
0x00007ff9eddfbd90 libc.so.6!UnknownFunction(0x29d8f)
0x00007ff9eddfbe40 libc.so.6!__libc_start_main(+0x7f)
0x0000000000237b2a UnrealEditor!_start(+0x29)




Malloc Size=262146 LargeMemoryPoolOffset=262162 
CommonUnixCrashHandler: Signal=11
[2024.12.17-13.34.21:055][  0]LogCore: === Critical error: ===
Unhandled Exception: SIGSEGV: invalid attempt to write memory at address 0x0000000000000003

[2024.12.17-13.34.21:055][  0]LogCore: Fatal error: [File:./Developer/DerivedDataCache/Private/DerivedDataBackends.cpp] [Line: 214] 
Unable to use default cache graph 'InstalledDerivedDataBackendGraph' because there are no writable nodes available.Add -DDC-ForceMemoryCache to the command line to bypass this if you need access to the editor settings to fix the cache configuration.
0x00007ff9f1040efb libUnrealEditor-DerivedDataCache.so!UE::DerivedData::FDerivedDataBackendGraph::FDerivedDataBackendGraph() [/mnt/horde/++UE5/Sync/Engine/Source/./Developer/DerivedDataCache/Private/DerivedDataBackends.cpp:208]
0x00007ff9f1044a03 libUnrealEditor-DerivedDataCache.so!UE::DerivedData::Private::FDerivedDataCache::FDerivedDataCache() [/mnt/horde/++UE5/Sync/Engine/Source/./Developer/DerivedDataCache/Private/DerivedDataBackends.cpp:1132]
0x00007ff9f1024478 libUnrealEditor-DerivedDataCache.so!UE::DerivedData::Private::CreateCache(FDerivedDataCacheInterface**) [/mnt/horde/++UE5/Sync/Engine/Source/./Developer/DerivedDataCache/Private/DerivedDataCache.cpp:1240]
0x00007ff9f102564f libUnrealEditor-DerivedDataCache.so!UE::DerivedData::GetCache() [/mnt/horde/++UE5/Sync/Engine/Source/./Developer/DerivedDataCache/Private/DerivedDataCacheModule.cpp:42]
0x000000000024b0ba UnrealEditor!FEngineLoop::PreInitPreStartupScreen(char16_t const*) [/mnt/horde/++UE5/Sync/Engine/Source/./Runtime/Launch/Private/LaunchEngineLoop.cpp:3332]
0x0000000000241fe2 UnrealEditor!GuardedMain(char16_t const*) [/mnt/horde/++UE5/Sync/Engine/Source/./Runtime/Launch/Private/LaunchEngineLoop.cpp:4429]
0x00007ff9ee0efbca libUnrealEditor-UnixCommonStartup.so!CommonUnixMain(int, char**, int (*)(char16_t const*), void (*)()) [/mnt/horde/++UE5/Sync/Engine/Source/./Runtime/Unix/UnixCommonStartup/Private/UnixCommonStartup.cpp:323]
0x00007ff9eddfbd90 libc.so.6!UnknownFunction(0x29d8f)
0x00007ff9eddfbe40 libc.so.6!__libc_start_main(+0x7f)
0x0000000000237b2a UnrealEditor!_start(+0x29)

could that be the culprit?

is the zenserver somehow involved in that data cache?

giluxx · December 17, 2024, 2:02pm

ok… sigh… ok…

i solved it., well a workaround,
so its definitely a problem with the zenserver. it runs but somehow it doesn’t play well with the editor.

so the solution to disable the zenserver and bypass it altogether and default to normal cache use.

so for whoever runs into the same problem the solution is to start the editor with the params:
-NoZen -ddc=InstalledNoZenLocalFallback

so:
/path/to/UnrealEditor -NoZen -ddc=InstalledNoZenLocalFallback

somehow disabling zen in the ini file is ignored so this does NOT work:

[Zen]
bEnableZen=false
bEnableZenLocal=false

nande · December 17, 2024, 8:47pm

good thing you found an alternative.

i wonder if it’s a firewall issue that makes the zen server unreachable (even if local)

system · January 16, 2025, 8:47pm

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.