UE 5.1 Android AR camera not displaying on HandheldAR project

Development Platform & Builds
, , , ,
31

Same Problem in 5.5 ? BUT instead i am getting black screen. its like my camera tracking is working but i can see through the camera.

so i tried to search for solution on DeepSeek and Chatgpt the gave the solution to enable camera feed option in D_ARSessionConfig. But i cant find that option anywhere.

can someone help me solve it.

reply from DeepSeek and ChatGPT:

Certainly! Let’s break down Step 4 (Configure AR Camera) in detail to ensure your AR app’s camera feed renders correctly as the background:

Step-by-Step Guide to Configure the AR Camera Feed

1. Open Project Settings

  • In Unreal Engine 5, go to Edit > Project Settings from the top menu.

2. Navigate to AR Plugin Settings

  • In the Project Settings window:
    1. Click Plugins on the left-hand panel.
    2. Scroll down to Augmented Reality (under the “XR” section).

3. Configure AR Session Config

  • If you already have an AR Session Config asset:

    • Under AR Session Config, select your existing AR Session Config asset (e.g., DefaultARSessionConfig).
    • If no config exists, click the + button to create a new one.

  • Enable Camera Feed:

    1. In the AR Session Config settings, ensure the Camera Feed section is enabled.
    2. Check the box for Enable Camera Feed (this allows the app to access the device’s camera).

4. Set Camera Feed as Background

  • In the same AR Session Config settings:
    1. Locate the AR Camera Feed section.
    2. Set Camera Feed Rendering to one of these modes:
    • Background: Renders the camera feed behind all scene objects (ideal for most AR apps).
    • Before Rendering: Renders the camera feed first, allowing scene objects to appear on top.
    • After Rendering: Avoid this mode (camera feed will block your AR content).

5. Update AR Pawn/Component

  • If your project uses a custom AR Pawn or AR Component:
    1. Open its Blueprint (e.g., ARPawn or ARComponent).
    2. Find the node where the AR Camera Feed is initialized (often in the Event BeginPlay graph).
    3. Ensure the AR Camera Feed component is set to render in the background (matching the Session Config settings).

6. Test in AR Preview

  • Use Mobile Preview (or deploy to a physical device) to verify:
    • The camera feed is visible as the background.
    • AR objects appear on top of the real-world view (no unwanted environment).

Troubleshooting

  • Camera Feed Not Visible:
    • Double-check that Enable Camera Feed is enabled in the AR Session Config.
    • Ensure the AR Session and AR Origin actors are properly placed in your level.
  • Black Screen:
    • Verify your device has camera permissions enabled (Android/iOS settings).
    • Test with a blank level to rule out conflicts with other assets.

Example Workflow

  1. Create a new AR Session Config asset (e.g., MyARSessionConfig).
  2. Enable Enable Camera Feed and set Camera Feed Rendering to Background.
  3. Assign MyARSessionConfig to your project’s AR Session actor in the level.
  4. Test in Mobile Preview to confirm the camera feed appears behind AR content.

By configuring these settings, your app should prioritize the real-world camera feed as the background, hiding any unwanted environments. Let me know if you need clarification on any sub-step! :video_game::iphone:

and also

i cant find AR camera feed option.

reply

If you can’t find the AR Camera Feed settings in Unreal Engine 5, it’s likely due to one of the following reasons. Let’s troubleshoot and fix this step-by-step:

1. Enable the AR Plugin

The AR Camera Feed option is part of Unreal Engine’s Augmented Reality Plugin, which must be enabled first.

  1. Go to Edit > Plugins.
  2. In the Plugins window:
    • Search for Augmented Reality in the search bar.
    • Check the box to Enable the plugin.
  3. Restart Unreal Engine for the changes to take effect.

2. Configure AR Session Config

The AR Camera Feed settings are tied to the AR Session Config asset. If you don’t have one, follow these steps:

Create an AR Session Config

  1. In the Content Browser:
    • Right-click and go to Miscellaneous > Data Asset.
    • Search for AR Session Config and create it (name it, e.g., MyARSessionConfig).

Enable Camera Feed

  1. Double-click your AR Session Config asset to open it.
  2. Under the Camera Feed section:
    • Check Enable Camera Feed.
    • Set Camera Feed Rendering to Background or Before Rendering.
    • (If these options are grayed out, your project may not be set up for mobile AR. See Step 4.)

3. Assign AR Session Config to Your Project

  1. Go to Project Settings > Plugins > Augmented Reality.
  2. Under AR Session Config, select your newly created MyARSessionConfig asset.
    • If this dropdown is empty, click the arrow (➤) and browse to your asset.

4. Ensure Mobile Platform Setup

The AR Camera Feed settings only appear if your project is configured for Android or iOS (since mobile AR apps use the device’s camera).

For Android:

  1. Go to Project Settings > Platforms > Android.
    • Set Minimum SDK Version to 24 or higher.
    • Under Advanced > Packaging, check Full Hardware Accelerated Execution (GPU).
  2. Go to Project Settings > Platforms > Android > ARCore:
    • Check Enable ARCore.

For iOS:

  1. Go to Project Settings > Platforms > iOS.
    • Under Advanced > ARKit, check Enable ARKit.

5. Add AR Session and AR Origin Actors

The AR Camera Feed won’t work without these actors in your level:

  1. In your level, go to the Place Actors panel.
  2. Search for AR Session and drag it into the scene.
  3. Search for AR Origin and drag it into the scene.

6. Check for Hidden Camera Feed in Blueprints

If the camera feed is still missing, it might not be linked to your AR Pawn or Player Controller:

  1. Open your AR Pawn/Character Blueprint (e.g., DefaultPawn).
  2. In the Event Graph, ensure the AR Camera Feed component is initialized:
    • Look for nodes like On AR Camera Feed Render Target Updated or Update Camera Texture.
  3. If missing, add an AR Camera Feed component to your Pawn:
    • In the Blueprint Components panel, click Add Component and search for AR Camera Feed.

7. Test with a Minimal Setup

  1. Create a new blank level.
  2. Add only:
    • AR Session
    • AR Origin
    • A simple AR object (e.g., a cube).
  3. Package the APK and test on a device.

Common Issues

Camera Feed Still Not Visible

  • Permissions: Ensure your Android/iOS app has camera permissions:
    • For Android: Add <uses-permission android:name="android.permission.CAMERA" /> to AndroidManifest.xml.
  • Black Screen: The camera feed may be blocked by a post-process volume or environment lighting. Disable all lights and post-processing effects.

“AR Camera Feed” Option Still Missing

  • Update Unreal Engine to the latest version (UE 5.3+).
  • Start a new project using the AR Template (File > New Project > Games > Augmented Reality).

Final Checks

  1. Test in Mobile Preview (Window > Virtual Devices > Launch).
  2. Ensure your Android/iOS device has camera permissions enabled in system settings.

If you still can’t find the option, share a screenshot of your AR Session Config settings or describe your project setup, and I’ll help further! :hammer_and_wrench::camera_flash: