Table of Contents

Image Cloud Recognition WeChat Mini Program Developer Guide

This chapter mainly introduces common features and implementation methods for combining EasyAR Cloud Recognition with WeChat Mini Programs.

Features and Usage

WeChat Mini Program XR-FRAME is an official XR/3D application development solution from WeChat. It uses hybrid rendering technology to achieve near-native performance while combining visual quality and development convenience, making it possible to quickly build AR applications. The framework supports core features such as image tracking, 3D model loading, animation control, video playback, and particle effects. Its development model is mainly WXML template programming, requiring only a small amount of logic code to achieve high-quality visual results.

EasyAR Cloud Recognition, CRS, focuses on image search scenarios for massive image libraries. Through cloud algorithms, it provides efficient target recognition with high cost performance and a low integration threshold, allowing developers to quickly integrate and complete feature development.

Data Flow

flowchart TB

B[API or EasyAR Web] --> A[Cloud Recognition CRS] <-->  D[Device-side WeChat Mini Program]

C[Virtual content] <-->  D[Device-side WeChat Mini Program]

After XR-FRAME is combined with Cloud Recognition, the local device is no longer limited by the number of targets, which can meet the needs of applications over very large ranges.

Implementation Flow

  1. Cloud recognition service call

    • Send an image recognition request through the EasyAR Cloud Recognition, CRS, API
    • Process the recognition result, including recognition success/failure and Meta processing

  2. Tracking image configuration

    • Dynamically set xr-ar-tracker according to trackingImage in the recognition result

  3. Virtual asset loading

    • Parse asset identifiers in Meta data
    • Use xr-asset to download virtual assets such as 3D models or videos
    • Add virtual assets to the scene and configure asset properties, such as scale and initial position

  4. AR content presentation

    • Spatially bind virtual assets to the recognized marker
    • Implement rendering effects that blend virtual and real content
    • Handle user interaction events, such as tapping and dragging

Common Features

After cloud recognition obtains a result, common AR features in WeChat Mini Programs include:

  • Recognition only and display of recognition results
  • Recognition only and display of video, animation, model, and script associated with the recognized target
  • Recognition + tracking overlay of video, animation, model, and script