EasyAR Sense 4.0 Beta is Coming!

EasyAR is finally going to be updated again!

In 2015, Sight Plus released China’s first AR engine EasyAR SDK 1.0

In 2019, Sight Plus is about to release EasyAR SDK 3.0 and EasyAR SDK 4.0 Beta. Over the past four years, over 80,000 developers have registered for EasyAR, with 30% of them coming from overseas. Furthermore, we have served more than a thousand companies. EasyAR is running stably on the apps of all industries including Autohome, China Merchants Bank, Bank of Communications, China Everbright Bank, Shanghai Pudong Development Bank, China Minsheng Bank, CCTV Video and Audio, Monument Valley, and multiple smart glasses. It has been approved by hundreds of millions of users.

Over the past four years, we are glad to see that EasyAR developers live up to expectations and have developed countless great AR applications and experiences. For example, Beeways uses EasyAR for museum interactive exhibitions, FPV uses EasyAR for AR drone battle game, Yangcheng uses EasyAR for picture book reading robot, Dalian AR Magic School uses EasyAR for AR education products such as AR Coloring Book, People’s Medical Publishing House uses EasyAR for medical education. Countless excellent developers’ cases have made us more convinced of our original intention of “Make AR Easier”.

EasyAR is committed to continuously improving the underlying AR infrastructure and providing developers and enterprises with comprehensive AR tools. This year, with the efforts of the EasyAR team, many leading AR capabilities which have been proved by the market such as Surface Tracking, Spatial Map, Motion Tracking will be realized in the upcoming EasyAR SDK 3.0 and EasyAR SDK 4.0 Beta. In addition, the EasyAR Unity plug-in will be open source, allowing developers to make better use of the combination of Unity 3D and EasyAR in their developing.

EasyAR SDK 4.0 Beta is the upgraded version of EasyAR SDK 3.0. It includes all the functions of EasyAR SDK 3.0 and additionally adds the exciting AR Cloud function. It can now realized new AR experiences which have been expected, including Multi-person AR, persistence, occlusion and collision:

Sparse Spatial Map

Sparse Spatial Map provides the ability to simultaneously generates point cloud maps for real-time location while scanning physical spaces. Developers can efficiently create applications which are based on real-world space, such as AR manuals and AR navigation. The virtual content deployed on the point cloud map will also be persisted in the real space to realize the connection between the virtual world and the physical world. In addition, multi-person sharing functions are also implemented through this.

Dense Spatial Map

AR experience will be more realistic with interactive collisions between virtual content and the physical world. EasyAR SDK 4.0 Beta supports Dense Spatial Map with a real-time reconstruction of the environments, which enables the effect of collisions, occlusions, etc., to provide a more realistic AR experience.

Motion Tracking

Provides multi-sensor fusion to solve for the position and attitude, reducing the drift caused by camera motion and making virtual objects more stable in space. At the same time, it provides the relocation function so that the positioning can be restored after the tracking is lost. Apps that use motion tracking on both iOS and Android devices, can work independently without ARKit as well as installing ARCore services through the Google Services Framework for Android users.

Dataset Generation

Supports generating a set of dataset files from any set of local image files for identification and tracking in native and unity applications. Helps developers to build more efficient applications

Features of SDK 3.0：

External Camera

This function enables AR identification and tracking by receiving picture frames from an external cameral. The AR display will no longer have to depend on the internal cameras of cellphones. As long as the device can detect the external camera and obtain the video stream, it can be used to transfer the video stream into the picture frames to the EasyAR SDK and use them in your AR application, thus helping the EasyAR developer to develop applications for AR/VR/MR glasses, drones, and USB device.

Surface Tracking

EasyAR SDK 3.0 is updated with Surface Tracking which is specially designed for smaller AR interactive games, AR short video capture, and product placement display. This function provides the ability to compute and track any surface feature points. By eliminating the time needed to look for planes, it can achieve surface fitting and gesture tracing with faster speeds and enhance the user experience.

AR Glasses Support

With the accelerated development of AR smart glasses this year, many AR glasses have been applied at the B-end. EasyAR has recalibrated the image recognition tracking parameters to adapt Android glasses. so that developers can develop AR glasses applications with EasyAR SDK. According to the introductions, EasyAR SDK currently supports the Action One and EPSON BT-350 AR glasses, More AR glasses equipment such as Microsoft Hololens will be supported in later versions.

Open-source Unity plugin and ARM64 Support

open source Unity3D plugins will make it easier for developers to develop EasyAR applications with Unity3D. The plug-ins include the use of efficient Unity rendering pipelines, the use of Unity's built-in Video Player and Android IL2CPP compiler interface, support for ARM64 compilation, etc. The plugin API is consistent with other languages.

Access to External Algorithm

The new API supports developers to access algorithms other than EasyAR SDK’s own algorithm (ImageTracker, etc.), providing more flexible capability extensions.

API Multi-language Optimization

Using Optional in API to systematically solve the problem of null reference input and output detection, supports C, C ++ 17, Traditional C ++, Java, Objective-C, Swift, and provides support for Kotlin through Java.

Reduced Package Size

Through the structural improvement and function cutting of the architecture, the package size of the SDK has been reduced.

Increased Rendering Support

Supports multi-threaded rendering and rendering APIs besides GLES2, which can deal with the impact of Apple's abandonment of GL.

Removed QR Code Function

Redundancy functions including QR code scanning will be removed in exchange to achieve smaller packages.