Heartbeat Collections

A catalogue of Heartbeat posts covering AR development on iOS and Android

Photo by David Grandmougin on Unsplash

Augmented Reality on iOS and Android

Augmented reality (AR) is one of the fastest growing “next wave” technologies in mobile development. To define AR, I’ll turn to Jameson Toole and his post (linked below) that explores combining AR and AI in mobile development:

Augmented reality is an experience that blends physical and digital environments. Think Pokemon Go or Snapchat. Computer-generated objects coexist and interact with the real world in a single, immersive scene. This is made possible by fusing data from multiple sensors — camera(s), gyroscopes, accelerometers, GPS, etc. — to form a digital representation of the world that can be overlaid on top of the physical one.

To help you get started with developing amazing mobile experiences with AR, we’ve compiled a helpful list of Heartbeat tutorials, explainers, and more. If you have any ideas for posts you’d like to see, let us know!

Using Core ML and ARKit to Build a Gesture-Based Interface iOS App

Harnessing mobile machine learning and augmented reality on iOS to browse the Internet with hand gestures.

— by Bruno Muniz

Using Core ML and ARKit to Build a Gesture-Based Interface iOS App

Using ARKit on iOS to Build an Augmented Reality Shooter Game

Learn how to build a new kind of first-person shooter using augmented reality with ARKit on iOS.

— by Yuma Soerianto

Using ARKit on iOS to Build an Augmented Reality Shooter Game

Using ARCore and Unity3D to Draw Lines in Augmented Reality

Learn how to draw lines in Augmented Reality using ARCore and Unity3D.

— by Shivang Chopra

Using ARCore and Unity3D to Draw Lines in Augmented Reality

Combining artificial intelligence and augmented reality in mobile apps

AI and AR are two of the most promising technologies available to mobile app developers. In this post, the two technologies are disambiguated, and we explore what might be built by combining the two.

— by Jameson Toole

Combining artificial intelligence and augmented reality in mobile apps

Writing a simple Waypoint System in Augmented Reality on iOS

Learn how to write a simple waypoint system in AR on iOS that virtual objects will follow as they move through a scene.

— by Dan Wyszynski

Writing a simple Waypoint System in Augmented Reality on iOS

Augmented Reality (AR) Development: Tools and Platforms

A look at the current publishers, platforms, and tools for developers working with augmented reality.

— by Harsh Chandra

Augmented Reality (AR) Development: Tools and Platforms

Hand Detection with Core ML and ARKit

ARKit allows mixing virtual objects and real world environment. In this post we explore how we can make our real hands interact with virtual objects using machine learning and Core ML in particular.

— by Gil Nakache

Hand Detection with Core ML and ARKit

Build your first Android AR app with ARCore and Sceneform in 5 minutes

Learn how to build an Android powered by Augmented Reality, using ARCore and Sceneform.

— by Calum Gathergood

Build your first Android AR app with ARCore and Sceneform in 5 minutes*

Create AR experiences with the Fritz Unity SDK — Bird Perch Tutorial with Pose Estimation

Learn how to use the Fritz Unity SDK to create an immersive augmented reality experience.

— by Christopher Kelly

Create AR experiences with the Fritz Unity SDK — Bird Perch Tutorial with Pose Estimation

Creating Snapchat Augmented Reality Lenses — A beginner’s guide

Using Lens Studio to create custom AR Lenses on Snapchat.

— by Harsh Chandra

Creating Snapchat AR Lenses—A beginner’s guide

Editor’s Note: Heartbeat is a contributor-driven online publication and community dedicated to exploring the emerging intersection of mobile app development and machine learning. We’re committed to supporting and inspiring developers and engineers from all walks of life.

Editorially independent, Heartbeat is sponsored and published by Fritz AI, the machine learning platform that helps developers teach devices to see, hear, sense, and think. We pay our contributors, and we don’t sell ads.

If you’d like to contribute, head on over to our call for contributors. You can also sign up to receive our weekly newsletters (Deep Learning Weekly and Heartbeat), join us on Slack, and follow Fritz AI on Twitter for all the latest in mobile machine learning.