A catalogue of Heartbeat posts covering AR development on iOS and Android
Augmented Reality on iOS and Android
Augmented reality (AR) is one of the fastest growing “next wave” technologies in mobile development. To define AR, I’ll turn to Jameson Toole and his post (linked below) that explores combining AR and AI in mobile development:
Augmented reality is an experience that blends physical and digital environments. Think Pokemon Go or Snapchat. Computer-generated objects coexist and interact with the real world in a single, immersive scene. This is made possible by fusing data from multiple sensors — camera(s), gyroscopes, accelerometers, GPS, etc. — to form a digital representation of the world that can be overlaid on top of the physical one.
To help you get started with developing amazing mobile experiences with AR, we’ve compiled a helpful list of Heartbeat tutorials, explainers, and more. If you have any ideas for posts you’d like to see, let us know!
Using Core ML and ARKit to Build a Gesture-Based Interface iOS App
Harnessing mobile machine learning and augmented reality on iOS to browse the Internet with hand gestures.
— by Bruno Muniz
Using ARKit on iOS to Build an Augmented Reality Shooter Game
Learn how to build a new kind of first-person shooter using augmented reality with ARKit on iOS.
— by Yuma Soerianto
Using ARCore and Unity3D to Draw Lines in Augmented Reality
Learn how to draw lines in Augmented Reality using ARCore and Unity3D.
— by Shivang Chopra
Combining artificial intelligence and augmented reality in mobile apps
AI and AR are two of the most promising technologies available to mobile app developers. In this post, the two technologies are disambiguated, and we explore what might be built by combining the two.
— by Jameson Toole
Writing a simple Waypoint System in Augmented Reality on iOS
Learn how to write a simple waypoint system in AR on iOS that virtual objects will follow as they move through a scene.
— by Dan Wyszynski
Augmented Reality (AR) Development: Tools and Platforms
A look at the current publishers, platforms, and tools for developers working with augmented reality.
— by Harsh Chandra
Hand Detection with Core ML and ARKit
ARKit allows mixing virtual objects and real world environment. In this post we explore how we can make our real hands interact with virtual objects using machine learning and Core ML in particular.
— by Gil Nakache
Build your first Android AR app with ARCore and Sceneform in 5 minutes
Learn how to build an Android powered by Augmented Reality, using ARCore and Sceneform.
— by Calum Gathergood
Create AR experiences with the Fritz Unity SDK — Bird Perch Tutorial with Pose Estimation
Learn how to use the Fritz Unity SDK to create an immersive augmented reality experience.
— by Christopher Kelly
Creating Snapchat Augmented Reality Lenses — A beginner’s guide
Using Lens Studio to create custom AR Lenses on Snapchat.
— by Harsh Chandra
Editor’s Note: Heartbeat is a contributor-driven online publication and community dedicated to exploring the emerging intersection of mobile app development and machine learning. We’re committed to supporting and inspiring developers and engineers from all walks of life.
Editorially independent, Heartbeat is sponsored and published by Fritz AI, the machine learning platform that helps developers teach devices to see, hear, sense, and think. We pay our contributors, and we don’t sell ads.
If you’d like to contribute, head on over to our call for contributors. You can also sign up to receive our weekly newsletters (Deep Learning Weekly and Heartbeat), join us on Slack, and follow Fritz AI on Twitter for all the latest in mobile machine learning.