Vision SDK for iOS

Vision SDK for iOS

  • Real-time classification of road signs
  • Semantic segmentation of the roadway into 12 different classes
  • Object detection for vehicles, pedestrians, road signs, and traffic lights
  • Following distance detection that indicates spacing to next vehicle
The Mapbox Vision SDK for iOS is currently in limited public beta.

The Mapbox Vision SDK for iOS is a library for interpreting road scenes in real-time directly on iOS devices using the device’s built-in camera. Features include:

  • Classification and display of regulatory and warning signs
  • Object detection for vehicles, pedestrians, road signs, and traffic lights
  • Semantic segmentation of the roadway into 12 different classes
  • Distance detection that indicates spacing to lead vehicle

Uses

Developers of native navigation applications can integrate the Vision SDK into their applications to enhance navigation experiences in real time and collect data that will improve the map data made available by Mapbox.

The Vision SDK, unlike similar products, provides functionality, safety alerts, or a heads-up display on customer’s existing devices without requiring video uploads or storage on device. Most importantly, the functionality of the Vision SDK is tied into the rest of Mapbox’s ecosystem: maps, navigation, customizable data layers, and more.

Requirements

The Vision SDK for iOS is written in Swift 4.1 and can be used with iOS 11.2 and higher on iPhone 7 or newer.

In addition to software and hardware requirements, use of the Vision SDK requires that the device is pointed with a view of the road. We strongly recommend using a dashboard or windshield mount to keep your phone oriented correctly while you drive. We have tested a few options and have seen positive results with two mounts (option 1 and option 2).

Installation and setup

The Vision SDK is currently in limited public beta. Contact our team to request access and receive installation instructions.

Device setup

In addition to installing the framework, you will need to set up the device in the vehicle. Some things to consider when choosing and setting up a mount:

  • Generally, shorter length mounts will vibrate less. Mounting to your windshield or to the dashboard itself are both options.
  • The Vision SDK will do best with detections when the phone is near or behind where your rearview mirror is. However, note that your local jurisdiction may have limits on where mounts may be placed.
  • Make sure the phone’s camera view is unobstructed (you will be able to tell with any of the video screens open).

Integration with other tools

The Vision SDK for iOS is a framework written in Swift that allows developers to interact with Mapbox Vision Core using a convenient user-facing API that handles platform-dependent tasks. The Vision SDK for iOS can be used independently or with Vision AR for iOS to create AR navigation experiences.

Conditions

Attribution

While the Vision SDK is using the camera you must display the Mapbox watermark on screen. Read more about attribution requirements in our terms of service.

Available resources

Learn more about the capabilities of the Vision SDK in the API reference and data types reference. Contact our team to request access to the SDK.