avkit
Create media playback experiences using AVKit. Use when adding video players with AVPlayerViewController, enabling Picture-in-Picture, routing media with AirPlay, using SwiftUI VideoPlayer views, configuring transport controls, displaying subtitles and closed captions, or integrating AVFoundation pl
By dpearson2699 · 2,716 installs
npx skills add dpearson2699/swift-ios-skills --skill avkit
Source repository · Upstream listing
AVKit
High level media playback UI built on AVFoundation. Provides system standard
video players, Picture in Picture, AirPlay routing, transport controls, and
subtitle/caption display. Targets Swift 6.3 / iOS 26+.
Contents
[Setup]( setup)
[AVPlayerViewController]( avplayerviewcontroller)
[SwiftUI VideoPlayer]( swiftui videoplayer)
[Picture in Picture]( picture in picture)
[AirPlay]( airplay)
[Transport Controls and Playback Speed]( transport controls and playback speed)
[Subtitles and Closed Captions]( subtitles and closed captions)
[Common Mistakes]( common mistakes)
[Review Checklist]( review checklist)
[References]( references)
Setup
Audio Session Configuration
Playback apps need an audio session category and the matching background mode
when they support background audio, AirPlay, or PiP.
1. Enable Background Modes Audio, AirPlay, and Picture in Picture (the
audio value in UIBackgroundModes )
2. Set the audio session category to .playback
3. Defer setActive(true) until playback begins so you do not interrupt other
audio prematurely
Imports
AVPlayerViewController
AVPlayerViewController is the standard UIKit player. It provides system
playback controls, PiP, AirPlay, subtitles, and frame analysis out of the box.
Do not subclass it.
Basic Presentation (Full Screen)
Inline (Embedded) Playback
Add AVPlayerViewController as a child view controller for inline playback.
Call addChild , add the view with constraints, then call didMove(toParent:) .
Key Properties
Use contentOverlayView to add non interactive views (watermarks, logos)
between the video and transport controls.
Delegate
Adopt AVPlayerViewControllerDelegate to respond to full screen transitions,
PiP lifecycle events, interstitial playback, and media selection changes.
Use the transition coordinator's animate(alongsideTransition:completion:) to
synchronize your UI with full screen animations.
Display Readiness
Observe isReadyForDisplay before showing the player to avoid a black flash:
SwiftUI VideoPlayer
The VideoPlayer SwiftUI view wraps AVKit's playback UI.
Basic Usage
Video Overlay
Add a SwiftUI overlay above the video content and below the system playback
controls. The overlay can be interactive, but it only receives events the system
controls do not handle.
UIKit Hosting for Advanced Control
VideoPlayer does not expose all AVPlayerViewController properties. For PiP
configuration, delegate callbacks, or playback speed control, wrap
AVPlayerViewController in a UIViewControllerRepresentable . See the full
pattern in [references/avkit patterns.md](references/avkit patterns.md).
Picture in Picture
PiP lets users watch video in a floating window while using other apps.
AVPlayerViewController supports PiP automatically once the app is configured,
the device supports PiP, and the current AVPlayerItem is playable video
content in an AVPlayer compatible format. Audio only items, unsupported
containers/codecs, or items that are not ready to display video can make PiP
unavailable even when app and device setup are correct. For custom player UIs,
use AVPictureInPictureController directly.
Prerequisites
1. Audio session category set to .playback (see [Setup]( setup))
2. Background Modes Audio, AirPlay, and Picture in Picture enabled
3. Ready AVPlayerItem with playable video media, not audio only content
4. Current playback context allows PiP; for custom players, observe isPictureInPicturePossible
Standard Player PiP
PiP is enabled by default on AVPlayerViewController . Control automatic
activation and inline to PiP transitions:
Restoring the UI When PiP Stops
When the user taps the restore button in PiP, implement the delegate method to
re present your player. Call the completion handler with true to signal the
system to finish the restore animation.
Custom Player PiP
For custom player UIs, use AVPictureInPictureController with an AVPlayerLayer
or sample buffer content source. Check device support before creating PiP UI,
then check the controller's isPictureInPicturePossible before starting PiP in
the current playback context. See [references/avkit patterns.md](references/avkit patterns.md)
for full custom player and sample buffer PiP patterns.
Linear Playback During Ads
Interstitial breaks can come from the media stream/manifest, which AVFoundation
exposes through AVPlayerItem.interstitialTimeRanges , or from an app owned
AVPlayerInterstitialEventController schedule. Do not assign
interstitialTimeRanges directly on iOS. Use requiresLinearPlayback only to
prevent seeking during required ad or legal segments:
AirPlay
AVPlayerViewController supports AirPlay automatically when app configuration,
media, routes, and device support allow external playback. No additional code is
required when using the standard player. The system displays the AirPlay button
in the transport controls when AirPlay capable devices are available.
AVRoutePickerView
Add a standalone AirPlay route picker button outside the player UI:
External Playback
AVPlayer allows external playback by default. Leave it enabled for AirPlay,
or set it explicitly when code elsewhere may disable it:
Set usesExternalPlaybackWhileExternalScreenIsActive only when you want the
player to automatically switch to external playback while an external screen
mode is active.
Transport Controls and Playback Speed
Custom Playback Speeds
Provide user selectable playback speeds in the player UI:
Use AVPlaybackSpeed.systemDefaultSpeeds to restore the default speed options.
Skipping and Seeking
On iOS, use the standard transport controls and AVPlayer.seek(...) for custom
app controls. AVPlayerViewController skipping behavior APIs such as
isSkipForwardEnabled , isSkipBackwardEnabled , and skippingBehavior are
tvOS focused; keep them out of iOS player implementations.
Now Playing Integration
AVPlayerViewController updates MPNowPlayingInfoCenter automatically by
default. Disable this if you manage Now Playing info manually:
Subtitles and Closed Captions
AVKit handles subtitle and closed caption display automatically when the media
contains appropriate text tracks. Users control subtitle preferences in
Settings Accessibility Subtitles & Captioning.
Programmatic Selection
allowedSubtitleOptionLanguages , requiresFullSubtitles , and the
AVPlayerViewControllerDelegate media selection callback are tvOS only. For iOS,
load the asset's .legible media selection group and select an option on the
AVPlayerItem when the app needs a default.
Providing Subtitle Tracks in HLS
Subtitles and closed captions are embedded in HLS manifests. AVKit reads them
from AVMediaSelectionGroup on the AVAsset . For local files, use media that
already includes legible subtitle or closed caption tracks, or author those
tracks into the playable asset before presenting it with AVKit.
Common Mistakes
DON'T: Subclass AVPlayerViewController
Apple explicitly states this is unsupported. It may cause undefined behavior or
crash on future OS versions.
DON'T: Skip audio session configuration for PiP
PiP and background playback depend on the playback audio session category and
the Audio, AirPlay, and Picture in Picture background mode.
DON'T: Forget the PiP restore delegate or its completion handler
Without restoreUserInterfaceForPictureInPictureStopWithCompletionHandler , the
system cannot return the user to your player. Failing to call
completionHandler(true) leaves the system in an inconsistent state.
DON'T: Create AVPlayer in a SwiftUI view's init
Creating the player eagerly causes performance issues. SwiftUI may recreate the
view multiple times.
Review Checklist
[ ] Audio session category set to .playback with mode: .moviePlayback
[ ] Audio session activation deferred until playback begins
[ ] Audio, AirPlay, and Picture in Picture background mode added to UIBackgroundModes
[ ] AVPlayerViewController is not subclassed
[ ] PiP tested with supported video media, not only app/device setup
[ ] PiP restore delegate method implemented and calls completionHandler(true)
[ ] Custom PiP checks both device support and current isPictureInPicturePossible
[ ] Custom PiP starts only from explicit user interaction
[ ] AVPlayer deferred to .task in SwiftUI (not created eagerly)
[ ] canStartPictureInPictureAutomaticallyFromInline set for inline players
[ ] requiresLinearPlayback toggled only during required ad/legal segments
[ ] tvOS only skipping APIs are not used for iOS transport controls
[ ] External playback is not disabled accidentally when AirPlay is required
[ ] Subtitle selection tested with actual media tracks
[ ] Video gravity set appropriately ( .resizeAspect vs .resizeAspectFill )
[ ] isReadyForDisplay observed before showing the player view
[ ] Error handling for network streamed content (HLS failures, timeouts)
References
Advanced patterns (custom player UI, interstitials, background playback, error handling): [references/avkit patterns.md](references/avkit patterns.md)
[AVKit framework](https://sosumi.ai/documentation/avkit)
[AVPlayerViewController](https://sosumi.ai/documentation/avkit/avplayerviewcontroller)
[VideoPlayer (SwiftUI)](https://sosumi.ai/documentation/avkit/videoplayer)
[AVPictureInPictureController](https://sosumi.ai/documentation/avkit/avpictureinpicturecontroller)
[AVRoutePickerView](https://sosumi.ai/documentation/avkit/avroutepickerview)
[AVPlaybackSpeed](https://sosumi.ai/documentation/avkit/avplaybackspeed)
[Configuring your app for media playback](https://sosumi.ai/documentation/avfoundation/configuring your app for media playback)
[Adopting Picture in Picture in a Standard Player](https://sosumi.ai/documentation/avkit/adopting picture in picture in a standard player)
[Playing video content in a standard user interface](https://sosumi.ai/documentation/avkit/playing video content in a standard user interface)