Apple Enhances HomeKit Secure Video with AI-Powered Features at WWDC 2024
Apple announced a significant update to its HomeKit Secure Video service at the 2024 Worldwide Developers Conference (WWDC), introducing features driven by its Apple Intelligence platform. The updates are currently available in developer beta for iOS 27 and tvOS 27, with a public release scheduled for fall 2024.
AI-Powered Video Summaries and Search
The Home app will now generate written summaries of motion alerts, identifying people, animals, vehicles, packages, and general motion.
The updated Home app generates written summaries of motion alerts captured by compatible cameras. These summaries identify detected objects and events, including people, animals, vehicles, packages, and general motion. The system can recognize individuals from the user's Photo Library.
Users can search recorded footage using natural language queries, such as “Show me my cat” or “find when a package was delivered.” The search function is available in the Home app and Spotlight. Apple noted that the current system cannot distinguish between visually similar objects, such as two cats of different colors.
Interface and Notification Changes
The camera view in the Home app now sequences clips chronologically across all cameras. Footage from multiple cameras capturing the same event is grouped together. Recordings identified as notable are separated above general recordings.
Notifications from the same device are combined into a single alert that updates with new activity. Users can enable or disable summaries per camera. Pressing and holding an incoming video notification plays a preview clip and provides access to nearby accessories, such as lights.
Resolution and Hardware Support
HomeKit Secure Video cameras now support streaming and recording at up to 4K resolution. Apple stated that 2K and 4K support depends on camera manufacturers implementing the updated HomeKit Secure Video specification. The feature does not require Apple Intelligence, though an upgrade to resolution support is not yet available in the current beta.
Performance and Reliability
Apple reported improvements in the reliability of capturing and storing HomeKit Secure Video footage, noting less missed activity overall. Beta testers of an Eve outdoor camera that frequently disconnected reported improved stability after the upgrade.
Energy Monitoring and Connectivity
A new Energy tab in the Home app displays usage data from Matter-compatible devices, showing current, average, and daily consumption in kilowatt-hours (kWh). Automations based on camera events or energy usage are not yet supported. The update introduces Thread 1.4, which Apple stated improves connectivity, faster pairing, and accessory updates for Thread home accessories.
Remote Updates and Configuration
Users can now update an Apple TV remotely via the Home app. Apple also introduced a streamlined interface for configuring Matter accessories.
Requirements and Compatibility
Apple Intelligence features require an iPhone 15 Pro or later, and an Apple TV running tvOS 27 or a HomePod running HomePod Software 27.
HomeKit Secure Video requires an iCloud+ plan:
- 50GB for one camera
- 200GB for up to five cameras
- 2TB or more for unlimited cameras
Limitations
The beta contains bugs and occasional crashes, and Apple described the AI-generated descriptions as brief. Reports indicate that adoption of the Matter standard for camera support has been slow, limiting the number of compatible cameras. Apple did not announce Matter support for cameras.
Statements on Siri and Partnerships
Apple stated that Siri Visual Intelligence features, including video descriptions and search, are included in the updates. One source reported that Apple partnered with Google Gemini for Siri’s AI capabilities, though this claim was not confirmed by Apple in other provided material. Apple did not disclose specific pricing for the new AI features beyond existing iCloud+ subscription tiers.