Video summary
iOS 27 Beta - 200+ Changes/Features!
Main summary
Key takeaways
Tech-focused summary of the iOS 27 beta walkthrough (200+ changes)
Spotlight indexing + Apple Intelligence integration
- Apple has completely overhauled Spotlight indexing.
- The changes are tied to revamped Apple Intelligence models and Apple Foundation models.
- Expected outcomes:
- More accurate/efficient basic Spotlight searches
- Faster and more reliable personal context for Apple Intelligence
- Siri and Spotlight are merged into a single interaction surface.
Unified Siri / Spotlight UI + new gesture model
- New “liquid glass” Siri animation that reacts to the content behind it while scrolling.
- Siri can be invoked normally (“Hey Siri”) or via swipe down to open the Spotlight/Siri interface.
- New top-swipe behaviors: swiping down from an open app triggers the Siri/Spotlight interface.
- Notification Center / Control Center / Siri are reorganized into separate sections, with Siri taking a central section.
New dedicated Siri app (conversation history + context continuity)
- Siri now includes a dedicated app that stores conversation history.
- Highlighted features:
- Search past conversations
- Resume or follow up without re-explaining context
- Rename conversations
- Attach photos/files to provide context
- Share conversations as PDF
- Playback audio from Siri conversations
- Cross-device context sync: conversations and context sync between iPhone and Mac (macOS 27).
“World knowledge” with sources
- Siri answers can include tap-to-view sources (e.g., Wikipedia and other online sources).
- Emphasis on improved handling of back-to-back follow-ups using world knowledge and context.
ChatGPT extension support (hidden entry + voice options)
- Siri supports switching to third-party extensions.
- ChatGPT extension can be selected via a hidden long-press → “Ask” → extensions flow.
- ChatGPT is described in this demo as less full-featured than Siri.
- Siri settings include voice selection for the ChatGPT extension, including default vs custom voices.
- Voice customization appears limited to newer hardware (mentioned: iPhone 17 Pro / iPhone “Air”; not iPhone 16 Pro).
Visual Intelligence / camera + Siri-in-camera
- The Camera app adds “Siri mode”: ask Siri about what you’re seeing (e.g., bottle/water example).
- “Siri / image search” in detail views is mentioned; external image search availability may be unstable in early beta.
Image Playground upgrades + wallpaper generation + inpainting/extend
- Image Playground is redesigned with suggested images.
- Adds more photorealistic generation (noted as “promising” but imperfect).
- Tools include:
- Cleanup/edit by marking areas to remove
- Generate photorealistic images
- Wallpaper creation directly
- Pinch-to-zoom + “extend” to expand wallpaper borders using AI
- Wallpaper creation can be prompt-driven with optional style + reference images.
- Some guardrails/content filtering are mentioned (e.g., a “Ferrari” prompt causing an error).
Home Screen / UI performance polish
- New extra-large widgets that occupy an entire home screen page.
- Improved home screen icon rearranging (less jitter).
- New dynamic iOS 27 wallpaper:
- Changes with time of day
- Includes tint/color customization
- Additional improvements claimed:
- Smoother unlocking
- Faster lock screen switching
- Reduced “sparkle” around icons; sharper icon rendering
- “Liquid glass” is extended across the UI, including Find My and Maps.
Lock Screen changes + security/accessibility
- Lock screen clock can be moved smaller near the date.
- Password/security:
- More password help options, including:
- Forget passcode flow
- Security lockout recovery
- More password help options, including:
- Lock screen behavior:
- Lock screen stays awake while browsing notifications
- Music widget:
- Swipe-away bug noted (no easy way to bring it back).
Find My + privacy improvements
- Find My gains liquid glass support and updated iconography (items → AirTag style).
- Location privacy:
- Hide location from specific individuals
- Hide has an expiration
- Can be manually restored
- Location sharing becomes more flexible, with hour/day/custom minute-level scheduling.
Network + connectivity enhancements
- Wi‑Fi settings show Wi‑Fi type (e.g., Wi‑Fi 6 / 802.11ax).
- Intelligent connectivity:
- iPhone can use cellular alongside Wi‑Fi for reliability
- UI notification when it switches/adds cellular
- Personal Hotspot becomes more efficient (less battery/heat).
- AirDrop improvements observed (faster recognition/reliability).
- NFC described as faster/more reliable.
- Control Center:
- “Connectivity” control can be resized and includes a small focus toggle.
System performance and battery/low power mode
- Faster app launches and improved Photos loading speed.
- Low Power Mode improvements:
- Faster camera launch
- Lower power drain for camera usage
- Better usability vs iOS 26 (still lower smoothness than normal)
iOS 27 “recovery” redesign (Mac-like)
- New recovery mode entry mimics Mac behavior (hold side button to enter recovery options).
- Recovery assistant UI includes:
- Try to fix software issues
- Software updates (with Apple data sharing mention)
- Diagnostics mode
- Erase all content and settings
- Recovery mode via computer restore
- UI details like language selection, Wi‑Fi, and battery display are called out.
Messaging (iMessage) and communication UX upgrades
- Messages:
- Auto-resend when a message fails
- Suggested actions from message notifications (add to Calendar/Notes)
- Drawing support inside messages
- Customize/remove record audio button in text field to reduce accidental voice notes
- Audio message playback speed button
- Per-message sending progress bars (parallel sending)
- Indicates when a draft exists
- Search by phone number/contact/nickname
- Mail:
- New ranking system for search relevance
- Mail indexing improvements when iPhone is locked
- FaceTime:
- Mention of dual capture (front + rear camera simultaneously), targeted to newer iPhone hardware.
Siri-based agents for password fixing (Apple Intelligence “agentic” flow)
- Security → auto fix passwords using Apple Intelligence:
- Automatically visits sites, signs in, and changes passwords
- Handles verification codes (“automatic verification”)
- Not always perfect in beta; described as finicky, though at least one successful case is claimed
- Goal: reduce user work on weak/compromised passwords while improving security.
Photos / camera / editing upgrades
- “Visual intelligence” is better integrated (doesn’t hijack photo capture).
- Enhanced editing tools:
- Cleanup with quality options (removes objects while preserving background more)
- Extend (smartly fills image borders)
- Reframe (adjust perspective/angle)
- Other Photos features:
- Ask Siri / image search in detail view
- Star ratings per photo
- Sync immediately option for iCloud Photos (pause in Low Power/Low Data)
- New collections (e.g., identity documents, captured-by-me)
- Keywords for image search via tagging/indexing
- Save video frame as photo
- Improved lens switching during zoom video
- Selection view for already selected items across albums/libraries
- Shared albums enhancements (filtering, temporary expiry, broader emoji reactions, full-resolution sharing)
- Notes: new slideshow customization options and better frame extraction.
Shortcuts + Safari + productivity
- Shortcuts editor redesign:
- New storage model / global values
- Multiple automation triggers per shortcut
- Expanded “what’s on screen” value extraction
- New triggers: screenshot saved, notification received
- Text-to-shortcut using Apple Intelligence (plain-language input)
- Safari:
- Tab topics organization (auto topic generation)
- Safari extension creation from text prompt
- “Notify me” for webpage change monitoring (site update notifications)
- Freeform:
- Dark mode support
- Collaborative folders with permissions
- Weather/Calendar/Reminders:
- Expanded UI views (hourly/10-day, highlights, precipitation/wind)
- Natural language event creation (slightly finicky in beta)
- Extra-large widgets for Calendar/Reminders
- Reminders grocery list curation with more language support for categorization
Main speaker / source
- Jeff Benjamin (host), 9to5Mac YouTube channel.