🫠Apple’s ‘Big’ AI Reveal

All the announcements from Apple's WWDC 2024

Key Points 

• Siri will have "onscreen awareness," allowing it to understand your requests and take action within more apps.

• Genmoji will allow you to create the exact emoji you need with AI.

• Image Playground will let you create AI images of people you're messaging with. 

• ChatGPT will be integrated into iOS, macOS, and iPadOS. 

• When using the Apple Pencil in Notes, Smart Script will enhance your handwriting using on-device ML, resulting in smoother and straighter notes.

• Math Notes in the calculator app will do the math for you.

• VisionOS 2 can transform existing images into spatial photos using ML.

👨🏻‍💻News - During the kickoff of Apple's Worldwide Developer's Conference, the company introduced "Apple Intelligence," a suite of machine learning features set to be integrated across its desktop and mobile platforms.

These so-called "new" capabilities, however, are a familiar blend of AI features we've seen from other companies riding the AI wave. Still, there was a lot to take in, right? Here's a rundown of all the announcements, covering updates to Siri, Genmoji, ChatGPT integrations, and more.

🍎All the Apple Intelligence news - 

• Siri: is getting a visual update with a rainbow ring around the edge of your screen when activated. Apple claims Siri will have "onscreen awareness," allowing it to understand your requests and take action within more apps over time, including both Apple and third-party apps. Additionally, you'll have the option to type to Siri, not just speak.

• Gemoji & Image generation: Apple is introducing "Genmoji," a new feature that generates emoji-like reactions on the fly, allowing you to create the exact emoji you need with AI. Additionally, iOS 18 will include a new image generation feature called Image Playground. This lets users create AI images of people they're messaging with, somewhat like an AI-enhanced Bitmoji. The aim is to make everyday conversations more enjoyable. This feature works across various apps and has its own dedicated app with the same name.

• ChatGPT integration: ChatGPT, powered by GPT-4, will be integrated into iOS, macOS, and iPadOS "later this year" as a backup for Siri when it can't handle your request. Apple says Siri will ask for your permission before sending any questions, documents, or photos to ChatGPT, and then present its answers to you. Initially, Apple is starting with ChatGPT but plans to support other AI models in the future. Additionally, ChatGPT will be available for use in Apple's system-wide AI writing tools and also to generate images.

• Other capabilities: Apple's AI features will enable actions between apps, manage notifications, automatically write text, and summarize content in mail and other apps. You can also change the tone of your writing with a prompt, similar to other AI writing tools. Additionally, Apple's AI can reference one app to perform actions in another, like playing a podcast your partner sent you.

🔔A reminder - The AI features will be available exclusively on the iPhone 15 Pro, 15 Pro Max, and iPads or Macs with M1 or later chips, and only when the language is set to English. These features will begin rolling out this fall with iOS 18, iPadOS 18, and macOS Sequoia.

👨🏻‍🏭But wait there's more.....

• Smart Script in iPad: This new feature will enhance your handwriting when using an Apple Pencil in Notes. Apple says this will make your notes smoother and straighter. The feature uses on-device machine learning to improve the appearance of your handwriting in real-time, so you'll see your own writing, just smoother and more legible.

• Calculator for iPad: iOS's long-standing tips calculator app is finally coming to larger screens. This update takes advantage of the additional screen space to introduce new features that couldn't fit on the iPhone. The most notable addition is Math Notes, which performs calculations for you.

• VisionOS 2: This brings productivity improvements and "new immersive experiences." The most notable is the ability to convert existing images into spatial photos. This new feature employs machine learning to generate extra angles, unlike the old way that required photos to be taken on an iPhone 15 Pro or the Vision Pro device.

🙃In conclusion - Essentially, Apple's big AI reveal, at least the "Apple Intelligence" part of it, boils down to a chatbot and an image generator. Instead of creating new things, Apple appears to be playing catch-up with competitors like Microsoft, Google, and Meta, who have had similar offerings for months. If you're still interested in watching the keynote, click below.