The first batch of AI features from Apple is coming next week! The next batch of features integrated with ChatGPT has entered developer testing

Author: Du Yu

Source: Hard AI

On Wednesday, October 23, amidst a series of negative news, Apple released a developer beta of Apple Intelligence with more AI features, including the long-awaited integration of ChatGPT services. Analysts expect these features to be released to the public by the end of the year.

At the same time, reports suggest that Apple is preparing to launch new low-end iPads and ultra-thin MacBook Air laptops around the spring of 2025, while delaying the release of the Mac Studio desktop with M4 chip to a later date in 2025.

However, Apple's stock price in the US market once fell by 3% after midday, reaching a near two-week low since October 11.

Earlier on the same day, it was reported that the Consumer Financial Protection Bureau (CFPB) in the United States ordered Apple to pay a $89 million fine to Goldman Sachs for credit card investigation actions. Renowned analyst Ming-Chi Kuo stated that iPhone 16 orders decreased by approximately 10 million units over three quarters, which may indicate that the AI features did not significantly boost flagship phone shipments. The expensive mixed reality headset Vision Pro has seen a significant reduction in production, and the current version may be completely discontinued by the end of the year, as a cheaper headset may be released before the end of 2025.

Next week, Apple will release the first batch of AI features to the public for the first time, with more highly anticipated features already in developer testing

Apple will release the latest operating system versions for iPhone iOS 18.1, iPadOS 18.1, and macOS Sequoia 15.1 to the public next week, with most rumors suggesting a launch on Monday, October 28.

This will be the first time Apple's generative AI products, announced at the WWDC global developer conference in June this year, will end developer testing and be publicly released to all users.

The first batch of AI features that regular users can experience include: a writing tool integrated into applications for summarizing and rewriting text, AI image cleanup in photos, summary of articles and notifications, and a redesigned Siri typing input experience.

Additionally, Apple has released developer versions of future operating system updates, namely iOS 18.2, iPadOS 18.2, and macOS Sequoia 15.2, containing more "next-stage" AI features such as Genmoji for smart emojis, Image Playground for image generation, Visual Intelligence, Image Wand for turning sketches into art pieces, and user queries integrated with ChatGPT Tracking Apple news, the tech website 9to5mac reported that iOS 18.2 will bring Apple Intelligence support to more regions, allowing users in various English-speaking environments such as Australia, Canada, New Zealand, South Africa, and the UK to experience AI features without changing the system language settings:

"Apple had planned to officially incorporate support for the above five English languages into the operating system in December 2024, which may mean that updates like iOS 18.2 currently in developer beta testing will be released to the public two months later."

In other words, perhaps as early as the end of this year, users in English-speaking markets will be able to experience the latest AI features integrated with ChatGPT.

Multiple sources indicate that after downloading the software update for the operating system, users will need to choose to use Apple Intelligence during the initial setup. However, only higher-end hardware devices support running generative AI features, such as iPhone 15 Pro and Pro Max, all iPhone 16 models, devices with A17 Pro chips (including the new iPad Mini), or M1 and higher chip versions for iPads, as well as Mac computers with M1 or higher chip versions.

The next batch of AI features includes the integration of Apple's assistant Siri with ChatGPT, which can be used without logging into the latter

Some analysts suggest that the first batch of Apple AI features officially launched next week may not be compelling enough for users to spend a lot of money on upgrading to a new device, but the next batch of AI features in the latest developer beta may excite users more as these features align more closely with the interesting descriptions at WWDC.

A well-known financial journalist tracking Apple reports posted on social media that if Apple could release the iOS 18.2 version of Apple Intelligence two months early (in September), the discussion outcome would be completely different, as this is a significant upgrade.

First and foremost is the integration of Apple's intelligent assistant Siri with OpenAI's ChatGPT. Apple stated that Siri will automatically detect when it needs to introduce ChatGPT's assistance to answer complex questions and will obtain user consent before each access to ChatGPT.

Users can access the platform without a ChatGPT account, but queries will be limited without an account. ChatGPT will also be integrated into Apple's system-wide AI writing tool and generate images for selected apps

TechCrunch, a tech media outlet, reported that ChatGPT, a third-party generative AI platform, will be integrated into Apple Intelligence in two ways - answering questions through Siri and serving as a creative option in AI writing tools:

"When the intelligent assistant is asked a question for which an immediate answer cannot be found, Siri will request access to the ChatGPT platform, with recipe and travel plans being two common query languages that may trigger this feature.

ChatGPT's writing function will also be integrated into all applications that have access to Apple's writing tools. Similar to operating ChatGPT, users input prompts and the service will write the text. These applications can also access ChatGPT's image generation platform."

Apple stated that ChatGPT will not store user data or use this data to train OpenAI models. Apple will also help users hide their IP addresses when accessing ChatGPT. Once logged into a ChatGPT account, user data is protected by the latter's policies.

Visual Intelligence Comparable to Google Lens, Image Playground - Next Highly Anticipated AI Function

The second interesting AI feature in the latest developer beta is Visual Intelligence, directly comparable to Google Lens. This tool can be used on the new iPhone 16 series through the camera control button to identify text or objects, and even provide real-time translation.

For example, pointing the camera at a restaurant can immediately provide information such as business hours and customer reviews, pointing at a product can use Google search to find where to buy it, or obtain more information through ChatGPT, as well as provide context for the image in front of you.

Visual Intelligence can also summarize text content captured by the camera, read text aloud, detect phone numbers and emails and add them to contact information, copy real-world text, scan QR codes, and more.

The third attractive AI feature is the image generation tool Image Playground, which uses user prompts such as concepts, descriptions, and roles to generate new images. Users can also choose to use friends and family as prompts, or generate images based on their own photos. Image Playground will be integrated into Apple's messaging app Message, Pages, Keynote, Freeform, and other applications

Among them, the Image Wand option allows users' sketches to be turned into complete images, allowing users to remove objects or distractions from photos, and also clean up handwritten notes. The Genmoji option can create emoji based on AI and user requests and embed them in text, with real people in the contact list also serving as materials.

Some analysts have pointed out that the art pieces generated by Image Playground mainly fall into two styles: animation and illustration, both deliberately avoiding photorealism, possibly to avoid ethical and legal issues arising from photo manipulation.

It has been discovered by some media that the feature of Siri coordinating actions within various applications is highly anticipated, but it did not appear in the latest developer beta version. However, it is expected to be released soon. The services of ChatGPT will also be part of Apple's visual intelligence.

As Apple Intelligence can only be used on a range of the latest devices, Wall Street and investors see the foray into AI as the catalyst for the next Apple smart hardware sales cycle. Since the announcement of AI in June, Apple's stock price has risen by about 19%.

However, some analysts have pointed out that Apple Intelligence is one of Apple's most important products in recent years, but also a huge risk:

Although companies such as Google, Samsung, Microsoft, Intel, AMD, and Qualcomm are vigorously promoting AI functions in smartphones and personal computers, there is still no conclusive evidence that consumers are more interested in generative AI than in pursuing better hardware, such as faster devices, larger displays, or longer battery life.

Apple to release three new Mac models with M4 chips next week, completing M4 upgrades for all Mac models next year, as well as a low-end iPad

Apple will also launch a series of Mac computer products with M4 chips next week to better support AI functions, including new MacBook Pro, Mac mini, and iMac desktops. Among them, the appearance of MacBook Pro and iMac will be similar to the current versions, while the Mac mini will undergo a major redesign for the first time in over a decade, becoming smaller and more like an Apple TV set-top box. Insiders revealed that the upgraded ultra-thin MacBook Air with the M4 chip is expected to be launched between January and March 2025. The last update was in March of this year with the M3 chip, and a 15-inch version with the M2 chip was introduced in June last year. The latest MacBook Air next year will have minor changes in appearance, with both 13-inch and 15-inch models featuring the new generation M4 chip.

At the spring event next year, Apple may plan to launch a new entry-level iPad (or the 11th generation iPad), as well as an improved version of the iPhone SE, a new iPad Air, and an upgraded iPad keyboard.

The higher-end, professional-oriented desktop Mac Studio without a display screen may be delayed until appearing between March and June next year. Apple is also continuing to develop the most expensive Mac Pro computer with the M4 chip version. In addition to chip upgrades, significant updates for Mac Studio and Mac Pro in the future include adding ray tracing and enhancing neural engines, both of which can enhance AI performance