Craig Federighi Discusses Sideloading At Web Summit Conference

Craig Federighi, Web Summit 2021:

Even if you have no intention of sideloading, people are routinely coerced or tricked into doing it. And that is true across the board, even on platforms like Android that make sideloading somewhat difficult to do.

Apple doesn’t trot out Federighi to a third-party conference with a highly-produced Keynote deck for the fun of it. They are clearly concerned that European lawmakers are actually going to do something they don’t want; that is, pass laws requiring them to offer sideloading as an option. On the whole, he presents good arguments against the policy. You can watch the full thing here.

However, one particular talking point highlights a severe weakness that I see in Apple’s stance. Federighi posits that a social networking app may choose to “avoid the pesky privacy protections of the App Store” and only make their apps available via sideloading. Apple’s customers would then have to leave the ‘safe’ Apple software ecosystem, or lose touch with their family and friends. This is sort of true. But what is omitted is that an app choosing to leave the App Store is not primarily doing so to avoid Apple’s privacy standards, but because it would then be able to avoid Apple’s IAP rules.

Apple benefits financially — measured in the billions of dollars per year — by keeping the App Store as a monopoly. However much it wants to tout the user privacy and safety benefits, Apple’s position would be far stronger if cynics weren’t able to point to the money being accrued by the App Store gravy train. The 30% cut is ultimately the driving factor that has led Europe to want to pass these competition laws in the first place. If Apple truly wants to put customers first and protect from sideloading, alternative app stores and the like, it needs to compromise on the business policies somehow.

Developers Must Opt In To 120Hz Animations On iPhone 13 Pro

Apple:

As a general rule, for better visual appearance use faster refresh rates when animating fast-moving items that travel across large areas of the screen. But, if you’re animating a smaller item that doesn’t move over a great distance, but “animates in place”, that typically doesn’t benefit from a high refresh rate. You can use slower refresh rates when animating smaller items without any impact to the visual appearance. Selecting the right animation speed is always a tradeoff between a smoother visual appearance and saving energy. As a guiding principle, strive for the lowest animation speed possible while maintaining good visual appearance.

If it wasn't for the PR stink on Friday, presumably this documentation would have taken even longer to appear.

This documentation should have been made available alongside the iOS 15 and Xcode 13 Release Candidate a week ago. Because it wasn’t, app developers didn’t even have a chance to get their software ProMotion-ready for iPhone 13 launch day. Indeed, the lack of published documentation meant that everyone assumed that adopting 120Hz would be done automatically by the system. This is how it works on the iPad Pro, which has supported ProMotion since 2017. But for the iPhone 13, high frame rate animation is actually gated twice, firstly by a global Info.plist key and secondly by the fact that each individual animation in the codebase will need to be audited and marked as wanting high refresh rate pacing.

All apps will see ProMotion benefits when the user is actively interacting with the display and generating touch events, which thankfully means scrolling is always ultra-responsive and fluid across the system.

However, this also puts an onus on developers to meticulously check all the animations in their app and do the code changes where it makes sense. 60 FPS animations in app like Twitter will stick out like a sore thumb if the user has just finished scrolling their timeline at a smooth 120 FPS rate. The stark contrast could even make it feel like the app is lagging, as the user’s brain becomes accustomed to seeing smoother motion. Whilst the work needed to opt-in is only one line of code, it is a pretty laborious task to do that for every animation in an app and I fear that very few developers will bother. Even for someone who cares, it’s an easy thing to forget when adding a feature or implementing a new screen of an app.

Clearly, Apple believes the benefit to battery life is worth the pain of enforcing selectivity. The second half of this document actually recommends not adopting 120Hz indiscriminately and reserving its use for “high-impact animations” only. That is, animations that cause significant on-screen content changes like a full-screen wipe to a new page. I guess we will have to trust their judgement on this, but it definitely should have been accompanied by better communication as it is such a big departure from the precedent set by ProMotion on the iPad Pro.

Apple Will 'Help' Some Developers Put A Single Link To Their Website In Their Apps

Apple:

Because developers of reader apps do not offer in-app digital goods and services for purchase, Apple agreed with the JFTC to let developers of these apps share a single link to their website to help users set up and manage their account. While in-app purchases through the App Store commerce system remain the safest and most trusted payment methods for users, Apple will also help developers of reader apps protect users when they link them to an external website to make purchases.

Apple’s resistance to change any App Stores rules of its own accord means that you have to read any of these announcements with extreme care and caution. The details matter.

In this case, I am perturbed by the fact that there are lot of words, a lot of paragraphs, surrounding what should be a straightforward policy change: allowing developers to link out to their website on the sign-up screen.

A couple of the limits are made transparent in the copy; this revised rule applies to reader apps only and developers are allowed a ‘single’ link only.

Setting aside Apple’s self-serving and/or contradictory rules around what counts as a reader app, what the heck does a single link mean in a digital world? It’s a hilarious concept. If I style a link with a big font, placed on a rectangle of prominent background colour, is that a single link … or is that a button? What if the single link takes up 90% of the screen, in a huge font? If I put a static link at the bottom of the screen like a footer, and the link doesn’t move or disappear when the user navigates to a new page, is that still a single link? I mean it’s still the same link, it is just permanently visible.

That’s one whole ordeal. The second part I zone in on — in my pessimistically critical reading — is ‘help’. What constitutes help? Of course, I fully expect Apple to lay out rules around the design and behaviour of the destination websites, possibly including limits on what payment methods can be used and the language used in the sign-up form. Furthermore, because this policy is not coming into effect until next year, it seems like this ‘help’ is going to include some kind of technical component too. Maybe Apple will have a special new API or something that ensures the link out to the website doesn’t change after the fact, or must link to a specifically (pre-approved) registered domain. Apple could ‘help’ by requiring use of a sandboxed web view that somehow doesn’t have access to a user’s standard AutoFill information.

Thirdly, all these developers obviously want the ability to link out to the web in order to encourage their customers to use payment methods other than Apple’s In-App Purchase. Apple’s press release implies that motivation but the actual wording isn’t so direct: it says the link is to enable users to “set up and manage their account”.

You’d hope Apple would comply to the Japanese law in good faith, but I’m certainly not ruling out something more sinister. I don’t think the implementation of ‘help’ will be onerous, but perhaps just inconvenient enough to make some percentage of developers not bother.

Ultimately, these rules should have a positive impact on user experience and a very small negative impact on Apple’s financials. Apple’s revenue from reader apps is already small, because those are the exact category of apps already allowed to circumvent In-App Purchase altogether. That being said, this Japanese settlement is not going to fundamentally resolve any of the other impending lawsuits; Spotify benefits from these new rules but will want more and will keep pushing, Epic is just going to be more furious that they don’t benefit at all, and there are plenty more EU and US investigations to come.

On-Device CSAM Scanning For iCloud Photos

Apple:

Another important concern is the spread of Child Sexual Abuse Material (CSAM) online. CSAM refers to content that depicts sexually explicit activities involving a child.

To help address this, new technology in iOS and iPadOS will allow Apple to detect known CSAM images stored in iCloud Photos. This will enable Apple to report these instances to the National Center for Missing and Exploited Children (NCMEC).

Apple’s method of detecting known CSAM is designed with user privacy in mind. Instead of scanning images in the cloud, the system performs on-device matching using a database of known CSAM image hashes provided by NCMEC and other child safety organizations.

The threshold is set to provide an extremely high level of accuracy and ensures less than a one in one trillion chance per year of incorrectly flagging a given account.

Only when the threshold is exceeded does the cryptographic technology allow Apple to interpret the contents of the safety vouchers associated with the matching CSAM images. Apple then manually reviews each report to confirm there is a match, disables the user’s account, and sends a report to NCMEC. If a user feels their account has been mistakenly flagged they can file an appeal to have their account reinstated.

The naysayers of the last week are not necessarily wrong. This issue is nuanced and Apple’s decisions involve concessions. Personally, I think Apple have done well here. They probably could have handled the communication surrounding the announcement better, but the actual functionality and policy decisions are reasonable.

In a world where Apple is isolated to all external pressures, I don’t think they would have done this at all. Ideally, Apple would like it such that your device and your data is sacrosanct. Impenetrable. That fits with their business model, it fits with their morals, and it fits with their marketing.

However big Apple is, they do still have to conform to government expectations and the law. That’s why in China they let a third-party Chinese company run the iCloud data centre. They can make it as secure as can be under that arrangement, but it’s still a compromise from the ideal situation where the data centres are managed by Apple themselves (and is how it happens in every other region of the world).

In the US, big tech companies are expected to help governments track and trace child abuse content happening on their platforms. Apple runs a big platform full of user generated content, iMessage and iCloud, yet their contribution to this specific cause has been disproportionally small, infinitesimal even. Facebook reports something like 20 million instances of CSAM a year to the NCMEC organisation. In that same timeframe, Apple barely crossed the 200 mark.

So, this is the underlying motivation for these new policies. Big government bodies want Apple to help to track down the spread of CSAM on their devices, in just the same way that other big cloud companies like Google, Amazon, and Facebook comply by scanning all incoming content to their platforms.

You have to assume that privacy issues are a key reason why Apple has historically been so lax in this department. It’s not that Apple has sympathy for the people spreading child pornography. Why right now? That is still unclear. Perhaps, behind closed doors, someone was threatening lawsuits or similar action if Apple didn’t step up to par soon. Either way, it’s crunch time.

I’m sure governments would welcome a free-for-all backdoor. Of course, Apple isn’t going to let that happen. So, what Apple has delivered is a very small, teensy-tiny, window into the content of user’s devices.

The actual system is almost identical to what Google/Amazon/Facebook do on their servers, attempting to match against a database of hashes provided by NCMEC. Except, Apple runs the matching process on device.

I’ve seen a bit of consternation around this. I don’t think it’s a big deal where the matching process happens. Arguably, if it is happening on device, security researchers have more visibility into what Apple is doing (or what a hypothetical nefarious actor is doing with the same technology) compared to if it was taking place on a remote server.

You do have to basically take Apple’s word that it is only scanning photos destined to be sent to iCloud. Sure. But you have to take Apple’s word on a lot of things. A malicious state could secretly compel Apple to do much worse with much less granularity. I don’t trust Apple any more or any less about this than the myriad other possible ‘backdoors’ that iOS could harbour. The slippery slope argument is a concern, and worth watching out for in the future, but I don’t see anything here that is an obvious pathway to that.

You also have to stay grounded in the baseline case. Right now, if you use iCloud Backup (clarifying again that this new Child Safety stuff only applies to if you use iCloud Photos, photos stored in the backup only are exempt), all of your phone’s data is stored on an Apple server somewhere in a manner that they can read your data if they so desire. This also means that a government can subpoena Apple to hand over that information. This is not a secret. Apple has done it countless times, purportedly in the presence of a valid warrant, including very publicly in the midst of the PR fiasco that was the 2016 San Bernadino shooter case.

With that in mind, almost all of your phone is already accessible to law enforcement or state actors if they so desire. This new entry point in the name of Child Safety pales in comparison to that level of potential access.

One assumption I’ve seen floated around is that Apple wants to roll out end-to-end encrypted iCloud Backup option in the future. The criticism is that this on-device scanning policy undermines the point of E2E because the scanner would still be able to “spy” on the data before it was cryptographically sealed. I mean, I guess that’s true to a degree, but I’d still rather have the option for end-to-end backups with a CSAM scanner in place, than not have it all which is the world we live in today.

The weakest link in the chain on the technical side of this infrastructure is the opaqueness of the hashed content database. By design, Apple doesn’t know what the hashes represent as Apple is not allowed to knowingly traffic illicit child abuse material. Effectively, the system works on third-party trust. Apple has to trust that the database provided by NCMEC — or whatever partner Apple works with in the future when this feature rolls out internationally — does only include hashes of known CSAM content.

I think there’s a reasonable worry that a government could use this as a way to shuttle other kinds of content detection through the system, by simply providing hashes of images of political activism or democracy or whatever some dictatorial leader would like to oppress. Apple’s defence for this is that all flagged images are first sent to Apple for human review, before being sent on. That feels flimsy.

My suggestion would be that all flagged images are reported to the user. That way, the system cannot be misused in secret. This could be built in the software stack itself, such that nothing is sent onward unless the user is notified. In press briefings, Apple has said they don’t want to do this because their privacy policy doesn’t allow them to retain user data, enabling a legitimate criminal who is sharing CSAM would simply be able to delete their photo library when alerted. I think tweaks to policy could solve it. For instance, it would be very reasonable for a flagged image to be automatically marked frozen in iCloud, unable to be deleted by a user, until it has gone through the review process. The additional layer of transparency is beneficial.

A13 Chip Inside Future Apple External Display

9to5Mac:

However, 9to5Mac has now learned from sources familiar with the matter that Apple is internally testing a new external display with a dedicated A13 chip and also Neural Engine. The new display is being developed under the codename J327, but at this point, details about technical specifications are unclear. According to sources, this display will have an Apple-made SoC, which right now is the A13 Bionic chip — the same one used in the iPhone 11 lineup.

Apple Silicon in an external display? That must be really exciting! Well, not really. It is most likely something boring. Perhaps the A13’s sole purpose is to drive higher density mini-LED dimming zones a la the new iPad Pro, probably repurposing a lot of the R&D investment for the iPad into this product.

Apple’s massive economies of scale means it may very well be cheaper for them to shove in A13 chips to act as the display’s controller, compared to the cost of designing new silicon for something bespoke. The new display project is in early development stages and by the time it ships, in a couple of years, the A13 would be old. It is analogous to how the T2 chip was used in the iMac Pro and later Intel MacBooks, which was essentially a rebranded A10 SoC. The T2 served ‘boring’ duties like driving the secure boot process and SSD controller.

If you want to take a more optimistic and exciting tone, the A13 could possibly be present to enable features like Face ID. That would be neat. Timing wise, that would line up too as the rumour mill expects Apple to transition Macs to Face ID biometrics in the next few years.

More than anything though, I simply hope the next-generation display is more affordable. It would obviously still be a premium product, it is Apple after all, but there’s a big difference between ~$2000 and $5000 (plus $1000 stand and $1000 nano-texture coating). As the technical capabilities of the iPad Pro’s Liquid Retina XDR display already surpass the Pro Display XDR, a significantly lower price point seems readily achievable.

Netflix Games Next Year

Bloomberg:

The idea is to offer video games on Netflix’s streaming platform within the next year, according to a person familiar with the situation. The games will appear alongside current fare as a new programming genre – similar to what Netflix did with documentaries or stand-up specials. The company doesn’t currently plan to charge extra for the content, said the person, who asked not to be identified because the deliberations are private.

This story has a lot of parallels to how Apple uprooted the music labels with $0.99 songs on iTunes. Apple became dominant, and the labels regretted their complacency.

Netflix became a streaming behemoth largely because traditional TV networks vastly undervalued the content they had. Infamously, Netflix paid a mere $30 million for streaming rights to 2500 TV shows and movies from the Starz catalogue. That is, $30 million for four years … a sum so unthinkably low in today’s market that I just had to double check the numbers. Similar cheap deals were struck with other studios too. This base of content was a huge springboard for Netflix’s streaming initiatives. By the time the incumbent content owners had realised their mistake, Netflix was getting established in the originals space and years ahead of the competition.

Playing in the games space is not going to be as straightforward. ‘Content’ in general is so hot right now and Netflix is the leader. People aren’t going to sell games to Netflix on the cheap. People might not even sell games to Netflix at all. PlayStation Now and Xbox Cloud Gaming are already trying to own this market, and they aren’t sharing their exclusive properties. Netflix does have popular intellectual property in the form of its original TV shows, but the question is whether it can convert viewers into players.

A significant reason why Netflix garnered consumer adoption of streaming is that it had a natural on-ramp to move its existing avid customer base of movie watchers getting DVDs by mail into watching the same movies online instead. The jump from watching TV to playing games is a much bigger chasm to cross. I’m not saying Netflix shouldn’t try to branch out, but I don’t think it is going to take over on the spot. I foresee a slow and gradual expansion.

Distribution is another issue altogether. The App Stores are a roadblock, obviously. You basically can’t offer game streaming on iOS, apart from through Safari. Apple TV lacks a web browser, so there’s no entry point there unless/until Apple’s rules change. A lot of people watch Netflix on their PlayStation and Xbox, but it seems unlikely they are going to welcome Netflix games with open arms, as they all want to push their own game streaming services. The Netflix app is installed on millions of set-top boxes and smart TVs worldwide, and are theoretically powerful enough to display game streams, but only a fraction of those will support pairing things like game controllers.

FaceTime in iOS 15

Apple:

FaceTime helps customers easily connect with those who matter most and with iOS 15, conversations with friends and family feel even more natural. With spatial audio, voices in a FaceTime call sound as if they are coming from where the person is positioned on the screen, and new microphone modes separate the user’s voice from background noise. Inspired by the stunning portrait photos taken on iPhone, Portrait mode is now available for FaceTime and designed specifically for video calls, so users can blur their background and put themselves in focus. While using Group FaceTime, a new grid view enables participants to see more faces at the same time.

Users can now share experiences with SharePlay while connecting with friends on FaceTime, including listening to songs together with Apple Music, watching a TV show or movie from Apple TV+ and other streaming services in sync, or sharing their screen to view apps together. SharePlay works across iPhone, iPad, and Mac, and with shared playback controls, anyone in a SharePlay session can play, pause, or jump ahead.

FaceTime calls also extend beyond Apple devices with the ability to create a link from iPhone, iPad, or Mac, and share it through Messages, Calendar, Mail, or third-party apps, so anyone can join a FaceTime call from their web browser on Android and Windows devices. FaceTime calls on the web remain end-to-end encrypted, so privacy is not compromised.

It is incredibly tempting to glibly pass off many of these new FaceTime additions as features targeting an era that (we all hope, at least) has passed, and Apple is late to the game. I’m pretty sure I tweeted a joke to that effect on keynote day. On reflection, though, it is an unfair view.

Zoom and Microsoft Teams have dominated mindshare recently because of the surge in popularity of group video chats in 2020, but FaceTime is a huge player when it comes to video calls in general, because it is incredibly popular for personal one-on-one calls. Maybe the biggest actually.

Save for grid view which is specific to mass group chats, all of these new iOS 15 features will be beneficial to the friendships and relationships forged over FaceTime calls that take place every single day, in their millions. Rather than painting it all with a pandemic brush, I now note that many of these features were actually requested and in demand years ago … well before anyone had heard of COVID-19. Screen sharing will make FaceTime family tech support so much better. The underlying intents of screen sharing and SharePlay go all the way back to iChat AV from macOS Tiger, but they never made the leap to FaceTime until now. I guess we have the pandemic to thank for motivating Apple to move these features higher up the internal to-do list.

Maybe some friend will get together on Group FaceTime because of SharePlay. Still niche though.

The ability to join FaceTime calls via web links (including Android and PC support) is clearly Apple’s half-hearted attempt to battle Zoom and Microsoft Teams in the remote work and school videoconferencing space. I doubt it will get much traction. Products like Teams have all sorts of components to help people collaborate on projects, and arrange group meetings. FaceTime has none of that stuff. FaceTime is more like an add-on of Messages, competing against WhatsApp and traditional phone calls if anything. You also see this in how each service handles identity; Zoom and Teams have abstracted user accounts, whereas on FaceTime you connect by sharing your personal phone number or email address — information that you only want to give out to close friends.

Apple Tracking Transparency

Between the PR blitz, ad campaigns and the actual feature itself, the rollout of App Tracking Transparency means that iOS users are now more aware of the relationship between apps and third-party advertising and analytics companies. The power to deny an app the ability to do something many people were previously oblivious to — third-party tracking — with one button press is powerful and meaningful.

You won’t see an App Tracking Transparency dialog show up in any Apple app. This is because App Tracking Transparency falls solely under the purview of third-party tracking, and Apple’s apps technically don’t share data with anyone but Apple. Under the letter of the law, Apple is in the clear. But of course, it is Apple that wrote the law. It’s been niggling at me for months that App Tracking Transparency is defined in such a way that Apple’s own data collection activity is unaffected.

Apple Card needs to send your data to third-party agencies to check your credit. It just so happens that one exemption of ATT is reporting data to a third-party for the purposes of evaluating creditworthiness.

App Tracking Transparency comprises a laundry list of clauses and exemptions, but the main distinction is the first-party versus third-party thing. That puts Apple in the clear as it doesn’t run an ad network that other companies participate in; Apple serves ads to its users inside its own ‘first-party’ walled garden. Apple’s targeted advertising currently manifests itself in the News app (ad banners), the Stocks app (ad banners in integrated News stories), and the App Store (search ads).

Whilst it is true that Apple’s ad network uses far fewer signals than most of its competitors to target ads, it probably collects more than you think. Basics like age, gender, home address, current GPS location are in play. It also incorporates what kinds of media you download from the App Store to generate demographics buckets. To reiterate, Apple looks at what you have downloaded across its content stores — music, television, books and apps — and puts your Apple ID in appropriate marketing categories. For instance, this means Apple News can advertise games to you, because your account’s profile indicates that you like to play games.

I’d refer to this as Apple’s ad tracking. Apple officially calls this “Personalised Ads”, because it wants to define tracking as a third-party concept. The behaviour of Personalised Ads is not conveyed through any kind of user-facing dialog or permissions prompt, unlike Apple Tracking Transparency. In fact, Apple enables ads personalisation by default. The setting to turn it off is buried in Settings, tucked away at the bottom of the Privacy screen (conveniently positioned below the fold).

I don’t really have a problem with News targeting ads based on stuff I read in news. I think what irks me the most about this situation is that an Apple ID is a prerequisite to owning an iPhone and you can’t download any application from the App Store without one. Apple’s delineations of first-party and third-party allows the App Store to share any information it pleases with the News app, without telling the user at all. It feels wrong that News silently target ads to me based on the apps I download, the music I listen to and the television shows I watch.

The data Apple is collecting is relatively boring and benign … but it still is data collection for the purposes of advertising. This goes against the principles Apple advocates in its commitments to privacy and data minimisation. Again, it’s not that Apple is applying one rule for itself and another for developers. After all, Facebook is allowed to share as much data as it wants with Instagram and WhatsApp as they all fall under the first-party rule. But I have come to expect Apple to be better than Facebook, and I expect them to do more than the bare minimum.

It is self-serving that Apple classifies the App Store as first-party and therefore its ad network avoids the friction of App Tracking Transparency. As it stands today, the vast majority of iOS users have ads personalisation de facto enabled and they don’t even know what it is or that it is happening.

One way for Apple to behave better about this would be to treat the App Store as if it was a third-party operation. In accordance with its own rules, this would mean the App Store would need to get explicit permission before it could show targeted ads. The permissions dialog would educate users about the kinds of data Apple collects for advertising purposes and let them make up their own minds about whether they are comfortable with it.

Apple Music Lossless

Apple:

Apple today announced Apple Music is bringing industry-leading sound quality to subscribers with the addition of Spatial Audio with support for Dolby Atmos. Spatial Audio gives artists the opportunity to create immersive audio experiences for their fans with true multidimensional sound and clarity. Apple Music subscribers will also be able to listen to more than 75 million songs in Lossless Audio — the way the artists created them in the studio. These new features will be available for Apple Music subscribers starting next month at no additional cost.

A couple of months ago, Spotify announced that they were working on a paid hi-fi tier to launch later this year. Spotify is actively seeking ways to increase profitability of its large pool of active users, and hi-fi looked like one way to do that. Seemingly simultaneously, Apple and Amazon were campaigning to the labels (who ultimately dictate streaming pricing) that they wanted to promote lossless quality options as a way to increase the overall number of people streaming, rather than as some incremental upsell. Apple and Amazon’s negotiations evidently succeeded and so both Apple Music and Amazon Music HD will be offering lossless at no extra cost. Apple and Amazon are able to focus on growing subscriber counts because they can afford to aggressively subsidise their streaming divisions. In contrast, Spotify is an independent company and draws all of its income from that subscription price. Therefore, it is much more sensitive to things like ARPU. Making hi-fi a commodity feature is not what Spotify wanted to happen.

In addition to the ruthless war of competitive business, I also think Apple recognises that lossless is a very niche thing. Similar to the App Store Small Business Program, lossless-as-free is a huge win for Apple in goodwill with very little associated cost to the company. It’s an attractive feature on paper but I doubt many people will ever stream Apple Music lossless in practice. Beyond just issues of bandwidth, I’d guess less than one percent of Apple Music subscribers actually have premium audio equipment that can reproduce the additional details found in lossless music compared to standard Apple Music AAC encoded tracks. This is reflected in the fact that streaming lossless will be an entirely opt-in feature.

The spatial audio tracks with Dolby Atmos is going to have a more meaningful impact on users. This will be on by default and can be experienced by the millions of AirPods owners. Apple says it will stream Atmos songs to any Apple or Beats headphones with the H1 or W1 chip, although I’m sure certain models (like AirPods Max) will do a better job at creating a 3D soundstage than others. Interestingly, Spatial Audio for video content specifically requires AirPods Pro or AirPods Max. I think the difference is that the latter uses the gyroscope and accelerometers to position the music relative to your iPhone or iPad. Apple Music won’t try to do relative positioning, and so the simulation of Dolby Atmos surround sound is purely done by the headphones themselves. This also means that any third-party headphones that tout Dolby Atmos support can also benefit.

The New Siri Remote

Apple:

The all-new Siri Remote features an innovative clickpad control that offers five-way navigation for better accuracy, and is also touch-enabled for the fast directional swipes Apple TV users love. The outer ring of the clickpad supports an intuitive circular gesture that turns it into a jog control — perfect for finding a scene in a movie or show. And with its one-piece aluminum design, the new Siri Remote fits more comfortably in a user’s hand.

It feels a little silly to be commending something as primitive as a TV remote, but the new Siri Remote deserves it. When Apple responded to the butterfly keyboard backlash, they simply reverted back to a tried-and-trusted design. The Magic Keyboard in the 2019 MacBook Pro was near-identical to what they shipped before — prior to the butterfly fiasco that is. It was a crowd pleaser but also a little boring. Had they really learned nothing in that four year span of misery?

The new Siri Remote is not retracing the past. It’s a robust combination of the Apple Infrared Remote and the trackpad Siri Remote, squarely addressing the failings of the latter. There’s no glass surface anymore, so it should be more durable and not prone to breaking upon being dropped or knocked off the coffee table. There’s asymmetry that you can feel with your fingers, so your brain can know which way is up just by touch. There is a physical D-Pad arrangement with labelled indicators, so you can do traditional up-right-left-down navigation like every other TV remote on the planet. And yet, at the same time, Apple didn’t lose the best bit of the trackpad: the ability to swipe the trackpad to zoom through a list of items. The circular D-Pad doubles as a capacitive touch surface (the “clickpad” as named by Apple marketing) so you can still do the same gestures on it. A new innovation: if you move your finger in a circular motion around the outer edge, it scrubs through the playing video just like an iPod clickwheel.

One let down is the lack of Find My integration, or even a simple beeper so you can make it ping if you misplace it. The omission of this functionality was made only more stark by the fact Apple chose this same event to sing the item-finding praises of the long-rumoured AirTag tracker. This remote should be harder to lose though; it is less likely to fall down a sofa simply because it is bigger and chunkier. Switching from an all-black finish to silver aluminium also makes it easier to see in the dark.

The other let down is the price: $59 for a remote is exorbitantly high. You can buy an entire Chromecast for less than the price of the Siri Remote. Unfortunately, the entire Apple TV product remains poorly priced. They refreshed the Apple TV 4K’s internals with an A12 chip, but it’s still sold at the same $179 price point and more ridiculously still, the Apple TV HD remains on sale — hardware unchanged aside from bundling the new remote — for the same (inflated) price it debuted at in 2015.

The A12 chip and the overhauled Remote do just enough to serve as a signal that Apple is committed to keeping the Apple TV around. I can allay my fears about its discontinuation. But clearly, there’s a lot more to be done in the living room and I hope Apple has more coming down the pipe in both hardware and software.

No iPhone Mini No More

9to5Mac:

Kuo says the 5.4-inch size is gone but there will still be four phones in total. It will just be a simpler affair: two high-end ‘Pro’ phones with 6.1-inch and 6.7-inch screens and two lower-end models with the same 6.1-inch and 6.7-inch sizes.

Before the 12 came out, I pondered quite openly whether the Mini was going to meet the market appropriately. It intuitively felt slightly off. Smartphone users like big screens and the Mini simply doesn’t deliver that. There’s been a lot of reporting around how the iPhone 12 mini has lagged behind the other iPhone 12 models in sales. It’s not an outright flop but it doesn’t seem to have performed up to Apple’s expectations either.

I continue to believe the Mini’s existence was largely motivated by concerns of price point rather than form factor. Apple needed a new phone to sell at $699 and it couldn’t match what it achieved with the iPhone 11 series this time around. For various reasons that probably involve OLED and/or dreaded 5G demons, the base model 6.1-inch iPhone price increased by $130 this year. So, the Mini was introduced to keep the $699 placeholder, as it were.

The news from Kuo backs up that theory. Apple doesn’t really care for the smaller size, they want the price points. By 2022, the components of the 6.1-inch model will have gone down and Apple will be able to sell it as the cheap flagship again. Moreover, the report alludes to the existence of a non-Pro 6.7-inch device. This new device SKU mean Apple will make the biggest iPhone screen size accessible to more people than ever. Using the current lineup’s pricing as a guide, the 2022 6.7-inch iPhone would be almost $300 cheaper than the 6.7-inch iPhone 12 Pro Max Apple sells today.

Apple Discontinues HomePod

Apple, via TechCrunch:

HomePod mini has been a hit since its debut last fall, offering customers amazing sound, an intelligent assistant, and smart home control all for just $99. We are focusing our efforts on HomePod mini. We are discontinuing the original HomePod, it will continue to be available while supplies last through the Apple Online Store, Apple Retail Stores, and Apple Authorized Resellers. Apple will provide HomePod customers with software updates and service and support through Apple Care.

When the iMac Pro was discontinued a week ago, there wasn’t much to fuss about. It is going away for obvious reasons. The iMac Pro was already feeling squeezed by the existence of high-end iMacs and the Mac Pro, and it will soon be unnecessary altogether with performant-yet-near-silent Apple Silicon iMacs in the offing.

The discontinuation of the HomePod is not so straightforward. The statement Apple gave to TechCrunch makes it very clear that there is not a new model just around the corner. This is the end of the road.

Honestly, the decision to cancel it feels like a misstep. The HomePod was overpriced but it was differentiated. The HomePod mini doesn’t really excel at anything. The mediocrity of the Mini’s sound quality means it leans much more heavily on the ‘smart’ component of being a smart speaker, and we know that Siri lags behind Alexa and Google Assistant in many ways. By focusing on the HomePod mini, Apple is implicitly focusing on Siri. Whether they actually make meaningful progress there is an open question.

The HomePod mini’s sound is fine for its size but its bass response and clarity — particularly at higher volumes — do not compare. I regard the Mini as something you put on your bedside table or in the kitchen, whereas the HomePod is a nice voice-controlled living room speaker. I’m not sure a replacement for that product exists, at least for Apple Music users. The closest I think you can get is the Echo Studio … which looks like a knock-off HomePod.

Siri's 'Intelligent' Default App Preferences

TechCrunch:

Apple has clarified that the iOS 14.5 beta is not actually allowing users to select a new default music service, as has been reported. Following the beta’s release back in February, a number of beta testers noticed that Siri would now ask which music service they would like to use when they asked Siri to play music. But Apple doesn’t consider this feature the equivalent to “setting a default” — an option it more recently began to allow for email and browser apps.

Instead, the feature is Siri intelligence-based, meaning it can improve and even change over time as Siri learns to better understand your listening habits.

When you swipe down on the iPhone’s home screen, you enter Spotlight. You type characters into the search field to quickly find an installed app on your phone. Before you type anything though, at the top of this view, there are four apps instantly visible: Siri Suggestions. Siri, or stripping the personified branding away, the operating system analyses your behaviour patterns to try and show you the app that you want, right upfront. I find it useful. A lot of the time, the app I intended to search for is actually just there, waiting for me. Swipe down, see the app icon, tap to launch, done.

Imagine instead that if upon opening Spotlight, Siri would launch the app it thought I wanted immediately. It would be infuriating. When it got it right, it would be cool but it won’t be able to get it right every time. These systems are always going to make mistakes, so you can’t go all in on a feature like that. Suggestions or recommendations are about as far as you can go without being frustrating. Even if it is was correct 49 times out of 50, that one time it is wrong will mean you will never use it again.

This latest music app situation falls directly in that latter camp. Through this TechCrunch article, Apple is very determined to say that the app picker UI is only a guide for Siri rather than a strict default app setting. If the actual behaviour of the feature reflects that, and Siri will sometimes change its mind about which app to use for a music request … that’s simply dumb. The central point of this feature is to make it so people don’t have to append ‘on Spotify’ / ‘on Pandora’ to the end of their voice requests. But if the unqualified form can’t be relied on to do that and work the same way every time, it’s pointless. The moment Siri decides to go off-piste and chooses an app you don’t expect it to, user confidence in the feature will crater and everyone will revert back to saying each command out in full.

Removing the need to specify the name of the third-party app is a good idea. Tying arbitrary and opaque machine learning decision-making to it is not. This feature should be implemented in the boring but reliable way: let the user pick a default app for each category of media from a list in Settings.

The Current Apple TV Doesn't Make Sense

Six Colors:

In the end, I’m left with the same feeling I had yesterday: Even after Apple has removed the two biggest reasons to buy an Apple TV (exclusive access to AirPlay and Apple’s video content), there is a whole collection of small reasons to buy an Apple TV. But of course, they all require that users pay a large premium—not the usual step-up for Apple products over the competition, but a fivefold increase in price. (Imagine if AirPods Max cost $1800.)

Some people will pay that premium. A lot of people won’t—and aren’t.

First off, Apple deserves some credit for cannibalising its own product so freely. Part of the reason the Apple TV feels a bit irrelevant at the moment is because Apple has chosen to convert some of its proprietary features into commodities. Whilst they had to relinquish control to some degree to broaden the availability of its TV+ original content, it didn’t have to offer ways for long-time iTunes Store customers to access their library of purchases from non-Apple devices .. but it did. A company that can cannibalise itself without fear is not a common thing.

All that being said, the current Apple TV hardware proposition is not good. It’s simply too expensive. A box that offers music, movies, photos, workouts and games through an Apple-designed interface is a desirable product, but it’s not worth $179. It’s not worth $149 even; the price that Apple still charges for the 1080p Apple TV.

That doesn’t mean Apple should get out the set-top box business. They totally should make one. Just like Apple thought it was worthwhile to make an entry-level smart speaker, there’s space in the market for an Apple streaming device. It supports all of Apple’s content services, from fitness workouts to photos, videos and games. Plus, it helps Apple participate in the connected living room, something that will become even more significant as the company prepares a renewed push for HomeKit and the wider Apple smart home ecosystem.

I’m not saying Apple has to stoop to the levels of $40 bargain bucket streaming sticks like those from Amazon and Roku. They are perfectly respectable products for what they are but that low-end isn’t worth Apple’s while.

What I want, what everyone wants, is a modern Apple TV with an updated processor. We will pay for the niceness. At $99, we’re sold. Like all of Apple’s products, the Apple TV should aim to fill the segment of the market that toes the line between being accessible to the masses and being aspirational luxury.

Unlock iPhone With Watch When Wearing Mask

9to5Mac:

Apple today released the first developer betas of iOS 14.5 and watchOS 7.4, bringing a major change to the integration between iPhone and Apple Watch. For the first time, you can now use your Apple Watch to unlock your iPhone when you’re wearing a face mask.

As of iOS 14.5, if the iPhone detects you are wearing a mask, you can use your unlocked Apple Watch as the identity key to let you in to your phone. Even for a first beta, it works really well. It’s fast. Written down, it sounds analogous to the macOS feature, but it feels very different when you try it.

Unlocking your Mac with your watch is comparatively sluggish. I guess this because the Watch is always passively ‘connected’ to its paired iPhone when in Bluetooth range, whereas when the Mac login screen wants to authenticate, it is searching for the user’s nearby Watch afresh each time. Moreover, the iPhone benefits from iOS’s slick lock screen transitions that guide the user smoothly through the unlocking process and the nice animations help to mask over some of the wait period.

I can only assume this has been on the cards ever since the pandemic reared its head. In iOS 13.5 last year, they rushed out what they could to improve the Face ID experience in the context of the pandemic. Many months later, they now have had the time to achieve a more sophisticated implementation of that goal, and that’s what we are seeing in iOS 14.5.

Some of the community reaction to this feature appearing in the beta can be summed up as follows: this means the iPhone 13 will not sport a fingerprint sensor, as Apple is resorting to fix the mask problem through software. Personally, I can’t make that connection.

The iPhone 13 feature set is independent to the needs of the current iOS user base. Even if you assume that Apple has always planned for this year’s iPhone to have Touch ID, they couldn’t not do this in the meantime once COVID hit. Apple has hundreds of millions of active Face ID-only phones out in the world to support. Plus, it will sell hundreds of millions of Face ID-only phones in the months leading up to this fall’s iPhone season, and hundreds of millions more for several years after that. (And not everyone has a Watch, of course.)

Apple TV+ Free Year Trials Extended Again

9to5Mac:

Any current customers with free trials set to end in the February to June period will now see those subscription renewals pushed out to July. Similarly, customers with an annual subscription that expires between February and June will also get the same additional months of service at no additional charge.

I am not surprised that they have to do this. Even before COVID struck, I was mentally modelling that they would need to repeat the free year trials at least one time over. The mechanics are slightly different to what I had predicted. In my head, I expected them to simply re-up the hardware offer; buy another Apple device, get another year.

What Apple has done instead is push back the renewal dates of those active trials. If you subscribed on the same day as the service launched — November 1st, 2019 — your free promotion essentially lasts nine extra months.

A subscription that was originally set to end on November 1, 2020 will now continue until July. However, anyone subscribing for the first time sees no such benefits. If you activate a new Apple device from today, your renewal date will be exactly one year out. Reading between the lines, Apple believes (or at least hopes) a TV+ subscription will be worth paying for in July.

Again, this should not come as a surprise to anyone. A library of exclusive newly-made originals takes time to build up. What is a little bizarre is why they didn’t announce the July date in October. It is surely a little embarrassing for Apple that they have trot back to the press to announce another extension of the ‘one year’ trials so soon, when the first extension happened so recently that it is still fresh in people’s minds. It feels like a public echo of internal flip-flopping.

Marking TV+ down as a failure at this stage is simply premature. I don’t know if it’s going to be a long-term success … but I recognise it’s too early to call it either way. It is true that If the TV+ strategy was adopted by a startup, of course it would fail; a standalone company simply doesn’t have the resources to backstop the early years of growth. For Apple, financials are not a practical concern. As long as it is committed at the executive levels to invest fiercely in originals for three-to-five years, accepting little to no monetary return in the meantime, it should be fine.