How Universal Control on macOS Monterey works


The best moment of this year’s WWDC keynote was a straightforward demo of a macOS feature, Universal Control. The idea is simple enough: it allows you to use the keyboard and trackpad on a Mac to directly control an iPad, and even makes it simple to drag and drop content between those devices.

What made the demo so impressive is how easy and seamless it all seemed. In a classic Apple move, there was no setup required at all. The segment happened so fast that it even seemed (incorrectly, as it turns out) like the Mac was able to physically locate the iPad in space so it knew where to put the mouse pointer.

After Zaprudering the clip and asking Apple a few questions, I now have a better understanding of what’s going on here. It turns out that the entire system is actually simpler than it first appears. It’s essentially a new way to use a bunch of technologies Apple had already developed. That’s not a knock on Universal Control — sometimes the best software features are a result of clever thinking instead of brute force technological improvements.

So here’s what’s happening in that demo.

First, you need to get the iPad and Mac relatively close to each other. Universal Control is built off the same Continuity and Handoff features that have long been a part of iOS and macOS. When the devices are close enough, their Bluetooth modules let each other know. Of course, all the devices here need to be on the same iCloud account for this to work.

Then, you start up Universal Control by dragging your mouse pointer all the way to the left or right edge of your Mac’s screen, then a little bit beyond that edge. When you do, the Mac will assume that you’re trying to drag the mouse over to another device, in this case the iPad.

So there’s no UWB location detection, just good old assumption. One note is that if you have lots of compatible devices, Monterey assumes that you’re dragging towards the last iPad or Mac you interacted with.

At this point, a Wi-Fi Direct connection is made and the iPad will show a small bar on the side with a little bump. It’s a sort of indicator that the iPad is aware you’re trying to drag a mouse into it. Keep dragging and pow, the bump breaks free into a circular mouse pointer. When the mouse is on the iPad screen, both it and the keyboard on your Mac control the iPad. Move it back to the Mac, and you control the Mac.

But there’s a clever little affordance built into that strange bar. There are a couple of arrows inside it, a hint that you can slide that bump up or down before it breaks free into the iPad itself. Doing that is how you line up the iPad’s screen with your Mac’s, so that dragging the mouse between the screens doesn’t result in a weird jump.

You go through the same process to set up a second device with Universal Control — it maxes out at three. If all this automatic setup sounds like a hassle, you can just go into system preferences and set a device as your preferred Universal Control buddy gadget.

However you set it up, you can drag and drop content between devices and it’ll use either Wi-Fi Direct or USB to transfer the files. Of course, if you’re dragging files into the iPad, make sure you have an app open (like Files) that can accept it.

That’s pretty much the long and the short of it. There are still some details to hash out, Apple tells me, and it isn’t available in the first developer preview. If you put your dock on the left or right edge of the screen, for example, it’s unclear if this whole setup will work.

What’s fascinating to me about this system — as I discuss in the video above — is that it’s only really possible because of a long series of software enhancements that have been built into the iPad over the years, including:

  1. Continuity, Handoff, and AirDrop. Universal Control isn’t technically AirDrop, but it’s the same basic idea. All of these are the basic ways that Apple devices communicate directly with each other instead of through the cloud.
  2. Multitasking. I’m not referring to split-screen, but the support for drag-and-drop that came along with the improved windowing options on the iPad.
  3. Keyboard and mouse support. That’s an obvious pre-requisite, but it wasn’t always obvious that Apple would put mouse support into the iPad.
  4. Sidecar. Sidecar’s the tool that lets you use an iPad as a second Mac monitor. I don’t think that Universal Control uses the same bits of software as Sidecar, but I do think that there were probably lessons there about latency that would prove useful here.

I had a hunch that there would be a similar story of evolution on the Mac side of this story. I figured that all the iPad and iOS technologies finding their way into the Mac with the last few releases played a part. Catalyst apps turned into native iPad apps for M1 Macs. Control Center, Shortcuts, and Focus mode all are iOS things that are also on the Mac.

Nice idea, but wrong. Apple tells me that the foundation on the Mac side is as simple as it seems, based on Continuity and Handoff.

I hope that Universal Control works as well in the real world as it did in this staged demo — and I know that’s no sure thing. But what I like about the feature is how it’s just a clever recombination of existing technologies that Apple had already built for other purposes.

Inside the Apple ecosystem, you expect that the trade you’re making for only using Apple devices is getting synergistic integrations like this. They’ve actually been rarer than I would have guessed the past few years. But as the Mac and the iPad start trading more and more features with each other, I expect we’ll see more of them going forward.



Source link

Leave a Reply

Your email address will not be published. Required fields are marked *