Oct 5, 2026 · by 郭立 · View source

iphone-use

Let AI agents drive a real iPhone, even apps with no API

iphone-use

Editorial analysis

The real story in this Product Hunt launch isn’t phone automation — it’s what social teams can steal from it

Every social media operator I know has the same quiet problem: the work that actually moves the needle is the work no API will let you touch. You can schedule a post through Buffer or Later, pull analytics through Metricool, but the moment a workflow crosses into a platform’s native app — a TikTok draft, an Instagram Story sticker, a LinkedIn comment thread — you’re back to thumbs on glass. That’s the gap iphone-use is poking at, and even if you never install it, the design thinking behind it is worth an hour of your week. The maker, 郭立, frames it plainly: plenty of apps people use daily have no API, and the goal was to let a coding agent operate a real phone the way it operates a browser. For creators, that’s less a product pitch than a provocation about where automation is actually heading.

What iphone-use actually is, and why it’s not a scheduling tool

Let me be precise, because the framing matters. iphone-use is not a social media scheduler. It’s a remote-control panel for a physical iPhone that evolved into an agent tool — the maker says it “started as a remote-control panel and turned into an agent tool once it became clear what an agent needs that a person doesn’t.” That list is the interesting part: an answer it can branch on (applied, not sent, unknown, retry-safe), refusals instead of taps that silently land elsewhere, and a way to replay a chore without spending tokens.

If you’ve ever watched a Hootsuite or Buffer job fail silently at 2 a.m. and only discovered it when a client asked why the Tuesday post never went out, you already understand why “applied, not sent, unknown” is a design principle worth stealing. Most social tooling gives you a binary: success or error. Real platforms give you a third state — the tap landed somewhere, but you don’t know where. Instagram’s own Graph API has this problem in miniature; you get a media container ID and then you wait, and sometimes you wait forever. The idea that an agent should be able to say “unknown, retry-safe” instead of guessing is, in my experience, the single biggest missing primitive in creator automation.

The other concrete detail: every request is timed, and the maker says tap-and-settle went from 8.5 seconds to 4.2 seconds. That’s a claim from the launch page, not an independent benchmark, but the direction is right. Latency is the difference between an automation that feels like a tool and one that feels like a hostage negotiation.

The “screen as text” insight is the one to steal

A commenter, Liam Peoples, nailed the part that matters most: “The screen as text is what makes this work for me. an agent reading plain text is way more reliable than guessing from a screenshot.” That’s a genuinely transferable insight for anyone building content workflows on top of AI. If you’re using a vision model to read a screenshot of your Instagram insights page, you’re paying for pixels and getting probabilistic garbage. If you can get the accessibility tree as text, you’re paying for tokens and getting structure.

I’d bet most social teams will hit this wall within the next year as they try to wire LLMs into reporting. The teams that figure out “text over pixels” early will have dashboards their competitors can’t match.

How it stacks up against the tools you already pay for

Here’s where I have to be honest about the comparison, because the temptation is to say “this replaces Buffer.” It doesn’t. Buffer, Hootsuite, Later, and Metricool all solve a problem iphone-use doesn’t touch: multi-account, multi-platform publishing at scale, with team permissions and approval flows. If you run social for a brand with five stakeholders and a legal review step, none of those tools are going anywhere.

What iphone-use gestures at is the layer beneath them — the native-app-only actions. Think about what you currently can’t do through any official API:

  • Post a TikTok with a specific sound pulled from the in-app library
  • Add a link sticker to an Instagram Story with a custom placement
  • Reply to a specific comment inside the LinkedIn app rather than the web
  • Save a Reel as a draft for a human to review before it goes live

Every one of those is a real workflow that currently costs a social manager 10–15 minutes of manual tapping. Multiply by a client roster and you’re looking at hours a week. The maker’s framing — “the same way it operates a browser” — is the right mental model. We accepted years ago that browser automation (Selenium, Playwright, and now browser-use style agents) was a legitimate way to handle web-only workflows. Phone automation is the same idea arriving late.

Why TikTok creators should care more than LinkedIn ones

If you’re a LinkedIn ghostwriter, the native app is a nice-to-have. If you’re a TikTok creator or a short-form agency, the native app is the platform. Sounds, effects, draft workflows, the “post to Story” toggle — none of that is exposed through the TikTok Content Posting API in a way that matches what the app can do. Same story with Instagram’s Content Publishing API, which still has meaningful restrictions on Stories and Reels features.

So the calculus is simple: the more your content strategy depends on in-app-only features, the more a tool like this — or the category it represents — matters to you. If your strategy is text-and-image posts, you can keep using the incumbents and never think about this again.

The security question that should stop you cold

I want to flag the strongest critique on the launch page, because it’s the one I’d raise myself. Gal Dayan from Dial wrote: “the part that gives me pause is the combo of ‘payment apps’ and ‘remote control from any browser’ in the same feature list. once there’s an HTTP API and a browser panel that can tap through a real phone, that control channel is now the actual attack surface, not the apps themselves — whoever can reach that endpoint can do whatever the agent can do, including in banking apps.”

That’s not a nitpick. It’s the whole ballgame. If you’re a social media manager thinking “cool, I’ll point this at my work phone,” you need to answer Dayan’s question for yourself: what stands between that remote panel and someone who isn’t you? The maker’s answer on the page is essentially “it needs a Mac with Xcode and the phone on USB” — which is a meaningful constraint, but it’s a setup requirement, not a security model. Local-only by default versus deliberately exposed is the distinction that matters, and the source doesn’t spell out which this is.

My take: even if you never use this specific tool, the pattern it represents — an agent with a live control channel into a device that holds your DMs, your saved payment methods, and your 2FA apps — is going to become a standard security review item for social teams within 18 months. Start thinking about it now.

Where the math breaks

The maker’s latency improvement (8.5s to 4.2s) is impressive in isolation and probably irrelevant at scale. If you’re automating 30 phone actions a day, 4 seconds each is two minutes of overhead. Fine. If you’re trying to run a 200-account TikTok operation, you’ve got a bigger problem: Apple doesn’t let you virtualize iPhones at scale, and you’d need a physical device per account, plugged into a Mac, running Xcode. That’s not a SaaS business — that’s a device farm, and the economics don’t work for anyone except the largest agencies.

So the honest positioning is: this is a power tool for solo operators and small teams who have a handful of high-value native-app workflows, not a platform for agencies managing hundreds of accounts. That’s not a knock. Most useful tools start there.

What social teams should actually borrow from this launch

Forget the product for a second. The design principles the maker articulated are a checklist you can apply to your own automation stack this week, no matter what tools you use.

First, demand tri-state answers from your tooling. When you use Zapier or Make to wire up a social workflow, ask yourself: does this automation tell me the difference between “posted,” “failed,” and “unknown”? Most don’t. That’s a bug you’re living with.

Second, prefer structured text over screenshots for any AI step. If you’re using OpenAI’s vision models or Claude to read platform analytics, you’re probably losing accuracy you don’t need to lose. Where a platform exposes an HTML DOM or an accessibility tree, use it.

Third, time your automations. The maker’s 8.5s-to-4.2s improvement came from measuring. If you don’t know how long your repurposing pipeline takes end-to-end, you can’t improve it. I’ve seen teams shave 40% off publishing time just by instrumenting the steps.

Fourth, treat “replay without spending tokens” as a feature request. The maker explicitly calls out “a way to replay a chore without spending tokens” as something agents need. That’s a direct shot at the current cost structure of AI-powered social workflows, where re-running a failed job means paying for the same inference twice. If you’re building anything on top of LLMs, cache aggressively.

The repurposing angle nobody’s talking about

Here’s the workflow I’d actually want to see this pattern applied to: the long-form-to-short-form pipeline. You record a 40-minute YouTube video, and you want to cut it into 8 TikToks, 5 Reels, 3 Shorts, and a LinkedIn carousel. Today that pipeline is CapCut plus Descript plus Opus Clip plus a human who knows which clip will actually land. Each tool has an API, sort of, and each API breaks in its own special way.

If a phone-native agent could handle the last mile — the part where the clip has to be uploaded through the app to get the right sound and the right cover frame — you’d close the loop. That’s the promise. It’s not here yet, and the security model isn’t here yet either. But it’s the direction.

What I’d watch, and what I’d test this week

I’d watch three things. First, how the maker answers Dayan’s security question in the comments — whether there’s a real local-only default or whether “needs a Mac and USB” is doing all the work. Second, whether anyone publishes an independent latency benchmark, because the 8.5s-to-4.2s number is a maker claim and I want to see it reproduced. Third, whether the “21-tool MCP server” that Jedidiah Behar asked about in the comments turns out to be a real integration surface or a marketing bullet — the source doesn’t say what the 21 tools are, and that’s the detail I’d want before recommending this to anyone.

What I’d test this week, without installing anything: audit your own publishing workflow and count how many steps require the native app. If it’s zero, you can safely ignore this entire category for another year. If it’s more than five, you’ve found your automation roadmap — and you now know what to look for when the next tool in this space launches. Also worth doing: check whether your current scheduler exposes failure states beyond pass/fail. If it doesn’t, that’s a support ticket worth filing, and a signal about which incumbent is actually paying attention to how social work gets done.

Ready to Create Your Own?

Join thousands of brands creating high-performing video ads with FLOWNIB. No editing skills required.

Start Creating for Free