Every Black Box Has an Expiration Date
Someone just reverse-engineered Apple's Neural Engine in a week. Your proprietary API is next.
The economics of reverse engineering just changed.
It used to take a specialized team months to crack a proprietary system. Binary analysis, protocol sniffing, painstaking trial and error. The complexity was the moat. If your internals were sufficiently opaque, you were safe — not because they were uncrackable, but because nobody could justify the cost.
That calculus broke last week.
Manjeet Singh, working with Claude Opus, reverse-engineered Apple’s M4 Neural Engine. The entire stack — from CoreML’s abstraction layers down to the IOKit kernel driver. They mapped 40+ private API classes, cracked the in-memory compilation path, and got transformer training running directly on hardware that Apple designed exclusively for inference. Forward pass, backward pass, Adam optimizer. No GPU, no Metal. Pure ANE compute.
The code is open source. The writeup documents everything step by step.
An ex-Apple Xcode engineer commented on Hacker News: “I worked on the Xcode team for years and know the lengths Apple goes to make this stuff difficult to figure out.”
It took a week.
The moat was never technical
Apple’s protection wasn’t in the silicon. The ANE’s compute primitives — convolution, matrix multiplication, softmax, elementwise ops — are the same ones you need for training. You just run them in reverse. The hardware doesn’t know or care which direction the gradients flow.
The moat was informational. No published ISA. No documented APIs. Everything routed through CoreML’s abstraction layers. A black box by policy, not by necessity.
That distinction matters. Technical moats require you to build better hardware. Informational moats only require that nobody looks too hard. And “nobody looks too hard” is not a durable assumption when one engineer with good intuition can pair with an AI that writes probing code, reasons through runtime introspection data, and iterates on hypotheses in hours.
This generalizes
The ANE was about as hard a target as you can find. Undocumented proprietary hardware. No public instruction set. Multiple abstraction layers. Made by the most secretive company in tech.
If that falls in a week, what’s the shelf life of your undocumented protocol? Your internal API? Your “competitive moat” that’s really just complexity nobody’s bothered to untangle yet?
Hardware companies, SaaS platforms, API providers — anyone whose advantage depends on keeping internals opaque is now operating on borrowed time. The cost of understanding a system just dropped by an order of magnitude. The only durable moats left are the ones that still hold up after someone understands exactly how they work.
The latent compute story
There’s a secondary implication that’s getting less attention. There are hundreds of millions of Apple Silicon devices in the world. Every one has an ANE sitting idle unless you’re running CoreML inference.
That’s an enormous pool of compute that was artificially locked. On-device fine-tuning — training on your own data, on your own hardware, without sending anything to the cloud — just went from theoretical to demonstrated. Apple has been selling the privacy story for years. This actually delivers on it in a way Apple themselves haven’t.
And it’s not just Apple. Qualcomm’s Hexagon DSP, Intel’s NPU, every “AI accelerator” shipping in consumer hardware. If the ANE’s fixed-function inference primitives can run backpropagation, theirs probably can too.
The speed of it
The HN thread is debating whether you can trust research done with an AI co-author. The code is open source and the results are reproducible. That question answers itself.
The real takeaway is the time compression. This style of work — human intuition directing the exploration, AI handling code generation and data analysis at inhuman iteration speed — is going to crack open a lot of things that were previously too expensive to bother with.
A week. Open source. Reproducible. That’s the new baseline for cracking proprietary hardware. Plan accordingly.