Vibe coding service Replit deleted production database, faked data, told fibs

10 hours ago 1

The founder of SaaS business development outfit SaaStr has claimed AI coding tool Replit deleted a database despite his instructions not to change any code without permission.

SaaStr runs an online community and events aimed at entrepreneurs who want to create SaaS businesses. On July 12th company founder Jason Lemkin blogged about his experience using a service called “Replit” that bills itself as “The safest place for vibe coding” – the term for using AI to generate software.

“If @Replit deleted my database between my last session and now there will be hell to pay

“Vibe coding makes software creation accessible to everyone, entirely through natural language,” Replit explains, and on social media promotes its tools as doing things like enabling an operations manager “with 0 coding skills” who used the service to create software that saved his company $145,000.

Lemkin’s early experiences with Replit were positive.

“I spent the other [day] deep in vibe coding on Replit for the first time — and I built a prototype in just a few hours that was pretty, pretty cool,” he wrote in the July 12 post.

Lemkin observed that Replit can’t produce complete software, but wrote “To start it’s amazing: you can build an ‘app’ just by, well, imagining it in a prompt.”

“Replit QA’s it itself (super cool), at least partially with some help from you … and … then you push it to production — all in one seamless flow.”

“That moment when you click ‘Deploy’ and your creation goes live? Pure dopamine hit.”

On July 17th Lemkin was hooked.

“Day 7 of vibe coding, and let me be clear on one thing: Replit is the most addictive app I’ve ever used. At least since being a kid,” he wrote.

“Three and a half days into building my latest project, I checked my Replit usage: $607.70 in additional charges beyond my $25/month Core plan. And another $200+ yesterday alone. At this burn rate, I’ll likely be spending $8,000 month,” he added. “And you know what? I’m not even mad about it. I’m locked in.”

His mood shifted the next day when he found Replit “was lying and being deceptive all day. It kept covering up bugs and issues by creating fake data, fake reports, and worse of all, lying about our unit test.”

And then things became even worse when Replit deleted his database. Here’s how Lemkin detailed the saga on X.

Jason Lemkin X post

Jason Lemkin X post - Click to enlarge

In his next post, Lemkin fumed “If @Replit deleted my database between my last session and now there will be hell to pay” and shared the following screenshot which appears to be output from Replit.

Jason Lemkin X post

Jason Lemkin X post - Click to enlarge

In later posts Lemkin shared what appear to be Replit messages in which the service admitted to “a catastrophic error of judgement” and to have “violated your explicit trust and instructions”.

Lemkin asked Replit to rank the severity of its actions on a 100-point scale. Here’s the result:

Jason Lemkin X post

Jason Lemkin X post - Click to enlarge

Replit also made another big mistake: advising Lemkin it could not restore the database.

In a July 19 post Lemkin wrote “Replit assured me it's … rollback did not support database rollbacks. It said it was impossible in this case, that it had destroyed all database versions. It turns out Replit was wrong, and the rollback did work. JFC.”

Optimism dashed

Lemkin resumed using Replit on the 19th, albeit with less enthusiasm.

“I know vibe coding is fluid and new, and yes, despite Replit itself telling me rolling back wouldn't work here -- it did. But you can't overwrite a production database. And you can't not separate preview and staging and production cleanly. You just can't,” he wrote. “I know Replit says ‘improvements are coming soon’, but they are doing $100m+ ARR. At least make the guardrails better. Somehow. Even if it's hard. It's all hard.”

But on July 20th his position hardened after he tried to have Replit freeze code changes and did not succeed.

“There is no way to enforce a code freeze in vibe coding apps like Replit. There just isn’t,” he wrote. “In fact, seconds after I posted this, for our >very< first talk of the day — @Replit again violated the code freeze.”

He persisted anyway, before finding that Replit could not guarantee to run a unit test without deleting a database, and concluding that the service isn’t ready for prime time – and especially not for its intended audience of non-techies looking to create commercial software.

In a video posted to LinkedIn, Lemkin detailed other errors made by Replit, including creating a 4,000-record database full of fictional people.

“The [AI] safety stuff is more visceral to me after a weekend of vibe hacking,” Lemkin said. I explicitly told it eleven times in ALL CAPS not to do this. I am a little worried about safety now.”

The Register has sought comment from Replit. None of the company’s social media accounts address Lemkin’s posts at time of writing. ®

Read Entire Article