Skip to content

Comment on How to use Alpaca-LoRA to fine-tune a model like ChatGPT

Comments

Low-rank adaptation (LoRA) ... has some advantages over previous methods:

- It is faster and uses less memory, which means it can run on consumer hardware.

- The output is much smaller (megabytes, not gigabytes).

- You can combine multiple fine-tuned models together at runtime.

This is great news for my dream of building a fine-tuned interactive messenger, that can deliver a message on my behalf by training it on my personality & the information I want to convey.

Now just add text to speech and a talking head, as discussed in that other submission about cloning yourself with AI... https://news.ycombinator.com/item?id=35280418

And then you hook it up to hundreds of dating apps and it just does the boring job of making introductory chat presenting you at the end with only the women who are interested in a real date.

My friend was doing this with mIRC scripts on our city's DALnet room in 2001. His bot hit up random users, asked a/s/l, and if they were female would text to speech "BabyGurl18 is female".

So we'd be watching a movie, he'd have his computer speakers turned up in his room, his bot would announce and he'd get up and leave, already in conversation

The problem of this strategy is that your dates may realise that you are not talking as well as a good dating LLM once they meet you.

your dates
meet you

Everything you said is a net positive for very many people

Disappointing many people in person isn’t very positive from my point of view.

It was bound to happen to anyway, at least we can make it more efficient

nl

And then someone uses it to create lots of fake people to populate the app so real people buy more subscriptions.

When you consider what will happen when everyone on dating apps is an LLM, you see the issue: in the end, everyone is "interested" in everyone who swiped right.

I'm reminded of this scene from the "I, Robot" movie: https://www.youtube.com/watch?v=ZKxr0wyIic4

What if you died but your chatbot didn't know?

Something like this is a theme in the book Idoru by William Gibson. What happens to the data of a dead person is one theme. Marriage to an AI another.

This is an idea I've been mulling over.

Maybe software running on your PC to capture everything you type, a voice transcriber that filters out your voice specifically and records that, and you've got a dataset that covers a lot of who you are.

Fine tune a model on that and boom, you're "immortal", and as LLMs get better and better, the fidelity of "you" gets better and better.

All the downsides of immortality without any of the fun. As expected from this timeline.

No downsides or fun for yourself, the main use I could see for it would be for something like being able to "talk" to your great great great grandpa one day.

It's like home video on steroids

I suppose that is the one retaining upside for the other person when it comes to immortality. But for the individual, none of the immortality fun remains. You aren't meeting or talking to them as you would in "normal" immortality, you are still dead and don't know if they even exist, you don't even get to ensure the right things are passed down.

So why write letters, time capsules, or leave any other sort of mementos for anyone ?

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.