Avatar

Confessions of a Crazy Person

@jackietastic / jackietastic.tumblr.com

Nerd nearing 40. Feat. Anxiety, Depression (in remission), ADHD, Tourette's, Panic Disorder, and a dash of the 'Tism.

So Hank Green got caught using AI and it’s a whole huge blow up, and I really don’t have much interest in adding to the pile on.

However, I do think this case is great example of what happens when smart people decide they can use these systems “responsibly.”

Let’s put aside the plagiarism and the energy use for a second (not that these don’t matter, but they’re not relevant to my point at the moment) and pretend these systems were made with entirely properly obtained info and ran on only solar, but otherwise were entirely the same. If you’re a person, you might think “okay, I’m going to only use this to come up with ideas for my next paper: I’m going to do all the research myself and the writing, I’m just gonna brainstorm topics.”

The thing is, even if you’re trying to limit use to just “brainstorming” the chatbot isn’t going to limit itself to just brainstorming. You might ask it “what should I write about involving Greek history” and it may suggest “the plague of Athens” but it’s also going to suggest some “basic info” on the plague of Athens that you might end up picking up and deciding your topic is. It’s going to provide you with “research.” And even if you decide to check that research yourself, that’s still setting you down a specific path you might not have picked organically.

And speaking of double checking its “research”, fact checking is a time heavy process. Not only now do you have to read the original text the bot provided, but you also have to compare it line by line with the summary the bot provided. That’s more time than it would have taken to just read the article by itself. And with any time heavy task, people are going to get lazy. And in original research being lazy might mean skimming a paper or an abstract, chatbots allow you to be lazy without looking at the article at all.

And soon enough, despite telling yourself you were only going to use it for brainstorming, you have offloaded topic generation, research and eventually even drafting because that’s what these bots are intended to do. They are not meant to serve as research tools or help brainstorm or serve as a bouncing off board: they are built to encourage maximum engagement. And that means if you go at them with the best of ethical intentions, they are built to tempt you to use them as much as possible, regardless of whatever line you drew in the sand for yourself.

Anyway, my main thought here is you are not smart enough to outwit the dopamine machine. It wants your attention and nothing more. Do not assume you can resist just because you know what’s under the hood.

Whenever you decide to use a tool, you should consider “what is this tool designed to do” and for LLM’s that answer is “maximize user engagement.” Anything else is in service to that goal.

My read of this came from Hank’s own response to the situation which you can find here. I’ve screenshotted the part in particular that drew my attention and spawned this post below:

Obvs, Hank’s situation is not the same as the scenario I laid out but I think the snippet above gets back to my main point which is these tools are built to encourage interaction and that’s a hard thing to avoid, regardless of intentions.

Some other notes:

1. As stated, I don’t bring this up to add to a pile on, just to use this as an example of something I’ve seen happen with folks trying to engage in this tech with an ethical framework. This is because-

2. Frankly, I think shame is a shit motivator. I bring all this up to try to draw attention to something I find under discussed which is what these LLMS are meant to do, and what they are advertised for which are often very separate lists. (I didn’t even get into how they’re meant to train off user data but that’s another can of worms). If you want to discourage AI use, it’s a far better strategy to listen to why the person is engaging with AI and then address that reason.

3. I don’t want to come off as someone trying to scare folks that they’ll get addicted just by touching the stuff: my point is merely that is it critical to know what something is made for before engaging with it. This actually goes for a lot of tech besides AI like Google or social media (which are also designed to 1. Capture your attention and 2. Show you advertisements). AI isn’t a special kind of evil in this way, merely a continuation of a tech trend where a product is sold to a consumer with the goal of the time of the consumer becoming the source of revenue.

4. I have book recs on this topic. As you can guess, this is an academic interest of mine. But that’s another post if folks are interested.

Avatar
Reblogged

I almost fell for a phone scam today. The moral of this story is that it doesn't matter how smart you are, there is a scam out there that could very well GET YOU in the right circumstances.

For me today, those circumstances were: Several days of being underslept. Over-stressed. Forgot to take my ADHD meds this morning. Already dealing with the harried mental state of day-before-travel stress. A personal panic trigger of missing appointments because I forgot about them.

We all know by now that the IRS will not call you on the phone. The jury duty people also will not call you on the phone, and this was the crucial piece of information that I did not have cold hard confirmation of today. Here is what happened, so that you can be equipped in case these fuckers call you:

Man with an American accent tells me he's from my city's courthouse. He tells me I missed jury duty summons yesterday and that now I'm in Trouble for contempt of court and failure to appear for jury duty. I protested that I hadn't gotten a notification for jury duty, he talked over me and said scary things about getting law enforcement involved unless I went to pay some fines and talk to the judge Right Now Today. He told me that I legally wasn't allowed to hang up the phone or put it on mute. He told me that I was under a "gag order" and I couldn't tell anyone about this except law enforcement or immediate family members. He already knew my address. He had official-sounding case numbers which he made me write down and repeat back to him. He had official addresses of where I needed to go and what I needed to do: Take the cash for my "fines" to a kiosk where I would pay them and receive a "voucher" that i would then take to the courthouse where I would supposedly speak to a judge. He told me again that if I hung up the phone before I got to the courthouse, it would be taken as obstruction or failure to comply or intent to flee and he would notify the police. He told me that if I went to sort it out with the judge, it might be waived and my money would be refunded.

I have not gotten jury duty summons for a WHILE -- since before the pandemic -- and I had been idly thinking recently that maybe I was due for one. So I heard all this and my panic button about Forgetting/Missing An Appointment got hit dead-on.

I panicked, I was upset and frantic, I was not thinking clearly. This is how they fucking get you.

Honestly, thank god he wanted me to take cash to a different location instead of giving him any financial information over the phone. Thank GOD for that, because it gave my nervous system 30 minutes or so to calm down and my higher brain functions to come back online so that I could notice that there were simply too many red flags in one interaction. I did go to my bank, I did withdraw quite a lot of money in cash.

The address he gave me to go to next was for a gas station. When I expressed confusion, the scammer had smooth explanations, and before I'd even parked, he'd texted me some glossy "official" looking infographics on how to use the kiosk and why the """government""" had started doing payments this way (supposedly a COVID measure, and because the funds were 'safer' or something). The kiosk, these infographic images said, was run by a company called BTC Tech, which they claimed was "Bailing Institute & Technologies". You will notice that that does not match the acronym. The infographic was full of grammatical errors, and thank god he had me sit there in my car and read the whole thing out loud "to make sure i understood it" so that I could hear myself vocally trip over every single one of those grammatical errors and think "Wow, this is weird, it wasn't proofread?"

He sent me a QR code for the ""kiosk"" which had a familiar logo on it. He had persistently asked me for my ETA to the next location, and he was pressuring me to get out of the car and go inside to the kiosk, and it was at this point that I started lying and said, "Sure, hang on one second, i have a pebble in my shoe or something I need to fix first" while I was googling "Bitcoin logo" to verify.

Didn't really need to verify because when I went inside, the only "kiosk" looking thing was an ATM looking thing that had "BITCOIN" written on it in very loud letters. Which brings us to one of two admittedly hilarious interactions, wherein i was standing there in front of the fucking bitcoin machine with my eyes narrowed going, "This is for Bitcoin" several times while he said "No no no no it's not, it's not bitcoin, it's BTC tech" and I kept saying "Well but it says Bitcoin on it in big letters." "No no, it's just a multi-currency system, it's for the courthouse, you have to get the voucher." "Ok but it's fucking BITCOIN, this feels like a scam, I don't think the government uses BITCOIN."

I walked out. I went back to my car. I told him that I wasn't comfortable, and that I needed to call the courthouse to verify with them what the charges were, or I needed to go in person to the courthouse to check what was up. He told me if I hung up, I'd be arrested, and if I stepped foot on government property, I'd be arrested.

It was at this point that I utilized a weapon which in many cases is very dangerous and unethical to use but hey, it's perfect for situations like this: White Lady* Tears. This is exactly the situation they're MEANT for -- buying yourself time to think when a man is strongarming you into meek obedience and fear. (* I am nonbinary but he didn't need to know that.)

Anyway I pretended to cry and told him i felt nauseous and that i was going to be sick and i was just uwu so fwightened and upset and uwu uwu uwu sob sob i felt like he was getting mad at me and it was so scawy oh woe oh no -- while this happened he texted me an arrest warrant that had one of my old roommates' names on it instead of mine, but that EPIC FUMBLE didn't even matter because the whole time I am frantically googling on my phone "jury duty scam" and finding a Reddit page from a guy who posted about the exact same thing happening to him.

I hung up. I called the courthouse, got patched through to the jury pool department, and as soon as the guy picked up, I said, "Hi, my name is Alex, I just got a call saying that I missed jury duty--" and before I could even finish the sentence, the guy said, "That was a scam, we will NEVER call you." I said thank god thank god oh fuck thank god, which brings me to the second hilarious moment of this escapade, where the jury duty guy cheerfully said, "But if you have a couple thousand dollars on you, you can come over and give them to me if you want!" which did make me burst out laughing. Thank you, jury duty guy, for that much-needed moment of levity. I hope you're having a good day.

You are not immune to social engineering. I am 36 years old, highly intelligent, educated, and VERY tech-savvy, and those fuckers STILL caught me at just the right moment and with just the right hook that it triggered panic and desperation and shame and guilt and overrode my critical thinking skills for a solid 30 minutes. If it happened to me, it could happen to you. BE FUCKING VIGILANT. THE IRS WILL NEVER CALL YOU, AND JURY DUTY WILL NEVER CALL YOU.

In hindsight, I'm actually glad that it played out the way it did. For one thing, as a life lesson, that was a pretty cheap one -- all that it cost me was about an hour of my life (including the time it took to go back to the bank and deposit the money I'd withdrawn, gossip extensively to the bank teller about what happened, and get home) and some grey hairs.

For another thing, that fucker spent all that time on the phone with me and didn't get my money. I snatched his smug asshole victory right out of his mouth at the last second and wasted his time -- time that he otherwise ould have spent scamming someone who might not have gotten over their panic in time.

I actually wish that I'd kept him on the phone longer, tbh. If I'd been less rattled, I bet I could have strung him along for another hour or two. Better he spend it with me than with someone else.

JURY DUTY WILL NOT CALL YOU ON THE PHONE.

My partner got a similar call a few weeks ago.

The scammers even had a setup where they "transferred" the call around. It was impressive, and they were prepared for questions about badge numbers, supervisor names, etc.

In hindsight, so much about the call was absurd -- that we were under surveillance, an arrest would automatically happen if we set foot in the police department, the need to go to a "self-serve bail kiosk", the refusal to allow anyone else on the line (the scammers did NOT want my partner to tell me anything).

I have read about this scam a million times.

But in the moment, it was incredibly intense. I only got a taste of it, too, when my partner passed me the phone. Even if you sense a red flag, you are not given a moment to examine it. So many scammer tactics are straight out of the abuser handbook: high urgency, authoritative voice, a barrage of instructions to follow. They want you scared and confused.

Even if you know, "the cops don't call", resisting this sort of thing takes practice!

I used to talk to a lot of cops in my old job, which is what helped me push back -- the minute I chastised the "officer" for being so jargon-heavy and not talking like a real person (something I did often at that old job), I was able to snap out of the scammer's spell and do a sanity check.

But if I had been a little poorer, a little more depressed, or things timed closer to my old legal troubles w/forgotten citations, I may have fallen for it.

I am with OP: You are not immune to social engineering. In fact, the more you think you are immune, the more you are likely suspectible.

A sanity check is what will break you out back into reality. DM a friend, do a Google search, talk to someone else in the house, call the very institution that is supposedly threatening you. Do *anything* to interrupt that scam call so you can think.

idk man not to sound like a cartoon hippie but if your entirrrrre blog and dash is about how the world sucks and everyones bigoted i think you are going to give yorself brain worms

"ah but all of this is important and true and if i dont reblog all of this important stuff waga baga THE WORMS! THATS WORMS! THE BRAIN WORMS!

i do not think you are doing activism chief i think what you are doing is sitting in your room flagellating yourself expecting something to happen

So I do 3D modeling and printing as a hobby, and a few weeks ago I designed wheel guards meant to prevent office chairs from running over cables and clothes... or your pet's tail.

I got the idea from cowcatchers old locomotives used to have.

Anyways, yesterday I uploaded the model to Thingiverse, and just hours after uploading it, the Community Relationship Manager of the whole website left a comment suggesting I enter the model into a competition that's currently being held on the site.

So I did... and now it's in third place not even a day later. First place is $500, but the competition still has a month to go.

Then the Community Manager contacted me again, telling me they want to feature my model in an upcoming design promotion.

Just, what is happening? I mostly made this thing for myself in, like, an hour, and now it's suddenly super popular? This is all a little bit overwhelming 😵‍💫

Other models I worked on for weeks didn't get nearly as popular. I swear, it's impossible to predict what people will like.

Anyways, if you want to print the wheel guards yourself, you can get the model here or here.

I also made a quiet version you can stick furniture felt pads on.

People love simple, extremely practical things. I hope you win!

you ever realize how able bodied people just are not expected to do things that cause them excruciating physical pain? like they’re just. not

if i shouldn’t use my cane because i can sometimes technically walk without it, it would just hurt like a motherfucker then abled people should no longer be allowed to use potholders to take things out of the oven because i mean

well they could technically pick up a hot pan with their bare hands. it would just hurt like a motherfucker

*sees an abled person using potholders*

i just think it’s really sad that you’re giving up on yourself like that

if you use potholders how will you ever build up the calluses necessary to pick up scalding hot metal without burning yourself so severely? it’s like you’re not even trying to get better

I mean, my mother uses potholders, but she’s in her 70s. You’re just… too YOUNG to be resorting to potholders at your age.

If you start using potholders, your inability to hold hot metal will only get worse.

My brain puts words together without my permission. For instance

Live, Laugh, Leviticus

please read this even if you're not indian. especially if you're not indian.

you've seen the jokes. india is "dirty", indians are "everywhere", why don't they fix their own country. ok. let me tell you why, and what's happening right now while nobody's watching.

first, the history you skipped: britain ruled india for two centuries and drained it. economist utsa patnaik's research estimates around $45 trillion in today's money was taken. the india that got independence in 1947 was one of the poorest countries on earth. every "why is india like this" question starts there. you don't get to profit off a robbery and then mock the crime scene.

now, what's happening RIGHT NOW:

in may the question paper for NEET leaked. that's the national medical entrance exam. over 2.2 million students took it. cancelled. years of studying, families' savings poured into coaching, gone overnight because someone sold the paper. students died by suicide after. these were kids who wanted to be doctors.

and out of that came a protest movement. a gen z group called the cockroach janta party, started by a 30 year old named abhijeet dipke, got 22 million instagram followers within DAYS. they've been doing a sit-in at jantar mantar in delhi demanding education minister dharmendra pradhan resign.

and then there's sonam wangchuk. if you've watched 3 idiots, he's the real engineer the character was based on. built solar schools in ladakh. invented ice stupas so himalayan villages have water. spent his whole life on education. he's 59 and he's been on hunger strike for 17+ days now. reporters went to see him this week and he was too weak to talk. and the troll armies are calling him "anti national" and "foreign funded". a man starving himself for other people's children. that's the thing here, anyone who asks a question is suddenly a traitor.

it's not one incident, it's everywhere you look:

• infrastructure worth thousands of crores failing within months of the ribbon cutting. tunnels collapsing in regions where heavy rain is a guarantee, not a surprise.

• youth unemployment near 10% for ages 15 to 29, 13.6% in cities. in a country of 1.42 billion where more than half the population is young.

• only about the top 3% of indians earn above 10 lakh a year. meanwhile billionaire wealth keeps ballooning and the headlines celebrate it.

• manipur burned for over two years. an ethnic conflict, tens of thousands displaced, and the prime minister barely said the word manipur while it happened.

• journalists raided. critics' houses bulldozed. activists sitting in jail for years without trial under laws like UAPA. our press freedom ranking has cratered.

• even the petrol is a fight now, ethanol blending pushed through while drivers complain about their engines and get no straight answers.

and through all of it, the PM, who came to power on religious polarisation (americans, sound familiar?), travels abroad for photo ops and has not held one single open press conference in over a decade. not one.

what i'm asking:

if you're not indian: share this. our media mostly won't cover any of it because the big outlets are owned by the same billionaires the government serves. the only reason wangchuk's fast is getting any coverage is people refusing to look away.

if you ARE indian: speak up even if you're comfortable. especially if you're comfortable. join the protests. add to this, correct me, translate it. staying quiet is a choice when nothing in this post touches your life.

india is not "dirty". india was robbed, and it's being robbed again, from the inside this time. but it's also the country where a 59 year old will starve for strangers' kids and 22 million young people will rally behind a party literally named after cockroaches, because cockroaches survive everything.

we can still save her. but only loudly.

reblog. share. don't scroll past.