Want to read Slashdot from your mobile device? Point it at m.slashdot.org and keep reading!

 



Forgot your password?
typodupeerror
×
Businesses

Horror Stories From Inside Amazon's Mechanical Turk (gizmodo.com) 114

From a report: The workers of Mechanical Turk, Amazon's on-demand micro-task platform, say they have encountered mutilated bodies, graphic videos of botched surgeries, and what appeared to be child pornography. They say they have been asked to transcribe Social Security numbers and other personal data. Sometimes their temporary bosses, "requesters" in Amazon's parlance, allegedly ask their anonymized employees to send along their underwear, take photos of their feet, or to draw pictures of their genitals. They say they have been paid to recount traumatic instances in their lives -- a cancer diagnosis, severe depression, or the death of a loved one -- often for less than a dollar. These are some of 1,100 responses to two surveys Gizmodo recently posed to gig workers on Mechanical Turk asking for their experiences using the platform. Unlike the tribulations of Amazon's warehouse workers, which have been well documented, the experiences of gig workers on Mechanical Turk are far less visible.
This discussion has been archived. No new comments can be posted.

Horror Stories From Inside Amazon's Mechanical Turk

Comments Filter:
  • Yes But... (Score:5, Insightful)

    by VorpalRodent ( 964940 ) on Wednesday January 29, 2020 @11:16AM (#59667950)

    Not to diminish their plight, but we here on Slashdot regularly have to wade through metaphorical rivers of muck, and we get paid nothing.

    We are also requested to fill out ever more demeaning and pointless surveys.

    • Re:Yes But... (Score:4, Informative)

      by Virtucon ( 127420 ) on Wednesday January 29, 2020 @11:44AM (#59668046)

      The door is over there on the left.

      • by Anonymous Coward

        Ignoring problems is stagnation. The first ingredient of solutions is identification.

      • Not to diminish their plight, but we here on Slashdot regularly have to wade through metaphorical rivers of muck, and we get paid nothing. We are also requested to fill out ever more demeaning and pointless surveys.

        The door is over there on the left.

        Given his/her complaints, I imagine the door would be on the right.

    • by bjwest ( 14070 )

      We are also requested to fill out ever more demeaning and pointless surveys.

      I've been here quite a while, and I don't recall ever being asked to fill out a survey.

      • by kackle ( 910159 )
        Perhaps he's being spammed and doesn't know it.
      • Re: (Score:3, Insightful)

        by Aighearach ( 97333 )

        Have you forgotten CowboyNeal already?! So sad, so so sad.

        The answer is CowboyNeal. Never forget.

        • Re: (Score:3, Insightful)

          by sysrammer ( 446839 )

          Each generation has to go through their own learning curve before they discover the shortcuts that their predecessors had to discover.

          It's CowboyNeal, all the way down.

      • by Nite_Hawk ( 1304 )

        We are also requested to fill out ever more demeaning and pointless surveys.

        I've been here quite a while, and I don't recall ever being asked to fill out a survey.

        Cowboy Neal

        • by bjwest ( 14070 )
          I don't know, maybe I'm getting senile, but I don't recall being asked to take surveys, but I do remember poles on the left side. Maybe that's what he's talking about? I never found them intrusive or annoying, in fact I took a few of them I found interesting.
      • by ebvwfbw ( 864834 )

        Please answer this survey:
        How do you like your panties?
        1) In a bunch.
        2) Un-bunched.

        When you take viagra you take:
        1) one Pill
        2) Two pills
        3) More than two pills.

    • Re:Yes But... (Score:5, Informative)

      by BeerFartMoron ( 624900 ) on Wednesday January 29, 2020 @11:51AM (#59668074)
      Switched from monitoring the homepage [slashdot.org] to using the RSS feed [slashdot.org] years ago and have not seen a Slashdot survey since then.
    • We are also requested to fill out ever more demeaning and pointless surveys.

      And I salute you for your brave contributions. Seriously though, just switch over to the RSS feed. I think that will help you out a bit. But just my two cents, if you want to wade the homepage more power to you.

      • I don't think I've seen a survey, or poll on Slashdot since Cmdr Taco left.....I miss the polls.
        • by aitikin ( 909209 )
          Polls are on the right hand side of the homepage now, below the book reviews (which I haven't seen a new one in a while) and the firehouse (at least on my /. homepage).

          They're not as fun as they used to be though.
    • by hey! ( 33014 )

      In other words, we're the real victims here?

  • The other side (Score:5, Informative)

    by alvinrod ( 889928 ) on Wednesday January 29, 2020 @11:23AM (#59667964)
    I understand that in this day and age you need a sensational title in order to get clicks, but I think the article does a fair job of showing off the good sides of the platform as well and includes some chunks like the following:

    While the vast majority of respondents did not offer a reason for why they started using the platform, 10 percent mentioned that they use Mechanical Turk to supplement their income from another full- or part-time job. Five percent mentioned that they started with Mechanical Turk after having been laid-off from another job. And four percent said they have a medical condition that prevents them from full-time employment.

    “I love working on mturk...”, one respondent wrote, “...im disabled so mturk gave me back my self confidence, and i don’t have to depend on my daughter for every little thing now, I was able to get my grand kids christmas presents.” Another worker said, “I am unable to hold a traditional job due to my health, but because of extenuating circumstances, I do not qualify for disability. So, when I discovered Mechanical Turk, it was a Godsend. Mechanical Turk allows me to be able to work within my limitations, which is really helping to build my confidence back up. I know I’m not making a livable wage doing this, but that’s OK. It’s a heck of a lot better than nothing.”

    There's also some other bits that have a bit of black humor in them:

    As one worker tells it, they were once working for a requester who wanted “many images of my feet in different positions with socks and without socks.” Since the requestor allegedly never paid, never responded to the workers’ inquiries, but still received the images before ultimately rejecting the job, they concluded that the HIT was probably a scam. “But I always wonder what happened to all those pictures of feet that he collected.”

    I wonder why anyone would even want to know that.

    • So you're saying you can get free cam whores on amazon turk?
    • I once read a story about a guy who got sent to a psychiatric hospital for having sex with a bicycle and the exhaust of a car ( assume the car had been stationary for some time or burns may have ocurred!! ), another about a guy who got sexually excited by pencils to the point he pushed them into his uretha.

      Some people have quite deviant and very odd fetishes and feet is nothing new. Someone collecting pictures of something as mundane as feet may be simply a picture collector of odd images or a huge stack o

      • ... another about a guy who got sexually excited by pencils to the point he pushed them into his urethra.

        Maybe he just got tired of guys at the gym calling him pencil dick.

  • by virtig01 ( 414328 ) on Wednesday January 29, 2020 @11:32AM (#59667990)

    Or have workers encountered pictures of mutilated bodies?

  • So stop doing it (Score:5, Insightful)

    by Kohath ( 38547 ) on Wednesday January 29, 2020 @11:40AM (#59668024)

    Every minute these people spend on this activity is 100% voluntary. They can stop any time and restart any time (or never). Don't call them tribulations when the people experiencing them are in complete control of everything that they are doing 100% of the time.

    • by Cinnamon Beige ( 1952554 ) on Wednesday January 29, 2020 @12:23PM (#59668168)

      Every minute these people spend on this activity is 100% voluntary. They can stop any time and restart any time (or never). Don't call them tribulations when the people experiencing them are in complete control of everything that they are doing 100% of the time.

      Given that apparently some of the people are getting stiffed on payment, I think that does count as a tribulation. Considering that scam postings almost certainly cost Amazon money as well as intangibles, long-term I think it would benefit them to require payment be placed in escrow either before the job is listed or before you can receive any work product. They can talk to their legal department on the best way to CYA on the escrow requirement, and make their legal department less depressed on being typically paid to do boring stuff & be ignored. (It might be possible for them to branch out and offer escrow services themselves, or just serve as a 3rd party who will handle verification.)

      Some of this also may be not entirely legal for Amazon to be involved with at all--I would sincerely doubt Amazon would want to be a test case for any claim of "Not Our Circus, Not Our Monkeys" on their liability for CP. The sensitive information might well also be a liability they won't want to deal with--just because you can possibly afford the lawyers doesn't mean you can afford the PR. Maybe they should consider having 'screening task postings' as an ongoing task they pay for themselves...with perhaps bonuses for people with good accuracy rates in flagging, and that part of the cost to post a task in the first place.

    • In an environment of scarcity nothing anyone does for money is "voluntary."
      • Scarcity.. for I assume food, shelter, clothing, medical care? We have an issue with the last one, though it is always available via emergency rooms as a last resort, but none of the rest are scarce in the US, comrade. So you point fails to stand.

        Now, if you mean scarcity for a nicer phone, a better apartment, more 'stuff' then sure, I guess (*wanking motion*).

        • Re:So stop doing it (Score:4, Informative)

          by Organic Brain Damage ( 863655 ) on Wednesday January 29, 2020 @01:44PM (#59668422)
          Medical care that is always available via the emergency rooms as a last resort is a very abridged version of medical care.

          Try being poor and having cancer. The ER will NOT provide you with surgery, chemotherapy or radiation. If your tumor is causing you to bleed from an open sore, the ER will put a bandaid on your open sore and send you on your way.
        • by Shotgun ( 30919 )

          If they are so easily available, why aren't you out providing room, board and medical care to the masses?

          • Same reason you aren't, I give more of a shit about buying more junk for me and my family. I freely admit i could help people with, say, $2K vs spending it on a TV. Yet I buy the TV.

            And so do bleeding heart liberals, they just ignore the cognitive dissonance.

        • by sjames ( 1099 )

          You do know you still get billed in the ER, even if there's no way in hell you can ever pay it off, right?

          Also, the ER will not give you the prescriptions you need in order to not have a life threatening medical problem.

    • Well if it comes down to trauma vs not eating or unable to buy medication. The Trauma from the job is the better option.
      Saying it is there fault for doing the job they were told to do, is just being a cruel person. Ok Trauma is the better option, but it isn't an option that should be given. Amazon needs to give these workers a way to report and refuse jobs which are just dealing with the worst part of humanity.

    • by hey! ( 33014 ) on Wednesday January 29, 2020 @12:36PM (#59668202) Homepage Journal

      Sure, if your circumstances allow you to stop earning money while you look for another job, that's a rational choice.

      I grew up comfortable, but in a working class neighborhood where many of my friends' parents were struggling to live paycheck to paycheck. They weren't poor because they didn't work hard. They were poor because they didn't have any money.

      The most important thing money buys you is time. If you're job is crummy, and you have enough money in the bank that you can spend a month looking for a better job, a year from now you'll have even *more* money in the bank. If you need this week's paycheck or else next week your family is homeless, chances are good that a year from now you'll be in the same place.

      • If you're job is crummy, and you have enough money in the bank that you can spend a month looking for a better job, a year from now you'll have even *more* money in the bank. If you need this week's paycheck or else next week your family is homeless, chances are good that a year from now you'll be in the same place.

        In every job switch I've made since I graduated from college ages ago my last day was a Friday and my first day at the new job was the following Monday. During this time I've changed jobs 4 times yet never required a month off nor taken a break between jobs. I'm going to have to disagree with your assertion.

        • Congratulations on your good luck. Not everyone is that fortunate.

          Also, you're missing the *time* component of this discussion. You had time to search for that next job because your previous job(s) did not consume all of your time.

    • by BenBoy ( 615230 )
      Reply or mod? Reply or mod? ... (sigh) Reply.

      Every minute these people spend on this activity is 100% voluntary. They can stop any time and restart any time (or never).

      Given our economy's winner take all model, Jeff Bezos, the guy with a hell of a lot of the carrots, calls the tune. Because if few enough people have enough of the carrots, they're indistinguishable from sticks (assuming one's in the habit of eating). I'm glad things have gone well enough for you that you don't get that. That's not everyone'

      • Yes, because you're either Jeff Bezos or you're fucking dying of starvation here in the US... Wanting more shit isn't being desperate and starving.
        • Re: (Score:2, Funny)

          by BenBoy ( 615230 )

          Yes, because you're either Jeff Bezos or you're fucking dying of starvation here in the US... Wanting more shit isn't being desperate and starving

          Sure, it's the middle-class dream. Got it. Say hi to Ayn for me, 'k?

    • I've pointed this out before, but when society sets you up to fail things can appear voluntary but not be.

      Technically North Korea is a Democracy, and everybody's there "voluntarily". That's an extreme example, but a less extreme example is living in a city where the jobs suddenly shift overseas and now you have no money for food. Should you be able to sell yourself into slavery for food?

      You used to be able to, it was called indentured servitude. In the late 20th century it was decided that a contrac
      • Having 100% of the population vote one way because they (and ofttimes their families) will be imprisoned for life or killed does not a democracy make, technically or otherwise.

        So the next question is are these people defacto selling themselves into slavery?

        slavery - the state of being a slave.

        slave - a person who is the legal property of another and is forced to obey them.

        So, no. Not here anyway.

        Technically North Korea is a Democracy, and everybody's there "voluntarily".

        Bullshit. Tell that to the

        • as in, in fact, for all intents and purposes, etc, etc.

          Also "Technically".

          You're literally contradicting yourself. North Koreans aren't "literal" slaves unless they are themselves called slaves. They may be defacto slaves though. You might be too, if your country keeps up it's current trajectory (assuming your not in one of the more liberal Nordic or European countries).

          And, uh, yeah, having 100% of the population vote one way would make it a democracy, provided those votes were real and were n
      • by Shotgun ( 30919 )

        So if all the companies went away, would these people be better off as subsistence farmers? Hunter gatherers?

        In a free country, you are free to alienate your labor for an agreed upon price. This is what is happening here. Whining that the people have no choice when they clearly do is complete nonsense.

        • by sjames ( 1099 )

          If they had sufficient land for subsistence farming or access to a sufficiently large area they could gather from, subsistence farming or hunting and gathering might well be better choices for them, but those options have been foreclosed in most places.

    • Overall I agree with you, unless one is stuck in Venezuela, another similar country, or a refugee camp throughout the planet and there is absolutely nothing else available for any type of economic sustenance.
    • This is the same problem that the company trying to sell censored versions of movies (before the studios shut them down) was trying to solve. You can't unsee things that you've seen, or unexperience things that you've experienced. If you want to be insulated from the seedier side of life, it has to be filtered out before you're exposed to it.

      Saying you can quit after you're exposed to it is kinda beside the point, because by that point the damage has already been done. Sure you can quit and stop subse
    • by nagora ( 177841 )

      Every minute these people spend on this activity is 100% voluntary. They can stop any time and restart any time (or never). Don't call them tribulations when the people experiencing them are in complete control of everything that they are doing 100% of the time.

      You are a moron. The point is that they are specifically not volunteering to see images of mutilated bodies and so on.

  • They choose their gigs!

    • They don't know what the gig is until they take it. "you're going to be looking at photos and providing feedback on their emotional content" doesn't say you're going to be looking at mutilated corpses or tortured animals.

      • "you're going to be looking at photos and providing feedback on their emotional content" doesn't say you're going to be looking at mutilated corpses or tortured animals.

        Yes. Yes, it does say that. If you're fully literate, anyways.

    • by skids ( 119237 )

      When it first started I did some HITs just to check it out. They were apparently developing a training data set for street address recognition and there were a lot of "tell us which photos have a visible number on a building" micro-jobs. Those were the golden days... almost felt like a game.

      Then those HITs disappeared and in their place were a bunch of people trying to get you to answer personal info surveys, or help SEO by positing URLs to a website or forum. The only decent HITs left were some audio tr

  • Disturbing (Score:5, Funny)

    by Cajun Hell ( 725246 ) on Wednesday January 29, 2020 @11:49AM (#59668064) Homepage Journal

    I find this story very disturbing.

    These are the kinds of things we used to get unpaid interns to do. Now we have to pay Amazon for the same work? Before anyone else stoops to using Mechanical Turk, I hope you'll stop and think about what you're doing to the market of valuble, no-paying jobs.

  • by pz ( 113803 ) on Wednesday January 29, 2020 @12:01PM (#59668106) Journal

    The vast majority of people driving are clothed, according to truckers who have additional perspective into people's habits in their cars. Here and there, there are reports of people driving in what might be considered an otherwise embarrassing state of dress. Does that mean that OHMIGODEVERYDRIVERISNEKKED!!!?!?!?!

    No. But, could you write a sensationalistic headline like TRUCKERS FORCED TO VIEW MUTILATED BODIES, GRAPHIC IMAGES, NAKED CHILDREN to click-bait people into an article about the rare instances of truckers getting an eyeful in what most would consider an incredibly boring job of long-haul driving? Sure, you could write it. Would it be accurate? Only in the narrowest of senses: it might better be considered a lie of omission.

    As for Mechanical Turk, I've come close to posting some HITs when I needed lots and lots of eyeballs to view something really mundane -- to tell me whether a collection of computer-generated English sentences were natural-sounding or awkward, so that I could fine-tune the generation algorithm. Given the pricing and setup, that would seem to be more-or-less the normal sort of work on Mechanical Turk: incremental, doesn't take much effort, lots of iterations, requires a human. Apparently there are people who find that sort of work fulfilling based on other comments here, and without being disparaging or judgemental on why that might be the case, I'm now disappointed that I didn't follow through with setting it up. I mean, if I can help someone feel empowered by giving them something to do while benefiting my work at a reasonable cost, there's nearly a moral imperative to do so.

    Maybe Mechanical Turk isn't the best way to arrange that sort of piece-work, but are there any other ways?

  • When I read shit like this I understand why it is that starfaring alien civilizations won't contact us openly; they're embarassed for us. :-(
    They just occasionally kidnap one of us for study to try to understand why it is we're so fucked up. :-(
  • progress (Score:5, Interesting)

    by Tom ( 822 ) on Wednesday January 29, 2020 @12:47PM (#59668238) Homepage Journal

    There was a time when we looked at the future and expected the best. Machines would do the "bad" work and humans would gain more prosperity and more free time, being able to focus on creative work, art and science.

    What came of that? Ah yeah, the dream of becoming filthy rich with a startup (after working for next to nothing for some years, and a tiny chance of actually succeeding at that dream), a complete focus on stock prices (when I was a kid, nobody outside the finance industry gave a shit about them and they were only mentioned on TV news when a really serious crash happened) and, of course, the largest transfer of wealth from everyone to a tiny, tiny, tiny fraction of super-rich in the history of our species.

    What happened to the dreams of a better world? Now we're again afraid of climate change the way we were afraid of WW3, and just surviving seems enough.

    • by GuB-42 ( 2483988 )

      That's the paradox, the world is clearly a better place than ever but negative thoughts dominate.

      Sure, everything didn't turned out as bright as we dreamed it would be. As expected for dreams. But things did improve, why not keep dreaming?

      Machine do the "bad" work. Just not all of it. Unfulfilling jobs and worker exploitation still exist, but there is less of it now, and besides a few exceptions, the situation is improving everywhere in the world.
      Talk about prosperity? Many thing that were only available to

      • by Tom ( 822 )

        But thanks to progress, we are not in a zero-sum game. If the poor are a little better off, and the rich are much better, how can it be a bad thing.

        Corrected for inflation, real incomes of both lower and middle class have actually fallen over the past twenty years in many parts of the world.

        About the only thing that is more difficult now is housing, a direct result of increasing population density.

        Population growth is zero or even negative in the areas (western cities) with the highest increase in housing costs. Population density does not explain the doubling of rents in many European cities, for example.

        Agreed that many things are indeed better and improving further. But many, many opportunities to improve life have been traded for stock prices and pseudo-w

  • Please let the invisible hand of the free market sort this out. It solved every problem in society, including human rights.

  • This is honestly the first time I have heard of Mechanical Turk, but it's apparently been around for quite a while.

    • Welcome back, I guess you didn't read slashdot for what, 15 years?

      Warning: it isn't a fine wine.

      • by gosand ( 234100 )

        Welcome back, I guess you didn't read slashdot for what, 15 years?

        Warning: it isn't a fine wine.

        I did "step away" for a few years. Not only from /., but from most online and all local and "traditional" news. It's surprising how liberating it is, especially with the low signal-to-noise ratio. Even now, I only really check the BBC for news, and even their information has become pretty click-baity and sensationalist. Not as bad as almost EVERYTHING else though. Every few months I kind of "dip my toe" into the cesspool that is mainstream news, and it makes me cringe every time. I just have no need f

        • Congratulations on your efforts to control your own reality. Humans are getting rarer and rarer in this Age of Zombies.

          Other than the BBC, if I'm curious about news the Reuters feed isn't that bad. It is the same crap stories as on the other sites, but they mostly just list them out instead of all the weird editorial crap and videos that most sites push. The BBC doesn't do as much international coverage as they used to.

          Even news sites where I mostly agree with the politics of the editorial staff, the conten

  • by LatencyKills ( 1213908 ) on Wednesday January 29, 2020 @01:00PM (#59668286)
    I RTFA, and somehow I've become so disconnected from the lingo of all of this bullshit, I can hardly figure out what they're talking about. Seriously, could someone boil this down in non-new-economy lingo? By my read, Amazon appears to have a gig job board (no idea why it is called Mechanical Turk) where people sign up to respond to micro-gigs (Amazon seems to call them HITS) posted by other people. Rolled into that are a bunch of muddy reports of people somehow gaming the system (or more likely the gig workers) to get "work" done *(such as getting them to send pictures of their feet), and then not paying them, and somehow even more perplexingly they end up tricked into looking at awful pictures and video through a mechanism that I can't even figure out and I have no idea if they're paid for that or not. Oh, and Amazon seems to ignore complaints filed by gig workers for the above. Am I anywhere close to right?
    • by kubajz ( 964091 )
      Mechanical Turk has been around since 2005 - hardly a novelty of "non-new-economy gig-jobs". If you need someone to tell you where the name came from and what mturk does, let me quote from Wikipedia: "The name Mechanical Turk was inspired by [...] an 18th-century chess-playing automaton [that beat] both Napoleon Bonaparte and Benjamin Franklin. It was later revealed that this "machine" was not an automaton at all, but was, in fact, a human chess master hidden in the cabinet beneath the board [...]. Likewise
      • Here's a short reference for him that can provide for a small, reliable "Funny" mod:

        Wonder what a Beowulf cluster of mechturks would look like.
        Oblig XKCD: https://dev/null [dev].
        In Soviet Turkey mechanical makes you!
        Something about Portman and Grits; and/or Hookers and Blow.

        Now get off of my lawn, you insensitive clod!

      • When I read it, Mechanical Turk rang a distant bell, and I was thinking it was in some scifi book I read as a teenager, so I appreciate the Wikipedia summary. Beyond that, I wasn't going for funny, but could you elaborate on how I'm "not really close to right" in my summary. Aighearach, who posted after you, says I'm exactly correct. I'm confused.
    • Am I anywhere close to right?

      Yes, exactly correct.

      There are also things like web programming jobs where you can paste together web apps for 12 cents an hour, or do custom artwork and business logos for 5 cents an hour.

      There is also a lot of data entry, where you go through some company's catalog or user list and paste the fields into a new CMS so some phishing site can get off the ground.

  • by Mary L. Gray and Siddharth Suri (below please find my buddy's book review of it, most interesting . . .)

    Yikes! The very first author who correctly and accurately explains Fei-Fei Li's machinations - - that self-righteous, grandstanding poseur - - founder of the microwork/micro-task platform, MTurk [and Stanford U. computer science prof, from the PRC originally, affiliated with Google and created ImageNet]. Oooooooooohhhhh, we need more diversity and equality in the workplace, preaches Fei-Fei Li, wh
  • That's what Turk is really about. It gives Amazon (and it's badly compensated staff, for the work they are asked to do) a hands off way of doing the work that supports the darker corners of the internet. Growth at all costs does eventually reach into that bag, and it's money trail is finally coming around to being exposed.

"The whole problem with the world is that fools and fanatics are always so certain of themselves, but wiser people so full of doubts." -- Bertrand Russell

Working...