• StudioLE@programming.dev
    link
    fedilink
    arrow-up
    50
    arrow-down
    6
    ·
    edit-2
    1 year ago

    Star rating systems don’t accurately convey opinions. The majority of reviews will be either 5* or 1* with only a few wannabe critics voting in between applying their own arbitrary votes.

    If Amazon are going to change things then why not adopt something more meaningful. Simple up/down votes for things that actually matter.

    Was this product as described: 👍/👎

    Are you satisfied with the quality: 👍/👎

    Are you satisfied with the value for money: 👍/👎

    Then a few optional questions for things that aren’t relevant to the product such as postage/packaging etc.

    • Hamartiogonic@sopuli.xyz
      link
      fedilink
      arrow-up
      45
      ·
      edit-2
      1 year ago

      Star ratings are very broken, because everyone seems to think of the rating differently. IMO the criteria should be like this:

      ⭐️ ⭐️ ⭐️ ⭐️ ⭐️ = The best thing ever.

      ⭐️ ⭐️ ⭐️ ⭐️⚫️ = Above average.

      ⭐️ ⭐️ ⭐️ ⚫️ ⚫️ = It’s ok. Get’s the job done. Not great, not terrible. The usual. Nothing special. Totally average.

      ⭐️ ⭐️ ⚫️ ⚫️ ⚫️ = Below average. I’m disappointed.

      ⭐️ ⚫️ ⚫️ ⚫️ ⚫️ = Worst thing ever. Crime against humanity. Ban this product and burn the remaining stock immediately.

      However, in reality people tend to use it like this.

      ⭐️ ⭐️ ⭐️ ⭐️ ⭐️ = It’s ok. I don’t have anything to complain about. Could be ok, could be great or anything in between.

      ⭐️ I’m not happy. Minor complaints, big complaints and anything in between.

      When it comes to book reviews, the five star reviews tend to be useless. Especially when it comes to self help books, it seems like those reviews were made by people who are completely incapable of noticing any flaws in the book. I’m inclined to think those people shouldn’t even review a book if they can’t think of it critically. On Amazon there are always lots and lots of fake reviews produced in a click farm, but in other places you’ll also find genuinely incompetent reviewers too.

      • CarbonIceDragon@pawb.social
        link
        fedilink
        English
        arrow-up
        22
        ·
        1 year ago

        I think the problem is partially the fault of companies that insist, at least where rated interactions with employees is concerned, that every interaction should be five stars, which in a system where the stars are all meaningful like this, is simply not realistically possible. This gives people the sense in general that rating anything that you don’t completely dislike anything less than 5 stars is a bad thing to do, because it risks hurting some employee somewhere who doesn’t deserve it.

      • chiliedogg@lemmy.world
        link
        fedilink
        arrow-up
        4
        ·
        1 year ago

        What it’s really useful for, however, is reviews.

        People don’t buy 4-star reviews, and angry people don’t give them. Those middle 3 stars are the reviews with reading.

        • Hamartiogonic@sopuli.xyz
          link
          fedilink
          arrow-up
          1
          ·
          1 year ago

          Can confirm. Especially when reading book reviews, I always skip the 5 star renews and focus on reading the others.

      • Square Singer@feddit.de
        link
        fedilink
        arrow-up
        4
        ·
        1 year ago

        Tbh, that different understanding doesn’t matter much if you have enough reviews since it averages out.

        If you compare two products with one review each, then yes, it hugely matters whether the one reviewer considered 5 stars as “expectations fullfilled” or “the best thing that happened to me ever”.

        But if you got >1k reviews, both sides will get equal amounts of both reviewer groups and it will average out so that both products will be compareable based on their stars.

        That’s a big misunderstanding many people have in regards to reviews. Many people are also afraid that unfair reviewers will skew the score. But since these unfair reviewers are usually spread equally over all products, it averages out as soon as you have a couple hundred reviews.

        And that’s also what that article criticises. It’s much more important how many reviews an article has than the exact value. It’s easy to get a straight 5-star rating if you have only a single review. It’s much harder to do so if you have 10k reviews.

        So the information value is: <100 or so reviews, the rating means little to nothing. >1000 reviews it can be usually trusted.

      • ssorbom@lemmy.world
        link
        fedilink
        arrow-up
        3
        ·
        1 year ago

        To be fair, I think it is reasonable to rate things you have no complaints about as high as possible. If I see a rating with three stars, I assume that it was okay with a few rough spots. I like the idea that all products start out as five stars unless there is something really wrong, and you start knocking points for problems.

        • Hamartiogonic@sopuli.xyz
          link
          fedilink
          arrow-up
          3
          ·
          1 year ago

          Then how do you tell the difference between a good product and a great product? For example, imagine you’re comparing an electric screwdriver from Lidl (parkside) and Boch. Should they both get 5 stars because nothing is broken and they get the job done?

          • LucyLastic@sh.itjust.works
            link
            fedilink
            arrow-up
            2
            ·
            1 year ago

            Lidl screwdriver = adequate for occasional DIY, 3 Stars

            Bosch screwdriver = can be used as a substitute chisel or crowbar every day for a lifetime, 5 stars

    • mythic_tartan@sh.itjust.works
      link
      fedilink
      arrow-up
      5
      ·
      1 year ago

      This is good. I would consider adding “Would you recommend to a friend” but that may be redundant given what you have already.

      • StudioLE@programming.dev
        link
        fedilink
        arrow-up
        4
        ·
        1 year ago

        I also found that an odd question.

        "you ordered a two pack of Durex extra small and a packet of malteasers. Would you recommend them to a friend? "

        No. Because who the hell recommends stuff…? Unless it’s something truly unique im not going to recommend it

        • sugar_in_your_tea@sh.itjust.works
          link
          fedilink
          arrow-up
          2
          ·
          1 year ago

          I get where you’re coming from, but my wife did really appreciate a recommendation for a feminine hygiene product (menstrual cup) from a family member. We rarely recommend products of any sort, much less inexpensive products, but my wife has already recommended that product multiple times.

          That said, I think it’s a poor question. I wouldn’t recommend a feminine hygiene product to my single, male friends, nor would I recommend that point and click adventure game to coworkers who mostly play competitive FPSs. I’ll even recommend “bad” products if I think it’ll fit whatever niche my friend wants to fill (e.g. that crappy screwdriver may not be good for screws, but maybe it’s decent for an art project).

          Maybe a better question is: would you buy this again if it was lost/stolen? As in, did this fill your need enough that you wouldn’t look at other products?

          • mythic_tartan@sh.itjust.works
            link
            fedilink
            arrow-up
            2
            ·
            edit-2
            1 year ago

            “Would you recommend this to a parallel universe instance of yourself in a similar situation, who is not yet decided on a purchase?”

        • dlok@lemmy.world
          link
          fedilink
          arrow-up
          1
          ·
          1 year ago

          Yeah I was using the Microsoft 365 suite for work and it asked if I’d recommend it to a friend. No itd be a weird thing to bring up in conversation with a personal friend to recommend.

        • mythic_tartan@sh.itjust.works
          link
          fedilink
          arrow-up
          1
          ·
          1 year ago

          Haha you’re right, it probably doesn’t really apply to most things. I do get asked what I recommend more than the average person because my friends and family know I research purchases too much. I hate buying junk.