Programmer and sysadmin (DevOps?), wannabe polymath in tech, science and the mind. Neurodivergent, disabled, burned out, and close to throwing in the towel, but still liking ponies 🦄 and sometimes willing to discuss stuff.

  • 1 Post
  • 15 Comments
Joined 2 years ago
cake
Cake day: June 26th, 2023

help-circle
  • There is an experimental distributed open source search engine: https://dawnsearch.org/

    It has a series of issues of its own, though.

    Per-user weighting was out of the reach of hardware 20 years ago… and is still out of the reach of anything other than very large distributed systems. No single machine is currently capable of holding even the index for the ~200 million active websites, much less the ~800 billion webpages in the Wayback Machine. Multiple page attributes… yes, that would be great, but again things escalate quickly. The closest “hope”, would be some sort of LLM on the scale of hundreds of trillions of parameters… and even that might fall short.

    Distributed indexes, with queries getting shared among peers, mean that privacy goes out the window. Homomorphic encryption could potentially help with that, but that requires even more hardware.

    TL;DR: it’s being researched, but it’s hard.


  • The basic algorithm is quite straightforward, it’s the scale and edge cases that make it hard to compete.

    “Ideally”, from a pure data perspective, everybody would have all the data and all the processing power to search through it on their own with whatever algorithm they prefer, like a massive P2P network of per-person datacenters.

    Back to reality, that’s pretty much insanely impossible. So we get a few search engines, with huge entry costs, offering more value the larger they get… which leads to lock-in, trying to game their algorithms, filtering, monetization, and all the other issues.






  • Education is supposed to teach “how to learn to learn”.

    Left to his own devices, then, without knowing quite what to ask or how to interpret the responses, the man in this case study “did his own research”

    The whole thing with “do your own research”, is kind of funny:

    • some use it to avoid explaining their points
    • others use it to come up with a lot of nonsense
    • while the proper way to begin any “research”, is to… ask an expert.

    Nobody has ended up in a psych hold, just by reading a bunch of Wikipedia articles, asking ChatGPT… then consulting a doctor.







  • I’m seeing about as many wrong questions as wrong answers. We’re at a point, where it’s becoming more accurate to ask, whether the quality of the answer, is “aligned” with the quality of the question.

    As for “AI” and “intelligence”… not so long ago, dogs had no intelligence or soul, and a tic-tac-toe machine was “AI”. The exact definition of “intelligence”, seems to constantly flow and bend, mostly following anthropocentric egocentrism trends.




  • Farooq Ahmed, an 18-year-old scrap dealer

    Without proper safety measures, workers handle toxic materials such as lead, mercury, and cadmium daily. “I cough a lot,” Ahmed admits with a sheepish grin. “But what can I do? This work feeds my family.”

    Food for today, death for tomorrow.

    On one hand, it’s criminal what companies like Apple do to hinder repairability. On the other, these people are killing themselves pretty quickly; instead of in a landfill, all those heavy metals are going to end up in the air after they get cremated.