• JoeKrogan@lemmy.world
    link
    fedilink
    English
    arrow-up
    20
    ·
    edit-2
    2 months ago

    Says the android. He’s like that alien in men in black pretending to be a human.

    • xcjs@programming.dev
      link
      fedilink
      English
      arrow-up
      4
      ·
      edit-2
      2 months ago

      I was reflecting on this myself the other day. For all my criticisms of Zuckerberg/Meta (which are very valid), they really didn’t have to release anything concerning LLaMA. They’re practically the only reason we have viable open source weights/models and an engine.

  • kromem@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    edit-2
    2 months ago

    It’s not as good as it seems at the surface.

    It is a model squarely in the “fancy autocomplete” category along with GPT-3 and fails miserably at variations of logic puzzles in ways other contemporary models do not.

    It seems that the larger training data set allows for better modeling around the fancy autocomplete parts, but even other similarly sized models like Mistral appear to have developed better underlying critical thinking capacities when you scratch below the surface that are absent here.

    I don’t think it’s a coincidence that Meta’s lead AI researcher is one of the loudest voices criticizing the views around emergent capabilities. There seems to be a degree of self-fulfilling prophecy going on. A lot of useful learnings in the creation of Llama 3, but once other models (i.e. Mistral) also start using extended training my guess is that any apparent advantages to Llama 3 right now are going to go out the window.

  • AutoTL;DR@lemmings.worldB
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    2 months ago

    This is the best summary I could come up with:


    Meta launched the latest iteration of its AI chatbot on Thursday with Llama 3, and CEO Mark Zuckerberg says it’s supposed to be really good.

    The new model boasts “state-of-the-art” performance on various industry-standard benchmarks and comes with “improved reasoning,” according to a company blog post.

    “In terms of all of the concerns around the more existential risks, I don’t think that anything at the level of what we or others in the field are working on in the next year is really in the ballpark of those types of risks,” he told the publication.

    It’s one reason Zuckerberg feels that the company can continue making Llama open-source or available for the public or researchers to tinker with.

    If Meta’s model achieves multimodality — meaning the ability to deliver results in various forms of media, including text, images, and video — then that may be a case when the company won’t want to make all aspects of its model open-source, Zuckerberg said.

    "For example, image generation is one that we’re looking at closely Especially in an election year, is that a net positive thing to do?


    The original article contains 314 words, the summary contains 186 words. Saved 41%. I’m a bot and I’m open source!

  • BetaDoggo_@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 months ago

    The 8B is incredible for it’s size and they’ve managed to do sane refusal training this time for the official instruct.