StrawberryPigtails@lemmy.sdf.org to Technology@lemmy.worldEnglish · 8 months agoIntroducing the Nextcloud AI Assistant - local, privacy-respecting, and fully open source 🎉youtu.beexternal-linkmessage-square32fedilinkarrow-up1188arrow-down117
arrow-up1171arrow-down1external-linkIntroducing the Nextcloud AI Assistant - local, privacy-respecting, and fully open source 🎉youtu.beStrawberryPigtails@lemmy.sdf.org to Technology@lemmy.worldEnglish · 8 months agomessage-square32fedilink
minus-squarepixxelkick@lemmy.worldcakelinkfedilinkEnglisharrow-up2·8 months agoYeah sorry I was specifically referring to the on prem LLM if that wasnt clear, and how much juice running that thing takes.
minus-squareDave@lemmy.nzlinkfedilinkEnglisharrow-up4·8 months agoSome of the other Nextcloud stuff (like that chat stuff) isn’t suitable on Raspberry Pi, I expect this will be the same. It’s released though, right? Might have to have a play.
minus-squareEatYouWell@lemmy.worldlinkfedilinkEnglisharrow-up2·8 months agoYou’d be surprised at how little computing power it can take, depending on the LLM.
Yeah sorry I was specifically referring to the on prem LLM if that wasnt clear, and how much juice running that thing takes.
Some of the other Nextcloud stuff (like that chat stuff) isn’t suitable on Raspberry Pi, I expect this will be the same. It’s released though, right? Might have to have a play.
You’d be surprised at how little computing power it can take, depending on the LLM.