Skip to main content Link Menu Expand (external link) Document Search Copy Copied

Project reseach - ai chatting • 2 min read

Description

the reseach that i did for the ai part of Place

Ollama

  • have used this in a side project but only in local host, i do not know to deploy it on a server and connect it to a website.

image

ollama 2

  • found an open source ai model

297964066-d5950ecc-f2fc-47bf-ae23-0167a75eec72

Pros:

  • understands general questions + answers them without beating around the bush

Screenshot 2024-01-21 at 1 05 17 PM

  • answers general questions

Screenshot 2024-01-21 at 1 07 41 PM

Screenshot 2024-01-21 at 1 09 27 PM

Screenshot 2024-01-21 at 1 01 48 PM

  • answers specific questions but it could also be a coincidence

Cons:

  • tried running the ai model on my pi but the 4 gigs was not enough to run it.
  • it even maxed out the swap partition.
  • where will i run the model?
    • is mr. mort’s server’s powerful enough?

phi

  • i found a 2.7b model that is 1.6 gigs that will prob work with a pi and possibly on a server

image

example responses from the model:

image

Screenshot 2024-01-21 at 12 57 05 PM

response time takes less than a second and the model is accurate. this might be the model that i will use.

cons:

Screenshot 2024-01-21 at 12 59 40 PM

  • talks too much
  • doesnt know what to say

Screenshot 2024-01-21 at 1 00 58 PM

Screenshot 2024-01-21 at 1 01 48 PM

  • provides false information
  • doesnt understand general questions.