Commit History

  1. fault-free model loading

    6e8312c
  2. add storage indicator

    cc91a1a
  3. improve model management

    0813164
  4. improve storage management

    37ee1f3
  5. provide more models, secure memory usage

    cd26609
  6. increase context length to 2048

    56919fd
  7. switch to 7b model

    ea7adad

  1. switch to 3b q2 model

    88b1f39
  2. adjust thread numbers

    4443d46
  3. switch to 1.5b

    4d633ef
  4. fix model id

    8287454
  5. Add app.py & requirements.txt

    0ff6c39