36 lines
1.6 KiB
HTML
36 lines
1.6 KiB
HTML
<p className="align-right date">Feb 17, 2023</p>
|
|
<h2 class="title">Cartman</h2>
|
|
<ul>
|
|
<li><a href="https://github.com/adoyle0/chatbots">Cartman</a> is trained by combining Microsoft's
|
|
<a href="https://huggingface.co/microsoft/DialoGPT-large">DialoGPT-large</a>
|
|
NLP model (trained on 147M samples of multi-turn dialogue from Reddit) with 17 seasons of
|
|
<a href="https://southparkstudios.com">South Park</a>
|
|
transcripts.
|
|
</li>
|
|
<li>
|
|
<p>
|
|
Requests are routed from
|
|
<a href="https://nginx.com">Nginx</a>
|
|
through
|
|
<a href="https://www.wireguard.com">WireGuard</a>
|
|
to a
|
|
<a href="https://www.tomshardware.com/news/raspberry-pi-4-8gb-tested">Raspberry Pi 4B 8GB</a>
|
|
running
|
|
<a href="https://fastapi.tiangolo.com">FastAPI</a>,
|
|
and the Cartman model using <a href="https://pytorch.org">PyTorch</a>.
|
|
It has enough RAM for more, but the CPU is pretty much at its limit. Expect it to take a few
|
|
seconds, I'm cheap. Sorry(kinda).
|
|
</p>
|
|
</li>
|
|
</ul>
|
|
<p>
|
|
You can download a Docker image if you'd like to run it on your own hardware for either
|
|
<a href="https://doordesk.net/files/chatbots_api_x86_64.tar.gz">x86_64</a>
|
|
or
|
|
<a href="https://doordesk.net/files/chatbots_api_aarch64.tar.gz">aarch64</a>.
|
|
</p>
|
|
<p>
|
|
More info <a href="https://github.com/adoyle0/cartman">here</a> as well as
|
|
<a href="https://github.com/adoyle0/cartman/tree/master/api/test">example scripts</a>
|
|
to talk to the docker container.
|
|
</p>
|