Flounder: Nov 2024 LLM Hack Day

Date/Time
Date(s) - November 10, 2024
1:00 pm - 2:30 pm

Categories

November event LLM hack day. Russell will talk about AI/LLMs and provide access to a server running CUDA with some LLMs installed. Hands on experience using an NVidia GPU for LLM.

Meeting will be at http://b.coker.com.au. No need to register just click on the link on the day.

Meeting officially opens at 1PM Melbourne time (02:00UTC), 10th of November.

Some useful URLs:

• https://huggingface.co/microsoft/phi-2 – Microsoft Phi-2 LLM – needs almost 12G of GPU RAM.
• https://github.com/ggerganov/llama.cpp – Running the Llama model via a C++ program.
• https://boinc.berkeley.edu/wiki/GPU_computing – how to donate your GPU power to research projects via BIONC.