My approach to problems like this is to write down the proposed model mathematically first, in extreme detail. I find hierarchical form to be the easiest way to break it down piece by piece. Once I have the maths then I turn it into a Stan model. Last step is to use the Stan output to answer the research questions. Source: 12 months ago

For instance my first choice in these cases is always a Bayesian inference tool like Stan. In my experience as someone who’s more of a programmer than mathematician/statistician, Bayesian tools like this make it much easier to not accidentally fool yourself with assumptions, and they can be pretty good at catching statistical mistakes. Source: about 1 year ago

I tend to be most impressed by tools and libraries. The stuff that has most impressed me in my time in ML is stuff like pytorch and Stan, tools that allow expression of a wide variety of statistical (and ML, DL models, if you believe there's a distinction) models and inference from those models. These are the things that have had the largest effect in my own work, not in the sense of just using these tools, but... Source: about 1 year ago

Oh its certainly used in practice. You should look into frameworks like Stan[1] and pyro[2]. I think bayesian models are seen as more explainable so they will be used in industries that value that sort of thing [1] https://mc-stan.org/. - Source: Hacker News / about 1 year ago

At this point the only people using such things are the programmers. Think e.g. STAN. https://mc-stan.org/ the rest of us: R, SAS, Excel. Source: about 1 year ago

For my fellow Windows shills, here's how you actually build it on windows: Before steps: 1. (For Nvidia GPU users) Install cuda toolkit https://developer.nvidia.com/cuda-downloads 2. Download the model somewhere: https://huggingface.co/TheBloke/Llama-2-13B-chat-GGML/resolve/main/llama-2-13b-chat.ggmlv3.q4_0.bin In Windows Terminal with Powershell:

    git clone https://github.com/ggerganov/llama.cpp.

- Source: Hacker News / 10 months ago

I use Ubuntu and configuring nvidia drivers is very easy installing from here https://developer.nvidia.com/cuda-downloads. Source: 11 months ago

You have posted almost no information about your Hardware and what exactly you have done. Do you actually have NVIDIA? Have you actually installed CUDA? Also when exactly do you get the error, while installed the python package or later? Source: 11 months ago

EDIT: LINK TO CUDA-toolkit: https://developer.nvidia.com/cuda-downloads. Source: 12 months ago

It's worth noting that you'll need a recent release of llama.cpp to run GGML models with GPU acceleration here is the latest build for CUDA 12.1), and you'll need to install a recent CUDA version if you haven't already (here is the CUDA 12.1 toolkit installer -- mind, it's over 3 GB). Source: about 1 year ago