Hugging Face is the main public registry for open machine-learning models and datasets. Each model lives in a git repository (with large files stored through Git LFS or the newer Xet storage) that holds weights, tokenizer files, configuration, and a model card. The Python libraries huggingface_hub, transformers, diffusers, datasets, and sentence-transformers download those repositories on demand into a local cache and load them with a single call. This page is a working control panel: the account settings, gated model approvals, and model repositories used in local experiments, plus links to the deeper pages in this folder.
Public models need no account at all. Gated models need two things: your account must have accepted the model's license on its Hub page, and requests must carry a token, typically set once with huggingface-cli login or the HF_TOKEN environment variable. Downloads are cached by repository and revision, so the second load is local; pin a revision (a commit hash) in production so a later push to the repository cannot silently change the weights you run.
from huggingface_hub import snapshot_download
from sentence_transformers import SentenceTransformer
# Download a specific revision of a repo into the local cache (token read from HF_TOKEN)
path = snapshot_download("sentence-transformers/all-MiniLM-L6-v2")
print(path)
model = SentenceTransformer("sentence-transformers/all-MiniLM-L6-v2")
vecs = model.encode(["Hugging Face hosts models", "The Hub stores datasets"])
print(vecs.shape) # (2, 384)
| Job | Model family below | Notes |
|---|---|---|
| Chat, reasoning, tool calling | Meta Llama instruct models | 3B suits laptops; 8B is a stronger RAG baseline |
| Input/output safety checks | Llama Guard | Classifier, not a chat model |
| Image generation | Stable Diffusion 3.5, FLUX.1 | Load through diffusers; large VRAM or unified memory |
| Embeddings for search and RAG | MiniLM, BGE | MiniLM for speed, BGE-large for retrieval quality |
| Running on Apple Silicon | MLX-LM, TorchAO | Quantized local inference within unified memory |
32GB Mac Optimized Environment | Master's AI Workflow
Usage: Key management tokens and license tracking.
| Resource | Function | Link |
|---|---|---|
| Access Log In | Hugging Face – The AI community | huggingface.co/login |
| Access Tokens | API authentication for PySpark/Databricks. | Settings/Tokens |
| Gated Access | Meta, Stability, and Black Forest permission tracker. | Gated-Repos |
Usage: Primary reasoning engines for local agents and data pipelines.
| Model Repo | Description | Direct Link | Status |
|---|---|---|---|
| Llama 3.2 3B Instruct | Lightweight, optimized for local Mac edge-inference. | meta-llama/Llama-3.2-3B-Instruct | ACCEPTED |
| Llama 3.0 8B Instruct | Standard baseline for RAG and complex tool calling. | meta-llama/Meta-Llama-3-8B-Instruct | ACCEPTED |
| Llama Guard 2 8B | Safety classifier for input/output monitoring. | meta-llama/Meta-Llama-Guard-2-8B | ACCEPTED |
Usage: High-fidelity diffusion for professional visual synthesis.
| Model Family | Specific Model Repo | Status |
|---|---|---|
| Stable Diffusion 3.5 | SD 3.5 Large | Turbo | ACCEPTED |
| FLUX.1 | FLUX.1 [schnell] | ACCEPTED |
Usage: Performance frameworks for 32GB Unified Memory.
| Framework | Benefit | Repo Link |
|---|---|---|
| Apple MLX-LM | Native Apple Silicon performance; bypasses PyTorch overhead. | MLX GitHub |
| TorchAO | Architecture optimization; enables INT4/FP8 on Mac GPU. | TorchAO GitHub |
Usage: High-speed vectorization for RAG and PySpark pipelines.
| Model | Strengths | Repo Link |
|---|---|---|
| all-MiniLM-L6-v2 | The Speed King. Ultra-fast, low latency for RAG search. | MiniLM Hub |
| BGE-Large-en-v1.5 | SOTA dense retrieval for large document databases. | BGE Hub |