{
  "contentStorage": "postgres",
  "title": "Llama",
  "description": "Llama 是 Meta 于 2023 年 2 月 24 日发布的首代 Llama 基础大模型，仅用公开数据集训练。",
  "url": "/it/works/llama/at/1.html",
  "entity": {
    "id": "work_llama",
    "type": "work",
    "title": "Llama",
    "slug": "llama",
    "summary": "Llama 是 Meta 于 2023 年 2 月 24 日发布的首代 Llama 基础大模型，仅用公开数据集训练。",
    "status": "published",
    "categories": [
      "category-science-technology"
    ],
    "tags": [],
    "sources": [
      {
        "id": "s1",
        "title": "Introducing LLaMA: A foundational, 65-billion-parameter language model — Meta AI",
        "url": "https://ai.meta.com/blog/large-language-model-llama-meta-ai/"
      },
      {
        "id": "s2",
        "title": "LLaMA: Open and Efficient Foundation Language Models — arXiv:2302.13971",
        "url": "https://arxiv.org/abs/2302.13971v1"
      },
      {
        "id": "s3",
        "title": "LLaMA — Hugging Face Transformers documentation (max_position_embeddings 2048)",
        "url": "https://huggingface.co/docs/transformers/en/model_doc/llama"
      },
      {
        "id": "s4",
        "title": "Llama (language model) — Wikipedia",
        "url": "https://en.wikipedia.org/wiki/Llama_(language_model)"
      }
    ],
    "createdAt": "2026-11-10T15:05:08+08:00",
    "updatedAt": "2026-11-10T15:05:08+08:00",
    "updatedBy": "user:admin",
    "revision": 1,
    "body": "Llama 是 Meta 于 2023 年 2 月 24 日发布的首代 Llama 基础大模型，仅用公开数据集训练。[^s1]\n\n## 发布背景\n发布时上下文窗口为2,048 tokens。[^s1]\n7B、13B、33B、65B 四个尺寸，仅用公开数据集训练，7B/13B 为 1.0 万亿 token，33B/65B 为 1.4 万亿 token。[^s1]\n\n## 定价与获取\n非商业研究许可、逐案申请获取，非完全开源、无官方 API 与定价；仅为基础模型，未发布官方对话微调版。[^s1]\n\n## 性能表现\n以下为Meta公布的自家评测结果，尚未经独立复现。[^s1]\n- MMLU (5-shot, LLaMA-65B)：63.4%（低于 Chinchilla-70B 的 67.5% 和 PaLM-540B 的 69.3%）[^s1]\n- HellaSwag (zero-shot, LLaMA-65B)：84.2%（高于 PaLM-540B 的 83.4%，低于 Chinchilla-70B 在常识推理多数任务上的表现之外的一个例外）[^s1]\n- GSM8k (LLaMA-65B)：50.9%（低于 Minerva-62B 的 52.4% 和 PaLM-540B 的 56.5%，但论文称其未做数学微调仍胜过 Minerva-62B 的多数投票外表现表述需以原文为准）[^s1]\n- HumanEval pass@1 (LLaMA-65B)：23.7%（高于 PaLM-62B 的 15.9%，低于 PaLM-540B 的 26.2%）[^s1]\n\n## 主要特点\n- 后继为 2023-07-18 发布的 Llama 2（7B/13B/70B），首次允许商业使用，上下文扩至 4,096 token。[^s1]\n\n## 定位与后续\nMeta Llama 系列第一代基础大模型，开创了小模型多 token 训练路线，其后继为允许商业使用的 Llama 2 及 Llama 3/4 系列。[^s1]",
    "url": "/works/llama.html",
    "lang": "it",
    "sourceLang": "zh",
    "fallback": true,
    "availableLangs": [
      "zh"
    ],
    "workKind": "ai_model"
  },
  "entities": null,
  "relations": [
    {
      "id": "relation_work_llama_published_by_meta",
      "fromId": "work_llama",
      "relationType": "published_by",
      "toId": "organization_meta",
      "sourceRefs": [
        {
          "entityId": "work_llama",
          "sourceId": "s1"
        }
      ],
      "label": "Published by",
      "targetId": "organization_meta",
      "targetTitle": "Meta",
      "targetUrl": "/it/organizations/meta.html",
      "incoming": false
    }
  ],
  "versions": [
    {
      "revision": 1,
      "updatedAt": "2026-11-10T15:05:08+08:00",
      "message": "当前版本",
      "hasSnapshot": true,
      "url": "/it/works/llama/at/1.html"
    }
  ],
  "viewRevision": 1,
  "lang": "it",
  "availableLangs": [
    "zh"
  ],
  "fallback": true,
  "infoFields": [
    {
      "key": "work_kind",
      "label": "Work kind",
      "value": "Modello di IA"
    }
  ],
  "relationsTotal": 1,
  "relationCounts": [
    {
      "relationType": "published_by",
      "incoming": false,
      "label": "Published by",
      "total": 1
    }
  ]
}