{ "schemaVersion": 2, "runId": "7b1432b7-7796-46eb-a8ec-9b4a6d2c8712", "fixtureIds": [ "gmod.ents-iterator.v1", "gmod.hook-add.v1", "gmod.isvalid.v1", "gmod.net-receivers.v1", "gmod.player-iterator.v1" ], "startedAt": "2026-07-10T12:39:25.296Z", "completedAt": "2026-07-10T12:57:18.796Z", "repeat": 1, "concurrency": 2, "attempts": [ { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "cognitivecomputations/dolphin-mistral-24b-venice-edition:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 1029, "version": "openrouter-api" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "cognitivecomputations/dolphin-mistral-24b-venice-edition:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 693, "version": "openrouter-api" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "cognitivecomputations/dolphin-mistral-24b-venice-edition:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 610, "version": "openrouter-api" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "cognitivecomputations/dolphin-mistral-24b-venice-edition:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 624, "version": "openrouter-api" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "cognitivecomputations/dolphin-mistral-24b-venice-edition:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 596, "version": "openrouter-api" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "cohere/north-mini-code:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter message content was empty or missing.", "finalResponse": null, "durationMs": 20276, "version": "openrouter-api", "usage": { "generationId": "gen-1783687177-RrHh6wtwNdVuV5HH5Fkq", "promptTokens": 160, "completionTokens": 1024, "totalTokens": 1184, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "cohere/north-mini-code:free", "attemptIndex": 1, "status": "pass", "detail": "Registers a named hook with hook.Add.", "finalResponse": "```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function()\n -- Minimal callback body\nend)\n```\nReason: Registers the function as a Think hook callback with the identifier MyAddon.Think.", "durationMs": 5793, "version": "openrouter-api", "usage": { "generationId": "gen-1783687186-imwKsjfNTeV2RTDfDY2n", "promptTokens": 169, "completionTokens": 500, "totalTokens": 669, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "cohere/north-mini-code:free", "attemptIndex": 1, "status": "pass", "detail": "Uses IsValid for entity/object validity.", "finalResponse": "```lua\nif ent and ent:IsValid() then\n -- safe to use ent\nend\n```\nReason: This checks both that ent exists and that it hasn't been removed or destroyed, ensuring the entity is still valid before using it.", "durationMs": 8227, "version": "openrouter-api", "usage": { "generationId": "gen-1783687192-J5bVEvYmrungKUW4AXap", "promptTokens": 166, "completionTokens": 613, "totalTokens": 779, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "cohere/north-mini-code:free", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nnet.Receive(\"MyAddon.Sync\", function(length)\n -- handle incoming net message\n local data = net.ReadString()\n print(\"MyAddon.Sync received:\", data)\nend)\n```\nReason: Registers a net message handler for \"MyAddon.Sync\" using net.Receive.", "durationMs": 4389, "version": "openrouter-api", "usage": { "generationId": "gen-1783687198-lXK1q1d2s7mrvtknRMs9", "promptTokens": 161, "completionTokens": 550, "totalTokens": 711, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "cohere/north-mini-code:free", "attemptIndex": 1, "status": "partial", "detail": "Still materializes player.GetAll().", "finalResponse": "```lua\nlocal plys = player.GetAll()\nfor i = 1, #plys do\n local v = plys[i]\n -- your code here\nend\n```\nReason: Storing the player table locally and iterating by numeric index reduces the overhead of `pairs` and improves performance.", "durationMs": 10699, "version": "openrouter-api", "usage": { "generationId": "gen-1783687200-OsLcmPJ8b8Q4hSy1s0o8", "promptTokens": 163, "completionTokens": 750, "totalTokens": 913, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "google/gemma-4-26b-a4b-it:free", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor _, ent in ipairs(ents.FindByClass(\"prop_physics\")) do\n -- code here\nend\n```\n\nReason: ents.FindByClass is the built-in engine function designed to return a table of entities matching a specific class, which is more efficient than iterating through all entities and checking their class manually.", "durationMs": 3352, "version": "openrouter-api", "usage": { "generationId": "gen-1783687202-f2o4TtFHDr7IlAh6AAGy", "promptTokens": 166, "completionTokens": 70, "totalTokens": 236, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "google/gemma-4-26b-a4b-it:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 1155, "version": "openrouter-api" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "google/gemma-4-26b-a4b-it:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 671, "version": "openrouter-api" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "google/gemma-4-26b-a4b-it:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 738, "version": "openrouter-api" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "google/gemma-4-26b-a4b-it:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 289, "version": "openrouter-api" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "google/gemma-4-31b-it:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 1515, "version": "openrouter-api" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "google/gemma-4-31b-it:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 982, "version": "openrouter-api" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "google/gemma-4-31b-it:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 2093, "version": "openrouter-api" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "google/gemma-4-31b-it:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 884, "version": "openrouter-api" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "google/gemma-4-31b-it:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 993, "version": "openrouter-api" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 143, "version": "openrouter-api" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 502.", "finalResponse": null, "durationMs": 257, "version": "openrouter-api" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 133, "version": "openrouter-api" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 139, "version": "openrouter-api" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 249, "version": "openrouter-api" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-thinking:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 144, "version": "openrouter-api" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-thinking:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 299, "version": "openrouter-api" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-thinking:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 243, "version": "openrouter-api" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-thinking:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 502.", "finalResponse": null, "durationMs": 364, "version": "openrouter-api" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-thinking:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 502.", "finalResponse": null, "durationMs": 264, "version": "openrouter-api" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.2-3b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 716, "version": "openrouter-api" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.2-3b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 638, "version": "openrouter-api" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.2-3b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 625, "version": "openrouter-api" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.2-3b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 664, "version": "openrouter-api" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.2-3b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 666, "version": "openrouter-api" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.3-70b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 1513, "version": "openrouter-api" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.3-70b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 1023, "version": "openrouter-api" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.3-70b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 1054, "version": "openrouter-api" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.3-70b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 920, "version": "openrouter-api" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.3-70b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 621, "version": "openrouter-api" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nousresearch/hermes-3-llama-3.1-405b:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 645, "version": "openrouter-api" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nousresearch/hermes-3-llama-3.1-405b:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 627, "version": "openrouter-api" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nousresearch/hermes-3-llama-3.1-405b:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 670, "version": "openrouter-api" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nousresearch/hermes-3-llama-3.1-405b:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 695, "version": "openrouter-api" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nousresearch/hermes-3-llama-3.1-405b:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 742, "version": "openrouter-api" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-30b-a3b:free", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor _, ent in ipairs(ents.FindByClass(\"prop_physics\")) do\n -- your code here\nend\n```\nReason: Uses FindByClass's iterator to avoid building a full table.", "durationMs": 36915, "version": "openrouter-api", "usage": { "generationId": "gen-1783687358-AByJC0q1OgcRwOixvwXX", "promptTokens": 183, "completionTokens": 636, "totalTokens": 819, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-30b-a3b:free", "attemptIndex": 1, "status": "pass", "detail": "Registers a named hook with hook.Add.", "finalResponse": "```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function() end)\n```\nReason: Registers a Think hook callback using the identifier MyAddon.Think.", "durationMs": 3240, "version": "openrouter-api", "usage": { "generationId": "gen-1783687362-B4TarmRIF0J78idWLajO", "promptTokens": 191, "completionTokens": 443, "totalTokens": 634, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-30b-a3b:free", "attemptIndex": 1, "status": "pass", "detail": "Uses IsValid for entity/object validity.", "finalResponse": "```lua\nif IsValid(ent) then\n -- safe to use ent\nend\n```\nReason: IsValid checks that the entity still exists and hasn't been removed.", "durationMs": 6295, "version": "openrouter-api", "usage": { "generationId": "gen-1783687365-EOlvcS7EPDfp2qowsmC2", "promptTokens": 189, "completionTokens": 418, "totalTokens": 607, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-30b-a3b:free", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nnet.Receive(\"MyAddon.Sync\", function(len, ply)\n -- handle the incoming net message\nend)\n```\nReason: registers a receiver for net messages named MyAddon.Sync", "durationMs": 2564, "version": "openrouter-api", "usage": { "generationId": "gen-1783687371-OptvP6kePjUvCmQwsqWR", "promptTokens": 186, "completionTokens": 223, "totalTokens": 409, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-30b-a3b:free", "attemptIndex": 1, "status": "partial", "detail": "Still materializes player.GetAll().", "finalResponse": "```lua\nlocal players = player.GetAll()\nfor _, ply in ipairs(players) do\n -- your code here\nend\n```\nReason: Cache player list and use ipairs for speed.", "durationMs": 7807, "version": "openrouter-api", "usage": { "generationId": "gen-1783687374-xYmVym7IwXdmeeuOKFto", "promptTokens": 185, "completionTokens": 836, "totalTokens": 1021, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free", "attemptIndex": 1, "status": "timeout", "detail": "HTTP request exceeded the attempt timeout.", "finalResponse": null, "durationMs": 120002, "version": "openrouter-api" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free", "attemptIndex": 1, "status": "timeout", "detail": "HTTP request exceeded the attempt timeout.", "finalResponse": null, "durationMs": 120002, "version": "openrouter-api" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free", "attemptIndex": 1, "status": "timeout", "detail": "HTTP request exceeded the attempt timeout.", "finalResponse": null, "durationMs": 120002, "version": "openrouter-api" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free", "attemptIndex": 1, "status": "timeout", "detail": "HTTP request exceeded the attempt timeout.", "finalResponse": null, "durationMs": 120002, "version": "openrouter-api" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free", "attemptIndex": 1, "status": "timeout", "detail": "HTTP request exceeded the attempt timeout.", "finalResponse": null, "durationMs": 120002, "version": "openrouter-api" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@medium", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor _, ent in ipairs(ents.FindByClass(\"prop_physics\")) do\n -- Perform actions on each prop_physics entity here\nend\n```\nReason: ents.FindByClass returns only entities matching the class, so we avoid constructing a table of all entities first.", "durationMs": 6028, "version": "openrouter-api", "usage": { "generationId": "gen-1783687635-Kh0MFFkzmbrQRT5SA1Pn", "promptTokens": 183, "completionTokens": 396, "totalTokens": 579, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@medium", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain exactly one fenced code block followed by a reason.", "finalResponse": "```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function()\n -- Callback body\nend)\nReason: hook.Add registers a Think hook callback with the identifier MyAddon.Think.\n```", "durationMs": 7289, "version": "openrouter-api", "usage": { "generationId": "gen-1783687641-CZOJnj0gFA4e58xRsYLj", "promptTokens": 191, "completionTokens": 353, "totalTokens": 544, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@medium", "attemptIndex": 1, "status": "pass", "detail": "Uses IsValid for entity/object validity.", "finalResponse": "```lua\nif IsValid(ent) then\n -- ent is valid, safe to call methods on it\nend\n```\nReason: IsValid checks that the entity exists and hasn't been removed, returning false for nil or invalid references, thus preventing runtime errors when calling methods.", "durationMs": 7318, "version": "openrouter-api", "usage": { "generationId": "gen-1783687648-gLXOzT8nksymsUW9KxH5", "promptTokens": 189, "completionTokens": 311, "totalTokens": 500, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@medium", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nnet.Receive(\"MyAddon.Sync\", function(len)\n -- Handle the incoming message\n local data = net.ReadString()\n -- Process data as needed\nend)\n```\nReason: net.Receive registers a receiver for the named net message, allowing the server/client to process incoming data.", "durationMs": 5797, "version": "openrouter-api", "usage": { "generationId": "gen-1783687655-aPljzbXPWY6UJG79s7vj", "promptTokens": 186, "completionTokens": 365, "totalTokens": 551, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@medium", "attemptIndex": 1, "status": "partial", "detail": "Still materializes player.GetAll().", "finalResponse": "```lua\nlocal pls = player.GetAll()\nfor i = 1, #pls do\n local ply = pls[i]\n -- your code here\nend\n```\nReason: Caching the player table and using a numeric for loop avoids hash lookups and repeated function calls, making it faster than pairs.", "durationMs": 5349, "version": "openrouter-api", "usage": { "generationId": "gen-1783687661-MUOTI5eCUs5N2yZN8HeH", "promptTokens": 185, "completionTokens": 508, "totalTokens": 693, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@low", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain exactly one fenced code block followed by a reason.", "finalResponse": "```lua\nfor _, ent in ipairs(ents.FindByClass(\"prop_physics\")) do\n -- your code here\nend\nReason: ents.FindByClass returns a table of only the matching entities, so you don't need to iterate over all entities first.\n```", "durationMs": 22064, "version": "openrouter-api", "usage": { "generationId": "gen-1783687666-fsyd34ZJtsEYTfJ9T1lk", "promptTokens": 183, "completionTokens": 574, "totalTokens": 757, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@low", "attemptIndex": 1, "status": "pass", "detail": "Registers a named hook with hook.Add.", "finalResponse": "```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function()\n -- Callback body (can be empty or minimal)\nend)\n```\nReason: hook.Add registers a function to the Think hook with the unique identifier MyAddon.Think.", "durationMs": 3076, "version": "openrouter-api", "usage": { "generationId": "gen-1783687688-pgczstecqK0Hh4FZjd9B", "promptTokens": 191, "completionTokens": 222, "totalTokens": 413, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@low", "attemptIndex": 1, "status": "pass", "detail": "Uses IsValid for entity/object validity.", "finalResponse": "```lua\nif IsValid(ent) then\n -- ent is valid, you can safely call its methods here\nend\n```\nReason: IsValid returns true only when the entity reference points to a living, non‑removed entity, preventing errors from calling methods on nil or invalid entities.", "durationMs": 3767, "version": "openrouter-api", "usage": { "generationId": "gen-1783687691-IZOTcurFgcIC0NFtUcDi", "promptTokens": 189, "completionTokens": 233, "totalTokens": 422, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@low", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nnet.Receive(\"MyAddon.Sync\", function(len)\n -- Example handling: read a string and print it\n local msg = net.ReadString()\n print(\"MyAddon.Sync received:\", msg)\nend)\n```\nReason: Registers a receiver for the net message named MyAddon.Sync using net.Receive, which will be called whenever a message with that name is sent.", "durationMs": 6744, "version": "openrouter-api", "usage": { "generationId": "gen-1783687695-Np1uwlCdaPg7jZgiy5h2", "promptTokens": 186, "completionTokens": 291, "totalTokens": 477, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@low", "attemptIndex": 1, "status": "partial", "detail": "Still materializes player.GetAll().", "finalResponse": "```lua\nlocal players = player.GetAll()\nfor i = 1, #players do\n local ply = players[i]\n -- your code here\nend\n```\nReason: A numeric for loop avoids the iterator overhead of pairs/ipairs and directly indexes the array part of the table, which is faster for iterating over all players.", "durationMs": 6095, "version": "openrouter-api", "usage": { "generationId": "gen-1783687702-PpCgQs43xTAP3n3h2ROm", "promptTokens": 185, "completionTokens": 426, "totalTokens": 611, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@high", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor _, ent in ents.Iterator() do\n if ent:GetClass() == \"prop_physics\" then\n -- process ent\n end\nend\n```\nReason: `ents.Iterator()` yields entities one by one without allocating a table of all entities, making it memory‑efficient for large entity counts.", "durationMs": 16424, "version": "openrouter-api", "usage": { "generationId": "gen-1783687708-bnxojsrnSNOyr4qJTaHm", "promptTokens": 183, "completionTokens": 694, "totalTokens": 877, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@high", "attemptIndex": 1, "status": "pass", "detail": "Registers a named hook with hook.Add.", "finalResponse": "```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function()\n -- Your think logic here\nend)\n```\nReason: Registers a Think hook with the unique identifier \"MyAddon.Think\" so the callback runs every frame.", "durationMs": 3453, "version": "openrouter-api", "usage": { "generationId": "gen-1783687724-bAIbtuGjMxwNbg7my7MG", "promptTokens": 191, "completionTokens": 303, "totalTokens": 494, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@high", "attemptIndex": 1, "status": "pass", "detail": "Uses IsValid for entity/object validity.", "finalResponse": "```lua\nif IsValid(ent) then\n -- ent is valid, safe to call methods\nend\n```\nReason: IsValid is the global function provided by Garry's Mod to reliably check if an entity exists and hasn't been removed.", "durationMs": 2903, "version": "openrouter-api", "usage": { "generationId": "gen-1783687728-aUB4pFPX1Vhfr14fjDxD", "promptTokens": 189, "completionTokens": 454, "totalTokens": 643, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@high", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nnet.Receive(\"MyAddon.Sync\", function(len, ply)\n -- Handle the incoming net message here\nend)\n```\nReason: Registers a net message receiver for \"MyAddon.Sync\" to handle incoming network messages with that name.", "durationMs": 4063, "version": "openrouter-api", "usage": { "generationId": "gen-1783687731-eNZZT35LEtcXeXdVQvEk", "promptTokens": 186, "completionTokens": 394, "totalTokens": 580, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@high", "attemptIndex": 1, "status": "partial", "detail": "Still materializes player.GetAll().", "finalResponse": "```lua\nlocal players = player.GetAll()\nfor i = 1, #players do\n local ply = players[i]\n -- your code here\nend\n```\nReason: A numeric for loop over the array returned by player.GetAll() avoids iterator overhead and is faster in LuaJIT.", "durationMs": 4774, "version": "openrouter-api", "usage": { "generationId": "gen-1783687735-T07lFPq4eDm7MsbxcPhK", "promptTokens": 185, "completionTokens": 670, "totalTokens": 855, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@medium", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor _, ent in ipairs(ents.FindByClass(\"prop_physics\")) do\n -- process ent\nend\n```\nReason: `ents.FindByClass` performs the class filtering in C++ and returns only matching entities, avoiding a full iteration of all entities in Lua.", "durationMs": 23908, "version": "openrouter-api", "usage": { "generationId": "gen-1783687740-8jiY3tqQ5hG82M3mq6eG", "promptTokens": 183, "completionTokens": 1988, "totalTokens": 2171, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@medium", "attemptIndex": 1, "status": "pass", "detail": "Registers a named hook with hook.Add.", "finalResponse": "```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function() end)\n```\nReason: Registers a Think hook callback with the identifier MyAddon.Think using hook.Add.", "durationMs": 3662, "version": "openrouter-api", "usage": { "generationId": "gen-1783687742-MMsSbkO3CYe8D1mhJbos", "promptTokens": 191, "completionTokens": 381, "totalTokens": 572, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@medium", "attemptIndex": 1, "status": "pass", "detail": "Uses IsValid for entity/object validity.", "finalResponse": "```lua\nif IsValid(ent) then\n -- ent is valid, safe to call methods on it\nend\n```\nReason: `IsValid(ent)` returns true only if the entity exists and is not a NULL entity, preventing errors when calling methods on invalid references.", "durationMs": 4979, "version": "openrouter-api", "usage": { "generationId": "gen-1783687745-oW1KjtUXKBKOxUaH712p", "promptTokens": 189, "completionTokens": 452, "totalTokens": 641, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@medium", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nnet.Receive(\"MyAddon.Sync\", function(len, ply)\n -- Handle the incoming message here\n -- Example: local data = net.ReadTable()\nend)\n```\nReason: This registers a net receiver for the message name \"MyAddon.Sync\" using Garry's Mod's net library.", "durationMs": 4384, "version": "openrouter-api", "usage": { "generationId": "gen-1783687750-qDP2i2K7pqKiiFF2mFTa", "promptTokens": 186, "completionTokens": 480, "totalTokens": 666, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@medium", "attemptIndex": 1, "status": "partial", "detail": "Still materializes player.GetAll().", "finalResponse": "```lua\nlocal players = player.GetAll()\nfor i = 1, #players do\n local v = players[i]\n -- loop body\nend\n```\nReason: Numeric for loop with a cached table avoids pairs overhead and repeated function calls, yielding the fastest iteration over the sequential player array.", "durationMs": 25082, "version": "openrouter-api", "usage": { "generationId": "gen-1783687755-UBRWbXkctdqg7IBpaXUr", "promptTokens": 185, "completionTokens": 1333, "totalTokens": 1518, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3.5-content-safety:free", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain exactly one fenced code block followed by a reason.", "finalResponse": "User Safety: safe", "durationMs": 3138, "version": "openrouter-api", "usage": { "generationId": "gen-1783687764-NxUbU5HVNv3Wjcg3PCwr", "promptTokens": 526, "completionTokens": 250, "totalTokens": 776, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3.5-content-safety:free", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain exactly one fenced code block followed by a reason.", "finalResponse": "User Safety: safe", "durationMs": 2715, "version": "openrouter-api", "usage": { "generationId": "gen-1783687767-4HtUMqSXendDh1MzjIjB", "promptTokens": 535, "completionTokens": 213, "totalTokens": 748, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3.5-content-safety:free", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain exactly one fenced code block followed by a reason.", "finalResponse": "User Safety: safe", "durationMs": 3246, "version": "openrouter-api", "usage": { "generationId": "gen-1783687769-jKvGLSGSz6bGaKfT5Rfm", "promptTokens": 532, "completionTokens": 266, "totalTokens": 798, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3.5-content-safety:free", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain exactly one fenced code block followed by a reason.", "finalResponse": "User Safety: safe", "durationMs": 3359, "version": "openrouter-api", "usage": { "generationId": "gen-1783687773-2tNCz4Io8Yg1C8FnBBca", "promptTokens": 528, "completionTokens": 251, "totalTokens": 779, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3.5-content-safety:free", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain exactly one fenced code block followed by a reason.", "finalResponse": "User Safety: safe", "durationMs": 2701, "version": "openrouter-api", "usage": { "generationId": "gen-1783687776-3hc20HpaYm0VivVrXKNJ", "promptTokens": 529, "completionTokens": 162, "totalTokens": 691, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-12b-v2-vl:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter message content was empty or missing.", "finalResponse": null, "durationMs": 26287, "version": "openrouter-api", "usage": { "generationId": "gen-1783687780-2CUcoyx181IoR0Md9c2d", "promptTokens": 178, "completionTokens": 1024, "totalTokens": 1202, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-12b-v2-vl:free", "attemptIndex": 1, "status": "pass", "detail": "Registers a named hook with hook.Add.", "finalResponse": "```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function() return true end)\n```\nReason: `hook.Add` registers the callback with the specified identifier for the `Think` hook, ensuring it runs each frame.\n", "durationMs": 10738, "version": "openrouter-api", "usage": { "generationId": "gen-1783687780-yNBBUbKRh6BwYVaN8XQB", "promptTokens": 186, "completionTokens": 513, "totalTokens": 699, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-12b-v2-vl:free", "attemptIndex": 1, "status": "pass", "detail": "Uses IsValid for entity/object validity.", "finalResponse": "```lua\nif ent and ent:IsValid() then\n -- call methods here\nend\n```\nReason: Ensures `ent` is not nil and the entity is still valid before calling methods, preventing errors from invalid references.\n", "durationMs": 17350, "version": "openrouter-api", "usage": { "generationId": "gen-1783687791-tTebOgar5jqmW3HaymVp", "promptTokens": 184, "completionTokens": 608, "totalTokens": 792, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-12b-v2-vl:free", "attemptIndex": 1, "status": "timeout", "detail": "HTTP request exceeded the attempt timeout.", "finalResponse": null, "durationMs": 120002, "version": "openrouter-api" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-12b-v2-vl:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter message content was empty or missing.", "finalResponse": null, "durationMs": 21410, "version": "openrouter-api", "usage": { "generationId": "gen-1783687808-7WADfFv3B3WzMBWVzzLN", "promptTokens": 180, "completionTokens": 1024, "totalTokens": 1204, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-9b-v2:free", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain exactly one fenced code block followed by a reason.", "finalResponse": "\n\n```lua\nfor _, ent in ipairs(ents.FindByClass(\"prop_physics\")) do\n -- process ent\nend\n```\nReason: `ents.FindByClass` directly retrieves entities of the specified class, avoiding the need to iterate through all entities and filter them, which is more efficient.\n", "durationMs": 13943, "version": "openrouter-api", "usage": { "generationId": "gen-1783687829-fAcQTNTTok5Ppd0gEgyS", "promptTokens": 178, "completionTokens": 470, "totalTokens": 648, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-9b-v2:free", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain exactly one fenced code block followed by a reason.", "finalResponse": "\n\n```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function() end)\n```\nReason: Uses `hook.Add` with the \"Think\" hook name, the specified identifier \"MyAddon.Think\", and an empty callback function.\n", "durationMs": 5344, "version": "openrouter-api", "usage": { "generationId": "gen-1783687843-h1pGuecy0H1Kg8nyfp9s", "promptTokens": 186, "completionTokens": 311, "totalTokens": 497, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-9b-v2:free", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain exactly one fenced code block followed by a reason.", "finalResponse": "\n\n```lua\nIsValid(ent)\n```\nReason: `IsValid` checks if the entity reference is still active and valid in the game world.\n", "durationMs": 7317, "version": "openrouter-api", "usage": { "generationId": "gen-1783687849-s5cy11xLBoWfYfGg01zF", "promptTokens": 184, "completionTokens": 314, "totalTokens": 498, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-9b-v2:free", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain exactly one fenced code block followed by a reason.", "finalResponse": "\n\n```lua\nnet.Receive(\"MyAddon.Sync\", function(len, ...) end)\n```\nReason: The `net.Receive` function in Garry's Mod Lua is used to register a networked message receiver, where the first argument is the message name and the second is the callback function.\n", "durationMs": 8135, "version": "openrouter-api", "usage": { "generationId": "gen-1783687856-VxkyingrrYlbCyf98q7a", "promptTokens": 181, "completionTokens": 392, "totalTokens": 573, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-9b-v2:free", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain exactly one fenced code block followed by a reason.", "finalResponse": "\n\n```lua\nfor i, v in ipairs(player.GetAll()) do ... end\n```\nReason: `ipairs` is more efficient than `pairs` for ordered lists with consecutive integer keys, which `player.GetAll()` typically provides.\n", "durationMs": 14962, "version": "openrouter-api", "usage": { "generationId": "gen-1783687864-uDg3x4P7v33z06FbUEXi", "promptTokens": 180, "completionTokens": 785, "totalTokens": 965, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@high", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 2441, "version": "openrouter-api" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@high", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 2083, "version": "openrouter-api" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@high", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 2089, "version": "openrouter-api" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@high", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 2003, "version": "openrouter-api" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@high", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 2499, "version": "openrouter-api" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@medium", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 1935, "version": "openrouter-api" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@medium", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 2045, "version": "openrouter-api" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@medium", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 2040, "version": "openrouter-api" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@medium", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 4029, "version": "openrouter-api" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@medium", "attemptIndex": 1, "status": "partial", "detail": "Still materializes player.GetAll().", "finalResponse": "```lua\nlocal players = player.GetAll()\nfor i = 1, #players do\n local ply = players[i]\n -- your code here\nend\n```\nReason: Storing the player list once and iterating with a numeric for loop avoids the overhead of `pairs` and repeated `player.GetAll()` calls, giving the fastest traversal of the current players.", "durationMs": 16161, "version": "openrouter-api", "usage": { "generationId": "gen-1783687949-bHeyWzYvrDjqJ216LcPv", "promptTokens": 237, "completionTokens": 235, "totalTokens": 472, "cost": 0, "cachedTokens": 32, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@low", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nfor i = 1, #ents.GetAll() do\n local ent = ents.GetAll()[i]\n if ent:GetClass() == \"prop_physics\" then\n -- your code here\n end\nend\n```\nReason: This iterates directly over the global entity list without creating a separate table of only prop_physics entities.", "durationMs": 19519, "version": "openrouter-api", "usage": { "generationId": "gen-1783687964-U5EIPt8bwRG04FGROOXZ", "promptTokens": 235, "completionTokens": 242, "totalTokens": 477, "cost": 0, "cachedTokens": 64, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@low", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 2015, "version": "openrouter-api" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@low", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 2086, "version": "openrouter-api" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@low", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 1972, "version": "openrouter-api" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@low", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 2137, "version": "openrouter-api" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@high", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter error: Internal Server Error", "finalResponse": null, "durationMs": 10755, "version": "openrouter-api" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@high", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter error: Internal Server Error", "finalResponse": null, "durationMs": 10731, "version": "openrouter-api" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@high", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter error: Internal Server Error", "finalResponse": null, "durationMs": 10906, "version": "openrouter-api" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@high", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter error: Internal Server Error", "finalResponse": null, "durationMs": 10724, "version": "openrouter-api" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@high", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter error: Internal Server Error", "finalResponse": null, "durationMs": 10716, "version": "openrouter-api" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@medium", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter error: Internal Server Error", "finalResponse": null, "durationMs": 10697, "version": "openrouter-api" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@medium", "attemptIndex": 1, "status": "pass", "detail": "Registers a named hook with hook.Add.", "finalResponse": "```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function()\n -- callback body\nend)\n```\nReason: registers a Think hook with identifier MyAddon.Think.", "durationMs": 7865, "version": "openrouter-api", "usage": { "generationId": "gen-1783688024-h2WYk3dlxyEZoEw4T2F5", "promptTokens": 249, "completionTokens": 181, "totalTokens": 430, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@medium", "attemptIndex": 1, "status": "pass", "detail": "Uses IsValid for entity/object validity.", "finalResponse": "```lua\nif not IsValid(ent) then return end\n```\nReason: `IsValid` is the standard Garry's Mod function to check an entity reference before using it.", "durationMs": 2773, "version": "openrouter-api", "usage": { "generationId": "gen-1783688029-g5d0wId34aCul5b9qZIP", "promptTokens": 247, "completionTokens": 171, "totalTokens": 418, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@medium", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nnet.Receive(\"MyAddon.Sync\", function(len, ply)\n -- handle the incoming message here\nend)\n```\nReason: registers a handler for the network message \"MyAddon.Sync\".", "durationMs": 2435, "version": "openrouter-api", "usage": { "generationId": "gen-1783688031-buCI8JtIzTSLaeocigay", "promptTokens": 242, "completionTokens": 224, "totalTokens": 466, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@medium", "attemptIndex": 1, "status": "partial", "detail": "Still materializes player.GetAll().", "finalResponse": "```lua\nlocal players = player.GetAll()\nfor _, ply in ipairs(players) do\n -- ...\nend\n```\nReason: caching the player list in a local variable and using `ipairs` avoids repeated table lookups and is faster than `pairs`.", "durationMs": 8369, "version": "openrouter-api", "usage": { "generationId": "gen-1783688032-3VH9KSS1g76XCeRg3JL1", "promptTokens": 243, "completionTokens": 344, "totalTokens": 587, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@low", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor _, ent in ipairs(ents.FindByClass(\"prop_physics\")) do\n -- process ent\nend\n```\nReason: `ents.FindByClass` is the standard way to get all entities of a class and iterate over them without manually building a separate table.", "durationMs": 3830, "version": "openrouter-api", "usage": { "generationId": "gen-1783688034-82HUpRWaisfVvmdTWVa9", "promptTokens": 241, "completionTokens": 227, "totalTokens": 468, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@low", "attemptIndex": 1, "status": "pass", "detail": "Registers a named hook with hook.Add.", "finalResponse": "```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function()\n -- callback body\nend)\n```\nReason: Registers a Think hook with the specified identifier.", "durationMs": 1929, "version": "openrouter-api", "usage": { "generationId": "gen-1783688038-MlmYbcFoIh5B7tuMngyi", "promptTokens": 249, "completionTokens": 73, "totalTokens": 322, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@low", "attemptIndex": 1, "status": "pass", "detail": "Uses IsValid for entity/object validity.", "finalResponse": "```lua\nif IsValid(ent) then\n -- safe to use ent\nend\n```\nReason: `IsValid` checks that the entity reference is not nil and still exists.", "durationMs": 4051, "version": "openrouter-api", "usage": { "generationId": "gen-1783688040-RoPvUSDHvzODD5u34tDD", "promptTokens": 247, "completionTokens": 81, "totalTokens": 328, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@low", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nnet.Receive(\"MyAddon.Sync\", function(len, ply)\n -- handle the incoming message here\nend)\n```\nReason: Registers a receiver for the networked message \"MyAddon.Sync\".", "durationMs": 3222, "version": "openrouter-api", "usage": { "generationId": "gen-1783688040-IhS3jWfyAQmyvjXFVASv", "promptTokens": 242, "completionTokens": 76, "totalTokens": 318, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@low", "attemptIndex": 1, "status": "partial", "detail": "Still materializes player.GetAll().", "finalResponse": "```lua\nlocal players = player.GetAll()\nfor i = 1, #players do\n local ply = players[i]\n -- your code here\nend\n```\nReason: Using a numeric for loop over a pre‑cached table avoids the overhead of pairs and repeated table lookups, making it the most efficient way to iterate over all current players.", "durationMs": 6572, "version": "openrouter-api", "usage": { "generationId": "gen-1783688044-tMMRo8k20bczKUJVUEKt", "promptTokens": 243, "completionTokens": 126, "totalTokens": 369, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "poolside/laguna-m.1:free", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain exactly one fenced code block followed by a reason.", "finalResponse": "\n```lua\nfor _, ent in ipairs(ents.FindByClass(\"prop_physics\")) do\n -- process each entity\nend\n```\nReason: Uses the engine's built-in `ents.FindByClass` to directly iterate over all `prop_physics` entities without manually building a table, leveraging the game's optimized entity lookup.\n", "durationMs": 21315, "version": "openrouter-api", "usage": { "generationId": "gen-1783688044-QvYJrzUwvjvdLRBYV6Nz", "promptTokens": 188, "completionTokens": 973, "totalTokens": 1161, "cost": 0, "cachedTokens": 96, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "poolside/laguna-m.1:free", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain exactly one fenced code block followed by a reason.", "finalResponse": "\n```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function() end)\n```\nReason: Uses hook.Add with \"Think\" as the hook name, \"MyAddon.Think\" as the unique identifier, and an empty function as the callback.\n", "durationMs": 8518, "version": "openrouter-api", "usage": { "generationId": "gen-1783688050-Vy8jHlpMAVVaNIRC7liV", "promptTokens": 195, "completionTokens": 280, "totalTokens": 475, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "poolside/laguna-m.1:free", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain exactly one fenced code block followed by a reason.", "finalResponse": "\n```lua\nif IsValid(ent) then\n -- safe to use ent\nend\n```\nReason: The `IsValid()` function checks if the entity exists and hasn't been removed from the game world, preventing errors when calling methods on invalid references.\n", "durationMs": 14598, "version": "openrouter-api", "usage": { "generationId": "gen-1783688059-0KrCygYwKwfzBlifJU5L", "promptTokens": 194, "completionTokens": 366, "totalTokens": 560, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "poolside/laguna-m.1:free", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain exactly one fenced code block followed by a reason.", "finalResponse": "\n```lua\nnet.Receive(\"MyAddon.Sync\", function(len)\n -- Handle incoming message here\nend)\n```\nReason: Uses net.Receive to register a handler for the \"MyAddon.Sync\" message with a function that receives the message length.\n", "durationMs": 9563, "version": "openrouter-api", "usage": { "generationId": "gen-1783688065-HRYizuruJWVtTxnNJBcG", "promptTokens": 188, "completionTokens": 282, "totalTokens": 470, "cost": 0, "cachedTokens": 96, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "poolside/laguna-m.1:free", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain exactly one fenced code block followed by a reason.", "finalResponse": "\n```lua\nlocal players = player.GetAll()\nfor i = 1, #players do\n local v = players[i]\n -- do stuff\nend\n```\nReason: Using a numeric loop on the cached table avoids the overhead of the `pairs` iterator and is faster in Lua for sequential tables.\n", "durationMs": 19312, "version": "openrouter-api", "usage": { "generationId": "gen-1783688073-7xV1T1PdFQIUuukyroJy", "promptTokens": 189, "completionTokens": 526, "totalTokens": 715, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "poolside/laguna-xs-2.1:free", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor _, ent in ipairs(ents.FindByClass(\"prop_physics\")) do\n -- use ent here\nend\n```\nReason: `ents.FindByClass` returns an iterator-friendly table without requiring manual construction, making it the standard approach for iterating specific entity classes in Garry's Mod Lua.", "durationMs": 595, "version": "openrouter-api", "usage": { "generationId": "gen-1783688075-GnwSSl7AVEdJ3P28LTO9", "promptTokens": 179, "completionTokens": 66, "totalTokens": 245, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "poolside/laguna-xs-2.1:free", "attemptIndex": 1, "status": "pass", "detail": "Registers a named hook with hook.Add.", "finalResponse": "```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function()\n -- Your think logic here\nend)\n```\nReason: The hook.Add function registers a callback for a specific hook name (\"Think\") with a unique identifier (\"MyAddon.Think\") to prevent duplicate registrations.", "durationMs": 873, "version": "openrouter-api", "usage": { "generationId": "gen-1783688075-Y3CYortxT9vIdNkQM9Z5", "promptTokens": 186, "completionTokens": 62, "totalTokens": 248, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "poolside/laguna-xs-2.1:free", "attemptIndex": 1, "status": "pass", "detail": "Uses IsValid for entity/object validity.", "finalResponse": "```lua\nif IsValid(ent) then\n ent:SomeMethod()\nend\n```\nReason: `IsValid` is the standard Garry's Mod function that checks if an entity reference is not only non-nil but also represents an existing in-game entity, preventing errors from calling methods on invalid or deleted entities.", "durationMs": 863, "version": "openrouter-api", "usage": { "generationId": "gen-1783688076-CLqbBmyXo24n6jvtoXOW", "promptTokens": 185, "completionTokens": 65, "totalTokens": 250, "cost": 0, "cachedTokens": 112, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "poolside/laguna-xs-2.1:free", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nnet.Receive(\"MyAddon.Sync\", function(len, ply)\n -- Handle the incoming message here\nend)\n```\nReason: net.Receive registers a callback function to handle incoming network messages with the specified name.", "durationMs": 614, "version": "openrouter-api", "usage": { "generationId": "gen-1783688081-abT97KHoCIeyKB5Pbhi7", "promptTokens": 179, "completionTokens": 50, "totalTokens": 229, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "poolside/laguna-xs-2.1:free", "attemptIndex": 1, "status": "partial", "detail": "Still materializes player.GetAll().", "finalResponse": "```lua\nfor i = 1, #player.GetAll() do\n\tlocal v = player.GetAll()[i]\n\t-- use v here\nend\n```\n\nReason: Using a numeric for loop with a pre-cached table avoids the overhead of calling the pairs iterator function on every iteration, which is faster for small, fixed-size collections like the player list.", "durationMs": 9546, "version": "openrouter-api", "usage": { "generationId": "gen-1783688083-Zbp0HOTSeOn2Y3VS8Ogs", "promptTokens": 180, "completionTokens": 75, "totalTokens": 255, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "qwen/qwen3-coder:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 1177, "version": "openrouter-api" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "qwen/qwen3-coder:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 1139, "version": "openrouter-api" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "qwen/qwen3-coder:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 404.", "finalResponse": null, "durationMs": 273, "version": "openrouter-api" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "qwen/qwen3-coder:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 999, "version": "openrouter-api" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "qwen/qwen3-coder:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 877, "version": "openrouter-api" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "qwen/qwen3-next-80b-a3b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 1249, "version": "openrouter-api" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "qwen/qwen3-next-80b-a3b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 1298, "version": "openrouter-api" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "qwen/qwen3-next-80b-a3b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 727, "version": "openrouter-api" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "qwen/qwen3-next-80b-a3b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 599, "version": "openrouter-api" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "qwen/qwen3-next-80b-a3b-instruct:free", "attemptIndex": 1, "status": "protocol_error", "detail": "OpenRouter HTTP 429.", "finalResponse": null, "durationMs": 671, "version": "openrouter-api" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@high", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor _, ent in ipairs(ents.FindByClass(\"prop_physics\")) do\n -- do something with ent\nend\n```\nReason: ents.FindByClass returns only entities of that class, avoiding the need to build and filter a table of all entities via ents.GetAll.", "durationMs": 37959, "version": "openrouter-api", "usage": { "generationId": "gen-1783688130-r5OQIQ9G9nitEQcLD9SV", "promptTokens": 177, "completionTokens": 5283, "totalTokens": 5460, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@high", "attemptIndex": 1, "status": "pass", "detail": "Registers a named hook with hook.Add.", "finalResponse": "```lua\nhook.Add( \"Think\", \"MyAddon.Think\", function() end )\n```\nReason: hook.Add is the Garry's Mod API used to register a callback for a named hook, with the identifier allowing later reference or removal.", "durationMs": 18403, "version": "openrouter-api", "usage": { "generationId": "gen-1783688138-Xp1wXn4in6GkhB3h76t7", "promptTokens": 186, "completionTokens": 906, "totalTokens": 1092, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@high", "attemptIndex": 1, "status": "pass", "detail": "Uses IsValid for entity/object validity.", "finalResponse": "```lua\nif IsValid(ent) then\n -- safely call methods on ent\nend\n```\nReason: IsValid is a global GMod function that safely checks whether the entity reference is non-nil and not pending removal, avoiding nil/index errors.", "durationMs": 12208, "version": "openrouter-api", "usage": { "generationId": "gen-1783688157-Bbw5jkvotVVSGtuWcpaw", "promptTokens": 183, "completionTokens": 605, "totalTokens": 788, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@high", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nnet.Receive(\"MyAddon.Sync\", function(len, ply)\n -- Handle incoming net message data here\nend)\n```\nReason: net.Receive registers a callback that executes whenever a net message with the given name is received.", "durationMs": 18536, "version": "openrouter-api", "usage": { "generationId": "gen-1783688168-Smx1ADi4Vq4wqAsjo6WU", "promptTokens": 179, "completionTokens": 982, "totalTokens": 1161, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@high", "attemptIndex": 1, "status": "partial", "detail": "Still materializes player.GetAll().", "finalResponse": "```lua\nlocal players = player.GetAll()\nfor i = 1, #players do\n local v = players[i]\n -- ...\nend\n```\nReason: player.GetAll() returns a contiguous array, so caching it and using a numeric for loop avoids the hash-lookup overhead of pairs and is the fastest iteration method.", "durationMs": 30804, "version": "openrouter-api", "usage": { "generationId": "gen-1783688169-rowNWy5ielkVxqZ5ywkK", "promptTokens": 179, "completionTokens": 1338, "totalTokens": 1517, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@low", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor ent in ents.Iterator(\"prop_physics\") do\n -- your code here\nend\n```\nReason: ents.Iterator returns a lazy iterator that yields only entities of the given class without allocating a table of all entities.", "durationMs": 11651, "version": "openrouter-api", "usage": { "generationId": "gen-1783688187-YdHVCjUZtGyllrjRWxHz", "promptTokens": 177, "completionTokens": 1428, "totalTokens": 1605, "cost": 0, "cachedTokens": 64, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@low", "attemptIndex": 1, "status": "pass", "detail": "Registers a named hook with hook.Add.", "finalResponse": "```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function()\nend)\n```\nReason: hook.Add is the GMod API used to register a callback on a named hook, with the second argument being the unique identifier.", "durationMs": 8154, "version": "openrouter-api", "usage": { "generationId": "gen-1783688199-2CUp7kFO0lEg4mLOX4Di", "promptTokens": 186, "completionTokens": 327, "totalTokens": 513, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@low", "attemptIndex": 1, "status": "pass", "detail": "Uses IsValid for entity/object validity.", "finalResponse": "```lua\nif IsValid(ent) then\n ent:SomeMethod()\nend\n```\nReason: IsValid safely returns false for nil or NULL entities, avoiding runtime errors when calling methods on invalid references.", "durationMs": 10079, "version": "openrouter-api", "usage": { "generationId": "gen-1783688200-MKn9GLujb3wu9r5daHkZ", "promptTokens": 183, "completionTokens": 488, "totalTokens": 671, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@low", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nnet.Receive( \"MyAddon.Sync\", function( len, ply )\n -- handle incoming net message data here\nend )\n```\nReason: net.Receive registers a callback that runs whenever a net message with the specified name is received.", "durationMs": 13476, "version": "openrouter-api", "usage": { "generationId": "gen-1783688207-poBjO399b8YptdBQY3M6", "promptTokens": 179, "completionTokens": 662, "totalTokens": 841, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@low", "attemptIndex": 1, "status": "partial", "detail": "Still materializes player.GetAll().", "finalResponse": "```lua\nlocal plys = player.GetAll()\nfor i = 1, #plys do\n local v = plys[i]\n -- ...\nend\n```\nReason: player.GetAll() returns a sequentially indexed table, so caching it and using a numeric for loop avoids pairs' hash iteration overhead and is the fastest way to visit all players.", "durationMs": 21467, "version": "openrouter-api", "usage": { "generationId": "gen-1783688210-0s8zSE0WcyAWaLsHKHVn", "promptTokens": 179, "completionTokens": 949, "totalTokens": 1128, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@none", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor _, ent in ipairs(ents.FindByClass(\"prop_physics\")) do\n -- do something with ent\nend\n```\nReason: ents.FindByClass returns only matching entities so no full entity table is built manually.", "durationMs": 2157, "version": "openrouter-api", "usage": { "generationId": "gen-1783688220-GDeVkxfoBidBaIH8oViG", "promptTokens": 180, "completionTokens": 51, "totalTokens": 231, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@none", "attemptIndex": 1, "status": "pass", "detail": "Registers a named hook with hook.Add.", "finalResponse": "```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function()\n -- minimal empty callback\nend)\n```\nReason: hook.Add registers a named callback on the given hook, using the identifier as the second argument.", "durationMs": 2110, "version": "openrouter-api", "usage": { "generationId": "gen-1783688222-3XHQho9awOQo1yfq63SG", "promptTokens": 189, "completionTokens": 48, "totalTokens": 237, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@none", "attemptIndex": 1, "status": "pass", "detail": "Uses IsValid for entity/object validity.", "finalResponse": "```lua\nif IsValid(ent) then\n ent:SomeMethod()\nend\n```\n\nReason: IsValid checks both that ent is not nil and that the entity hasn't been removed, preventing errors from calling methods on invalid entities.", "durationMs": 2448, "version": "openrouter-api", "usage": { "generationId": "gen-1783688224-2DQ7Rq7WiqVjP3HShSlM", "promptTokens": 186, "completionTokens": 50, "totalTokens": 236, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@none", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nutil.AddNetworkString(\"MyAddon.Sync\")\n\nnet.Receive(\"MyAddon.Sync\", function(len, ply)\n -- handle incoming net message here\nend)\n```\nReason: util.AddNetworkString registers the net message name on both server and client, and net.Receive sets the callback to handle incoming messages with that name.", "durationMs": 2709, "version": "openrouter-api", "usage": { "generationId": "gen-1783688227-F1mcSDE4xxBUYt1uP2DG", "promptTokens": 182, "completionTokens": 74, "totalTokens": 256, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@none", "attemptIndex": 1, "status": "partial", "detail": "Still materializes player.GetAll().", "finalResponse": "```lua\nlocal players = player.GetAll()\nfor i = 1, #players do\n local v = players[i]\nend\n```\nReason: Using a numeric loop over the array returned by player.GetAll avoids hash traversal and per-iteration function calls from pairs, making it faster and more GC-friendly.", "durationMs": 2980, "version": "openrouter-api", "usage": { "generationId": "gen-1783688230-4CdrL0ycanpBrFo96nGj", "promptTokens": 182, "completionTokens": 65, "totalTokens": 247, "cost": 0, "cachedTokens": 0, "cacheWriteTokens": 0 } } ], "summary": { "statusCounts": { "pass": 47, "partial": 14, "incorrect": 0, "protocol_error": 88, "policy_violation": 0, "timeout": 6, "unavailable": 0, "unsupported": 0, "trace_error": 0, "scored": 61 }, "groups": [ { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "cognitivecomputations/dolphin-mistral-24b-venice-edition:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "cohere/north-mini-code:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "google/gemma-4-26b-a4b-it:free", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "google/gemma-4-31b-it:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-thinking:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.2-3b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.3-70b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nousresearch/hermes-3-llama-3.1-405b:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-30b-a3b:free", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "timeout" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@low", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@medium", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@high", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@medium", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3.5-content-safety:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-12b-v2-vl:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-9b-v2:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@high", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@low", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@medium", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@high", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@low", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@medium", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "poolside/laguna-m.1:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "poolside/laguna-xs-2.1:free", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "qwen/qwen3-coder:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "qwen/qwen3-next-80b-a3b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@high", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@low", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@none", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "cognitivecomputations/dolphin-mistral-24b-venice-edition:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "cohere/north-mini-code:free", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "google/gemma-4-26b-a4b-it:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "google/gemma-4-31b-it:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-thinking:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.2-3b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.3-70b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nousresearch/hermes-3-llama-3.1-405b:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-30b-a3b:free", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "timeout" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@low", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@medium", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@high", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@medium", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3.5-content-safety:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-12b-v2-vl:free", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-9b-v2:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@high", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@low", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@medium", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@high", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@low", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@medium", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "poolside/laguna-m.1:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "poolside/laguna-xs-2.1:free", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "qwen/qwen3-coder:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "qwen/qwen3-next-80b-a3b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@high", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@low", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@none", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "cognitivecomputations/dolphin-mistral-24b-venice-edition:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "cohere/north-mini-code:free", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "google/gemma-4-26b-a4b-it:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "google/gemma-4-31b-it:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-thinking:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.2-3b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.3-70b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nousresearch/hermes-3-llama-3.1-405b:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-30b-a3b:free", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "timeout" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@low", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@medium", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@high", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@medium", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3.5-content-safety:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-12b-v2-vl:free", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-9b-v2:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@high", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@low", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@medium", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@high", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@low", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@medium", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "poolside/laguna-m.1:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "poolside/laguna-xs-2.1:free", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "qwen/qwen3-coder:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "qwen/qwen3-next-80b-a3b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@high", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@low", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@none", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "cognitivecomputations/dolphin-mistral-24b-venice-edition:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "cohere/north-mini-code:free", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "google/gemma-4-26b-a4b-it:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "google/gemma-4-31b-it:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-thinking:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.2-3b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.3-70b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nousresearch/hermes-3-llama-3.1-405b:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-30b-a3b:free", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "timeout" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@low", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@medium", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@high", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@medium", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3.5-content-safety:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-12b-v2-vl:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "timeout" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-9b-v2:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@high", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@low", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@medium", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@high", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@low", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@medium", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "poolside/laguna-m.1:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "poolside/laguna-xs-2.1:free", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "qwen/qwen3-coder:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "qwen/qwen3-next-80b-a3b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@high", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@low", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@none", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "cognitivecomputations/dolphin-mistral-24b-venice-edition:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "cohere/north-mini-code:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "google/gemma-4-26b-a4b-it:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "google/gemma-4-31b-it:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "liquid/lfm-2.5-1.2b-thinking:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.2-3b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "meta-llama/llama-3.3-70b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nousresearch/hermes-3-llama-3.1-405b:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-30b-a3b:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "timeout" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@low", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-super-120b-a12b:free@medium", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@high", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3-ultra-550b-a55b:free@medium", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-3.5-content-safety:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-12b-v2-vl:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "nvidia/nemotron-nano-9b-v2:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@high", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@low", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-120b:free@medium", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@high", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@low", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "openai/gpt-oss-20b:free@medium", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "poolside/laguna-m.1:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "poolside/laguna-xs-2.1:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "qwen/qwen3-coder:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "qwen/qwen3-next-80b-a3b-instruct:free", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@high", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@low", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "openrouter", "model": "tencent/hy3:free@none", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" } ], "passAtKRate": "47/61" } }