{ "schemaVersion": 2, "runId": "c99506be-e7cc-4900-90b0-2a059597aa89", "fixtureIds": [ "gmod.ents-iterator.v1", "gmod.hook-add.v1", "gmod.isvalid.v1", "gmod.net-receivers.v1", "gmod.perf.angle-zero.v1", "gmod.perf.config-var.v1", "gmod.perf.darkrpvar.v1", "gmod.perf.disttosqr.v1", "gmod.perf.ents-iterator.v1", "gmod.perf.find-ents-near.v1", "gmod.perf.find-players-near.v1", "gmod.perf.for-vs-while.v1", "gmod.perf.hook-once.v1", "gmod.perf.hudpaint-cache.v1", "gmod.perf.local-color.v1", "gmod.perf.local-vs-global.v1", "gmod.perf.localplayer-cache.v1", "gmod.perf.looking-at.v1", "gmod.perf.meta-vs-arg.v1", "gmod.perf.msg-vs-print.v1", "gmod.perf.pairs-ipairs-for.v1", "gmod.perf.plain-lua-vs-fn.v1", "gmod.perf.player-cache-hooks.v1", "gmod.perf.ply-table-index.v1", "gmod.perf.seq-tables.v1", "gmod.perf.setdrawcolor-split.v1", "gmod.perf.sqlite-vs-mysql.v1", "gmod.perf.steamid-cache.v1", "gmod.perf.string-table-concat.v1", "gmod.perf.surface-drawrect.v1", "gmod.perf.surface-text.v1", "gmod.perf.table-count-hash.v1", "gmod.perf.table-empty.v1", "gmod.perf.table-hasvalue.v1", "gmod.perf.table-literal.v1", "gmod.perf.table-random.v1", "gmod.perf.x-times-x.v1", "gmod.player-iterator.v1" ], "startedAt": "2026-07-10T15:41:59.142Z", "completedAt": "2026-07-10T16:21:33.096Z", "repeat": 1, "concurrency": 1, "attempts": [ { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor _, ent in ents.Iterator() do\n if ent:GetClass() == \"prop_physics\" then\n -- Process entity\n end\nend\n```\nReason: Using ents.Iterator() allows you to iterate over all active entities using a stateless iterator, avoiding the table creation and memory overhead of ents.GetAll() or similar functions.", "durationMs": 6107, "version": "1.1.1" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Registers a named hook with hook.Add.", "finalResponse": "```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function()\n -- Callback body\nend)\n```\nReason: The `hook.Add` function is the standard way to register callback functions to hooks in Garry's Mod Lua, using the hook name, a unique identifier, and the callback function.", "durationMs": 3878, "version": "1.1.1" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Uses IsValid for entity/object validity.", "finalResponse": "```lua\nif IsValid(ent) then\n -- Safe to use ent\nend\n```\nReason: In Garry's Mod Lua, the `IsValid(ent)` function checks if the entity reference is not nil and that the underlying engine entity has not been destroyed.", "durationMs": 4156, "version": "1.1.1" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nnet.Receive(\"MyAddon.Sync\", function(len, ply)\n -- Handle the incoming network message here\nend)\n```\nReason: net.Receive is the standard Garry's Mod library function used to register a receiver callback for net messages sent from the server to client, or vice versa.", "durationMs": 4145, "version": "1.1.1" }, { "fixtureId": "gmod.perf.angle-zero.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal ZERO_ANGLE = Angle()\n```\nReason: Caching a single Angle instance as a local upvalue outside the hot path avoids garbage collection overhead and memory allocations from constructing new objects on every iteration.", "durationMs": 7343, "version": "1.1.1" }, { "fixtureId": "gmod.perf.config-var.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal setting_color = Color(255, 255, 255)\nlocal col = setting_color\n```\nReason: Local variables are accessed by index at compile-time using virtual register slots, avoiding the costly runtime hash table lookups required to resolve nested tables.", "durationMs": 4669, "version": "1.1.1" }, { "fixtureId": "gmod.perf.darkrpvar.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal jobName = ply:getDarkRPVar(\"job\")\n```\nReason: DarkRP retrieves player-specific variables (such as custom job names) using the optimized ply:getDarkRPVar internal network table instead of standard NWStrings.", "durationMs": 4791, "version": "1.1.1" }, { "fixtureId": "gmod.perf.disttosqr.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal pos1 = Vector( 0, 0, 0 )\nlocal pos2 = Vector( 0, 0, 100 )\nlocal threshold = 150\n\nif pos1:DistToSqr( pos2 ) < ( threshold * threshold ) then\n -- Vectors are closer than threshold\nend\n```\nReason: Vector:DistToSqr avoids the expensive square root operation required by Vector:Distance, making it significantly faster for threshold comparisons.", "durationMs": 3940, "version": "1.1.1" }, { "fixtureId": "gmod.perf.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor _, ent in ents.Iterator() do\n -- Do something with ent\nend\n```\nReason: `ents.Iterator()` is the wiki-recommended iterator because it avoids creating a new table copy on every call, unlike `ents.GetAll()`, making it significantly more efficient for performance-critical code.", "durationMs": 4615, "version": "1.1.1" }, { "fixtureId": "gmod.perf.find-ents-near.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal function GetNearbyEntities(ply, radius)\n return ents.FindInSphere(ply:GetPos(), radius)\nend\n```\nReason: ents.FindInSphere is faster and more optimized in source engine C++ benchmarks for general radial queries than ents.FindInBox or ents.FindInCone.", "durationMs": 3890, "version": "1.1.1" }, { "fixtureId": "gmod.perf.find-players-near.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal function GetPlayersInSphere(position, radius)\n local players = {}\n local radiusSqr = radius * radius\n local allPlayers = player.GetAll()\n for i = 1, #allPlayers do\n local ply = allPlayers[i]\n if ply:GetPos():DistToSqr(position) <= radiusSqr then\n players[#players + 1] = ply\n end\n end\n return players\nend\n```\nReason: Iterating over the small list of active players via `player.GetAll()` and performing a squared-distance check avoids the high overhead of searching through thousands of map/prop entities inside the spatial partition with `ents.FindInSphere`.", "durationMs": 5295, "version": "1.1.1" }, { "fixtureId": "gmod.perf.for-vs-while.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor i = 1, n do\n -- loop body\nend\n```\nReason: The numeric `for` loop is optimized at the engine/VM level in LuaJIT, utilizing fast bytecode instructions and register allocations without the manual variable increment and conditional checks required by a while loop.", "durationMs": 4701, "version": "1.1.1" }, { "fixtureId": "gmod.perf.hook-once.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\n-- Faster pattern: Call hook.Run once per tick passing all players\nhook.Add(\"Tick\", \"NotifyPlayersOnce\", function()\n local players = player.GetAll()\n hook.Run(\"NotifyPlayersTick\", players)\nend)\n```\nReason: Calling hook.Run once avoids the CPU overhead of traversing the hook registry and calling hook functions N times (once per player) every tick.", "durationMs": 5181, "version": "1.1.1" }, { "fixtureId": "gmod.perf.hudpaint-cache.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nhook.Add(\"HUDPaint\", \"FasterHealthDraw\", function()\n local ply = LocalPlayer()\n if not IsValid(ply) then return end\n \n local hp = ply:Health()\n \n -- Draw call 1 using hp\n -- Draw call 2 using hp\n -- Draw call 3 using hp\nend)\n```\nReason: Caching the LocalPlayer reference and the return value of Health() in local variables avoids repeated C-boundary crossings and engine-level player/health retrievals within the same frame.", "durationMs": 4506, "version": "1.1.1" }, { "fixtureId": "gmod.perf.local-color.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal white = Color(255, 255, 255)\n-- Inside the paint loop:\n-- Use the cached 'white' variable instead of recreating it\ndraw.SimpleText(\"Hello\", \"DermaDefault\", x, y, white)\n```\nReason: Calling Color() repeatedly in a high-frequency paint loop creates a new table every frame, causing unnecessary garbage collection overhead; caching the color object in a local variable outside the loop avoids this.", "durationMs": 4018, "version": "1.1.1" }, { "fixtureId": "gmod.perf.local-vs-global.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal sin = math.sin\nfor i = 1, 1000000 do\n local y = sin(i)\nend\n```\nReason: Caching the global table function into a local variable avoids repeated table lookups in the hot loop, as local variable access in Lua is significantly faster.", "durationMs": 3817, "version": "1.1.1" }, { "fixtureId": "gmod.perf.localplayer-cache.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal LocalPlayer = LocalPlayer\nlocal lp\nlocal function GetLocalPlayer()\n if not lp or not lp:IsValid() then\n lp = LocalPlayer()\n end\n return lp\nend\n```\nReason: Caching `LocalPlayer()` in a local variable avoids repeated expensive engine calls and global function lookups, while checking `:IsValid()` handles cases where the player object changes or is not yet initialized during early load.", "durationMs": 4151, "version": "1.1.1" }, { "fixtureId": "gmod.perf.looking-at.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal function ArePlayersLookingAtEachOther(ply1, ply2, threshold)\n threshold = threshold or 0.8 -- Cosine of maximum allowed angle (e.g., 0.8 is ~36 degrees)\n \n local pos1 = ply1:GetShootPos()\n local pos2 = ply2:GetShootPos()\n \n -- Vector pointing from ply1 to ply2\n local dir = pos2 - pos1\n dir:Normalize()\n \n -- Both players must aim towards each other's position\n local dot1 = ply1:GetAimVector():Dot(dir)\n if dot1 < threshold then return false end\n \n local dot2 = ply2:GetAimVector():Dot(-dir)\n return dot2 >= threshold\nend\n```\nReason: Dot products of aim vectors and relative displacement vectors avoid expensive inverse trigonometric functions (`math.acos`) to determine alignment.", "durationMs": 5342, "version": "1.1.1" }, { "fixtureId": "gmod.perf.meta-vs-arg.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nSomeHelper(ply)\n```\nReason: SomeHelper(ply) avoids the table/metatable lookup on the player object required by the colon operator method call ply:SomeHelper().", "durationMs": 4965, "version": "1.1.1" }, { "fixtureId": "gmod.perf.msg-vs-print.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal Msg = Msg\nMsg(\"Debug message\\n\")\n```\nReason: Msg is faster than print because it does not convert nil or non-string arguments automatically, does not append a newline, and caching it as a local avoids global lookup in the hot path.", "durationMs": 4058, "version": "1.1.1" }, { "fixtureId": "gmod.perf.pairs-ipairs-for.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "incorrect", "detail": "Did not match a fixture answer pattern.", "finalResponse": "```lua\nlocal count = #t\nfor i = 1, count do\n local value = t[i]\n -- process value\nend\n```\nReason: Numeric for loops with cached table length allow LuaJIT (Garry's Mod's Lua engine) to fully JIT-compile and optimize the loop without the overhead of iterator function calls or closures associated with pairs/ipairs.", "durationMs": 4715, "version": "1.1.1" }, { "fixtureId": "gmod.perf.plain-lua-vs-fn.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "incorrect", "detail": "Matched an incorrect-answer pattern.", "finalResponse": "```lua\n-- Standard DarkRP fn: fn.Filter(fn.Map(fn.Id, list), filterFunc) creates multiple intermediate tables and closures.\n-- This approach: A single-pass procedural loop that filters and maps elements inline.\nlocal function getActiveCPAgents(players)\n local result = {}\n local count = 0\n for i = 1, #players do\n local ply = players[i]\n -- Filter condition\n if IsValid(ply) and ply:Alive() and ply:isCP() then\n count = count + 1\n -- Map transformation\n result[count] = ply:Nick()\n end\n end\n return result\nend\n```\nReason: Procedural single-pass iteration eliminates the performance overhead of allocating intermediate tables and invoking multiple closures per element.", "durationMs": 5606, "version": "1.1.1" }, { "fixtureId": "gmod.perf.player-cache-hooks.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal cachedPlayers = player.GetAll()\n\nlocal function rebuildCache()\n cachedPlayers = player.GetAll()\nend\n\nhook.Add(\"PlayerInitialSpawn\", \"RebuildPlayerCache\", rebuildCache)\n\nhook.Add(\"PlayerDisconnected\", \"RebuildPlayerCache\", function()\n -- Rebuild on the next tick so the disconnected player is fully removed from player.GetAll()\n timer.Simple(0, rebuildCache)\nend)\n\nhook.Add(\"Think\", \"OptimizedThink\", function()\n for i = 1, #cachedPlayers do\n local ply = cachedPlayers[i]\n -- Perform per-tick operations on ply here\n end\nend)\n```\n\nReason: Caching the player list on join and leave events avoids the CPU overhead of creating a new table and garbage collecting it every single tick via player.GetAll().", "durationMs": 5541, "version": "1.1.1" }, { "fixtureId": "gmod.perf.ply-table-index.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\n-- Store data in a local table keyed by the player object\nlocal playerData = {}\n\n-- Write\nplayerData[ply] = value\n\n-- Read (highly optimized direct table lookup)\nlocal value = playerData[ply]\n```\nReason: Indexing the player object directly (e.g. `ply.field`) triggers the metatable `__index` metamethod to access the player's internal table, whereas a plain Lua table lookup keyed by the player object bypasses this metatable overhead entirely.", "durationMs": 5553, "version": "1.1.1" }, { "fixtureId": "gmod.perf.seq-tables.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal tbl = { \"apple\", \"banana\", \"cherry\" }\nfor i = 1, #tbl do\n local val = tbl[i]\nend\n```\nReason: Sequential number-indexed arrays are faster because LuaJIT can optimize numeric loops and array access, avoiding hash lookups and iterator overhead.", "durationMs": 4724, "version": "1.1.1" }, { "fixtureId": "gmod.perf.setdrawcolor-split.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nsurface.SetDrawColor(r, g, b, a)\n```\nReason: Calling the function with separate numeric arguments (r, g, b, a) avoids the overhead of creating or unpacking a Color table/object in Lua on every frame.", "durationMs": 3756, "version": "1.1.1" }, { "fixtureId": "gmod.perf.sqlite-vs-mysql.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal steamid = \"STEAM_0:1:123456\"\nlocal result = sql.Query(\"SELECT * FROM player_data WHERE steamid = \" .. sql.SQLStr(steamid) .. \";\")\n```\nReason: Local SQLite runs in-process on the same machine and requires no network round-trips, eliminating network latency completely.", "durationMs": 4422, "version": "1.1.1" }, { "fixtureId": "gmod.perf.steamid-cache.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal Player = debug.getregistry().Player\nlocal _SteamID = Player.SteamID\n\n-- Cache SteamIDs in a table on the player entity itself to avoid cross-lookup overhead\nfunction Player:SteamID()\n local id = self._steamID\n if not id then\n id = _SteamID(self)\n self._steamID = id\n end\n return id\nend\n```\nReason: Overriding the Player metatable method to retrieve and cache the SteamID directly in the player's entity table avoids the overhead of repeated engine-level C/C++ boundary crossings.", "durationMs": 4308, "version": "1.1.1" }, { "fixtureId": "gmod.perf.string-table-concat.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain 0 through 0 candidate loops.", "finalResponse": "```lua\nlocal tbl = {}\nfor i = 1, 10000 do\n tbl[#tbl + 1] = \"piece\"\nend\nlocal result = table.concat(tbl)\n```\nReason: In Lua, strings are immutable, so repeated `..` concatenation creates a new string copy every time, leading to O(N^2) time complexity and massive garbage collector overhead, whereas inserting pieces into a table and calling `table.concat` allocates the memory once and joins them efficiently in C.", "durationMs": 4108, "version": "1.1.1" }, { "fixtureId": "gmod.perf.surface-drawrect.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nsurface.SetDrawColor(r, g, b, a)\nsurface.DrawRect(x, y, width, height)\n```\nReason: `surface.DrawRect` is a direct engine-level draw call that avoids the Lua-side overhead, conditional checks, and calculations that `draw.RoundedBox` performs to handle corner rounding.", "durationMs": 4463, "version": "1.1.1" }, { "fixtureId": "gmod.perf.surface-text.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nsurface.SetFont(\"DermaDefault\")\nsurface.SetTextColor(255, 255, 255, 255)\nsurface.SetTextPos(10, 10)\nsurface.DrawText(\"Hello World\")\n```\nReason: surface.SetTextPos and surface.DrawText are direct C++ engine bindings, bypassing the Lua-side overhead of draw.DrawText or draw.SimpleTextOutlined which perform extensive string formatting, position recalculations, and multiple overlapping draw calls for outlines.", "durationMs": 5625, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-count-hash.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal tbl = { \"apple\", \"banana\", \"cherry\" }\nlocal length = #tbl\n```\nReason: The length operator `#` is the standard, fastest, and most common way in Lua and Garry's Mod to get the length of a sequential table (an array).", "durationMs": 4053, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-empty.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nt = {}\n```\nReason: `t = {}` is a constant-time O(1) operation that allocates a new empty table, whereas `table.Empty(t)` iterates over every element to set it to `nil`, resulting in O(N) complexity which is significantly slower for large tables.", "durationMs": 5143, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-hasvalue.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "incorrect", "detail": "Matched an incorrect-answer pattern.", "finalResponse": "```lua\n-- Slow approach: table.HasValue (O(n) search)\nlocal list = { \"apple\", \"banana\", \"cherry\" }\nlocal exists = table.HasValue(list, \"banana\")\n\n-- Faster approach: Key lookup in a table/set (O(1) search)\nlocal set = { [\"apple\"] = true, [\"banana\"] = true, [\"cherry\"] = true }\nlocal exists = set[\"banana\"] ~= nil\n```\nReason: Key-based lookup in a Lua table acts as a hash map, resulting in O(1) time complexity, whereas table.HasValue performs a linear scan over the array elements resulting in O(n) time complexity.", "durationMs": 4183, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-literal.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal myTable = {\n field1 = \"value1\",\n field2 = \"value2\",\n field3 = \"value3\"\n}\n```\nReason: Defining fields directly in the table constructor allows LuaJIT to pre-allocate the correct hash and array sizes, preventing costly table rehashing and memory reallocations during subsequent assignments.", "durationMs": 5456, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-random.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal randomElement = tbl[math.random(#tbl)]\n```\nReason: Using math.random with the length operator is faster because table.Random internally handles non-sequential tables by converting keys to a temporary table or iterating, whereas direct array indexing is a constant-time O(1) operation.", "durationMs": 4409, "version": "1.1.1" }, { "fixtureId": "gmod.perf.x-times-x.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal squared = x * x\n```\nReason: Direct multiplication is faster in Lua than the exponentiation operator (`x ^ 2`), which incurs the overhead of a function call.", "durationMs": 67432, "version": "1.1.1" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attemptIndex": 1, "status": "pass", "detail": "Uses player.Iterator() (wiki-recommended Lua-cached iterator).", "finalResponse": "```lua\nfor _, ply in player.Iterator() do\n\t-- ...\nend\n```\nReason: player.Iterator() is the modern, optimized iteration method in Garry's Mod that avoids the memory allocation overhead of player.GetAll().", "durationMs": 4433, "version": "1.1.1" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor _, ent in ents.Iterator() do\n if ent:GetClass() == \"prop_physics\" then\n -- Code to execute on each prop_physics entity\n end\nend\n```\nReason: Using `ents.Iterator()` traverses the engine's internal entity list directly via a stateless iterator, avoiding the allocation of a temporary Lua table that functions like `ents.GetAll()` or `ents.FindByClass()` would create.", "durationMs": 6096, "version": "1.1.1" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Registers a named hook with hook.Add.", "finalResponse": "```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function()\n -- Code here runs every frame\nend)\n```\nReason: This uses Garry's Mod's standard `hook.Add` library function to register a callback function to the \"Think\" event hook with the custom identifier \"MyAddon.Think\".", "durationMs": 4289, "version": "1.1.1" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Uses IsValid for entity/object validity.", "finalResponse": "```lua\nif IsValid(ent) then\n -- Safe to call methods on ent\nend\n```\nReason: The global `IsValid` function safely checks if the entity is non-nil, exists in the game world, and is not a NULL entity, avoiding runtime errors that would occur if you directly called the `ent:IsValid()` method on a nil reference.", "durationMs": 4471, "version": "1.1.1" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nnet.Receive(\"MyAddon.Sync\", function(len, ply)\n -- Handle the net message data here\nend)\n```\nReason: In Garry's Mod, incoming net messages are handled using the net.Receive function, which takes the message name and a callback function to process the message content.", "durationMs": 4505, "version": "1.1.1" }, { "fixtureId": "gmod.perf.angle-zero.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal temp_ang = Angle()\n\n-- Inside the hot path, reuse the cached angle by resetting its fields in-place\ntemp_ang.p = 0\ntemp_ang.y = 0\ntemp_ang.r = 0\n```\nReason: Instantiating a new Angle object via `Angle()` allocates memory on the Lua-to-C++ boundary, causing garbage collection overhead, whereas caching a local Angle and resetting its components in-place avoids new allocations.", "durationMs": 9313, "version": "1.1.1" }, { "fixtureId": "gmod.perf.config-var.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal color = Color(255, 0, 0)\nlocal currentColor = color\n```\nReason: Local variables are stored in registers and accessed directly by index, completely bypassing the multiple table lookups required to resolve nested keys.", "durationMs": 5329, "version": "1.1.1" }, { "fixtureId": "gmod.perf.darkrpvar.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal jobName = ply:getDarkRPVar(\"job\")\n```\nReason: ply:getDarkRPVar(\"job\") is the official DarkRP API for accessing networked player variables, whereas ply:GetNWString(\"job\") is legacy, inefficient, and no longer natively updated by modern DarkRP.", "durationMs": 6403, "version": "1.1.1" }, { "fixtureId": "gmod.perf.disttosqr.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal isWithinRange = vec1:DistToSqr(vec2) < (threshold * threshold)\n```\nReason: Vector:DistToSqr calculates the squared distance between two vectors, avoiding the expensive square root operation required by Vector:Distance.", "durationMs": 5491, "version": "1.1.1" }, { "fixtureId": "gmod.perf.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor _, ent in ents.Iterator() do\n\t-- Your code here\nend\n```\nReason: ents.Iterator is the wiki-recommended way to iterate over all entities in Garry's Mod because it does not allocate a new table on each call, unlike ents.GetAll.", "durationMs": 9052, "version": "1.1.1" }, { "fixtureId": "gmod.perf.find-ents-near.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal entities = ents.FindInSphere(ply:GetPos(), 500)\n```\nReason: ents.FindInSphere is highly optimized by the Source Engine's spatial partitioning grid, making it faster than manual distance checks or ents.FindInBox for radial queries.", "durationMs": 5152, "version": "1.1.1" }, { "fixtureId": "gmod.perf.find-players-near.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal function GetPlayersInRadius(pos, radius)\n local players = {}\n local radiusSqr = radius * radius\n local allPlayers = player.GetAll()\n\n for i = 1, #allPlayers do\n local ply = allPlayers[i]\n if ply:GetPos():DistToSqr(pos) <= radiusSqr then\n players[#players + 1] = ply\n end\n end\n\n return players\nend\n```\nReason: Iterating over the cached `player.GetAll()` table and checking squared distance is much faster because it avoids the expensive C++ engine spatial partition search that returns and allocates a table for all entity types in the area.", "durationMs": 6021, "version": "1.1.1" }, { "fixtureId": "gmod.perf.for-vs-while.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor i = 1, n do\n -- loop body\nend\n```\nReason: Numeric for loops in Lua use specialized virtual machine instructions and registers, avoiding the manual updates and comparisons of a while loop.", "durationMs": 5221, "version": "1.1.1" }, { "fixtureId": "gmod.perf.hook-once.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\n-- Call hook.Run once per tick passing the array of all players\nlocal plys = player.GetAll()\nhook.Run(\"OnPlayerTickBatch\", plys)\n\n-- The hook listener loops through the players internally\nhook.Add(\"OnPlayerTickBatch\", \"CustomLogic\", function(plys)\n for i = 1, #plys do\n local ply = plys[i]\n -- Custom logic per player\n end\nend)\n```\nReason: Calling hook.Run once avoids the substantial overhead of Lua-to-C hook resolution and function call overhead for every player on every tick.", "durationMs": 6394, "version": "1.1.1" }, { "fixtureId": "gmod.perf.hudpaint-cache.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal ply = LocalPlayer()\nif ply:IsValid() then\n local hp = ply:Health()\n draw_call_1(hp)\n draw_call_2(hp)\n draw_call_3(hp)\nend\n```\nReason: Storing the player object and their health in local variables avoids redundant C-to-Lua boundary crossings and engine lookups across multiple calls.", "durationMs": 7452, "version": "1.1.1" }, { "fixtureId": "gmod.perf.local-color.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal white = Color(255, 255, 255)\n\n-- Inside the paint hook/loop:\nsurface.SetDrawColor(white)\n```\nReason: Calling Color() inside a paint loop instantiates a new table/object every frame, generating significant garbage collection overhead, whereas caching it in a local variable outside the loop reuses a single reference.", "durationMs": 5912, "version": "1.1.1" }, { "fixtureId": "gmod.perf.local-vs-global.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal sin = math.sin\n-- Use 'sin' instead of 'math.sin' inside the loop\n```\nReason: Localizing the function avoids two table lookups (`_G.math` and then `math.sin`) per iteration by storing the function reference in a fast local register.", "durationMs": 5303, "version": "1.1.1" }, { "fixtureId": "gmod.perf.localplayer-cache.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal ply\nlocal function GetLocalPlayer()\n if not IsValid(ply) then\n ply = LocalPlayer()\n end\n return ply\nend\n```\nReason: Caching the player entity in a local variable avoids repeated global table lookups and engine-side C-calls, falling back to LocalPlayer() only when the cache is invalid.", "durationMs": 6967, "version": "1.1.1" }, { "fixtureId": "gmod.perf.looking-at.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal function ArePlayersFacingEach Other(ply1, ply2, threshold)\n threshold = threshold or 0.7 -- Roughly 45 degrees tolerance\n\n local dir = ply2:GetShootPos() - ply1:GetShootPos()\n dir:Normalize() -- Normalizes in-place to prevent object allocation\n\n -- ply1 must aim along dir (dot > threshold), ply2 must aim against dir (dot < -threshold)\n return ply1:GetAimVector():Dot(dir) > threshold and ply2:GetAimVector():Dot(dir) < -threshold\nend\n```\nReason: Using vector dot products of the players' aim vectors against their relative displacement vector determines alignment without expensive trigonometric operations (math.acos) or garbage-collected vector allocation.", "durationMs": 8255, "version": "1.1.1" }, { "fixtureId": "gmod.perf.meta-vs-arg.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nSomeHelper(ply)\n```\nReason: Direct function calls avoid the metatable index lookup on the player userdata object required by the colon method syntax.", "durationMs": 5626, "version": "1.1.1" }, { "fixtureId": "gmod.perf.msg-vs-print.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal Msg = Msg\nMsg(\"Debug message\\n\")\n```\nReason: Localizing `Msg` avoids global lookup overhead, and `Msg` writes directly to the engine console without the argument-stringification and tab-spacing overhead of `print`.", "durationMs": 5660, "version": "1.1.1" }, { "fixtureId": "gmod.perf.pairs-ipairs-for.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "incorrect", "detail": "Did not match a fixture answer pattern.", "finalResponse": "```lua\nlocal length = #tbl\nfor i = 1, length do\n local val = tbl[i]\n -- process val\nend\n```\nReason: Numeric for loops with a cached length are compiled directly into highly optimized machine code loops by LuaJIT (which Garry's Mod runs on), bypassing the function call and iterator overhead of pairs and ipairs.", "durationMs": 5245, "version": "1.1.1" }, { "fixtureId": "gmod.perf.plain-lua-vs-fn.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "incorrect", "detail": "Matched an incorrect-answer pattern.", "finalResponse": "```lua\n-- Traditional DarkRP fn approach:\n-- local names = fn.Map(function(ply) return ply:Nick() end, fn.Filter(function(ply) return ply:isCop() end, player.GetAll()))\n\n-- Faster approach (Direct imperative single-pass loop):\nlocal plys = player.GetAll()\nlocal names = {}\nlocal count = 0\n\nfor i = 1, #plys do\n local ply = plys[i]\n if ply:isCop() then\n count = count + 1\n names[count] = ply:Nick()\n end\nend\n```\nReason: Direct imperative loops avoid the high overhead of Lua function calls, closure allocations, and intermediate tables generated by DarkRP's functional combinators.", "durationMs": 5858, "version": "1.1.1" }, { "fixtureId": "gmod.perf.player-cache-hooks.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal CachedPlayers = player.GetAll()\n\nhook.Add(\"PlayerInitialSpawn\", \"CachePlayers_Join\", function(ply)\n table.insert(CachedPlayers, ply)\nend)\n\nhook.Add(\"PlayerDisconnected\", \"CachePlayers_Leave\", function(ply)\n table.RemoveByValue(CachedPlayers, ply)\nend)\n\nhook.Add(\"Think\", \"CachedPlayers_Think\", function()\n for i = 1, #CachedPlayers do\n local ply = CachedPlayers[i]\n -- Think logic here\n end\nend)\n```\nReason: Calling player.GetAll() every tick allocates a new table and bridges C++ to Lua, causing substantial garbage collection overhead, whereas a local cached table and a numeric loop avoid any allocations.", "durationMs": 6890, "version": "1.1.1" }, { "fixtureId": "gmod.perf.ply-table-index.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal playerData = {}\n\n-- Writing data\nplayerData[ply] = \"value\"\n\n-- Reading data (significantly faster as it bypasses the entity metatable)\nlocal val = playerData[ply]\n\n-- Clean up when the player leaves to prevent memory leaks\nhook.Add(\"EntityRemoved\", \"CleanPlayerData\", function(ent)\n playerData[ent] = nil\nend)\n```\nReason: Indexing a player entity directly triggers the Entity metatable's __index lookup, whereas indexing a local Lua table by the player object bypasses this overhead completely.", "durationMs": 7159, "version": "1.1.1" }, { "fixtureId": "gmod.perf.seq-tables.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "incorrect", "detail": "Did not match a fixture answer pattern.", "finalResponse": "```lua\nlocal tbl = {\n \"value1\",\n \"value2\",\n \"value3\"\n}\n```\nReason: Sequential number-indexed arrays are stored in the table's array portion, allowing extremely fast iteration using a numeric for loop or ipairs, which LuaJIT can optimize and compile much more efficiently than pairs/next traversal over hash-map parts.", "durationMs": 5570, "version": "1.1.1" }, { "fixtureId": "gmod.perf.setdrawcolor-split.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nsurface.SetDrawColor(r, g, b, a)\n```\nReason: Passing separate numeric arguments is faster because it avoids the overhead of indexing table keys (.r, .g, .b, .a) or creating temporary Color objects that trigger garbage collection in hot rendering paths.", "durationMs": 4704, "version": "1.1.1" }, { "fixtureId": "gmod.perf.sqlite-vs-mysql.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal steamid = \"STEAM_0:1:123456\"\nlocal result = sql.Query(\"SELECT value FROM player_data WHERE steamid = \" .. sql.SQLStr(steamid) .. \";\")\n```\nReason: Local SQLite executes synchronously on the same machine, eliminating the network latency, socket overhead, and handshake delays associated with a remote MySQL database connection.", "durationMs": 5282, "version": "1.1.1" }, { "fixtureId": "gmod.perf.steamid-cache.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal plyMeta = FindMetaTable(\"Player\")\nlocal oldSteamID = plyMeta.SteamID\n\nfunction plyMeta:SteamID()\n local id = self._cachedSteamID\n if not id then\n id = oldSteamID(self)\n self._cachedSteamID = id\n end\n return id\nend\n```\nReason: Overriding the Player:SteamID method to cache the string in the player's Lua table avoids the high overhead of crossing the Lua-to-C boundary on subsequent calls.", "durationMs": 6094, "version": "1.1.1" }, { "fixtureId": "gmod.perf.string-table-concat.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain 0 through 0 candidate loops.", "finalResponse": "```lua\nlocal pieces = {}\nfor i = 1, 10000 do\n pieces[i] = \"piece\"\nend\nlocal result = table.concat(pieces)\n```\nReason: Using `table.concat` on an array of strings avoids creating thousands of intermediate garbage strings, drastically reducing memory allocations and garbage collection overhead.", "durationMs": 4481, "version": "1.1.1" }, { "fixtureId": "gmod.perf.surface-drawrect.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nsurface.SetDrawColor(color)\nsurface.DrawRect(x, y, width, height)\n```\nReason: `surface.DrawRect` is a direct C-side engine binding that bypasses the Lua-land wrapper overhead, color table unpacking, and corner-radius checks performed inside `draw.RoundedBox`.", "durationMs": 5679, "version": "1.1.1" }, { "fixtureId": "gmod.perf.surface-text.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nsurface.SetFont(\"Default\")\nsurface.SetTextColor(255, 255, 255, 255)\nsurface.SetTextPos(x, y)\nsurface.DrawText(str)\n```\nReason: The `surface.*` functions interface directly with the engine's C++ rendering code, avoiding the Lua overhead, string parsing, and alignment calculations performed by the `draw` library wrappers.", "durationMs": 5846, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-count-hash.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal length = #myTable\n```\nReason: The length operator (#) is the native Lua operator for retrieving the length of sequential tables, executing in O(log n) time (or O(1) in LuaJIT) compared to table.Count which runs in O(n) time by iterating through all keys.", "durationMs": 4685, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-empty.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nt = {}\n```\nReason: Creating a new table is a constant-time O(1) operation, whereas `table.Empty(t)` is a Lua-implemented O(N) loop that iterates through every key to set it to nil.", "durationMs": 7058, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-hasvalue.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\n-- Define the set using keys for members\nlocal mySet = {\n [\"value1\"] = true,\n [\"value2\"] = true,\n [\"value3\"] = true\n}\n\n-- Fast O(1) lookup\nif mySet[\"value2\"] then\n -- Value exists\nend\n```\nReason: Lua tables are implemented as hash maps, allowing key lookups in O(1) constant time, whereas table.HasValue performs a linear search through the array elements, which runs in O(N) time.", "durationMs": 5233, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-literal.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal t = { x = 1, y = 2, z = 3 }\n```\nReason: Defining fields directly in the table constructor allows LuaJIT to pre-allocate the table with the correct size, avoiding the overhead of multiple reallocations and rehashes that occur when assigning fields one by one to an empty table.", "durationMs": 5554, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-random.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal randomElement = tbl[math.random(#tbl)]\n```\nReason: table.Random supports non-sequential tables and performs an O(N) key-counting traversal, whereas using math.random with the length operator achieves O(1) direct index access.", "durationMs": 5353, "version": "1.1.1" }, { "fixtureId": "gmod.perf.x-times-x.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal y = x * x\n```\nReason: Direct multiplication is significantly faster in LuaJIT than the exponentiation operator (x^2) or math.pow(x, 2), which introduce overhead.", "durationMs": 4515, "version": "1.1.1" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attemptIndex": 1, "status": "pass", "detail": "Uses player.Iterator() (wiki-recommended Lua-cached iterator).", "finalResponse": "```lua\nfor _, ply in player.Iterator() do\n\t-- code\nend\n```\nReason: player.Iterator() is the modern, optimized iteration method in Garry's Mod that avoids the garbage collection overhead of allocating a new table with player.GetAll().", "durationMs": 6183, "version": "1.1.1" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor _, ent in ents.Iterator() do\n\tif ent:GetClass() == \"prop_physics\" then\n\t\t-- Do something with the entity\n\tend\nend\n```\nReason: Using ents.Iterator() iterates directly over the engine's internal entity list, avoiding the memory allocation of a temporary table of all entities that ents.GetAll() would create.", "durationMs": 5971, "version": "1.1.1" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Registers a named hook with hook.Add.", "finalResponse": "```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function()\n -- Code here runs every frame\nend)\n```\nReason: Garry's Mod uses the hook.Add function to register callbacks to hooks, specifying \"Think\" as the hook event and \"MyAddon.Think\" as the unique identifier.", "durationMs": 4712, "version": "1.1.1" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Uses IsValid for entity/object validity.", "finalResponse": "```lua\nif IsValid(ent) then\n -- Safe to call methods on ent\nend\n```\nReason: The global `IsValid` function safely handles cases where the entity reference `ent` is either `nil` or a cleared `NULL` engine object, which would otherwise trigger a runtime script error if methods were called on it directly.", "durationMs": 4483, "version": "1.1.1" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nnet.Receive(\"MyAddon.Sync\", function(len, ply)\n -- Handle the incoming network message data here\nend)\n```\nReason: net.Receive is the standard Garry's Mod library function used to associate a callback function with a specific net message name.", "durationMs": 4540, "version": "1.1.1" }, { "fixtureId": "gmod.perf.angle-zero.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal my_angle = Angle()\n\n-- In the hot path:\nmy_angle:Zero()\n```\nReason: Pre-allocating a single Angle object outside the hot path and calling `:Zero()` to reset it in-place avoids the memory allocation and garbage collection overhead of constructing a new Angle object.", "durationMs": 7332, "version": "1.1.1" }, { "fixtureId": "gmod.perf.config-var.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "incorrect", "detail": "Matched an incorrect-answer pattern.", "finalResponse": "```lua\nlocal cached_color = myaddon.config.color\n\nlocal color = cached_color\n```\nReason: Local variables are stored in virtual machine registers and accessed directly, avoiding the multiple hash table lookups required to resolve nested tables.", "durationMs": 5952, "version": "1.1.1" }, { "fixtureId": "gmod.perf.darkrpvar.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal jobName = ply:getDarkRPVar(\"job\")\n```\nReason: DarkRP stores and networks player job data via its own internal system accessed via `getDarkRPVar`, which is more efficient and reliable than the engine's generic `GetNWString`.", "durationMs": 5406, "version": "1.1.1" }, { "fixtureId": "gmod.perf.disttosqr.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal vecA = Vector(100, 200, 300)\nlocal vecB = Vector(110, 200, 305)\nlocal threshold = 50\n\nif vecA:DistToSqr(vecB) < (threshold * threshold) then\n -- The distance between the vectors is within the threshold\nend\n```\nReason: Using Vector:DistToSqr avoids the computationally expensive square root operation required by Vector:Distance.", "durationMs": 5393, "version": "1.1.1" }, { "fixtureId": "gmod.perf.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor _, ent in ents.Iterator() do\n -- Code to execute for each entity\nend\n```\nReason: `ents.Iterator` is the wiki-recommended efficient iterator for looping over all entities because it does not allocate a copy of the entity list table, unlike `ents.GetAll`.", "durationMs": 4709, "version": "1.1.1" }, { "fixtureId": "gmod.perf.find-ents-near.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal pos = ply:GetPos()\nlocal range = 500\nlocal mins = pos - Vector(range, range, range)\nlocal maxs = pos + Vector(range, range, range)\nlocal entities = ents.FindInBox(mins, maxs)\n```\nReason: ents.FindInBox is faster than ents.FindInSphere because it performs a simple axis-aligned bounding box (AABB) overlap check, avoiding the more expensive distance/radius calculations.", "durationMs": 5748, "version": "1.1.1" }, { "fixtureId": "gmod.perf.find-players-near.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal function GetPlayersInSphere(position, radius)\n\tlocal targets = {}\n\tlocal radiusSqr = radius * radius\n\tlocal players = player.GetAll()\n\t\n\tfor i = 1, #players do\n\t\tlocal ply = players[i]\n\t\tif ply:GetPos():DistToSqr(position) <= radiusSqr then\n\t\t\ttargets[#targets + 1] = ply\n\t\tend\n\tend\n\t\n\treturn targets\nend\n```\nReason: Iterating over player.GetAll() with a squared distance check is faster because it only evaluates the small pool of active players (typically <= 128) rather than querying the spatial partition for all entities in the area, avoiding the heavy C++-to-Lua object instantiation overhead for non-player entities.", "durationMs": 6056, "version": "1.1.1" }, { "fixtureId": "gmod.perf.for-vs-while.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor i = 1, n do\n -- loop body\nend\n```\nReason: Numeric for loops in Lua are optimized at the bytecode level using dedicated VM instructions and registers, avoiding the explicit lookup, addition, and re-assignment operations required to increment a counter in a while loop.", "durationMs": 4582, "version": "1.1.1" }, { "fixtureId": "gmod.perf.hook-once.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal players = player.GetAll()\nhook.Run(\"TickPlayers\", players)\n```\nReason: Calling hook.Run once avoids the CPU overhead of repeating hook table lookups, argument handling, and listener function calls for every player.", "durationMs": 6160, "version": "1.1.1" }, { "fixtureId": "gmod.perf.hudpaint-cache.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nhook.Add(\"HUDPaint\", \"OptimizedHealthDraw\", function()\n local ply = LocalPlayer()\n if not IsValid(ply) then return end\n\n local hp = ply:Health()\n\n -- Draw calls using the cached health value\n draw.SimpleText(\"Health: \" .. hp, \"DermaDefault\", 50, 50, color_white)\n draw.SimpleText(\"HP: \" .. hp, \"DermaDefault\", 50, 70, color_white)\n draw.SimpleText(hp, \"DermaDefault\", 50, 90, color_white)\nend)\n```\nReason: Caching LocalPlayer() and the health value in local variables avoids repeated C++ boundary transitions and function lookups across multiple calls in the same frame.", "durationMs": 6112, "version": "1.1.1" }, { "fixtureId": "gmod.perf.local-color.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal color_white = Color(255, 255, 255)\n\nhook.Add(\"HUDPaint\", \"DrawBox\", function()\n surface.SetDrawColor(color_white)\n surface.DrawRect(50, 50, 100, 100)\nend)\n```\nReason: Calling Color() inside a loop repeatedly instantiates new table objects, causing garbage collection overhead, whereas caching the color in a local variable outside the loop allows reusing the same reference.", "durationMs": 5628, "version": "1.1.1" }, { "fixtureId": "gmod.perf.local-vs-global.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal sin = math.sin\n\nfor i = 1, 1000000 do\n local y = sin(i)\nend\n```\nReason: Localizing the function caches the lookup, replacing a table index operation (`math.sin`) with a fast local register lookup in Lua's virtual machine.", "durationMs": 4475, "version": "1.1.1" }, { "fixtureId": "gmod.perf.localplayer-cache.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal lp\nlocal function GetLocalPlayer()\n if not IsValid(lp) then\n lp = LocalPlayer()\n end\n return lp\nend\n```\nReason: Caching the player entity in a local variable avoids repeated global table lookups and C-function overhead, while the `IsValid` check ensures the player is fully initialized before caching.", "durationMs": 6113, "version": "1.1.1" }, { "fixtureId": "gmod.perf.looking-at.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal function ArePlayersFacingEachOther(ply1, ply2, threshold)\n threshold = threshold or 0.7\n local dir = ply2:GetShootPos() - ply1:GetShootPos()\n dir:Normalize()\n return ply1:GetAimVector():Dot(dir) > threshold and ply2:GetAimVector():Dot(dir) < -threshold\nend\n```\nReason: Using the dot product of the players' aim vectors against the normalized vector between them allows checking if they are facing each other using cheap vector arithmetic, avoiding expensive math.acos calls.", "durationMs": 7522, "version": "1.1.1" }, { "fixtureId": "gmod.perf.meta-vs-arg.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nSomeHelper(ply)\n```\nReason: `SomeHelper(ply)` is faster because `ply:SomeHelper()` requires indexing the Player userdata to look up the function in its metatable, which incurs a performance penalty compared to a direct function call.", "durationMs": 5741, "version": "1.1.1" }, { "fixtureId": "gmod.perf.msg-vs-print.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal Msg = Msg\nMsg( \"debug\\n\" )\n```\nReason: Localizing `Msg` avoids global namespace lookups and bypasses `print`'s internal overhead of string conversion, tab separation, and newline formatting.", "durationMs": 5100, "version": "1.1.1" }, { "fixtureId": "gmod.perf.pairs-ipairs-for.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor i = 1, #myTable do\n local value = myTable[i]\n -- process value\nend\n```\nReason: Garry's Mod uses LuaJIT, which optimizes numeric for loops into highly efficient machine instructions, bypassing the generator function call overhead associated with ipairs and pairs.", "durationMs": 5855, "version": "1.1.1" }, { "fixtureId": "gmod.perf.plain-lua-vs-fn.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal names = {}\nlocal count = 0\nlocal plys = player.GetAll()\n\nfor i = 1, #plys do\n local ply = plys[i]\n if ply:Team() == TEAM_CITIZEN then\n count = count + 1\n names[count] = ply:Nick()\n end\nend\n```\nReason: A single-pass numeric loop avoids closure allocations, function call overhead, and intermediate table creations inherent in functional combinators.", "durationMs": 5562, "version": "1.1.1" }, { "fixtureId": "gmod.perf.player-cache-hooks.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal cachedPlayers = player.GetAll()\n\nlocal function updateCache()\n cachedPlayers = player.GetAll()\nend\n\nhook.Add(\"PlayerInitialSpawn\", \"CachePlayers_Join\", updateCache)\nhook.Add(\"PlayerDisconnected\", \"CachePlayers_Leave\", function()\n -- timer.Simple(0) ensures the disconnected player is fully removed from player.GetAll() before rebuild\n timer.Simple(0, updateCache)\nend)\n\nhook.Add(\"Think\", \"CachedThinkExample\", function()\n for i = 1, #cachedPlayers do\n local ply = cachedPlayers[i]\n -- Process player logic here\n end\nend)\n```\nReason: Caching the player list and rebuilding it only on join/leave events avoids allocating a new table and querying the C++ engine via player.GetAll() up to 66+ times per second, significantly reducing garbage generation and CPU overhead.", "durationMs": 6563, "version": "1.1.1" }, { "fixtureId": "gmod.perf.ply-table-index.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal playerData = {}\n\n-- Store data\nplayerData[ply] = value\n\n-- Read data (fast direct lookup bypassing metatable search)\nlocal value = playerData[ply]\n\n-- Clean up to prevent memory leaks when players disconnect\nhook.Add(\"PlayerDisconnected\", \"CleanupFastData\", function(ply)\n playerData[ply] = nil\nend)\n```\nReason: Indexing the player object directly triggers GMod's custom `__index` metamethod which routes through C-side lookups, whereas a local Lua table indexed by the player object bypasses all metatable overhead for direct, near-instantaneous reads.", "durationMs": 6415, "version": "1.1.1" }, { "fixtureId": "gmod.perf.seq-tables.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "incorrect", "detail": "Did not match a fixture answer pattern.", "finalResponse": "```lua\nlocal my_table = { \"value1\", \"value2\", \"value3\" }\n```\nReason: Sequential number-indexed arrays store values contiguously in the table's array portion, allowing the LuaJIT compiler to optimize iteration via numeric for loops or ipairs, whereas string-keyed maps store values in the hash portion which requires slower hash-chain traversal using pairs or next.", "durationMs": 5670, "version": "1.1.1" }, { "fixtureId": "gmod.perf.setdrawcolor-split.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nsurface.SetDrawColor(r, g, b, a)\n```\nReason: Passing separate numeric arguments is faster because it avoids the overhead of Color object allocation, table dereferencing, and GC churn in hot rendering hooks.", "durationMs": 5225, "version": "1.1.1" }, { "fixtureId": "gmod.perf.sqlite-vs-mysql.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal result = sql.Query(\"SELECT * FROM player_data WHERE steamid = \" .. sql.SQLStr(steamID) .. \";\")\n```\nReason: Local SQLite runs directly in-process on the game server's host machine, eliminating the network latency, TCP overhead, and connection handshake delays associated with query requests to a remote MySQL server.", "durationMs": 5285, "version": "1.1.1" }, { "fixtureId": "gmod.perf.steamid-cache.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal plyMeta = debug.getregistry().Player\nlocal oldSteamID = plyMeta.SteamID\n\nfunction plyMeta:SteamID()\n local cached = self._steamID\n if not cached then\n cached = oldSteamID(self)\n self._steamID = cached\n end\n return cached\nend\n```\nReason: Caching the SteamID directly on the Player entity's Lua table avoids the overhead of crossing the Lua-to-C boundary on repeated calls.", "durationMs": 6781, "version": "1.1.1" }, { "fixtureId": "gmod.perf.string-table-concat.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain 0 through 0 candidate loops.", "finalResponse": "```lua\nlocal pieces = {}\nfor i = 1, 10000 do\n pieces[i] = \"piece\"\nend\nlocal result = table.concat(pieces)\n```\nReason: Using table.concat avoids creating thousands of intermediate string allocations in memory, preventing garbage collection overhead and reducing time complexity from quadratic to linear.", "durationMs": 5424, "version": "1.1.1" }, { "fixtureId": "gmod.perf.surface-drawrect.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nsurface.SetDrawColor(color)\nsurface.DrawRect(x, y, w, h)\n```\nReason: surface.DrawRect calls the engine's C++ rendering functions directly, bypassing the Lua-implemented overhead and parameter checks of the draw.RoundedBox wrapper.", "durationMs": 6016, "version": "1.1.1" }, { "fixtureId": "gmod.perf.surface-text.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nsurface.SetFont( \"DermaDefault\" )\nsurface.SetTextColor( 255, 255, 255, 255 )\nsurface.SetTextPos( x, y )\nsurface.DrawText( text )\n```\nReason: surface.DrawText and its setup functions are direct C++ engine bindings, whereas the draw library functions are Lua-implemented wrappers that introduce overhead from string splitting, alignment calculations, and multiple draw calls for outlines.", "durationMs": 5775, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-count-hash.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal tbl = { \"apple\", \"banana\", \"cherry\" }\nlocal length = #tbl\n```\nReason: The native `#` operator is the fastest and standard Lua method to get the length of a sequential, one-indexed array-like table.", "durationMs": 5686, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-empty.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nt = {}\n```\nReason: Creating a new table with `t = {}` is a simple O(1) allocation, whereas `table.Empty(t)` uses a loop to set every key to nil, which is an O(N) operation and significantly slower for large tables.", "durationMs": 7034, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-hasvalue.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\n-- Fast lookup table (set) representation\nlocal mySet = {\n [\"value1\"] = true,\n [\"value2\"] = true,\n [\"value3\"] = true\n}\n\n-- Check if value exists (O(1) time complexity)\nif mySet[\"value2\"] then\n -- Value exists\nend\n```\nReason: Key-based lookup in a table uses a hash map operation with O(1) average time complexity, whereas table.HasValue performs a linear scan with O(N) time complexity.", "durationMs": 5508, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-literal.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal tbl = {\n field1 = \"value1\",\n field2 = \"value2\",\n field3 = \"value3\"\n}\n```\nReason: Putting fields in the table constructor allows the LuaJIT VM to pre-allocate the table with the correct hash/array size in a single allocation, avoiding the performance overhead of repeated resizing and rehashing that occurs when assigning fields one by one to an empty table.", "durationMs": 5329, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-random.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal randomElement = tbl[math.random(#tbl)]\n```\nReason: Using math.random with the length operator `#` is an O(1) lookup, whereas table.Random is designed for non-sequential tables and incurs O(N) traversal overhead.", "durationMs": 20391, "version": "1.1.1" }, { "fixtureId": "gmod.perf.x-times-x.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal squared = x * x\n```\nReason: Direct multiplication is faster and more easily optimized by the LuaJIT compiler than using the exponentiation operator (x ^ 2) or math.pow.", "durationMs": 5179, "version": "1.1.1" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attemptIndex": 1, "status": "pass", "detail": "Uses player.Iterator() (wiki-recommended Lua-cached iterator).", "finalResponse": "```lua\nfor _, ply in player.Iterator() do\n\t-- ply represents the player object\nend\n```\nReason: player.Iterator() is the modern and optimized method in Garry's Mod that avoids allocating a new table copy on every call, unlike player.GetAll().", "durationMs": 37526, "version": "1.1.1" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 2346, "version": "1.1.1" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Registers a named hook with hook.Add.", "finalResponse": "```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function()\n -- Callback code here\nend)\n```\nReason: hook.Add is the standard Garry's Mod function used to attach callbacks to engine events.", "durationMs": 9386, "version": "1.1.1" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Uses IsValid for entity/object validity.", "finalResponse": "```lua\nif IsValid(ent) then\n -- safe to call methods on ent\nend\n```\nReason: The IsValid() global function checks both that the reference is not nil and that its underlying C++ entity object has not been destroyed by the engine.", "durationMs": 9466, "version": "1.1.1" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nnet.Receive(\"MyAddon.Sync\", function(len, ply)\n -- Your handler logic here\nend)\n```\nReason: `net.Receive` is the built-in function provided by the Garry's Mod net library to register a callback for when a specific network message string is received.", "durationMs": 7952, "version": "1.1.1" }, { "fixtureId": "gmod.perf.angle-zero.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal cachedAngle = Angle()\n\nlocal function MyHotPath()\n cachedAngle:Zero()\n -- Use cachedAngle safely here without allocating a new object\nend\n```\nReason: Caching an Angle object outside the loop and resetting it with `:Zero()` prevents continuous object allocation and significantly reduces garbage collection overhead.", "durationMs": 13168, "version": "1.1.1" }, { "fixtureId": "gmod.perf.config-var.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal myaddon_config_color = Color(255, 255, 255)\n\nhook.Add(\"HUDPaint\", \"MyAddonDraw\", function()\n surface.SetDrawColor(myaddon_config_color)\nend)\n```\nReason: Local variables are resolved via fast register accesses in LuaJIT, whereas nested table fields require slower hash map lookups on every read.", "durationMs": 9266, "version": "1.1.1" }, { "fixtureId": "gmod.perf.darkrpvar.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal jobName = ply:getDarkRPVar(\"job\")\n```\nReason: DarkRP uses its own custom networking system to sync variables like job and money, which is significantly more bandwidth-efficient than standard NWStrings.", "durationMs": 9987, "version": "1.1.1" }, { "fixtureId": "gmod.perf.disttosqr.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal isWithinRange = vec1:DistToSqr(vec2) < (threshold * threshold)\n```\nReason: DistToSqr avoids the computationally expensive square root calculation that is performed when calculating actual distance, making it much faster for simple threshold comparisons.", "durationMs": 9693, "version": "1.1.1" }, { "fixtureId": "gmod.perf.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor _, ent in ents.Iterator() do\n -- Do something with 'ent'\nend\n```\nReason: `ents.Iterator()` is a stateless C-side iterator that avoids the overhead of allocating and garbage-collecting a new table on every call, making it significantly faster and more memory-efficient than `ipairs(ents.GetAll())`.", "durationMs": 9343, "version": "1.1.1" }, { "fixtureId": "gmod.perf.find-ents-near.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain 0 through 0 candidate loops.", "finalResponse": "```lua\nlocal nearby = ents.FindInSphere(ply:GetPos(), 250)\nfor i = 1, #nearby do\n local ent = nearby[i]\n if IsValid(ent) then\n -- Process entity\n end\nend\n```\nReason: ents.FindInSphere uses the engine's internal C++ spatial partitioning (BSP/octree) to quickly cull distant entities, making it vastly faster than iterating through ents.GetAll() and calculating distances in Lua.", "durationMs": 10156, "version": "1.1.1" }, { "fixtureId": "gmod.perf.find-players-near.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal function GetPlayersInRadius(pos, radius)\n local found = {}\n local radiusSqr = radius * radius\n for _, ply in ipairs(player.GetAll()) do\n if ply:GetPos():DistToSqr(pos) <= radiusSqr then\n found[#found + 1] = ply\n end\n end\n return found\nend\n```\nReason: Iterating the globally cached `player.GetAll()` table and using `DistToSqr` is much faster because it avoids the C++ spatial partition query and prevents the expensive Lua table allocation/garbage collection overhead caused by returning all entities in the sphere.", "durationMs": 14750, "version": "1.1.1" }, { "fixtureId": "gmod.perf.for-vs-while.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor i = 1, n do\n -- loop body\nend\n```\nReason: A numeric `for` loop is generally faster because the loop counter, limit, and step are managed internally by optimized VM instructions, avoiding explicit incrementing and condition checking in Lua space.", "durationMs": 9825, "version": "1.1.1" }, { "fixtureId": "gmod.perf.hook-once.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nhook.Add(\"Tick\", \"NotifyPlayersBatch\", function()\n local plys = player.GetAll()\n hook.Run(\"CustomPlayerTick\", plys)\nend)\n```\nReason: Calling hook.Run once minimizes the expensive internal table lookups and function dispatch overhead of the hook library, which scales poorly when executed per-player every single tick.", "durationMs": 14539, "version": "1.1.1" }, { "fixtureId": "gmod.perf.hudpaint-cache.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nhook.Add(\"HUDPaint\", \"OptimizedHealthDraw\", function()\n local ply = LocalPlayer()\n if not IsValid(ply) then return end\n \n local health = ply:Health()\n \n draw.SimpleText(health, \"DermaDefault\", 50, 50, color_white)\n draw.SimpleText(health, \"DermaDefault\", 50, 70, color_white)\n draw.SimpleText(health, \"DermaDefault\", 50, 90, color_white)\nend)\n```\nReason: Caching the result of LocalPlayer():Health() into a local variable avoids the performance overhead of repeatedly crossing the Lua-to-C++ boundary within the same frame.", "durationMs": 14484, "version": "1.1.1" }, { "fixtureId": "gmod.perf.local-color.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal myColor = Color(255, 255, 255) -- or simply use the built-in color_white\n\nhook.Add(\"HUDPaint\", \"OptimizedPaintLoop\", function()\n surface.SetDrawColor(myColor)\n surface.DrawRect(0, 0, 100, 100)\nend)\n```\nReason: Caching the Color object outside the render hook prevents allocating a new table every frame, avoiding unnecessary garbage collection overhead and potential stuttering.", "durationMs": 13895, "version": "1.1.1" }, { "fixtureId": "gmod.perf.local-vs-global.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal sin = math.sin\nfor i = 1, 10000 do\n local val = sin(i)\nend\n```\nReason: Local variable lookups in Lua are faster than table lookups since locals are accessed by index in a register rather than by a hash map lookup.", "durationMs": 8932, "version": "1.1.1" }, { "fixtureId": "gmod.perf.localplayer-cache.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal ply\n\nhook.Add(\"Think\", \"OptimizedHook\", function()\n ply = IsValid(ply) and ply or LocalPlayer()\n if not IsValid(ply) then return end\n\n -- Use 'ply' here directly instead of calling LocalPlayer()\nend)\n```\nReason: Caching the local player entity object and only re-fetching it if it evaluates as invalid avoids the overhead of repeatedly calling the C++ bound `LocalPlayer()` function every frame.", "durationMs": 16802, "version": "1.1.1" }, { "fixtureId": "gmod.perf.looking-at.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal function ArePlayersLookingAtEachOther(ply1, ply2, threshold)\n threshold = threshold or 0.8\n local dir = (ply2:GetShootPos() - ply1:GetShootPos()):GetNormalized()\n return ply1:GetAimVector():Dot(dir) > threshold and ply2:GetAimVector():Dot(-dir) > threshold\nend\n```\nReason: The dot product of normalized vectors yields the cosine of the angle, allowing a fast threshold comparison that avoids expensive math.acos calls while verifying both aim vectors align with the line connecting the players.", "durationMs": 12139, "version": "1.1.1" }, { "fixtureId": "gmod.perf.meta-vs-arg.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nSomeHelper(ply)\n```\nReason: Calling a function directly avoids the overhead of metatable index lookups associated with the colon operator.", "durationMs": 8931, "version": "1.1.1" }, { "fixtureId": "gmod.perf.msg-vs-print.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nMsgN(\"Debug line\")\n```\nReason: MsgN directly calls the engine's print function, bypassing the additional formatting overhead and type checks of the global print function.", "durationMs": 8550, "version": "1.1.1" }, { "fixtureId": "gmod.perf.pairs-ipairs-for.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor i = 1, #tbl do\n local val = tbl[i]\nend\n```\nReason: Garry's Mod runs on LuaJIT, which heavily optimizes numeric for loops over sequential arrays and avoids the function call overhead required by pairs and ipairs iterators.", "durationMs": 14758, "version": "1.1.1" }, { "fixtureId": "gmod.perf.plain-lua-vs-fn.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal result = {}\nlocal index = 1\nfor i = 1, #inputList do\n local item = inputList[i]\n if item.isValid then\n result[index] = item.value * 2\n index = index + 1\n end\nend\n```\nReason: A single imperative loop avoids intermediate table allocations, closure creation, and function call overhead, allowing LuaJIT to fully trace and optimize the execution.", "durationMs": 10705, "version": "1.1.1" }, { "fixtureId": "gmod.perf.player-cache-hooks.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal cachedPlayers = {}\nlocal numPlayers = 0\n\nlocal function RefreshPlayerCache()\n cachedPlayers = player.GetAll()\n numPlayers = #cachedPlayers\nend\n\nhook.Add(\"PlayerInitialSpawn\", \"UpdatePlayerCacheJoin\", RefreshPlayerCache)\nhook.Add(\"PlayerDisconnected\", \"UpdatePlayerCacheLeave\", RefreshPlayerCache)\n\n-- Initialize cache in case script loads after players have joined\nRefreshPlayerCache()\n\nhook.Add(\"Tick\", \"OptimizedPlayerTick\", function()\n for i = 1, numPlayers do\n local ply = cachedPlayers[i]\n if IsValid(ply) then\n -- Perform tick logic for ply here\n end\n end\nend)\n```\nReason: Calling `player.GetAll()` every tick creates a new table and causes significant garbage collection overhead; updating the cache only on connect/disconnect events avoids this continuous memory allocation while allowing a highly optimized numerical loop.", "durationMs": 13375, "version": "1.1.1" }, { "fixtureId": "gmod.perf.ply-table-index.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal playerData = {}\n\n-- Store data\nplayerData[ply] = value\n\n-- Read data frequently\nlocal myData = playerData[ply]\n```\nReason: Accessing a standard Lua table avoids the __index metamethod overhead and C++ boundary crossing inherent to userdata entity objects.", "durationMs": 11689, "version": "1.1.1" }, { "fixtureId": "gmod.perf.seq-tables.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal collection = {\n \"item1\",\n \"item2\",\n \"item3\"\n}\n\nfor i = 1, #collection do\n local value = collection[i]\nend\n```\nReason: Sequential number-indexed arrays iterated with a numeric for-loop are much faster in LuaJIT than string-keyed maps using pairs() because they avoid hash table lookups and allow for highly optimized, predictable memory access.", "durationMs": 10490, "version": "1.1.1" }, { "fixtureId": "gmod.perf.setdrawcolor-split.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nsurface.SetDrawColor(255, 255, 255, 255)\n```\nReason: Passing separate number primitives is faster in LuaJIT because it completely avoids the overhead of table allocation (if created inline) and the internal C++ field lookups required to extract values from a Color object.", "durationMs": 11406, "version": "1.1.1" }, { "fixtureId": "gmod.perf.sqlite-vs-mysql.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal result = sql.Query(\"SELECT * FROM player_data WHERE steamid = 'STEAM_0:1:12345678' LIMIT 1\")\nif result then\n PrintTable(result)\nend\n```\nReason: Local SQLite has lower latency because it operates directly on the local server disk, completely avoiding the network overhead and round-trip time required to communicate with a remote MySQL database.", "durationMs": 9336, "version": "1.1.1" }, { "fixtureId": "gmod.perf.steamid-cache.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal function GetCachedSteamID(ply)\n local id = ply.CachedSteamID\n if id then return id end\n \n id = ply:SteamID()\n ply.CachedSteamID = id\n return id\nend\n```\nReason: Retrieving a stored value from a Lua table bypasses the overhead of crossing the C/C++ boundary that occurs when calling engine functions.", "durationMs": 14100, "version": "1.1.1" }, { "fixtureId": "gmod.perf.string-table-concat.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "protocol_error", "detail": "Answer must contain 0 through 0 candidate loops.", "finalResponse": "```lua\nlocal pieces = {}\nfor i = 1, 10000 do\n pieces[i] = \"some_small_string_piece_\" .. i\nend\nlocal final_string = table.concat(pieces)\n```\nReason: table.concat allocates memory once for the final string, avoiding the massive performance overhead of allocating and garbage-collecting thousands of intermediate string objects caused by repeated .. concatenation.", "durationMs": 10961, "version": "1.1.1" }, { "fixtureId": "gmod.perf.surface-drawrect.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nsurface.DrawRect(x, y, w, h)\n```\nReason: surface.DrawRect avoids the Lua wrapper overhead, color table lookup, and conditional branch checks present in draw.RoundedBox.", "durationMs": 15652, "version": "1.1.1" }, { "fixtureId": "gmod.perf.surface-text.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nhook.Add(\"HUDPaint\", \"DrawFastText\", function()\n surface.SetFont(\"Default\")\n surface.SetTextColor(255, 255, 255, 255)\n surface.SetTextPos(50, 50)\n surface.DrawText(\"Fastest drawing approach\")\nend)\n```\nReason: Calling the underlying C-bound `surface.*` functions directly bypasses the additional Lua-side overhead, table lookups, and function calls introduced by wrapper libraries like `draw`.", "durationMs": 11937, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-count-hash.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\n#table_name\n```\nReason: The `#` operator is the standard, built-in, and most performant way in Lua 5.1/LuaJIT (which GMod uses) to get the length of a sequential array.", "durationMs": 8176, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-empty.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nt = {}\n```\nReason: Reassigning to a new table is an O(1) operation that simply drops the reference to the old table, avoiding the O(n) iteration overhead of `table.Empty()`.", "durationMs": 12717, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-hasvalue.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal mySet = {\n [\"apple\"] = true,\n [\"banana\"] = true,\n [\"orange\"] = true\n}\n\nif mySet[\"apple\"] then\n -- Value exists\nend\n```\nReason: Using the values as table keys allows for O(1) hash map lookups, whereas table.HasValue performs a slower O(n) sequential search through the list.", "durationMs": 11357, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-literal.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal tbl = { x = 1, y = 2, z = 3 }\n```\nReason: Using the table constructor allows Lua to pre-allocate the exact size needed for the fields, avoiding expensive reallocations and rehashing that occur when assigning elements to an initially empty table.", "durationMs": 10175, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-random.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal randomElement = tbl[math.random(#tbl)]\n```\nReason: Using the length operator (#) with math.random provides O(1) direct access, avoiding the O(N) iteration and counting overhead of table.Random.", "durationMs": 11095, "version": "1.1.1" }, { "fixtureId": "gmod.perf.x-times-x.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal result = x * x\n```\nReason: In LuaJIT, direct multiplication avoids the function call and exponentiation overhead of `math.pow(x, 2)` or `x^2`, compiling to a single fast CPU multiplication instruction.", "durationMs": 9919, "version": "1.1.1" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attemptIndex": 1, "status": "partial", "detail": "Uses ipairs but still allocates via player.GetAll() each time.", "finalResponse": "```lua\nfor _, ply in ipairs(player.GetAll()) do\n -- Do something with ply\nend\n```\nReason: Using `ipairs` is faster and more optimal than `pairs` when iterating over sequentially indexed tables like the one returned by `player.GetAll()`.", "durationMs": 10133, "version": "1.1.1" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor _, ent in ipairs(ents.FindByClass(\"prop_physics\")) do\n -- your code here\nend\n```\nReason: `ents.FindByClass` filters entities on the C++ side and only returns a table of the matching entities, avoiding the performance overhead of building a table of every entity in the map like `ents.GetAll` would.", "durationMs": 14333, "version": "1.1.1" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Registers a named hook with hook.Add.", "finalResponse": "```lua\nhook.Add(\"Think\", \"MyAddon.Think\", function()\n -- Callback body\nend)\n```\nReason: The `hook.Add` function is the standard way to register a callback to a specific event (like \"Think\") with a unique identifier in Garry's Mod.", "durationMs": 8680, "version": "1.1.1" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Uses IsValid for entity/object validity.", "finalResponse": "```lua\nif IsValid(ent) then\n -- safe to call methods on ent\nend\n```\nReason: `IsValid()` checks if the reference is non-nil and ensures the underlying C++ entity object has not been removed from the engine.", "durationMs": 8607, "version": "1.1.1" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nnet.Receive(\"MyAddon.Sync\", function(len, ply)\n -- Your handler code here\nend)\n```\nReason: net.Receive is the standard function in Garry's Mod used to register a callback that executes when a network message with the specified name is received.", "durationMs": 8565, "version": "1.1.1" }, { "fixtureId": "gmod.perf.angle-zero.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal tempAngle = Angle()\n\nlocal function MyHotPathFunction()\n tempAngle:Zero()\n -- Modify and use tempAngle here instead of calling Angle()\nend\n```\n\nReason: Reusing a pre-allocated variable and resetting it with `:Zero()` avoids the expensive C++ userdata memory allocation and subsequent garbage collection overhead of constructing a new Angle object every time.", "durationMs": 16205, "version": "1.1.1" }, { "fixtureId": "gmod.perf.config-var.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal myaddon_config_color = Color(255, 255, 255)\n\nhook.Add(\"HUDPaint\", \"MyAddonDraw\", function()\n surface.SetDrawColor(myaddon_config_color)\nend)\n```\nReason: Local variables are stored in registers and accessed via direct array indexing in the Lua VM, entirely bypassing the expensive string hashing and hash table lookups required for nested global tables.", "durationMs": 11861, "version": "1.1.1" }, { "fixtureId": "gmod.perf.darkrpvar.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "incorrect", "detail": "Did not match a fixture answer pattern.", "finalResponse": "```lua\nlocal jobName = team.GetName(ply:Team())\n```\nReason: Garry's Mod networks a player's team index natively, so looking up the name locally via the engine's team library is much faster and avoids wasting networked string limits.", "durationMs": 11841, "version": "1.1.1" }, { "fixtureId": "gmod.perf.disttosqr.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nvec1:DistToSqr(vec2) < (threshold * threshold)\n```\nReason: It calculates the squared distance, avoiding the computationally expensive square root operation required to find the exact distance.", "durationMs": 11371, "version": "1.1.1" }, { "fixtureId": "gmod.perf.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor _, ent in ents.Iterator() do\n -- do something with ent\nend\n```\nReason: ents.Iterator() is the wiki-recommended zero-allocation iterator, making it significantly faster and more memory-efficient than creating a new table with ents.GetAll().", "durationMs": 10403, "version": "1.1.1" }, { "fixtureId": "gmod.perf.find-ents-near.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal nearby_ents = ents.FindInSphere(ply:GetPos(), 500)\n```\nReason: ents.FindInSphere leverages the Source engine's spatial partitioning to rapidly query entities within a radius without iterating through all entities on the server.", "durationMs": 12490, "version": "1.1.1" }, { "fixtureId": "gmod.perf.find-players-near.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal function GetPlayersInRadius(pos, radius)\n local found = {}\n local radiusSqr = radius * radius\n for _, ply in ipairs(player.GetAll()) do\n if ply:GetPos():DistToSqr(pos) <= radiusSqr then\n found[#found + 1] = ply\n end\n end\n return found\nend\n```\nReason: Iterating over the relatively small list of all players and checking their squared distance avoids the expensive engine overhead of querying the spatial partition for every entity type and generating a large intermediate table.", "durationMs": 16236, "version": "1.1.1" }, { "fixtureId": "gmod.perf.for-vs-while.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor i = 1, n do\n -- loop body\nend\n```\nReason: The numeric `for` loop utilizes dedicated, highly optimized virtual machine opcodes for iteration, avoiding the manual incrementation and condition checking overhead required by a `while` loop.", "durationMs": 10993, "version": "1.1.1" }, { "fixtureId": "gmod.perf.hook-once.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nhook.Add(\"Tick\", \"NotifyAllPlayers\", function()\n local plys = player.GetAll()\n hook.Run(\"CustomPlayerTick\", plys)\nend)\n```\nReason: hook.Run has internal overhead from string lookups and iterating over listeners, so calling it once with a table of players is significantly faster than invoking that overhead for every single player in a loop.", "durationMs": 13499, "version": "1.1.1" }, { "fixtureId": "gmod.perf.hudpaint-cache.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nhook.Add(\"HUDPaint\", \"OptimizedHUD\", function()\n local ply = LocalPlayer()\n if not IsValid(ply) then return end\n \n local hp = ply:Health()\n draw.SimpleText(\"Health: \" .. hp, \"DermaDefault\", 50, 50, color_white)\n draw.SimpleText(\"Health: \" .. hp, \"DermaDefault\", 51, 51, color_black)\n draw.SimpleText(\"Health: \" .. hp, \"DermaDefault\", 52, 52, color_white)\nend)\n```\nReason: Caching the health value in a local variable eliminates the overhead of repeatedly executing C++ engine function calls (LocalPlayer and Health) multiple times in a single frame.", "durationMs": 25988, "version": "1.1.1" }, { "fixtureId": "gmod.perf.local-color.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal cachedColor = Color(255, 255, 255)\n\nhook.Add(\"HUDPaint\", \"MyOptimizedPaintLoop\", function()\n surface.SetDrawColor(cachedColor)\nend)\n```\nReason: Caching the Color object outside the hook prevents a new table from being allocated every frame, which avoids unnecessary memory usage and garbage collection overhead.", "durationMs": 14858, "version": "1.1.1" }, { "fixtureId": "gmod.perf.local-vs-global.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal sin = math.sin\nfor i = 1, 100000 do\n local result = sin(i)\nend\n```\nReason: Local variables in Lua are stored in fast virtual machine registers, avoiding the overhead of expensive hash table lookups required by global variables like `math.sin` during every iteration.", "durationMs": 11686, "version": "1.1.1" }, { "fixtureId": "gmod.perf.localplayer-cache.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal ply\n\nhook.Add(\"Think\", \"OptimizedPlayerCache\", function()\n if not IsValid(ply) then\n ply = LocalPlayer()\n if not IsValid(ply) then return end\n end\n\n -- Use 'ply' here instead of calling LocalPlayer()\nend)\n```\nReason: Caching the player entity in a local variable and only updating it when it becomes invalid avoids the overhead of crossing the Lua-to-C++ boundary on every frame or tick.", "durationMs": 17669, "version": "1.1.1" }, { "fixtureId": "gmod.perf.looking-at.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "partial", "detail": "Matched a partial-answer pattern.", "finalResponse": "```lua\nlocal function AreLookingAtEachOther(ply1, ply2, threshold)\n threshold = threshold or 0.8\n local dir = (ply2:GetShootPos() - ply1:GetShootPos()):GetNormalized()\n return ply1:GetAimVector():Dot(dir) > threshold and ply2:GetAimVector():Dot(dir) < -threshold\nend\n```\nReason: The dot product computes the cosine of the angle between two normalized vectors using basic arithmetic, allowing for a fast threshold check without the performance overhead of trigonometric functions like math.acos.", "durationMs": 19173, "version": "1.1.1" }, { "fixtureId": "gmod.perf.meta-vs-arg.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nSomeHelper(ply)\n```\nReason: Direct function calls avoid the overhead of metatable string key lookups associated with method syntax.", "durationMs": 10193, "version": "1.1.1" }, { "fixtureId": "gmod.perf.msg-vs-print.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nMsgN(\"debug line\")\n```\nReason: MsgN directly outputs to the console and avoids the internal formatting, argument iteration, and tab-separation overhead that the global print function performs.", "durationMs": 12648, "version": "1.1.1" }, { "fixtureId": "gmod.perf.pairs-ipairs-for.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nfor i = 1, #myTable do\n local val = myTable[i]\nend\n```\nReason: A numeric for loop is the fastest in Garry's Mod (LuaJIT) because it completely avoids the function call and iterator overhead associated with pairs and ipairs.", "durationMs": 11632, "version": "1.1.1" }, { "fixtureId": "gmod.perf.plain-lua-vs-fn.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal result = {}\nlocal count = 1\nfor i = 1, #inputList do\n local val = inputList[i]\n if val > 0 then -- filter condition\n result[count] = val * 2 -- map transformation\n count = count + 1\n end\nend\n```\nReason: A single `for` loop avoids the function call overhead, closures, and intermediate table allocations inherent to DarkRP's `fn` combinators.", "durationMs": 13358, "version": "1.1.1" }, { "fixtureId": "gmod.perf.player-cache-hooks.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal cached_players = player.GetAll()\nlocal cached_count = #cached_players\n\nhook.Add(\"PlayerInitialSpawn\", \"PlayerCache_Join\", function(ply)\n cached_count = cached_count + 1\n cached_players[cached_count] = ply\nend)\n\nhook.Add(\"PlayerDisconnected\", \"PlayerCache_Leave\", function(ply)\n for i = 1, cached_count do\n if cached_players[i] == ply then\n table.remove(cached_players, i)\n cached_count = cached_count - 1\n break\n end\n end\nend)\n\nhook.Add(\"Think\", \"OptimizedTickHook\", function()\n for i = 1, cached_count do\n local ply = cached_players[i]\n if IsValid(ply) then\n -- Tick logic for player here\n end\n end\nend)\n```\nReason: Maintaining a sequential table updated only on join and leave avoids the overhead of table creation in player.GetAll() and allows the use of a highly optimized numeric for-loop instead of ipairs() every single tick.", "durationMs": 20572, "version": "1.1.1" }, { "fixtureId": "gmod.perf.ply-table-index.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal playerData = {}\n\n-- Writing\nplayerData[ply] = value\n\n-- Reading\nlocal data = playerData[ply]\n```\nReason: Local Lua table lookups avoid the expensive __index metamethod and C-boundary overhead incurred when accessing properties on Garry's Mod userdata objects.", "durationMs": 16145, "version": "1.1.1" }, { "fixtureId": "gmod.perf.seq-tables.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "incorrect", "detail": "Did not match a fixture answer pattern.", "finalResponse": "```lua\nlocal fastArray = {\n \"first_value\",\n \"second_value\",\n \"third_value\"\n}\n```\nReason: Sequential number-indexed arrays are stored in the contiguous array part of Lua's table structure, making iteration with a numeric for loop or `ipairs` significantly faster than the hash map lookups required for string keys.", "durationMs": 10462, "version": "1.1.1" }, { "fixtureId": "gmod.perf.setdrawcolor-split.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nsurface.SetDrawColor( 255, 255, 255, 255 )\n```\nReason: Passing separate numbers directly to the C API avoids the overhead of Lua table indexing and metatable lookups associated with passing a Color object.", "durationMs": 11266, "version": "1.1.1" }, { "fixtureId": "gmod.perf.sqlite-vs-mysql.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "pass", "detail": "Matched a pass pattern.", "finalResponse": "```lua\nlocal result = sql.Query(\"SELECT * FROM player_data WHERE steamid = 'STEAM_0:1:1234567'\")\nif result then\n PrintTable(result)\nelseif result == false then\n print(\"SQL Error: \" .. sql.LastError())\nend\n```\nReason: Local SQLite reads and writes directly to the local disk, completely eliminating the network round-trip latency and socket overhead required to communicate with a remote MySQL server.", "durationMs": 13742, "version": "1.1.1" }, { "fixtureId": "gmod.perf.steamid-cache.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6139, "version": "1.1.1" }, { "fixtureId": "gmod.perf.string-table-concat.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7308, "version": "1.1.1" }, { "fixtureId": "gmod.perf.surface-drawrect.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 5992, "version": "1.1.1" }, { "fixtureId": "gmod.perf.surface-text.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6971, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-count-hash.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6215, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-empty.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6321, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-hasvalue.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6454, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-literal.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7039, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-random.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6990, "version": "1.1.1" }, { "fixtureId": "gmod.perf.x-times-x.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6263, "version": "1.1.1" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6741, "version": "1.1.1" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6754, "version": "1.1.1" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6173, "version": "1.1.1" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7048, "version": "1.1.1" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 11740, "version": "1.1.1" }, { "fixtureId": "gmod.perf.angle-zero.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6458, "version": "1.1.1" }, { "fixtureId": "gmod.perf.config-var.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6474, "version": "1.1.1" }, { "fixtureId": "gmod.perf.darkrpvar.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7960, "version": "1.1.1" }, { "fixtureId": "gmod.perf.disttosqr.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7167, "version": "1.1.1" }, { "fixtureId": "gmod.perf.ents-iterator.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6905, "version": "1.1.1" }, { "fixtureId": "gmod.perf.find-ents-near.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6967, "version": "1.1.1" }, { "fixtureId": "gmod.perf.find-players-near.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6890, "version": "1.1.1" }, { "fixtureId": "gmod.perf.for-vs-while.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6960, "version": "1.1.1" }, { "fixtureId": "gmod.perf.hook-once.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6805, "version": "1.1.1" }, { "fixtureId": "gmod.perf.hudpaint-cache.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6462, "version": "1.1.1" }, { "fixtureId": "gmod.perf.local-color.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6212, "version": "1.1.1" }, { "fixtureId": "gmod.perf.local-vs-global.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6990, "version": "1.1.1" }, { "fixtureId": "gmod.perf.localplayer-cache.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6678, "version": "1.1.1" }, { "fixtureId": "gmod.perf.looking-at.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 5953, "version": "1.1.1" }, { "fixtureId": "gmod.perf.meta-vs-arg.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6221, "version": "1.1.1" }, { "fixtureId": "gmod.perf.msg-vs-print.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6546, "version": "1.1.1" }, { "fixtureId": "gmod.perf.pairs-ipairs-for.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 5937, "version": "1.1.1" }, { "fixtureId": "gmod.perf.plain-lua-vs-fn.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6190, "version": "1.1.1" }, { "fixtureId": "gmod.perf.player-cache-hooks.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6853, "version": "1.1.1" }, { "fixtureId": "gmod.perf.ply-table-index.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6007, "version": "1.1.1" }, { "fixtureId": "gmod.perf.seq-tables.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6173, "version": "1.1.1" }, { "fixtureId": "gmod.perf.setdrawcolor-split.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6189, "version": "1.1.1" }, { "fixtureId": "gmod.perf.sqlite-vs-mysql.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6927, "version": "1.1.1" }, { "fixtureId": "gmod.perf.steamid-cache.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6477, "version": "1.1.1" }, { "fixtureId": "gmod.perf.string-table-concat.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6965, "version": "1.1.1" }, { "fixtureId": "gmod.perf.surface-drawrect.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6944, "version": "1.1.1" }, { "fixtureId": "gmod.perf.surface-text.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 5734, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-count-hash.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7320, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-empty.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6202, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-hasvalue.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6246, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-literal.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6272, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-random.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6164, "version": "1.1.1" }, { "fixtureId": "gmod.perf.x-times-x.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6752, "version": "1.1.1" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6230, "version": "1.1.1" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6116, "version": "1.1.1" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6401, "version": "1.1.1" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6342, "version": "1.1.1" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 5568, "version": "1.1.1" }, { "fixtureId": "gmod.perf.angle-zero.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7031, "version": "1.1.1" }, { "fixtureId": "gmod.perf.config-var.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7131, "version": "1.1.1" }, { "fixtureId": "gmod.perf.darkrpvar.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 5548, "version": "1.1.1" }, { "fixtureId": "gmod.perf.disttosqr.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6158, "version": "1.1.1" }, { "fixtureId": "gmod.perf.ents-iterator.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6222, "version": "1.1.1" }, { "fixtureId": "gmod.perf.find-ents-near.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7092, "version": "1.1.1" }, { "fixtureId": "gmod.perf.find-players-near.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7488, "version": "1.1.1" }, { "fixtureId": "gmod.perf.for-vs-while.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6838, "version": "1.1.1" }, { "fixtureId": "gmod.perf.hook-once.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 8056, "version": "1.1.1" }, { "fixtureId": "gmod.perf.hudpaint-cache.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6272, "version": "1.1.1" }, { "fixtureId": "gmod.perf.local-color.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7516, "version": "1.1.1" }, { "fixtureId": "gmod.perf.local-vs-global.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6353, "version": "1.1.1" }, { "fixtureId": "gmod.perf.localplayer-cache.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6238, "version": "1.1.1" }, { "fixtureId": "gmod.perf.looking-at.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6153, "version": "1.1.1" }, { "fixtureId": "gmod.perf.meta-vs-arg.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6172, "version": "1.1.1" }, { "fixtureId": "gmod.perf.msg-vs-print.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6238, "version": "1.1.1" }, { "fixtureId": "gmod.perf.pairs-ipairs-for.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6204, "version": "1.1.1" }, { "fixtureId": "gmod.perf.plain-lua-vs-fn.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7064, "version": "1.1.1" }, { "fixtureId": "gmod.perf.player-cache-hooks.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7270, "version": "1.1.1" }, { "fixtureId": "gmod.perf.ply-table-index.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6450, "version": "1.1.1" }, { "fixtureId": "gmod.perf.seq-tables.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7015, "version": "1.1.1" }, { "fixtureId": "gmod.perf.setdrawcolor-split.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 5808, "version": "1.1.1" }, { "fixtureId": "gmod.perf.sqlite-vs-mysql.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6172, "version": "1.1.1" }, { "fixtureId": "gmod.perf.steamid-cache.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6638, "version": "1.1.1" }, { "fixtureId": "gmod.perf.string-table-concat.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6180, "version": "1.1.1" }, { "fixtureId": "gmod.perf.surface-drawrect.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6929, "version": "1.1.1" }, { "fixtureId": "gmod.perf.surface-text.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6139, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-count-hash.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7175, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-empty.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6136, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-hasvalue.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 8056, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-literal.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6285, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-random.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 8745, "version": "1.1.1" }, { "fixtureId": "gmod.perf.x-times-x.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 10236, "version": "1.1.1" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 8900, "version": "1.1.1" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 9246, "version": "1.1.1" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 8833, "version": "1.1.1" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 8162, "version": "1.1.1" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 11099, "version": "1.1.1" }, { "fixtureId": "gmod.perf.angle-zero.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7430, "version": "1.1.1" }, { "fixtureId": "gmod.perf.config-var.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6717, "version": "1.1.1" }, { "fixtureId": "gmod.perf.darkrpvar.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6284, "version": "1.1.1" }, { "fixtureId": "gmod.perf.disttosqr.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6948, "version": "1.1.1" }, { "fixtureId": "gmod.perf.ents-iterator.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6799, "version": "1.1.1" }, { "fixtureId": "gmod.perf.find-ents-near.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6320, "version": "1.1.1" }, { "fixtureId": "gmod.perf.find-players-near.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6768, "version": "1.1.1" }, { "fixtureId": "gmod.perf.for-vs-while.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 5987, "version": "1.1.1" }, { "fixtureId": "gmod.perf.hook-once.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7399, "version": "1.1.1" }, { "fixtureId": "gmod.perf.hudpaint-cache.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7847, "version": "1.1.1" }, { "fixtureId": "gmod.perf.local-color.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7887, "version": "1.1.1" }, { "fixtureId": "gmod.perf.local-vs-global.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7319, "version": "1.1.1" }, { "fixtureId": "gmod.perf.localplayer-cache.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7911, "version": "1.1.1" }, { "fixtureId": "gmod.perf.looking-at.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6928, "version": "1.1.1" }, { "fixtureId": "gmod.perf.meta-vs-arg.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7756, "version": "1.1.1" }, { "fixtureId": "gmod.perf.msg-vs-print.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 8136, "version": "1.1.1" }, { "fixtureId": "gmod.perf.pairs-ipairs-for.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7726, "version": "1.1.1" }, { "fixtureId": "gmod.perf.plain-lua-vs-fn.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7346, "version": "1.1.1" }, { "fixtureId": "gmod.perf.player-cache-hooks.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7234, "version": "1.1.1" }, { "fixtureId": "gmod.perf.ply-table-index.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6167, "version": "1.1.1" }, { "fixtureId": "gmod.perf.seq-tables.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7055, "version": "1.1.1" }, { "fixtureId": "gmod.perf.setdrawcolor-split.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6500, "version": "1.1.1" }, { "fixtureId": "gmod.perf.sqlite-vs-mysql.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6427, "version": "1.1.1" }, { "fixtureId": "gmod.perf.steamid-cache.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6591, "version": "1.1.1" }, { "fixtureId": "gmod.perf.string-table-concat.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6771, "version": "1.1.1" }, { "fixtureId": "gmod.perf.surface-drawrect.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6476, "version": "1.1.1" }, { "fixtureId": "gmod.perf.surface-text.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6662, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-count-hash.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6023, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-empty.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6352, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-hasvalue.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6845, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-literal.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6099, "version": "1.1.1" }, { "fixtureId": "gmod.perf.table-random.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7049, "version": "1.1.1" }, { "fixtureId": "gmod.perf.x-times-x.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 6486, "version": "1.1.1" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attemptIndex": 1, "status": "protocol_error", "detail": "CLI exited without a valid strict response.", "finalResponse": null, "durationMs": 7203, "version": "1.1.1" } ], "summary": { "statusCounts": { "pass": 143, "partial": 20, "incorrect": 10, "protocol_error": 131, "policy_violation": 0, "timeout": 0, "unavailable": 0, "unsupported": 0, "trace_error": 0, "scored": 173 }, "groups": [ { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.ents-iterator.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.hook-add.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.isvalid.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.net-receivers.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.angle-zero.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.angle-zero.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.angle-zero.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.angle-zero.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.angle-zero.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.angle-zero.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.angle-zero.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.angle-zero.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.config-var.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.config-var.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.config-var.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.config-var.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.config-var.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "incorrect" }, { "fixtureId": "gmod.perf.config-var.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.config-var.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.config-var.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.darkrpvar.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.darkrpvar.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.darkrpvar.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "incorrect" }, { "fixtureId": "gmod.perf.darkrpvar.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.darkrpvar.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.darkrpvar.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.darkrpvar.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.darkrpvar.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.disttosqr.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.disttosqr.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.disttosqr.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.disttosqr.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.disttosqr.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.disttosqr.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.disttosqr.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.disttosqr.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.ents-iterator.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.ents-iterator.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.ents-iterator.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.ents-iterator.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.find-ents-near.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.find-ents-near.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.find-ents-near.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.find-ents-near.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.find-ents-near.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.find-ents-near.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.find-ents-near.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.find-ents-near.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.find-players-near.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.find-players-near.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.find-players-near.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.find-players-near.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.find-players-near.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.find-players-near.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.find-players-near.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.find-players-near.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.for-vs-while.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.for-vs-while.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.for-vs-while.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.for-vs-while.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.for-vs-while.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.for-vs-while.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.for-vs-while.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.for-vs-while.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.hook-once.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.hook-once.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.hook-once.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.hook-once.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.hook-once.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.hook-once.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.hook-once.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.hook-once.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.hudpaint-cache.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.hudpaint-cache.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.hudpaint-cache.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.hudpaint-cache.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.hudpaint-cache.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.hudpaint-cache.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.hudpaint-cache.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.hudpaint-cache.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.local-color.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.local-color.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.local-color.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.local-color.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.local-color.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.local-color.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.local-color.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.local-color.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.local-vs-global.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.local-vs-global.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.local-vs-global.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.local-vs-global.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.local-vs-global.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.local-vs-global.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.local-vs-global.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.local-vs-global.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.localplayer-cache.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.localplayer-cache.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.localplayer-cache.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.localplayer-cache.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.localplayer-cache.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.localplayer-cache.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.localplayer-cache.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.localplayer-cache.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.looking-at.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.looking-at.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.looking-at.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.looking-at.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.looking-at.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.looking-at.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.looking-at.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.looking-at.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.meta-vs-arg.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.meta-vs-arg.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.meta-vs-arg.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.meta-vs-arg.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.meta-vs-arg.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.meta-vs-arg.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.meta-vs-arg.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.meta-vs-arg.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.msg-vs-print.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.msg-vs-print.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.msg-vs-print.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.msg-vs-print.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.msg-vs-print.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.msg-vs-print.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.msg-vs-print.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.msg-vs-print.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.pairs-ipairs-for.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.pairs-ipairs-for.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.pairs-ipairs-for.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.pairs-ipairs-for.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.pairs-ipairs-for.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.pairs-ipairs-for.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "incorrect" }, { "fixtureId": "gmod.perf.pairs-ipairs-for.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "incorrect" }, { "fixtureId": "gmod.perf.pairs-ipairs-for.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.plain-lua-vs-fn.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.plain-lua-vs-fn.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.plain-lua-vs-fn.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.plain-lua-vs-fn.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.plain-lua-vs-fn.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.plain-lua-vs-fn.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "incorrect" }, { "fixtureId": "gmod.perf.plain-lua-vs-fn.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "incorrect" }, { "fixtureId": "gmod.perf.plain-lua-vs-fn.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.player-cache-hooks.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.player-cache-hooks.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.player-cache-hooks.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.player-cache-hooks.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.player-cache-hooks.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.player-cache-hooks.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.player-cache-hooks.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.player-cache-hooks.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.ply-table-index.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.ply-table-index.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.ply-table-index.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.ply-table-index.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.ply-table-index.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.ply-table-index.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.ply-table-index.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.ply-table-index.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.seq-tables.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.seq-tables.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.seq-tables.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "incorrect" }, { "fixtureId": "gmod.perf.seq-tables.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.seq-tables.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "incorrect" }, { "fixtureId": "gmod.perf.seq-tables.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.seq-tables.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "incorrect" }, { "fixtureId": "gmod.perf.seq-tables.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.setdrawcolor-split.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.setdrawcolor-split.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.setdrawcolor-split.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.setdrawcolor-split.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.setdrawcolor-split.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.setdrawcolor-split.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.setdrawcolor-split.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.setdrawcolor-split.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.sqlite-vs-mysql.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.sqlite-vs-mysql.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.sqlite-vs-mysql.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.sqlite-vs-mysql.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.sqlite-vs-mysql.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.sqlite-vs-mysql.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.sqlite-vs-mysql.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.sqlite-vs-mysql.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.steamid-cache.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.steamid-cache.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.steamid-cache.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.steamid-cache.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.steamid-cache.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.steamid-cache.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.steamid-cache.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.perf.steamid-cache.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.string-table-concat.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.string-table-concat.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.string-table-concat.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.string-table-concat.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.string-table-concat.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.string-table-concat.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.string-table-concat.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.string-table-concat.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.surface-drawrect.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.surface-drawrect.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.surface-drawrect.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.surface-drawrect.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.surface-drawrect.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.surface-drawrect.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.surface-drawrect.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.surface-drawrect.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.surface-text.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.surface-text.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.surface-text.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.surface-text.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.surface-text.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.surface-text.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.surface-text.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.surface-text.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-count-hash.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-count-hash.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-count-hash.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-count-hash.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-count-hash.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-count-hash.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-count-hash.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-count-hash.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-empty.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-empty.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-empty.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-empty.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-empty.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-empty.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-empty.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-empty.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-hasvalue.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-hasvalue.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-hasvalue.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-hasvalue.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-hasvalue.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-hasvalue.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "incorrect" }, { "fixtureId": "gmod.perf.table-hasvalue.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-hasvalue.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-literal.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-literal.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-literal.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-literal.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-literal.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-literal.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-literal.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-literal.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-random.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-random.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-random.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.table-random.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-random.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-random.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-random.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.table-random.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.x-times-x.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.x-times-x.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.x-times-x.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.perf.x-times-x.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.x-times-x.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.x-times-x.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.x-times-x.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.perf.x-times-x.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "agy", "model": "Claude Opus 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "agy", "model": "Claude Sonnet 4.6 (Thinking)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (High)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "agy", "model": "Gemini 3.1 Pro (Low)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "partial" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (High)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Low)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "agy", "model": "Gemini 3.5 Flash (Medium)", "attempts": 1, "passCount": 1, "passAtK": true, "bestStatus": "pass" }, { "fixtureId": "gmod.player-iterator.v1", "adapterId": "agy", "model": "GPT-OSS 120B (Medium)", "attempts": 1, "passCount": 0, "passAtK": false, "bestStatus": "protocol_error" } ], "passAtKRate": "143/173" } }