172
long context keeps getting longer but using it well is still an art
the context windows are enormous now. that does not mean dumping everything in works. the models still attend unevenly across a giant window. curate, do not just stuff.
Post ID#0109
Merit172
Replies11
SectorMI/SIGNAL
[Add a comment]
Checking session…
[11 comments]
Bbitflipben1.1k·2mo ago
thank you for not making this a 20 minute video
125
Nnightshiftsoc1.7k·2mo ago
curious if anyone has tried this with a local model
9
Ppromptpig2.2k·3mo ago
tried it for an afternoon, not sold yet
117
Nnightshiftsoc1.7k·2mo ago
any gotchas you ran into setting it up?
111
Rredteamko1.5k·2mo ago
what model were you running for this?
103
Lllamawhisperer1.1k·1mo ago
stealing this approach for work, thanks
78
Tthreatmodeltia871·2mo ago
the comments here are better than most blog posts
87
Nnightshiftsoc1.7k·2mo ago
had no idea you could do that, mind blown
59
Ccoldstarter1.6k·2mo ago
works on my machine, famous last words
101
Hheapoverflow1.1k·2mo ago
any gotchas you ran into setting it up?
47
Aasyncannie1.2k·2mo ago
what is the failure mode when the tool call times out?
22