boyter

Came here to post than and you already did. Thank you!

You are welcome. Glad to hear its working for you. I have a few ideas I am working on to improve its relevance too that I hope pan out.

boyter

2 ay öncediscuss

Grep prints out every matching line. For some searches a LLM might do it will get a lot of noise, and it might have to make that search because it cannot be specific. Targeted search can reduce the number of tokens.

I suspect this comparison is against reading the whole codebase though compared to just getting the bits you need.

boyter

2 ay öncediscuss

Interesting. I too have been working in this space, though I took a different approach. Rather than building an index, I worked on making a "smarter grep" by offering search over codebases (and any text content really) with ranking and some structural awareness of the code. Most of my time was spend dealing with performance, and as a result it runs extremely quickly.

I will have to add this as a comparison to https://github.com/boyter/cs and see what my LLMs prefer for the sort of questions I ask. It too ships with MCP, but does NOT build an index for its search. I am very curious to see how it would rank seeing as it does not do basic BM25 but a code semantic variant of it.

This seems to work better for the "how does auth work" style of queries, while cs does "authenticate --only-declarations" and then weighs results based on content of the files, IE where matches are, in code, comments and the overall complexity of the file.

Have starred and will be watching.

boyter

2 ay öncediscuss

Been working on https://searchcode.com/ again which I bought back, albeit as code search tool for LLMs. It solves the “should I use this library” by allowing the LLM to inspect search and analyse it before integration. Can use it to compare multiple repositories before downloading. It comes with a large amount of token savings and can be really useful when wanting to learn about a codebase.

Since it does it anyway I added dossier pages to it as well https://searchcode.com/repo/github.com/rust-lang/rust Which is useful for humans, and shows what the system is creating.

Best part is that I get to use the tools I have built, so https://github.com/boyter/scc and https://github.com/boyter/cs to improve it which benefits anyone using those tools.

boyter

2 ay öncediscuss

Many Muslims drink anyway. A lot of those in Iran brew wine/beer in their house.

Tobacco in Australia has been taxed to the point we have a huge black market for it now. You would have thought people would have learnt from prohibition.

You cannot police morals.

boyter

2 ay öncediscuss

Id be ok with that if wine had the same taste. No alcohol free wine tastes even close, and none of them are good in their own right.

Some of the non-alcoholic beers are pretty good though and I am happy to drink them.

boyter

3 ay öncediscuss

I reimagined https://searchcode.com/ since I realised LLMs have issues when it comes to understanding code you want to integrate. It’s useful for looking though any codebase, or multiple without having to clone it.

I use it when I have candidate libraries to solve a problem, or I just want to find out how things work. Most recently I pointed it at fzf and was able to pull the insensitive SIMD matching it uses and speed my own projects up.

I can’t find it right now, but there was a post about how ripgrep worked from a someone who walked through the code finding interesting patterns and doing a write up on it. With this I get it over any codebase I find interesting, or can even compare them.

boyter

4 ay öncediscuss

I read this when it came out and having written similar things for searchcode.com (back when it was a spanning code search engine), and while interesting I have questions about,

    We routinely see rg invocations that take more than 15 seconds

The only way that works is if you are running it over repos 100-200 gigabytes in size, or they are sitting on a spinning rust HDD, OR its matching so many lines that the print is the dominant part of the runtime, and its still over a very large codebase.

Now I totally believe codebases like this exist, but surely they aren't that common? I could understand this is for a single customer though!

Where this does fall down though is having to maintain that index. That's actually why when I was working on my own local code search tool boyter/cs on github I also just brute forced it. No index no problems, and with desktop CPU's coming out with 200mb of cache these days it seems increasingly like a winning approach.

boyter

4 ay öncediscuss

The disk cache has a huge impact. However they claim it’s for multiple searches so it should be in it.

boyter

4 ay öncediscuss

Such a good read. I actually went back though it the other day to steal the searching for the least common byte idea out to speed up my search tool https://github.com/boyter/cs which when coupled with the simd upper lower search technique from fzf cut the wall clock runtime by a third.

There was this post from cursor https://cursor.com/blog/fast-regex-search today about building an index for agents due to them hitting a limit on ripgrep, but I’m not sure what codebase they are hitting that warrants it. Especially since they would have to be at 100-200 GB to be getting to 15s of runtime. Unless it’s all matches that is.

boyter

4 ay öncediscuss

Its pretty easy to step over those limits.

Also localhost and presumably this are good for validating your logic before you throw in roles, network and everything else that can be an issue on AWS.

Confirm it runs in this, and 99% of the time the issue when you deploy is something in the AWS config, not your logic.

boyter

4 ay öncediscuss

All of the above.

Stop reading the news. It makes you depressed or angry. Go hiking. Walk on the beach. Play with a dog or your children. Climb a tree.

Leave the slave slab phone at home, or delete every news and social app. Do not browse the web. Take a book and read.

It will be hard at first. Then it gets easier. Best thing I ever did.

Reminder. What passes for news today wouldn’t have registered for most people 100 years ago.

boyter

5 ay öncediscuss

Chased the wrong thing. It’s the 1% lows that matter more generally.

boyter

5 ay öncediscuss

If you have a high frame rate to start with it’s pretty nice and feels smoother. But a low frame rate turned into a high one looks good but feels laggy.

So arguably you never need frame gen for a game, since it only really works when it’s already pretty nice.

boyter

5 ay öncediscuss

Not familiar with that tool. What follows is my best guess based on what I am seeing.

Serena looks to be a precision tool. Since it uses uses LSP its able to replicate a lot of what a IDE would allow and IDE for LLM's.

cs by contrast is more of a discovery tool. When you're trying to find where the work actually happens it can help you, and since there is no index involved you can get going instantly on any codebase while they are index.

You could use cs for instant to find where the complexity lies, and then use Serena to modify it.

boyter

5 ay öncediscuss

Seems to be a load issue, hopefully easily resolved

    Request URL https://lightwave.so/api/register/ephemeral
    Request Method POST 
    Status Code 429 Too Many Requests

boyter

8 ay öncediscuss

People who give away things like this tend to be good people. As such when someone comes asking for help or new things they are inclined to help.

Your response is where it should go when things get rude, but you don't want to start there.

boyter

7 yıl öncediscuss

Hah! That’s exactly what happened in Australia.

There is legit talk about changing the hugest plans here from 100/40 to 120/20. It’s that bad. Which is moot anyway because 40% of the “new” network probably cannot get that speed anyway.

Submissions

Bucketsquatting is finally dead

Sloc Cloc and Code – Locomo (LLM Output Cost MOdel)

Rare Not Random – Using Token Efficiency for Secrets Scanning

Implementing a Clear Room Z80 / ZX Spectrum Emulator with Claude Code

Show HN: CS – indexless code search that understands code, comments and strings

Go.mod Hackery for Compatibility Testing

I Taught Myself to Code on a Cracked Android Phone. Now I Can't Get Hired

The Final Chapter for GummySearch

Open source is still broken

Vibe Coding, Six Months Later: The Honeymoon's Over

My Domain Was Poached by a Cambodian

[untitled]

ElevenLabs is the best text-to-speech AI system

Doom running on a pregnancy test

comments