HackerTrans
TopNewTrendsCommentsPastAskShowJobs

artembugara

no profile record

Submissions

Web Search API Types: Three Architectures, One Confusing Name

newscatcherapi.com
4 points·by artembugara·w zeszłym miesiącu·0 comments

Show HN: CatchAll – slowest web search API that outperforms everything on recall

platform.newscatcherapi.com
7 points·by artembugara·3 miesiące temu·1 comments

comments

artembugara
·3 miesiące temu·discuss
If you want to try it without creating an account: https://platform.newscatcherapi.com/catchall/try?utm_source=...
artembugara
·3 miesiące temu·discuss
You can also check any signal from publicly available sources using tools like CatchAll.

For example, "CEO and CFO appointments at US public companies in the last two weeks" found 142 records [0]

You can also set up monitors to get updates.

[0] https://platform.newscatcherapi.com/catchall/example/gtm--ex...
artembugara
·5 miesięcy temu·discuss
By the law of large numbers, it's not a significant distance.
artembugara
·6 miesięcy temu·discuss
+1 for Mercury.

Another good thing about Mercury is that in case you’re stuck/not being treated fairly, you can just email/publicly mention Immad (CEO) and he’ll reply within minutes and will look into this
artembugara
·7 miesięcy temu·discuss
Chrome on iPhone
artembugara
·7 miesięcy temu·discuss
Do you mean it’s written by AI?

Or just my writing style?
artembugara
·7 miesięcy temu·discuss
It really makes sense, and the best part — customers love it. It’s the simple form of pricing, and it’s simple to understand.

In many cases though, you don’t know whether the outcome is correct or not but we just have evals for that.

Our product is a SOTA recall-first web search for complex queries. For example, let’s say your agent needs to find all instances of product launches in the past week.

“Classic” web search would return top results while ours return a full dataset where each row is a unique product (with citations to web pages)

We charge a flat fee per record. So, if we found 100 records, you pay us for 100. Of its 0 then it’s free.
artembugara
·7 miesięcy temu·discuss
We started doing quarterly RFC at Newscatcher, and it was a big game-changer. We're entirely remote.

I got this idea from Netflix's founder's book "No Rules Rules" (highly recommend it)

Overall, I think the main idea is: context is what matters, and RFC helps you get your (mine, I'm the founder) vision into people's heads a bit more. Therefore, people can be more autonomous and move on faster.
artembugara
·10 miesięcy temu·discuss
done
artembugara
·10 miesięcy temu·discuss
no no, they want to use it on external data, we do not do any internal data.

I'll give a few examples of how they use the tool.

Example 1 -- real estate PE that invests in multi-family residential buildings. Let's say they operate in Texas and want to get notifications about many different events. For example, they need to know about any new public transport infrastructure that will make specific area more accessible -> prices wil go up.

There are hundreds of valid records each month. However, to derive those records, we usually have to sift through tens of thousands of hyper-local news articles.

Example 2 -- Logistics & Supply Chain at F100 Tracking of all the 3rd party providers, any kind of instability in the main regions, disruptions at air and marine ports, political discussions around the regulation that might affect them, etc. There are like 20-50 events, and all of them are multi-lingual at global scale.

thousands of valid records each week, millions of web pages to derive those from.
artembugara
·10 miesięcy temu·discuss
Oh, I totally see your point.

We’re optimising for large enterprises and government customers that we serve, not consumers.

Even the most motivated people, such as OSINT or KYC analysts, can only skim through tens, maybe hundreds of web pages. Our tool goes through 10,000+ pages per minute.

An LLM that has to open each web page to process the context isn’t much better than a human.

A perfect web search experience for LLM would be to get just the answer, aka the valid tokens that can be fully loaded into context with citations.

Many enterprises should leverage AI workflows, not AI agents.

Nice to have // must have. Existing AI implementations are failing because it’s hard to rely on results; therefore, they’re used for nice-to-haves.

Most business departments know precisely what real-world events can impact their operations. Therefore, search is unnecessary; businesses would love to get notifications.

The best search is no search at all. We’re building monitors – a solution that transforms your catchALL query into a real-time updating feed.
artembugara
·10 miesięcy temu·discuss
Congrats on the HN Launch!

It's probably the best research agent that uses live search. Are you using Firecrawl, I assume?

We're soon launching a similar tool (CatchALL by NewsCatcher) that does the same thing but on a much larger scale because we already index and pre-process millions of pages daily (news, corporate, government files). We're seeing so much better results compared to parallel.ai for queries like "find all new funding announcements for any kind of public transit in California State, US that took place in the past two weeks"

However, our tool will not perform live searches, so I think we're complementary.

i'd love to chat.
artembugara
·3 lata temu·discuss
can
artembugara
·3 lata temu·discuss
As far as I remember, I fully own all the right to the output of OpenAI (for example).
artembugara
·3 lata temu·discuss
Have a question to the Generative AI experts here.

So, I can use smthg like GPT-4 to label data and then use that as a train set for my own LLM, right?

EDIT: adding this from OpenAI Restriction TOS: "(iii) use output from the Services to develop models that compete with OpenAI;"