Yes, but it’s got some cool Haskell projects (like a new language). Also, it has some big Haskell names there. When I worked there I debugged a compiler performance issue with one of the original creators, and there’s people like Lamport or Wolfram or Cerf brought in for talks.
Assuming V1 and V2 offer users the same functionality, there’s a bunch of tests you can offer. The best one IMO is oracle testing where you do something on v1 and v2 and check they do the same thing. Preferably roll out to a subset of users such as via a canary deployment and make sure you have a rollback plan.
> Also, how much success people have or had with automating the E2E tests for their various apps by stringing such agents themselves together?
There’s a few startups in the space doing this like QA Tech in Stockholm, and others even in YC (but I forgot the name). I’m skeptical of how successful they’ll be, not just from complex test cases but things like data management and mistakingly affecting other tests. Interesting to follow just in case though, E2E is a pain!
Can you share more about ML based fuzzing? I do pretty basic fuzzing and that's been pretty useful at work for testing, and am keen to learn about better more modern approaches than mine!