HackerTrans
TopNewTrendsCommentsPastAskShowJobs

whilo

no profile record

Submissions

[untitled]

1 points·by whilo·3 bulan yang lalu·0 comments

[untitled]

1 points·by whilo·3 bulan yang lalu·0 comments

Memory That Collaborates

datahike.io
43 points·by whilo·4 bulan yang lalu·5 comments

Show HN: Stratum – SQL that branches and beats DuckDB on 35/46 1T benchmarks

datahike.io
12 points·by whilo·4 bulan yang lalu·3 comments

Show HN: Stratum - a pure JVM columnar SQL engine using the Java Vector API

datahike.io
3 points·by whilo·4 bulan yang lalu·1 comments

comments

whilo
·4 bulan yang lalu·discuss
Hey. Hybrid in which sense?

I have integrated Stratum's columnar indices as a secondary index in the new query engine of https://github.com/replikativ/datahike itself, so for numerical data you will be able to use Datalog/SQL to have combined (OLTP, OLAP, ...) processing. Same for proximum (persistent HNSW vector index) and scriptum (persistent Lucene).

Stratum already can be copy-on-write updated online with better write throughput than purely columnar alternatives (Stratum uses a persistent B-tree over column chunks) as far as I tested. I have not compared it in benchmarks yet though, DuckDB recommends to not update it online for instance. But it depends on the workload, if you do random access writes the columnar layout overhead will still be a slow-down compared to OLTP/Datahike's row/entity-wise indices. Also storing fully variable strings in a column is inefficient, for this you want the entity-wise indices.
whilo
·4 bulan yang lalu·discuss
Hi HN - I’m the author of Stratum.

The headline benchmark result is that on 10M rows, Stratum is faster than DuckDB on 35 of 46 single-threaded analytical queries, despite running entirely on the JVM.

But the main idea is actually branchable tables: you can fork a table in O(1), keep copy-on-write snapshots, and query different branches through SQL.

It speaks the PostgreSQL wire protocol, so psql/JDBC/DBeaver work out of the box.

Benchmarks, methodology, and repo are linked from the page. Happy to answer questions.
whilo
·4 bulan yang lalu·discuss
Hi HN - I’m the author of Stratum.

Stratum is a columnar SQL engine built on the JVM exploring two ideas:

• SIMD execution using the Java Vector API

• copy-on-write branching for tables

It speaks the PostgreSQL wire protocol, so tools like psql, JDBC, and DBeaver work out of the box.

The engine is pure JVM (no JNI). In benchmarks on 10M rows it performs competitively with DuckDB on many analytical queries.

GitHub repo: https://github.com/replikativ/stratum

Benchmarks and methodology are described in the docs.

Happy to answer questions - feedback very welcome.