HackerTrans
TopNewTrendsCommentsPastAskShowJobs

hamilton

no profile record

comments

hamilton
·l’année dernière·discuss
We do have plans. It's a question of effort, not business / philosophy.
hamilton
·l’année dernière·discuss
it can, but it doesn't format. You can even run the ast!
hamilton
·l’année dernière·discuss
Obviously one advantage of SQL is everyone knows it. But conceptually, I agree. I think [1]Malloy is also doing some really fantastic work in this area.

This is one of the reasons I'm excited about DuckDB's upcoming [2]PEG parser. If they can pull it off, we could have alternative dialects that run on DuckDB.

[1] https://www.malloydata.dev/ [2] https://duckdb.org/2024/11/22/runtime-extensible-parsers.htm...
hamilton
·l’année dernière·discuss
Definitely something we want too! (I'm the author / lead for the UI)
hamilton
·l’année dernière·discuss
I agree; one thing that is neat about Instant SQL is for many reasons, you can't do this with in any other DBMS. You really need DuckDB's specific architecture and ergonomics.
hamilton
·l’année dernière·discuss
Great feedback! Thanks. We agree w/ the red errors. It's not helpful when it feels like your editor is screaming at you.
hamilton
·l’année dernière·discuss
You should read the post! This is what the feature does.
hamilton
·l’année dernière·discuss
Can you say more? Where does it error out? Sounds like a bug; if you could post an example query, I bet we can fix that.
hamilton
·l’année dernière·discuss
What about it is bizarre?
hamilton
·l’année dernière·discuss
Me too (author of the post here). In fact, I was watching a seasoned data engineer at MotherDuck show me how they would attempt to debug a regex in a CTE. As a longtime SQL user, I felt the pain immediately; haven't we all been there before? Instant SQL followed from that.
hamilton
·l’année dernière·discuss
Correct. We only enable fast previews for SELECT statements, which is the actual hard problem. This said, at some point we're likely to also add support for previewing a CTAS before you actually run it.
hamilton
·l’année dernière·discuss
You can use any variation of DuckDB valid syntax that you want! I prefer to put from first just because I think it's better, but Instant SQL works with traditional select __ from __ queries.
hamilton
·l’année dernière·discuss
Indeed, we are! We worked with DuckDB Labs to add the query_location information, which we're also enriching with the tokenizer to draw a path through the AST to the cursor location. I've been wanting to do this since forever, and now that we have it, there's actually a long tail of inspection / debugging / enrichment features we can add to our SQL editor.
hamilton
·l’année dernière·discuss
ftr I'm still on X & posting! https://x.com/hamiltonulmer
hamilton
·l’année dernière·discuss
True; at the moment the UI is not open source. We've talked about releasing the Column Explorer as a standalone component, but haven't been able to prioritize it yet. We'd like to!
hamilton
·l’année dernière·discuss
(I designed and built the Column Explorer feature)

Observable's column summary feature is very nice! But I do think there's a very common lineage around these kinds of diagnostics which motivated both Observables and ours. See Jeff Heer's profiler paper[1] for more.

I'm very passionate about this area because I think "first mile problems" are underserved by most tools, but they take the longest to work out.

We had to do some gnarly things[2] to make this feature work well; and there's a lot of room to make it scale nicely and cover all DuckDB data types.

[1] http://vis.stanford.edu/papers/profiler [2] https://motherduck.com/blog/introducing-column-explorer/