I think data analysis can use more collaboration! So I'm building a multiplayer data canvas using tldraw and duckdb WASM! It's been a lot of building too

Check it out https://kavla.dev/

I went to Copenhagen this summer. I was quite disappointed in the bicycle infrastructure, I felt like it was on par with what we have in Stockholm. Rented bikes and biked around for two days. It was nice!

Not sure how this index is being calculated (site breaks a lot), but my general feeling was that Denmark is just better at marketing than actual infrastructure when comparing to Stockholm at least

Pocketbase is awesome. I'm using it as the auth layer for my side project (https://kavla.dev/).

The hooks are great, even relatively complex things like spinning up infrastructure is easy (https://pocketbase.io/docs/go-event-hooks/)

I'm building Kavla, its an infinite multiplayer canvas for data analytics.

I have a video on how it works on https://kavla.dev/

And a live demo here: https://demo.kavla.dev/

I've been working in the data space for five years now. Kavla is something that I personally feel would make my job more fun!

Built with tldraw and duckdb

Very cool. Also very performant on the UI. On a side note, I can see this becoming very popular among a Greek audience due to its name.

This is cool - I like the concept and the usefulness.

Thank you! It means a lot!

For my homeserver I just have a small python script dumping metrics (CPU, RAM, disk, temperature and network speed) into a database (timescaleDB).

Then I visualize it with grafana, It's actually live here if you want to check it out: https://grafana.dahl.dev

What’s the benefit of having this exposed to the web? Given it’s monitoring a homeserver, seems like overkill.

Why not secure it behind a VPN or tailscale if it’s just for personal use?

None really, I had an idea that my friends could check it out if they notice a service disruption. They don't though, so it's just for fun!

Would you mind sharing the python script?

having this up seems ill-advised. posting a link on HN seems crazy

How does the threat model change when exposing grafana to the public? Apart from vulnerabilities in grafana itself? Perhaps hackers will be extra motivated to cause blips in those graphs? Exposing grafana publically is unusual, but I don't see an obvious error-mode.

It’s really not abnormal. GrafanaLabs does this all the time with their IaaS product.

There’s nothing wrong with exposing Grafana as long as you’re following security best practices.

It’s 2024, zero trust networking is where you want to be. Real zero trust networking is NOT adding a VPN to access internal services. It’s doing away with the notion of internal services all together and securing them for exposure on the internet.

I mean this is true but the key part is “securing them for exposure on the internet.” Adding a simple 2FA layer (I think google calls this the Access Proxy or Identity Aware Proxy) on top is usually the way you secure zero trust services.

I don’t think it is advisable to directly expose your Grafana to the public internet where you can hit it with dictionary attacks.

Really? So in 2024, folks are only deploying services that have excellent security, and not anything else? This seems like a high bar to clear but I'm curious to learn.

Article and discussion from earlier today that’s relevant: https://news.ycombinator.com/item?id=41274932

It’s about zero trust, includes the claim “VPNs are Deprecated!”

Those companies can afford letting people try "Denial of Wallet" attacks on them, though.

I, for one, will still keep using VPNs as an additional layer of security and expose only a single UDP port (WireGuard), to at least reduce the chances of that happening.

Thanks!

The implementations of zero trust that I have seen involve exposing your service to the public internet with an Authenticating Proxy on top. So instead of trusting the network implicitly you trust the caller’s auth token before they can connect to the server.

So you might have an internal service that has passed a minimal security bar that you can only establish an https connection with if you have a valid SSO token.

I love platform work! 3 YoE with data engineering and platform stuff

  Location: Stockholm, Sweden
  Remote: Yes
  Willing to relocate: No
  Technologies: SQL, Python, terraform, devops things, GCP, AWS
  Résumé/CV: https://dahl.dev/assets/Alexander_Dahl.pdf
  Email: hn.parsnip103@passmail.net
  Website: https://dahl.dev

I use seafowl hosted on Cloud Run for a side project for Swedish Real Estate data. Around a million rows, seafowl works great!

One killer feature (aside from scaling to zero) is that the queries can be constructed as GET requests. That means we can cache the query results with cloudflare.

I have it exposed here if you want to write some SQL and check it out live: https://bostadsbussen.se/sold/query

Glad to hear you've had good results! Yes, @mildbyte did a great job making Seafowl comply with HTTP cache semantics (i.e. Etags/Cache-Control), and it should give good results for both CDNs and browsers. When building Open Data Monitor [0] I certainly observed some nice speed ups.

For those interested in how caching works (i.e. if your dataset is public it could be an easy win) more info is in the docs [1]

[0] https://open-data-monitor.splitgraph.io/week/2023-05-22

It's a Socrata scraper that renders diffs of public/government datasets

[1] https://seafowl.io/docs/getting-started/tutorial-fly-io/part...

For my latest interview cycle I had issues with race conditions when it came to scheduling with recruiters. I summarized my thoughts on it and how I used https://github.com/niccokunzmann/open-web-calendar to self-host my calendar.

Location: Stockholm, Sweden

Remote: Yes

Willing to relocate: No

Technologies: SQL, Python, terraform, devops things, GCP

Résumé/CV: https://dahl.dev/assets/Alexander_Dahl.pdf

Email: hackernews@dahl.dev

Website: https://dahl.dev

Hi, I'm a Data (infrastructure) Engineer available to work from January 2023. Currently on a travel sabbatical where me and my partner have trekked in Nepal! After having used large distributed systems at work I'm very passionate about small resource constrained systems in my spare time.

Here is an example of a blogpost about a small system that is hosted for free :-) https://blog.dahl.dev/posts/stringing-together-several-free-...