Why did they fail? VS Code tries to load the file into RAM (Electron 📉). Notepad++ uses a buffer that eventually overflows on massive datasets.
Scope cheats. We don't load the file. We stream it directly from the disk using Go and Wails. 1TB file? Zero RAM spike.
I put VS Code, Notepad++, and my new tool (Scope) in a ring with a 500GB log file.
💀 VS Code choked. 🐢 Notepad++ tried its best but couldn't open it. ⚡️ Scope opened it in 0.4 seconds.
Here is the video evidence. 👇
youtu.be/FLRIGifcUrQ
I've built for everyone else. Now I'm building for me.
My career has been filled with amazing projects for incredible people and companies. It's a truly wild feeling to see your own idea finally start coming to life.
It's a different kind of stake, a different kind of excitement.
#FoundersJourney
Stop building pollers for your docker agents. An isolated container behind a firewall is just an IoT device.
We used the IoT playbook to get "zero inbound port" command & control. It's secure for the customer, scalable, and the future of SaaS.
#data #docker
developyr.substack.com/publish/post...
I have been asked about how will AI be incorporated into the Lokryn suite?
It won’t.
AI will be ready one day, but for now, for compliance, we think that should be deterministic.
This may not be the popular current opinion, but it’s one we stand on. We have kept AI out, on purpose. #data
Been spending some evenings and Sundays working on this, I think we are getting close. Check out products and pricing.
www.lokryn.com
Thank you! Yes, it is one of those everyone needs it, and everyone hates to build it and also, no one wants to pay 5k per month lol. So I think this will be good for smaller shops.
Pipe Audit: Rust-Fast Data Validation. Data quality tools are too heavy. Pipe Audit is a blazing-fast, language-agnostic validation engine. Configure simple .toml files and validate data anywhere.
Free CLI/lib. Heavy Duty with Dashboard from $99/mo.
#dataengineering #rust #devops #dataquality
Product Coming Soon--Flight Recorder: Flat-Rate Logging. Stop paying per-GB. Flight Recorder is your self-hosted logger with tamper-evident logs for audits, minus the enterprise price tag.
Free forever with unlimited volume. Heavy Duty plan with full UI & alerts from $99/mo.
#logging #observability
Product Coming Soon--Tracks: Feature Flags. Feature flags aren't free—they're tech debt. Tracks finds stale flags and integrates with Jira to help you clean them up.
Free for 10k MAU. Heavy Duty plan with Unlimited MAUs & Stale Flag Reports from $69/mo.
#featureflags #devops #cicd #techdebt
Product Coming Soon--Foreman: The Language-Agnostic Orchestrator. Stop compromising. Forman is a workflow engine that runs in your environment. No language-lock, your code & data never leave your control.
Free dev sandbox. Heavy Duty plan with Visual UI from $69/mo.
#orchestration #selfhosted
Product Coming Soon--re-Deliver: Guaranteed Webhook Reliability. Missed callbacks are a silent killer. re-Deliver secures every event, letting you manage and replay missed webhooks in order.
Free for 10k callbacks. Heavy Duty plan with 7-day ordered replay from $69/mo.
#webhooks #devops #api
Product Coming Soon--Gatehouse: Auth without the bloat. Stop choosing between risky DIY auth and bloated enterprise platforms. Get the expert features you actually need, like passwordless & MFA, without the enterprise overhead.
Free for 1000 MAU. Heavy Duty plan from $49/mo.
#auth #security #saas
Tired of dev tools for small teams being either "free toys" or "enterprise bloat"? 😤
Me too. So I'm building the alternative.
Announcing Lokryn: a new suite of pro-level, self-hosted tools that don't cost a junior dev's salary.
open.substack.com/pub/developy...
#dev #devtools #saas #startups
Lokryn Pipeaudit dashboard, Shades of green with orange.
WIP Friday! 👀 Here's a first look at the PipeAudit dashboard we're building.
The goal is to make your data validation results and audit trails super easy to visualize.
No more hunting for answers. Just clear visibility. More to come!
#PipeAudit #DataEngineering #WIP #UIUX #RustLang
Fixed! Thank you so much for the catch! Truly appreciated.
Most data tools are built for the enterprise. They're expensive, monolithic, and overkill for startups.
Announcing Lokryn: a new suite of data tools built for SMBs. Think modular, developer-friendly, and compliance-first. And yes, it's all built on Rust 🦀.
www.lokryn.com
Real talk for data folks: a lot of our time feels less like engineering and more like archaeology, right? Digging through logs after something has already broken.
I wrote down some thoughts on how we can change that pattern.
developyr.substack.com/p/your-data-...
#DataFolk #DataEngineering
Want to see the code behind the chaos? 📂 The full repository is public here: github.com/developyrs/a...
#OpenSource #Python
Building an agentic AI data pipeline the hard way. 🤖
I took a deep dive into the real-world struggles of getting an AI agent to work autonomously. No hype, just the honest journey.
Watch the full code walkthrough:
youtu.be/x4KCMFlOwxI
#AgenticAI #DataEngineering #LLM #Gemini #Llama3
P.S. I'll be doing a full code walkthrough of this entire experiment on my YouTube channel soon, and the repo will be made public. Follow along for that! ▶️ 📂
#YouTube #OpenSource
I used Microsoft Copilot to help build an Agentic AI data pipeline, forcing it to remove the usual guardrails to test the hype vs. reality.
The results?
Read the full "Lab Notes" experiment here:
#AgenticAI #DataEngineering #LLM
developyr.substack.com/p/i-let-copi...
How do you let devs & QA test with fresh production data without exposing PII?
My 'Lab Notes' article walks through using Trino, Nessie & Iceberg to create ephemeral, zero-copy environments with on-the-fly PII masking. 🛡️
developyr.substack.com/p/lab-notes-...
#DataEngineering #DataSecurity #Trino
Consulting isn’t just advice — it’s partnership. We design scalable, adaptable data systems so your team can move from firefighting to forward momentum. Let’s build clarity together. #DataConsulting #DataStrategy #ScalableSystems #Developyr #DataOps
No data is perfect, some is actionable.
The sooner you stop chasing “perfect,” the sooner you start making progress.
Comfort in the Unknown isn’t about having all the answers — it’s about moving forward when you don’t.
#DataEngineering #ProblemSolving #ComfortInTheUnknown
Tackling a classic data engineering dilemma for my next 'Lab Notes' article:
How do you analyze FRESH production data without
a) creating slow, costly copies, and
b) exposing sensitive PII?
It feels like you have to compromise on one of these.
#DataEngineering #DataSecurity #PII #substack
Evening thought: The most elegant data architecture is often the simplest one that gets the job done. It's easy to get lost in complex tools, but clarity and simplicity usually win in the long run.
#DataArchitecture #DataEngineering
I have definitely added it to my EDA routine for sure.
Monday morning question for all the data folks ☕:
What's your go-to tool for quick, local data exploration on your laptop?
Are you team DuckDB, Polars, Pandas 2.0, or something else entirely? Curious to see what everyone is building with.
#DataEngineering #DataScience #DuckDB #Polars #Python
Just submitted a talk proposal for DataTune 2026 on "Decoding the Modern Data Lakehouse." 🤞
My goal is to bring a clear framework to the 6 core lakehouse patterns we see in the wild. Hope to see some local tech folks there!
#DataEngineering #NashvilleTech #DataArchitecture #DataTune2026