every-single-day-i-tldr

Almost every single day I TLDR!

This repo is my personal archive of articles, blog posts, and videos I found interesting. Think of it as a massive shared bookmarks list—like a daily newsletter, but without the newsletter. ߒ᠔ip: Use Ctrl+F to search for topics you care about. I’m the co-founder and CTO of conduktor.io, a real-time AI Data Governance platform built around Kafka. In 2025, I’m focused on AI, Data, Kafka, and all things tech. ߚࠈappy reading!

01-09-2026

• https://openai.com/index/hugging-face-incident-and-the-road-ahead/ The Hugging Face incident and the road ahead | OpenAI

26-08-2026

• https://www.youtube.com/watch?v=xH7U7w9Qzlo Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again

25-08-2026

• http://www.incompleteideas.net/IncIdeas/BitterLesson.html The Bitter Lesson

11-08-2026

• https://danluu.com/ai-coding/ Agentic test processes, LLM benchmarks, and other notes on agentic coding

Cave

• https://kuber.studio/blog/Reflections/Humanising-LLM-Outputs-is-Actually-Dumb Humanising LLM Outputs is Dumb

28-07-2026

• https://medium.com/@fmorillo/streaming-data-lake-spark-vs-flink-into-apache-iceberg-3903e9b54122 Streaming Data Lake: Spark vs Flink into Apache Iceberg

25-07-2026

• https://www.dbos.dev/blog/postgres-listen-notify-scalability Postgres LISTEN/NOTIFY Actually Scales
• https://engineering.touchbistro.com/ingesting-postgres-shards-into-a-redshift-data-warehouse-with-kafka-and-debezium-2c1d8d487761 Ingesting Postgres Shards into a Redshift Data Warehouse with Kafka and Debezium

06-06-2026

• https://www.0xkato.xyz/how-llms-actually-work/ How LLMs Actually Work | 0xkato

01-06-2026

• https://www.altimate.ai/blog/the-correctness-layer-in-ade The Correctness Layer

04-05-2026

• https://www.youtube.com/watch?v=LRo33rnv6rQ This is AGI: Sequoia AI Ascent 2026 Keynote

18-01-2026

• https://blog.yakkomajuri.com/blog/raising-money-fucked-me-up Raising money fucked me up

17-01-2026

• https://cursor.com/blog/scaling-agents Scaling long-running autonomous coding

16-01-2026

• https://simplescraper.io/blog/how-to-mcp How to MCP - The Complete Guide to Understanding Model Context Protocol and Building Remote Servers
• https://playground.ai.cloudflare.com/ Workers AI LLM Playground

07-01-2026

• https://newsletter.pragmaticengineer.com/p/when-ai-writes-almost-all-code-what?publication_id=458709&post_id=183694080&isFreemail=true&r=hc7kn&triedRedirect=true When AI writes almost all code, what happens to software engineering?
• https://huggingface.co/learn/cookbook/en/dspy_gepa Prompt Optimization for Language Models with DSPy GEPA

05-01-2026

• https://www.profgalloway.com/2026-predictions/ 2026 Predictions | No Mercy / No Malice

22-12-2025

• https://marginlab.ai/blog/swe-bench-deep-dive/ SWE-Bench: The $500B Benchmark
• https://simonwillison.net/2025/Dec/18/code-proven-to-work/ Your job is to deliver code you have proven to work
• https://www.aiforswes.com/p/you-dont-need-to-spend-100mo-on-claude [Revised] You Don’t Need to Spend $100/mo on Claude Code: Your Guide to Local Coding Models
• https://dataengineeringcentral.substack.com/p/building-a-ducklake-open-source-style Building a DuckLake ... Open Source Style.

14-12-2025

• https://newsletter.pragmaticengineer.com/p/evals A pragmatic guide to LLM evals for devs
• https://www.youtube.com/watch?v=z1ISq9Ty4Cg Why humans are AI’s biggest bottleneck (and what’s coming in 2026)

13-12-2025

• https://newsletter.pragmaticengineer.com/p/mcp-deepdive Building MCP servers in the real world

08-12-2025

• https://martinalderson.com/posts/has-the-cost-of-software-just-dropped-90-percent/ 100%

06-12-2025

• https://medium.com/@kakamber07/how-i-made-postgres-fly-on-2-cores-and-4gb-ram-1-2-billion-rows-in-0-7-seconds-1a0e01c49571 Make Postgres Fly: 1.2B Rows on 2 Cores & 4GB RAM

01-12-2025

• https://www.instantdb.com/essays/agents_building_counterstrike Codex, Opus, Gemini try to build Counter Strike

30-11-2025

• https://www.404media.co/grokipedia-is-the-antithesis-of-everything-that-makes-wikipedia-good-useful-and-human/ Grokipedia Is the Antithesis of Everything That Makes Wikipedia Good, Useful, and Human
• https://www.humanlayer.dev/blog/writing-a-good-claude-md Writing a good CLAUDE.md
• https://blog.yakkomajuri.com/blog/local-rag So you wanna build a local RAG?

29-11-2025

• https://taranis.ie/datacenters-in-space-are-a-terrible-horrible-no-good-idea/ Datacenters in space are a terrible, horrible, no good idea.

27-11-2025

• https://www.youtube.com/watch?v=qImgGtnNbx0 He saved OpenAI, invented the “Like” button, and built Google Maps: Bret Taylor (Sierra)
• https://www.gartner.com/document-reader/document/7077298 How to Select the Right Data Hub Strategy
• https://www.youtube.com/watch?v=Kr3Sh2PKA8Y Google DeepMind CEO Demis Hassabis on AI, Creativity, and a Golden Age of Science
• https://www.youtube.com/watch?v=GT0jtVjRy2E How we restructured Airtable’s entire org for AI

26-11-2025

• https://www.abzglobal.net/web-development-blog/ilya-sutskever-yann-lecun-and-the-end-of-just-add-gpus Ilya Sutskever, Yann LeCun and the End of “Just Add GPUs”

25-11-2025

• https://www.anthropic.com/engineering/advanced-tool-use Introducing advanced tool use on the Claude Developer Platform \ Anthropic
• https://www.promptarmor.com/resources/google-antigravity-exfiltrates-data Google Antigravity Exfiltrates Data

23-11-2025

• https://jack-vanlightly.com/blog/2025/11/5/how-would-you-like-your-iceberg-sir-stream-or-batch-ordered How Would You Like Your Iceberg Sir? Stream or Batch Ordered?

22-11-2025

• https://blog.modelcontextprotocol.io/posts/2025-11-21-mcp-apps/ MCP Apps: Extending servers with interactive user interfaces

19-11-2025

• https://www.dataengineeringweekly.com/p/the-dark-data-tax-how-hoarding-is The Dark Data Tax: How Hoarding is Poisoning Your AI

18-11-2025

• https://www.mckinsey.com/capabilities/quantumblack/our-insights/the-state-of-ai The State of AI: Global Survey 2025 | McKinsey

16-11-2025

• https://djnn.sh/posts/anthropic-s-paper-smells-like-bullshit/ anthropic’s paper smells like bullshit
• https://startupsandcode.substack.com/p/the-gpu-depreciation-lie The GPU Depreciation Lie

08-11-2025

• https://bravenewgeek.com/everything-you-know-about-latency-is-wrong/ Everything You Know About Latency Is Wrong – Brave New Geek

Everything You Know About Latency Is Wrong Okay, maybe not everything you know about latency is wrong. But now that I have your attention, we can talk about why the tools and methodologies you use to measure and reason about latency are likely horribly flawed. In fact, they’re not just flawed, they’

04-11-2025

• https://aws.amazon.com/about-aws/whats-new/2025/10/amazon-kinesis-data-streams-fis-actions-api-errors/ Amazon Kinesis Data Streams announces new Fault Injection Service (FIS) actions for API errors
• https://alex-jacobs.com/posts/the-case-against-pgvector/ The Case Against pgvector

03-11-2025

• https://blog.sshh.io/p/how-i-use-every-claude-code-feature How I Use Every Claude Code Feature
• https://medium.com/fresha-data-engineering/from-json-to-avro-in-the-cdc-pipeline-ff24ac9c9abc From JSON to AVRO in the CDC pipeline
• https://bigdata.2minutestreaming.com/p/event-streaming-is-topping-out Event Streaming is Topping Out

02-11-2025

• https://wyounas.github.io/aws/concurrency/2025/10/30/reproducing-the-aws-outage-race-condition-with-model-checker/ Reproducing the AWS Outage Race Condition with a Model Checker
• https://www.morling.dev/blog/you-dont-need-kafka-just-use-postgres-considered-harmful/ “You Don’t Need Kafka, Just Use Postgres” Considered Harmful

27-10-2025

• https://flink.apache.org/2025/10/15/apache-flink-agents-0.1.0-release-announcement/ Apache Flink has a new exciting sub-projects: Agents 0.1.0, for even-driven AI agents!
• https://github.com/johannschopplich/toon Token-Optimized Object Notation, JSON for LLMs at half the token cost
• https://github.com/cisco-ai-defense/mcp-scanner Scan MCP Servers for vulnerabilities
• https://www.onehouse.ai/blog/kafka-connect-vs-flink-vs-spark-choosing-the-right-ingestion-framework Apache Kafka (Kafka Connect) vs. Apache Flink vs. Apache Spark: Choosing the Right Ingestion Framework

21-10-2025

• https://thenewstack.io/apache-kafka-4-1-the-3-big-things-developers-need-to-know/ Apache Kafka 4.1: The 3 Big Things Developers Need To Know

19-10-2025

• https://www.youtube.com/watch?v=HUkBz-cdB-k Terence Tao: Hardest Problems in Mathematics, Physics & the Future of AI | Lex Fridman Podcast #472
• https://github.com/henryhawke/ReasonSuite MCP for using logical razors and types of reasoning. An expansion of sequential reasoning mcp.
• https://mariozechner.at/posts/2025-08-15-mcp-vs-cli/ MCP vs CLI: Benchmarking Tools for Coding Agents

just make a good CLI. It’s simpler and more portable. Plus, the output of your CLI can be further filtered and massaged just by piping it into another CLI tool, which can increase token efficiency at the cost of additional instructions. That’s not possible with MCPs.

18-10-2025

• https://www.wheresyoured.at/openai400bn/ OpenAI Needs $400 Billion In The Next 12 Months

17-10-2025

• https://jack-vanlightly.com/blog/2025/10/15/why-im-not-a-fan-of-zero-copy-apache-kafka-apache-iceberg Why I’m not a fan of zero-copy Apache Kafka-Apache Iceberg
• https://www.dataengineeringweekly.com/p/revisiting-medallion-architecture-760 Revisiting Medallion Architecture: Data Vault in Silver, Dimensional Modeling in Gold
• https://medium.com/fresha-data-engineering/the-good-the-bad-and-the-automq-5aa7a8748e71 The Good, The Bad and The AutoMQ. Slack’s KIP-1176, Aiven’s Diskless 2.0
• https://simonwillison.net/2025/Oct/16/claude-skills/ Claude Skills are awesome, maybe a bigger deal than MCP

16-10-2025

• https://www.youtube.com/watch?v=dthbi4lzO58 AI Could Wipe Out the Working Class | Sen. Bernie Sanders

02-10-2025

• https://assets.anthropic.com/m/12f214efcc2f457a/original/Claude-Sonnet-4-5-System-Card.pdf Claude Sonnet 4.5 System Card

28-09-2025

• https://blog.dataengineerthings.org/the-case-for-hybrid-cache-for-object-stores-4b1f02ec6c9a The Case for Hybrid Cache for Object Stores
• https://newsletter.pragmaticengineer.com/p/how-claude-code-is-built How Claude Code is built
• https://www.infoq.com/podcasts/ai-ml-data-engineering-trends-2025 AI, ML, and Data Engineering InfoQ Trends Report 2025 - InfoQ

Transcript Introductions [00:30] Srini Penchikala: Hello everyone. Welcome to the 2025 AI and ML Trends Report podcast. Greetings from the InfoQ, AI/ML and data engineering team. Today we also have a special guest for this year’s trends report discussion. This podcast is part of our annual report to

26-09-2025

• https://blog.cloudflare.com/cloudflare-data-platform/ Announcing the Cloudflare Data Platform: ingest, store, and query your data directly on Cloudflare

23-09-2025

• https://github.com/MagicBeansAI/magictunnel Smart MCP Proxy - One intelligent tool that discovers the right tool for any request.

16-09-2025

• https://andrewchen.substack.com/p/ai-will-change-how-we-build-startups AI will change how we build startups -- but how?

09-09-2025

• https://dataengineeringcentral.substack.com/p/medallion-architecture-truth-or-fiction Medallion Architecture. Truth or Fiction?

07-09-2025

• https://www.reddit.com/r/ClaudeAI/comments/1lkfz1h/how_i_use_claude_code/ How I use Claude Code : r/ClaudeAI

06-09-2025

• https://www.pagerduty.com/eng/august-28-kafka-outages-what-happened-and-how-were-improving/ August 28 Kafka Outages – What Happened and How We’re Improving

31-08-2025

• https://arxiv.org/pdf/2410.06351 Moving Faster and Reducing Risk: Using LLMs in Release Deployment
• https://grafana.com/blog/2025/08/22/how-to-monitor-your-homelab-with-beyla-ebpf-and-opentelemetry/ How to monitor with Beyla, eBPF, and OpenTelemetry
• https://steipete.me/posts/2025/optimal-ai-development-workflow My Current AI Dev Workflow - Very similar to mine, love it!

30-08-2025

• https://levelup.gitconnected.com/what-i-learned-from-anthropic-teams-claude-code-practice-d3ddfa1d051e How Anthropic raised their level using Claude Code themselves
• https://archive.is/HowHM Andrew Ng: Product Management Is Now the Bottleneck in Startups

the real bottleneck in AI startups isn’t coding — it’s product management

• https://github.com/apple/container apple/container: A tool for creating and running Linux containers using lightweight virtual machines on a Mac. It is written in Swift, and optimized for Apple silicon.

29-08-2025

• https://www.datadoghq.com/blog/engineering/rust-timeseries-engine/#throttling-under-heavy-load?utm_source=tldrdata Evolving our real-time timeseries storage again: Built in Rust for performance at scale
• https://www.seangoedecke.com/the-simplest-thing-that-could-possibly-work/ Do the simplest thing that could possibly work
• https://blog.dataengineerthings.org/why-we-didnt-rewrite-debezium-in-rust-66c35ae9dce8 Why We Didn’t Rewrite Debezium in Rust

we chose to build on top of the Debezium Embedded Engine and perform deep customizations.

• https://www.datadoghq.com/blog/cloud-cost-management-saved-millions/ How we saved $1.5 million per year with Cloud Cost Management | Datadog

Solution was to minimize non-current versions in S3 buckets

24-08-2025

• https://github.com/SudhenduP/kafka-mcp-integration Simple example of an MCP server with Kafka
• https://medium.com/@joe.njenga/use-claude-code-hooks-newest-feature-to-fully-automate-your-workflow-341b9400cfbe How I’m Using Claude Code Hooks To Fully Automate My Workflow

23-08-2025

• https://research.kudelskisecurity.com/2025/08/19/how-we-exploited-coderabbit-from-a-simple-pr-to-rce-and-write-access-on-1m-repositories/ How We Exploited CodeRabbit: From a Simple PR to RCE and Write Access on 1M Repositories
• https://rmoff.net/2025/08/18/kafka-to-iceberg-exploring-the-options/ Kafka to Iceberg - Exploring the Options
• https://medium.com/@oscarpulido55/iceberg-ahead-navigating-the-three-flavors-of-iceberg-on-bigquery-e004eec18d5c Navigating the Three Flavors of Iceberg on BigQuery
• https://www.chkk.io/ Chkk Upgrade Copilot for Open Source

Agentic Upgrades for Open Source Software

• https://developers.redhat.com/articles/2025/08/21/hidden-pitfalls-kafka-tiered-storage#key_configurations The hidden pitfalls of Kafka tiered storage

12-08-2025

• https://www.maginative.com/article/google-announces-new-ai-agents-for-data-analysis-science/ Google Announces New AI Agents for Data Analysis & Science
• https://seattledataguy.substack.com/p/the-inconvenient-truths-of-self-service The Inconvenient Truths of Self-Service Analytics

07-08-2025

• https://cyata.ai/blog/cracking-the-vault-how-we-found-zero-day-flaws-in-authentication-identity-and-authorization-in-hashicorp-vault/ Cracking the Vault: how we found zero-day flaws in authentication, identity, and authorization in HashiCorp Vault

06-08-2025

• https://sderosiaux.github.io/vc-story/ It’s Not 2021 Anymore | The Real Story of VC-Backed Startups

03-08-2025

• https://kashw1n.com/blog/nodejs-2025/ Modern Node.js Patterns for 2025
• https://blog.puzzmo.com/posts/2025/07/30/six-weeks-of-claude-code/ 6 Weeks of Claude Code

29-07-2025

• https://medium.com/@community_md101/what-is-a-data-marketplace-and-why-your-organisation-needs-it-today-60f06c12be53 What is a Data Marketplace
• https://engineering.fb.com/2025/07/23/security/policy-zones-meta-purpose-limitation-batch-processing-systems/ Policy Zones: How Meta enforces purpose limitation at scale in batch processing systems - Engineering at Meta

The restrictions on downstream data must be equal to or more restrictive than those of the upstream source from which the data originates

27-07-2025

• https://intelligence.org/the-problem/ The Problem

Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war.

• https://dynomight.net/wanting The AI safety problem is “wanting”

20-07-2025

• https://www.youtube.com/watch?v=WWoyWNhx2XU Anthropic co-founder: AGI predictions, leaving OpenAI, what keeps him up at night
• https://isovalent.com/blog/post/cilium-netkit-a-new-container-networking-paradigm-for-the-ai-era/ Cilium netkit: The Final Frontier in Container Networking Performance
• https://www.youtube.com/watch?v=5QcCeSsNRks François Chollet: How We Get To AGI
• https://medium.com/@lucascarrasquillaparra/chat-with-your-documents-tool-rag-vector-dbs-cosine-sim-claude-api-implementation-2312cf14c67a RAG (vector DBs + cosine sim.) & Claude API implementation
• https://github.com/qdhenry/Claude-Command-Suite/tree/main commands for Claude Code that provide structured workflows for software development tasks including code review, feature creation, security auditing, and architectural analysis.
• https://sootyempiric.blogspot.com/2025/07/comparisons-between-life-in-uk-and-usa.html Comparisons Between Life in the UK and the USA

19-07-2025

• https://x.com/alexwei_/status/1946477742855532918 I’m excited to share that our latest @OpenAI experimental reasoning LLM has achieved a longstanding grand challenge in AI: gold medal-level performance on the world’s most prestigious math competition—the International Math Olympiad (IMO)
• https://nigeltao.github.io/blog/2020/jsonptr.html Jsonptr: Using Wuffs’ Memory-Safe, Zero-Allocation JSON Decoder

hermetic

18-07-2025

• https://newsletter.pragmaticengineer.com/p/the-pulse-140 The Pulse #140: Does Cursor make developers less effective?
• https://sankalp.bearblog.dev/my-claude-code-experience-after-2-weeks-of-usage/ My Experience With Claude Code After 2 Weeks of Adventures

14-07-2025

• https://thenewstack.io/ebpf-has-a-bright-future-in-infrastructure-development/ eBPF Has a Bright Future in Infrastructure Development

13-07-2025

• https://aeon.co/essays/consciousness-is-not-a-thing-but-a-process-of-inference Consciousness is not a thing, but a process of inference

an agent or a self: something that engages in proactive, purposeful inference about its own future, based on a thick model of time.

• https://substack.gauravvohra.com/p/search-is-dead-long-live-llms-winning-in-the-era-of-llms-ai-overviews-and-geo SEO Is Dead. Long Live GEO

07-07-2025

• https://www.youtube.com/watch?v=5QcCeSsNRks François Chollet: How We Get To AGI
• https://seattledataguy.substack.com/p/speed-without-understanding-one-of Speed Without Understanding - One of the Biggest Risks in Data Engineering
• https://www.infoq.com/news/2025/06/linkedin-northguard-xinfra LinkedIn Announces Northguard and Xinfra: Scaling beyond Kafka for Log Storage and Pub/Sub
• https://github.com/bjaggi/acl-to-cc-rbac-utility Tool to migrate MSK stuff (topics, schemas, acls etc.) to Confluent Cloud

06-07-2025

• https://sderosiaux.medium.com/you-dont-need-a-data-owner-until-you-do-363ff250aa4b You Don’t Need a Data Owner. Until You Do.
• https://blog.zomato.com/apache-flink-journey-zomato-from-inception-to-innovation Apache Flink Journey @Zomato: From Inception to Innovation
• https://debezium.io/blog/2025/06/13/openlineage-integration/ Native data lineage in Debezium with OpenLineage

Data lineage is the process of tracking the flow and transformations of data from its origin to its final destination.

05-07-2025

• https://www.mckinsey.com/capabilities/quantumblack/our-insights/seizing-the-agentic-ai-advantage GenAI paradox: exploring AI use cases | McKinsey

Data accessibility and quality gaps. These gaps tend to exist for both structured and unstructured data, with unstructured material remaining largely ungoverned in most organizations.

• https://www.mckinsey.com/capabilities/people-and-organizational-performance/our-insights/the-future-of-work-is-agentic Building and managing an agentic AI workforce | McKinsey

04-07-2025

• https://juhache.substack.com/p/boring-semantic-layer-mcp Boring Semantic Layer + MCP = 🔥

03-07-2025

• https://gradientflow.substack.com/p/how-to-future-proof-your-ai-governance How to future-proof your AI governance strategy
• https://newsletter.pragmaticengineer.com/p/the-10x-overlemployed-engineer The 10x “overlemployed” engineer

01-07-2025

• https://github.com/nimtable/nimtable nimtable/nimtable: The Control Plane for Apache Iceberg.
• https://clickhouse.com/blog/why-openai-uses-clickhouse-for-petabyte-scale-observability Why OpenAI chose ClickHouse for petabyte-scale observability

30-06-2025

• https://wangjunfei.com/2025/02/10/Announcing-Stonemq-A-high-performance-and-efficient-message-queue-developed-in-Rust/ Stonemq: A high-performance and efficient message queue developed in Rust

29-06-2025

• https://medium.com/@elisowski/databricks-vs-microsoft-fabric-which-one-is-best-for-your-data-needs-6154310084cc Databricks vs Microsoft Fabric

22-06-2025

• https://www.youtube.com/watch?v=LCEmiRjPEtQ (46) Andrej Karpathy: Software Is Changing (Again)

21-06-2025

• https://medium.com/@hugolu87/everything-from-the-databricks-2025-summit-8c257aa44dee Everything from the Databricks 2025 summit
• https://sanjmo.medium.com/the-era-of-passive-data-management-is-over-what-cdos-must-do-now-to-drive-ai-driven-9d2ea531806b The Era of Passive Data Management is Over; What CDOs Must Do (Now) to Drive AI-driven Transformation

12-06-2025

• https://www.reddit.com/r/apachekafka/comments/1l9p6z0/costeffective_logging_at_scale_sharechats_journey/ Cost-Effective Logging at Scale: ShareChat’s Journey to WarpStream : r/apachekafka
• https://medium.com/@richardhightower/is-rag-dead-anthropic-says-no-290acc7bd808 Is Contextual Retrieval the new RAG?

11-06-2025

• https://zuplo.com/docs/handlers/mcp-server From OpenAPI to MCP in 2sec

09-06-2025

• https://www.ibm.com/downloads/documents/gb-en/12f5a71117cdc329 Agentic AI in Financial Services - Opportunities, Risks, and Responsible Implementation

04-06-2025

• https://medium.com/@elisowski/mcp-explained-the-new-standard-connecting-ai-to-everything-79c5a1c98288 MCP Explained: The New Standard Connecting AI to Everything

01-06-2025

• https://longform.asmartbear.com/more-or-less/ More for more / More for less / Less for less strategies

29-05-2025

• https://www.streamingdata.tech/p/current-london-2025 Current London 2025 - by Yaroslav Tkachenko

26-05-2025

• https://www.youtube.com/watch?v=2-yrkW-nhlU Claude Sonnet Called the FBI (virtually) Over a $2 Vending Machine
• https://lp.eptura.com/rs/267-JUP-120/images/2025 Workplace Index_TL-EPT-2222-EN 1.pdf?version=0 2025 Workplace Index - Return To Office & AI stuff
• https://www.youtube.com/watch?v=vtIzMaLkCaM The Craft of Writing Effectively - we write to change readers’ ideas/world

25-05-2025

• https://github.com/JorianWoltjer/mcp-cli mcp-cli: CLI to interact with and list Model Context Protocol (MCP) servers in SSE (Server-Sent Events) transport mode
• https://blog.jaisal.dev/articles/mcp MCP: May Cause Pwnage - MANY Backdoors in Disguise
• https://seanfalconer.medium.com/how-kafka-flink-databricks-and-neon-power-the-modern-stack-for-ai-agents-6c7e4599567f How Kafka, Flink, Databricks, and Neon Power the Modern Data Stack for AI Agents
• https://ainativedev.io/news/text-diffusion Is Text Diffusion for Code a Game Changer? dLLM
• https://blog.det.life/data-engineering-now-with-30-more-bullshit-b9de5f81f8c2 Data Engineering: Now with 30% More Bullshit

24-05-2025

• https://www.infoq.com/articles/rethinking-medallion-architecture/ The End of the Bronze Age: Rethinking the Medallion Architecture
• https://medium.com/snowflake/how-to-clean-and-enrich-data-before-it-lands-in-snowflake-5bc937486b82 How to Clean and Enrich Data Before It Lands in Snowflake

23-05-2025

• https://moderndata101.substack.com/p/the-role-of-the-data-architect The Role of the Data Architect in AI Enablement
• https://www.anthropic.com/news/claude-4 Introducing Claude 4 \ Anthropic

16-05-2025

• https://www.infoq.com/articles/practical-design-patterns-modern-ai-systems/ Beyond the Gang of Four: Practical Design Patterns for Modern AI Systems

15-05-2025

• https://batteryventures.substack.com/p/ai-is-growing-our-appetite-for-saas AI Is Growing Our Appetite for SaaS, Not Destroying It

10-05-2025

• https://scet.berkeley.edu/the-next-next-big-thing-agentic-ais-opportunities-and-risks/ The Next “Next Big Thing”: Agentic AI’s Opportunities and Risks
• https://www.promptfiddle.com/ Prompt Fiddle using BAML #promptengineering

07-05-2025

• https://www.microsoft.com/en-us/microsoft-cloud/blog/2025/05/07/empowering-multi-agent-apps-with-the-open-agent2agent-a2a-protocol/ Empowering multi-agent apps with the open Agent2Agent (A2A) protocol

06-05-2025

• https://current.confluent.io/post-conference-videos-2025/re-engineering-kafka-consumers-for-india-scale-dream11s-journey-to-processing-millions-of-message-bng25 Re-engineering Kafka Consumers for ‘India Scale’: Dream11’s Journey to Processing Millions of Message
• https://www.datadoghq.com/blog/engineering/streaming-platform-kafka-custom-abstractions/ Achieving relentless Kafka reliability at scale with the Streaming Platform

05-05-2025

• https://www.khoslaventures.com/the-opportunity-for-ai-in-healthcare-is-here-now/ The Opportunity for AI in Healthcare is here now
• https://www.docker.com/blog/build-to-prod-mcp-servers-with-docker/ How to build and deliver an MCP server for production
• https://github.com/cloudflare/mcp-server-cloudflare mcp-server-cloudflare
• https://longform.asmartbear.com/purgatory/ Product Purgatory: When they love it but still don’t buy

04-05-2025

• https://www.anthropic.com/news/integrations Claude can now connect to your world \ Anthropic
• https://medium.com/data-science-collective/agentic-ai-comparing-new-open-source-frameworks-21ec676732df Agentic AI: Comparing New Open-Source Frameworks
• https://blog.metamirror.io/zero-copy-a-modern-data-fantasy-a28b535b6bfa “Zero-Copy” a modern data fantasy

30-04-2025

• https://github.com/mcp-ecosystem/mcp-gateway mcp-ecosystem/mcp-gateway: MCP Gateway - A lightweight gateway service that transforms APIs into MCP servers

29-04-2025

• https://www.decodable.co/blog/agentic-ai-will-make-things-worse-before-it-makes-them-better Agentic AI Will Make Things Worse Before It Makes Them Better
• https://drive.google.com/file/d/10zJPuXAzEBIdnwSH14IQmt9KwQPyxMRV/view NEXT 25 DEVLT-202 - [Rubens de Almeida Zimbres] [Next25 - Lightning Talk]

26-04-2025

• https://ai.meta.com/blog/llama-4-multimodal-intelligence/ The Llama 4 herd: The beginning of a new era of natively multimodal AI innovation
• https://blog.owulveryck.info/2025/04/22/mcps-3-us-making-a-tool-useful-usable-and-used-by-and-for-an-llm.html MCP’s 3 U’s: Making a Tool Useful, Usable, and Used by and for an LLM #ontology
• https://codemia.io/blog/path/Apache-Kafka-40-Deep-Dive-Breaking-Changes-Migration-and-Performance Apache Kafka 4.0 Deep Dive: Breaking Changes, Migration, and Performance
• https://www.infoq.com/news/2025/04/azure-mcp-server-public-preview/ Azure MCP Server
• https://medium.com/google-cloud/architecting-a-multi-agent-system-with-google-a2a-and-adk-4ced4502c86a Architecting a Multi-Agent System with Google A2A and ADK

25-04-2025

• https://hiddenlayer.com/innovation-hub/novel-universal-bypass-for-all-major-llms/ Novel Universal Bypass for All Major LLMs

24-04-2025

• https://topicpartition.io/blog/kip-1150-diskless-topics-in-apache-kafka KIP-1150 in Apache Kafka is a big deal (Diskless Topics)
• https://www.youtube.com/watch?v=99HVEF7r2N4 Building Data Systems in 2025: S3 as Primary Storage: Cost, Latency, Caching Strategies
• https://a16z.com/a-deep-dive-into-mcp-and-the-future-of-ai-tooling/ A Deep Dive Into MCP and the Future of AI Tooling | Andreessen Horowitz
• https://www.mckinsey.com/capabilities/quantumblack/our-insights/the-state-of-ai The State of AI: Global survey | McKinsey
• https://seanfalconer.medium.com/the-ai-silo-problem-how-data-streaming-can-unify-enterprise-ai-agents-0a138cf6398c The AI Silo Problem: How Data Streaming Can Unify Enterprise AI Agents

23-04-2025

• https://menlovc.com/perspective/the-modern-ai-stack-design-principles-for-the-future-of-enterprise-ai-architectures/ The Modern AI Stack: Design Principles for the Future of Enterprise AI Architectures - Menlo Ventures

21-04-2025

• https://moderndata101.substack.com/p/introducing-lakehouse-20-what-changes Lakehouse 2.0, decentralization

13-04-2025

• https://seanfalconer.medium.com/how-to-build-a-multi-agent-orchestrator-using-flink-and-kafka-4ee079351161 How to Build a Multi-Agent Orchestrator Using Flink and Kafka

07-04-2025

• https://www.datadoghq.com/blog/focus-and-datadog/ Simplify Multi-Cloud Cost Management With FOCUS and Datadog

04-04-2025

• https://gradientflow.substack.com/p/autonomous-ai-agents-are-changing Autonomous AI Agents Are Changing Knowledge Work—Fast

31-03-2025

• https://www.responsive.dev/blog/performance-optimization-kafka-streams-101 Kafka Streams 101: Optimizing your apps for maximum performance
• https://speakerdeck.com/angioia/building-your-enterprise-knowledge-graph-one-data-product-at-a-time Building your Enterprise Knowledge Graph one data product at a time

27-03-2025

• https://vutr.substack.com/p/bufstream-stream-kafka-messages-to Bufstream: Stream Kafka Messages to Iceberg Tables in Minutes

24-03-2025

• https://www.allthingsdistributed.com/2025/03/in-s3-simplicity-is-table-stakes.html In S3 simplicity is table stakes

23-03-2025

• https://medium.com/@danthelion/we-need-to-talk-about-byoc-b58c506aec4d We Need To Talk About BYOC.
• https://quesma.com/blog-detail/aiops-observability Lessons from the pre-LLM AI in Observability: Anomaly Detection and AIOps vs. P99
• https://www.infoq.com/articles/secure-ai-powered-early-detection-system/ Secure AI-Powered Early Detection System for Medical Data Analysis & Diagnosis
• https://medium.com/quantumblack/solving-data-quality-for-gen-ai-applications-11cbec4cbe72 Solving data quality for gen AI applications and unstructured documents
• https://levelup.gitconnected.com/chain-of-draft-cod-is-the-new-king-of-prompting-techniques-d9dc17f12051 Chain-of-Draft (CoD): TLDR: think step by step, 5 words minimum for each step
• https://www.gartner.com/doc/reprints?id=1-2HKZSYYT&ct=240516&st=sb Trending Questions About Generative AI (Gartner)
• https://medium.com/everyday-ai/craziest-mcp-servers-you-must-try-f23526a165f5 (not-so) Craziest MCP Servers You Must Try

22-03-2025

• https://a16z.com/a-deep-dive-into-mcp-and-the-future-of-ai-tooling/ A Deep Dive Into MCP and the Future of AI Tooling
• https://medium.com/@andrew_schofield/early-access-release-of-queues-for-kafka-in-apache-kafka-4-0-0ae2f3f69ac9 Early access release of Queues for Kafka in Apache Kafka 4.0

21-03-2025

• https://redpanda-data.medium.com/apache-iceberg-topics-stream-directly-into-your-data-lake-0250a8dfdd76 Apache Iceberg Topics: Stream directly into your data lake

20-03-2025

• https://seanfalconer.medium.com/the-future-of-ai-agents-is-event-driven-9e25124060d6 The Future of AI Agents is Event-Driven
• https://lazypro.medium.com/evolution-of-rag-baseline-rag-graphrag-and-kag-93b6f221bde6 Evolution of RAG: RAG, GraphRAG, and KAG
• https://medium.com/@getindatatechteam/the-evolution-of-real-time-data-streaming-in-business-7b4d24fe1af3 The Evolution of Real-Time Data Streaming in Business

15-03-2025

• https://seattledataguy.substack.com/p/5-hard-earned-lessons-in-building 5 Hard-Earned Lessons in Building a Successful Data Career: Embracing Mistakes and Driving Impact

12-03-2025

• https://buf.build/blog/bufstream-multi-region Multi-region, active-active Bufstream at 100 GiB/s

08-03-2025

• https://www.reddit.com/r/apachekafka/comments/1j5mszx/kafka_dr_strategy_handling_producer_failover_with/ Kafka DR Strategy - Handling Producer Failover with Conduktor
• https://www.blef.fr/data-news-week-25-10/ Data News — AI, dbt, SQLMesh, data teams

06-03-2025

• https://www.infoq.com/presentations/firewall-java-ebpf/ Building a Lightning Fast Firewall with Java & eBPF
• https://www.nationalsecurity.ai/ Superintelligence Strategy
• https://vutr.substack.com/p/how-is-databricks-spark-different How is Databricks’ Spark different from Open-Source Spark?

03-03-2025

• https://www.infoq.com/presentations/zero-trust-devsecops/ A Zero Trust Future for Applications: Practical Implementation and Pitfalls

02-03-2025

• https://morganperry.substack.com/p/devtools-brew-71-early-revenue-illusion Early Revenue Illusion & Building Companies That Last. — As founder, this article is clearly spot-on!

01-03-2025

• https://www.databricks.com/blog/improving-retrieval-and-rag-embedding-model-finetuning Improving Retrieval and RAG with Embedding Model Finetuning

22-02-2025

• https://grafana.com/blog/2025/02/20/the-next-generation-of-grafana-mimir-inside-mimirs-redesigned-architecture-for-increased-reliability/ The next generation of Grafana Mimir: Inside Mimir’s redesigned architecture for increased reliability

18-02-2025

• https://thedatasource.substack.com/p/engineering-byoc-enterprise-startups Engineering BYOC: Enterprise Startups Share Their Playbooks

16-02-2025

• https://www.anthropic.com/news/the-anthropic-economic-index Introducing the Anthropic Economic Index
• https://www.hotds.dev/p/humans-of-the-data-sphere-issue-8 Humans of the Data Sphere Issue #8
• https://www.stream.security/post/toxic-combination-real-time-agents-on-top-static-cspm Toxic Combination: The Pitfalls of layering real-time agents on top of Static CSPM
• https://kai-waehner.medium.com/real-time-model-inference-with-apache-kafka-and-flink-for-predictive-ai-and-genai-bf9459f66c13 Real-Time Model Inference with Apache Kafka and Flink for Predictive AI and GenAI

12-02-2025

• https://www.warpstream.com/blog/kafka-transactions-explained-twice Kafka Transactions Explained
• https://www.infoq.com/articles/building-trust-ai/ Building Trust in AI: Security and Risks in Highly Regulated Industries

11-02-2025

• https://defragzone.substack.com/p/techs-dumbest-mistake-why-firing (9) Tech’s Dumbest Mistake: Why Firing Programmers for AI Will Destroy Everything

10-02-2025

• https://medium.com/codex/google-just-annihilated-deepseek-and-openai-with-their-new-flash-2-0-model-f5ac84b4bb60 Gemini Flash 2.0 is the new pop
• https://blog.cloudflare.com/cloudflare-incident-on-february-6-2025/ Cloudflare incident on February 6, 2025

05-02-2025

• https://www.datadoghq.com/blog/data-jobs-monitoring/ Troubleshoot and Optimize Data Processing Workloads With Data Jobs Monitoring
• https://medium.com/@msakhatsky/modern-data-architectures-explained-a9a4e0c8d8ed Modern Data Architectures Explained

04-02-2025

• https://www.nextdata.com/our-pov/the-data-mesh-challenge-how-to-close-the-gap-between-inception-and-operation-at-scale The data mesh challenge: closing the gap between strategy and operation at scale (high level generic stuff)
• https://journalofbigdata.springeropen.com/articles/10.1186/s40537-021-00468-0 Big data quality framework: a holistic approach to continuous quality management
• https://jack-vanlightly.com/blog/2025/2/3/why-snowflake-wants-streaming Why Snowflake wants streaming — Jack Vanlightly
• https://www.linkedin.com/pulse/more-freedom-means-problems-cost-decentralization-stéphane-derosiaux-15bxe/ More Freedom means More Problems (the cost of decentralization) #me
• https://futurism.com/deepseek-failed-every-security-test DeepSeek Failed Every Single Security Test, Researchers Found

03-02-2025

• https://youtubetranscriptoptimizer.com/blog/05_the_short_case_for_nvda The Short Case for Nvidia Stock [very long article] #ai

02-02-2025

• https://restate.dev/blog/every-system-is-a-log-avoiding-coordination-in-distributed-applications/ Every System is a Log: Avoiding coordination in distributed applications Restate

01-02-2025

• https://www.linkedin.com/pulse/subtle-art-cost-comparisons-tristan-stevens-tqtue/ The subtle art of cost comparisons #kafka #redpanda #warpstream

30-01-2025

• https://www.datadoghq.com/blog/engineering/husky-storage-compaction/ Husky: Efficient Compaction at Datadog Scale | Datadog
• https://newsletter.pragmaticengineer.com/p/the-pulse-122-deepseek-rocks-the The Pulse #122: DeepSeek rocks the tech industry
• https://blog.det.life/stream-processing-systems-in-2025-risingwave-flink-spark-streaming-and-whats-ahead-6e24927f7d8b Stream Processing Systems in 2025: RisingWave, Flink, Spark Streaming, and What’s Ahead

21-01-2025

• https://seanfalconer.medium.com/event-driven-ai-building-a-research-assistant-with-kafka-and-flink-e95db47eb3f3 Event-Driven AI: Building a Research Assistant with Kafka and Flink
• https://startree.ai/resources/disaggregating-observability-with-kafka-startree-grafana Disaggregated Observability Stack with Kafka, StarTree, & Grafana

20-01-2025

• https://www.lesswrong.com/posts/njAZwT8nkHnjipJku/alignment-faking-in-large-language-models Alignment Faking in Large Language Models

19-01-2025

• https://dataengineeringcentral.substack.com/p/data-quality-with-databricks-labs Data Quality with Databricks Labs new DQX tool
• https://blog.det.life/aws-s3-tables-what-it-means-for-apache-iceberg-and-the-data-ecosystem-4a1f6b978b22 AWS S3 Tables: What it Means for Apache Iceberg and the Data Ecosystem
• https://blog.stackademic.com/linux-creator-reveals-the-future-of-programming-with-ai-91455af6747e AI will change the way we code, but it will be a gradual evolution, not a sudden revolution.
• https://mill-build.org/blog/6-garbage-collector-perf.html Understanding JVM Garbage Collector Performance

18-01-2025

• https://www.latent.space/p/o1-skill-issue o1 isn’t a chat model: it needs your goal, some eventual warnings, and a massive context dump to do its job properly. Like a junior person.

15-01-2025

• https://materializedview.io/p/infrastructure-vendors-are-in-a-tough Infrastructure Vendors Are in a Tough Spot, Confluent, Warpstream, Kafka

13-01-2025

• https://sanjmo.medium.com/2025-enterprise-data-ai-trends-agents-platforms-and-moonshots-0010c8b4d1f3 2025 Enterprise Data & AI Trends: Agents, Platforms, and Moonshots

12-01-2025

• https://lukaspetersson.com/blog/2025/bitter-vertical/ AI founders will learn The Bitter Lesson
• https://medium.com/@yingjunwu/data-engineers-why-you-really-need-to-learn-ai-61e408fa38df Data Engineers: Why You Really Need to Learn AI
• https://www.dataengineeringweekly.com/p/the-future-of-data-lakehouses-a-fireside The Future of Data Lakehouses: A Fireside Chat with Vinoth Chandar - Founder CEO Onehouse & PMC Chair of Apache Hudi
• https://matduggan.com/stop-trying-to-schedule-a-call-with-me/ Stop Trying To Schedule A Call With Me

11-01-2025

• https://www.youtube.com/watch?v=w9WE1aOPjHc François Chollet / Machine Learning Street Talk #podcast
• https://qlikdork.com/2024/12/visualizing-dimensional-relationships/ Visualizing Dimensional Relationships: Sankey and Decomposition Tree #dataviz
• https://iconsolutions.com/blog/i-got-opentelemetry-to-work-but-why-was-it-so-complicated/ I got OpenTelemetry to work. But why was it so complicated? #otel

09-01-2025

• https://unzip.dev/0x01f-ai-and-startup-moats/ AI and Startup Moats

06-01-2025

• https://blog.practicalengineering.management/the-changing-engineering-landscape-and-how-to-stay-ahead-of-it-1bcdf9d63f6a The Changing Engineering Landscape and How to Stay Ahead of It

05-01-2025

• https://zohaib.me/using-llms-and-cursor-for-finishing-projects-productivity/ Using LLMs and Cursor to become a finisher

03-01-2025

• https://minimaxir.com/2025/01/write-better-code/ Can LLMs write better code if you keep asking them to “write better code”?

02-01-2025

• https://www.cs.cmu.edu/~pavlo/blog/2025/01/2024-databases-retrospective.html Databases in 2024: A Year in Review
• https://simonwillison.net/2024/Dec/31/llms-in-2024/ Things we learned about LLMs in 2024

01-01-2025

• https://www.infoq.com/news/2024/12/cloudflare-2024-review-report/ Cloudflare 2024 Year in Review: Strong Growth for GitHub Copilot and Go Surpasses Node.js

31-12-2024

• https://aipapersacademy.com/chain-of-continuous-thought/ LLM Reasoning with Chain of Continuous Thought by Meta AI
• https://aipapersacademy.com/chain-of-continuous-thought/ LLM Reasoning with Chain of Continuous Thought by Meta AI

23-12-2024

• https://newsletter.betterstack.com/p/how-dropbox-saved-millions-of-dollars How Dropbox Saved Millions of Dollars by Building a Load Balancer

22-12-2024

• https://www.youtube.com/watch?v=tOGK1nlHdFo Lenny & Marc Benioff (salesforce)
• https://www.vldb.org/pvldb/vol16/p3335-butrovich.pdf Tigger: A Database Proxy That Bounces With User-Bypass
• https://www.youtube.com/watch?v=vD-0dw4gUhw P99 CONF 2024 | The Next Chapter in the Sordid Love/Hate Relationship Btwn DBs & OSes by Andy #ebpf

21-12-2024

• https://cdn.openai.com/papers/practices-for-governing-agentic-ai-systems.pdf practices-for-governing-agentic-ai-systems.pdf
• https://www.responsive.dev/blog/kafka-streams-2024-year-in-review Kafka Streams Wrapped: 2024 in review
• https://medium.com/building-the-open-data-stack/a-guide-to-agentic-ai-architecture-c665f2ba30c2 A Guide to Agentic AI Architecture | Building Real-World, Real-Time AI

20-12-2024

• https://arcprize.org/blog/oai-o3-pub-breakthrough OpenAI o3 Breakthrough High Score on ARC-AGI-Pub

19-12-2024

• https://www.dataengineeringweekly.com/p/the-future-of-data-engineering-dews (4) The Future of Data Engineering: DEW’s 2025 Predictions

17-12-2024

• https://towardsdatascience.com/top-10-data-ai-trends-for-2025-4ed785cafe16 Top 10 Data & AI Trends for 2025. Agentic AI, small data
• https://www.dataengineeringweekly.com/p/the-state-of-data-engineering-in The State of Data Engineering in 2024: Key Insights and Trends

16-12-2024

• https://thealliance.ai/blog/the-state-of-open-source-trust The State of Open Source AI Trust and Safety - End of 2024 Edition
• https://dataengineeringcentral.substack.com/p/aws-s3-tables-the-iceberg-cometh AWS S3 Tables?! The Iceberg Cometh
• https://www.kai-waehner.de/blog/2024/12/04/the-data-streaming-landscape-2025/ The Data Streaming Landscape 2025

15-12-2024

• https://meltware.com/2024/12/04/s3-tables A First Look at S3 (Iceberg) Tables
• https://gradientflow.substack.com/p/empowering-ai-agents-with-real-time Empowering AI Agents with Real-Time Data
• https://towardsdatascience.com/agentic-mesh-the-future-of-generative-ai-enabled-autonomous-agent-ecosystems-d6a11381c979 Agentic Mesh: The Future of Generative AI-Enabled Autonomous Agent Ecosystems. // i find this overthinking what exist today (it’s called applications) but good to know
• https://karetech.medium.com/data-quality-the-path-to-striking-gold-in-your-lakehouse-24bec0fc29f6 Data Quality
• https://redmonk.com/kholterhoff/2024/12/12/why-message-queues-endure-a-history/ Why Message Queues Endure: A History
• https://grafana.com/opentelemetry-report/ OpenTelemetry: Challenges, priorities, adoption patterns, and solutions
• https://newsletter.pragmaticengineer.com/p/the-pulse-118 Particularly excited about Devin as AI agent to open PRs

README 内容过长，已截取前 64 KB。完整内容请前往 GitHub 仓库查看。