Datamediumcommunity

data-engineer

Build scalable data pipelines, modern data warehouses, and real-time streaming architectures. Implements Apache Spark, dbt, Airflow, and cloud-native data platforms.

The full SKILL.md could not be loaded right now. You can still install it from the upstream repo.

Featured in these articles

Long-form deep dives where this skill is referenced or applied. Skim the article, then come back here to install.

ArticleAdvanced Patterns — Hooks, MCP Servers, Custom Tools, System PromptsOnce you've outgrown the defaults: hooks for deterministic side effects, MCP servers for org-specific data, custom tools, and system-prompt surgery.
ArticleSupabase — Postgres, Auth & Storage in OneReal Postgres, auth, file storage and pgvector behind one SDK. For an AI product, having your data and your vectors in the same database is a quiet superpower.
ArticleChunking — The Decision That Sets Your CeilingYou can't retrieve what you chunked badly. Chunking is the most under-rated lever in RAG — and the cheapest to get right.

data-engineer

The 1,441 skills, demystified in one PDF.

Featured in these articles