TIL (Today I Learned)

🧠 Latest TIL → Mann Whitney U Test

📚 Total TIL entries: 22 📅 Last updated: 2026-03-04

---

A collection of things I learn and fix every day while studying data engineering, Python, Linux, Airflow, and web development.

This repo helps me track my progress, organize solutions to debugging issues, and document concepts in my own words.

Inspired by @drecali's TIL repo and his advice to document even small learnings early on.

---

📂 Categories

Airflow

• Troubleshooting: Running dbt inside Airflow (Docker) on EC2
• Making Slack Notification DAG Visible in Airflow UI with .airflowignore
• Batch Candle Silver to Snowflake
• Batch Trade Silver to Snowflake

Data Engineering

• deque sliding window for streaming
• Stock Volatility Alert System with Snowflake & Slack

dbt

• dbt Troubleshooting notes
• dbt Compilation & schema issues and macro
• dbt Core Concepts & Setup Guide

DevOps & system

• Airflow/Docker/WSL Troubleshooting: Core Commands and Fixes
• Deploying Airflow DAGs on EC2 (Docker)

Git & GitHub

• GitHub video and media handling
• Ubuntu WSL Essential Commands Cheat Sheet
• Pushing Only a Single File Using git stash
• Rebase vs Merge Strategy
• GitHub Team Workflow Guide

Linux

• Linux Practical commands I used

Python

• dict.get() and unpacking patterns
• enumerate basics
• next() fundamentals
• Sorting dictionary by value and Top-N extraction

Statistics

• Mann-Whitney U Test practical notes

---

💡 About

Each entry documents a real issue resolved, concept clarified, or system behavior understood through hands-on experience.

---

🧠 Patterns I’m Learning Repeatedly

• Idempotent pipeline design
• Separation of orchestration vs transformation (Airflow vs dbt)
• Observability via Slack alerts
• Debugging containerized environments
• Streaming window mechanics
• Git workflow discipline (rebase vs merge decisions)