Lesson 1Schema Validation: Required Fields, Data Types, Date Parsing, and Timezone HandlingLearn to define and enforce strong schemas for order-level data, checking required fields, data types, and date formats while managing time zones, late data, and schema changes from various sources in Botswana's context.
Defining required order-level fieldsValidating numeric and string data typesParsing dates and timestamps safelyStandardising time zones and offsetsCatching schema drift and evolutionAutomated schema checks in pipelinesLesson 2Documenting Data Lineage and Assumptions for Reproducibility and AuditabilityLearn to record data lineage, business rules, and modelling assumptions for retail order pipelines, ensuring reproducibility, governance, and auditability across teams, tools, and changing source systems in Botswana.
Capturing source-to-target mappingsRecording business transformation rulesTracking metric definitions over timeMaintaining data dictionariesVersioning pipelines and schemasAudit trails for regulatory reviewsLesson 3Loading CSVs into Analytical Tools and Environment Setup (Excel, SQL, Python, R, BI Tools)Acquire practical skills to load CSV order files into Excel, SQL databases, Python, R, and BI tools, setting up encodings, delimiters, data types, and project environments for reproducible, scalable workflows in Botswana.
Configuring CSV import optionsManaging encodings and delimitersBulk loading into SQL warehousesPython and R data ingestion scriptsConnecting BI tools to raw tablesVersioning and environment managementLesson 4Temporal Derivations: Extracting Date Parts, Rolling Windows, Fiscal Calendars, Week/Month BoundariesDiscover methods to derive temporal features from order timestamps, including calendar attributes, fiscal periods, rolling windows, and custom week or month boundaries fitting Botswana's retail trading patterns and reporting needs.
Extracting standard date partsBuilding fiscal calendars and periodsCustom retail week and month boundariesRolling windows for KPIsLag and lead features for ordersSeasonality and holiday flagsLesson 5Data Partitioning and Sampling for Efficient Exploration and Reproducible AnalysisUnderstand partitioning and sampling of large retail order datasets for efficient exploration, model development, and testing, while keeping temporal structure, seasonality, and key business segments for reproducible experiments in Botswana.
Partitioning by date and storeTrain, validation, and test splitsStratified sampling by segmentDownsampling and upsampling tacticsCreating reproducible random samplesManaging partitions in data warehousesLesson 6Detecting and Handling Missing Values: Strategies and Imputation Specific to Transactional DataMaster systematic ways to detect, profile, and handle missing values in transactional retail data, selecting imputation or exclusion strategies that maintain revenue, quantity, and customer behaviour signals without biasing analyses in Botswana.
Profiling missingness patternsMCAR, MAR, and MNAR in retail dataImputing prices, discounts, and costsHandling missing customer identifiersDealing with incomplete order linesDocumenting imputation decisionsLesson 7Outlier Detection and Treatment for Price, Quantity, Discount, and Revenue FieldsLearn to identify, diagnose, and treat outliers in price, quantity, discount, and revenue fields, separating data errors from true extreme behaviour to safeguard model stability and business reporting accuracy in Botswana.
Profiling distributions and extremesRule-based outlier thresholdsStatistical and robust detection methodsSeparating errors from rare eventsCapping, trimming, and winsorizingMonitoring outliers over timeLesson 8Standardising Categorical Fields: Region, Product_Category, Product_Subcategory, Marketing_Channel, Device_TypeLearn to standardise key categorical attributes in retail orders so regions, product hierarchies, marketing channels, and device types are consistent, analysable, and ready for segmentation, attribution, and performance reporting in Botswana.
Designing canonical code listsNormalising region and market labelsStandardising product category hierarchiesCleaning marketing_channel valuesHarmonising device_type and platformHandling legacy and deprecated valuesLesson 9Creating Derived Fields: Gross_Margin, Margin_Rate, Average_Order_Value, Unit_Cost, Order_Value ComponentsMaster creating core financial and behavioural derived metrics from order data, including gross margin, margin rate, average order value, unit costs, and order value components supporting profitability and pricing analysis in Botswana.
Calculating gross_margin and net_revenueComputing margin_rate and markupsAverage_order_value and basket sizeUnit_cost and unit_price derivationsDecomposing order_value componentsValidating derived metric consistency
