QuickDevGuide

Home › ETL - Talend & SSIS

Transform: Cleaning & Standardising Data — ETL - Talend & SSIS

Typical transformations, in the order they usually run: Step Example Trim & normalise " ANA@X.COM " → "ana@x.com" Type conversion "120.50" → Decimal("120.50"), mixed date formats → ISO dates Standardise codes usd → USD, "M"/"Male" → M De-duplicate keep latest per business key Validate required fields, ranges, formats → reject bad rows with a reason Enrich / derive currency conversion, lookups, ordermonth Reject, don't drop Send invalid rows to a reject/quarantine table with the error so someone can fix the source. Silently dropping rows hides data problems. Use Decimal for money — floats cannot represent 0.1 exactly.

Key Takeaways