Data Integrity

Data Integrity Problems

Garbage in, garbage out. The accuracy of your model can only be as good as the quality of your data. Survivorship bias is only one of many data integrity problems that can haunt system developers. Futures traders must deal with issue of forming continuous contracts and Forex traders must confront the problem of continuous trading where there are not traditional daily bars. Unfortunately, it is not uncommon to find missing dates, extra data, opens less than the low of the day, closes greater than the high of the day, unadjusted splits, or unaccounted for large dividend payouts. The error rate found in different data sources can vary enormously. Market Testing Wizards has invested significant time into data research and significant capital to purchase the highest quality data.