Lester was a fugitive from justice...
...and there was a HUGE bounty offered for him. It would account for his otherwise irrational hatred of trackers, as it wouldn't be too much of a stretch to imagine them doing some bounty hunting in addition to their usual activities. This film takes place in the future of Miracle Mile
.