The correlation between cholesterol in the diet and cholesterol levels in the blood is rather dubious from what I've seen.
In a normal human, 70% of the cholesterol we need is generated by our bodies from other things, only 30% comes from diet. That can get out of whack, and if you cut the dietary component to zero, your body may compensate by making more, and too much, potentially.