They were never huge; they got a lot of hype just because a) they entered parliament and b) even Marine Le Pen considers them too racist to work with. But they've never had support much above, say, 5-10%. Which is a terrifying amount in itself for a party of literal nazis, but they've never been likely to win an election.