FT-8 is 31 dB more "efficient" than SSB on the receiver side. It is also around 6 dB more efficient on transmit duty cycle than SSB.
In other words an FT-8 signal being driven by 1 watt is almost 37 dB louder at a receiver than a SSB signal from the same transmitter. The equivalent is that a 1 watt FT-8 signal is comparable in S/N ratio at your receiver to a 5 kW SSB signal from the same location presuming the antennas are unchanged. Most "Good Copy" SSB is in the 20-30 dB S/N region. This means that FT-8 can accommodate an antenna system that is, politely put, a "lossy" dummy load. SSB can not.
Now lets consider a 10 Watt FT-8 signal -- it is the equivalent of a 50 kW SSB signal....
A decent analysis (not FT-8) of the effect of mode choice is in the December 2013 QST, pages 30-32. The Noise bandwidth of FT-8 is ~6.2 Hz - this determines the S/N ratio NOT the occupied bandwidth of 50 Hz. As a result it would lie between JT-65 and PSK-31 on the graphs in the article... Closer to JT-65 than PSK-31
So, your antenna is "deaf"

but you are using one of the more efficient modes of amateur communication in FT-8 - that is why you can "hear" so many more stations......
Grover