811As are "instant on" tubes, the "warmup time" is a second or two.
Sounds like you have either a bad connection at the socket or that tube is a goner.
Agreed. If a filament is taking a while to light up you've got resistance creeping in somewhere. Check that the pins on the tube are not overly oxidised, and that the socket is clamping nicely to the tube pins.
I have also seen tubes with dry joints inside the pins - often a 'technical tap' with a VDE / High Voltage screwdriver would do the trick, but this wasn't a long term solution.
At any rate, don't worry so much about the plates glowing. They can develop a cherry red glow without visible damage (i.e., melting the glass or warping the plate), but tube life won't be great. That said, it won't be great regardless.
The AL-811 is a great amp for chasing the odd DXPedition or checking into a net once a week on SSB. Beyond that, installing a set of 572B tubes will move you up to a nice 'Medium Duty' amplifier, capable of running 600-800 Watts PEP & 500 watts carrier.
Beyond that, an AL-80B or AL-572 would make a nice medium duty amplifier. The AL-80B is a nice 800 Watt carrier amplifier, and the AL-572 will do 1Kw carrier reasonably easily.
If you want "proper duty", its hard to beat an AL-1500. No frills, but like the Heathkit SB-200 it will be round for years. Honest 2500 Watt PEP amplifier with a fantastic 8877 triode that is currently being made in both the USA and China.