The observation that certain hybrid organisms have lower fitness than the parent organisms; for example they grow more poorly or have lower survival rates. Hybrid inviability is the opposite of hybrid vigor.