Cargo trousers with knit band