One man wept while others appealed for significant, urgent changes as an inquiry explores a building scandal