The Treasury Inspector General for Tax Administration estimated that about 1 million callers to two IRS customer service lines did not receive quality service.