Pakistan Prime Minister Imran Khan has vowed to go after the "thieves", who left the country badly in debt and set up a high-powered commission to probe huge debts incurred during the last 10 years, as he defended arrests of several key political figures in corruption cases.