If TEA Party members and people who belong to groups with "Patriot" in the name were statistically more apt to apply for tax exempt status where it is not justified, then you would have a point. So you can't claim profiling. Remember, this was not an audit. This was an application for tax exempt status, all of which were granted, by the way, AFTER THE ELECTION. Hell, the IRS didn't even follow their own guidelines:
IRS agents singled out dozens of organizations for additional reviews because they included the words "tea party" or "patriot" in their exemption applications, said Lois Lerner, who heads the IRS division that oversees tax-exempt groups. In some cases, groups were asked for lists of donors, which violates IRS policy in most cases, she said.
See, these groups can't operate until they receive the blessing from the IRS. What the IRS did was use the power of the federal government to effectively shut down political opposition until after Obama's reelection.