America is definitely not a secular state.
The first amendment says "Congress shall make no law respecting an establishment of religion, or prohibiting the free exercise thereof; "
The government cannot prohibit citizens from exercising their religion. The whole separation of church and state is from something Thomas Jefferson wrote but its not in the constitution or bill of rights. It was their first amendment right to exercise their religious beliefs during the inauguration (as it would be anytime).