The God in the Bible, particularly the Old Testament, is a physical being that is physically seen by the people like Moses. He communicates with people and performs miracles to prove his existence and power. Strangely, he is not omniscient and not all powerful. There are several times when God is tricked, negotiated with, shown to have incomplete knowledge or had his power overcome. The Bible is also clear that other gods exist and they do have power, but God of Abraham is simply the most powerful.
The Bible is kind of a crazy book that has very little to do with what's taught modern Churches. You really should read it some time.