This isn't really surprising.
The "AI experts" (oof) are the people who are best poised to reap any economic rewards either through being in tech pushing AI, or being otherwise invested (personally or financially) in AI succeeding. These include the people who magically think that productivity gains will benefit workers, as opposed to owners, which ignores 100 years of productivity-gain data.
The "non-AI-experts" are presumably regular workers who see the C-suite and owners salivating at AI as the fastest way to stop paying actual humans to do a service, or for companies to degrade quality with a magical-thinking "I can't believe it's good enough!" mindset that actually gives customers a worse experience (for a greater profit).
What this divergence doesn't rule out is that the "expert" class has well-founded reason for optimism, and the "non-expert" class has well-founded reason for pessimism. It just suggests that one side sees itself as the owner class in a corpo-owned dystopian cyberpunk future where wealth has access to skill and skill doesn't have access to wealth.