Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Description

Deequ is an innovative library that extends Apache Spark to create "unit tests for data," aiming to assess the quality of extensive datasets. We welcome any feedback and contributions from users. The library requires Java 8 for operation. It is important to note that Deequ version 2.x is compatible exclusively with Spark 3.1, and the two are interdependent. For those using earlier versions of Spark, the Deequ 1.x version should be utilized, which is maintained in the legacy-spark-3.0 branch. Additionally, we offer legacy releases that work with Apache Spark versions ranging from 2.2.x to 3.0.x. The Spark releases 2.2.x and 2.3.x are built on Scala 2.11, while the 2.4.x, 3.0.x, and 3.1.x releases require Scala 2.12. The primary goal of Deequ is to perform "unit-testing" on data to identify potential issues early on, ensuring that errors are caught before the data reaches consuming systems or machine learning models. In the sections that follow, we will provide a simple example to demonstrate the fundamental functionalities of our library, highlighting its ease of use and effectiveness in maintaining data integrity.

Description

Scala seamlessly integrates both object-oriented and functional programming paradigms into a single, elegant high-level language. With its static type system, Scala minimizes the likelihood of errors in intricate applications, while its compatibility with JVM and JavaScript allows developers to create efficient systems that can leverage extensive libraries. The Scala compiler is adept in managing static types, meaning that in most instances, you don't need to specify variable types; its robust type inference handles this automatically. Structural data types in Scala are represented by case classes, which automatically provide well-defined methods for toString, equals, and hashCode, in addition to enabling deconstruction through pattern matching. Moreover, in Scala, functions are treated as first-class citizens, allowing for the creation of anonymous functions using a streamlined syntax. This versatility makes Scala an appealing choice for developers seeking a language that combines the best of both programming worlds.

API Access

Has API

API Access

Has API

Screenshots View All

Screenshots View All

Integrations

Coverity Static Analysis
ERNIE 4.5
GPT-4.1
GPT-4o mini
Gemini 2.5 Flash-Lite
Gemma 4
Grok 4.1 Thinking
Koyeb
Llama 3.3
Mistral 7B
Mistral Large 2
Mistral Small 3.1
OpenAI o3
Qwen2.5
Snipplr
SonarQube Cloud
Sublime Text
SwapCode AI
Typora
ZeroPath

Integrations

Coverity Static Analysis
ERNIE 4.5
GPT-4.1
GPT-4o mini
Gemini 2.5 Flash-Lite
Gemma 4
Grok 4.1 Thinking
Koyeb
Llama 3.3
Mistral 7B
Mistral Large 2
Mistral Small 3.1
OpenAI o3
Qwen2.5
Snipplr
SonarQube Cloud
Sublime Text
SwapCode AI
Typora
ZeroPath

Pricing Details

No price information available.
Free Trial
Free Version

Pricing Details

Free
Free Trial
Free Version

Deployment

Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook

Deployment

Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook

Customer Support

Business Hours
Live Rep (24/7)
Online Support

Customer Support

Business Hours
Live Rep (24/7)
Online Support

Types of Training

Training Docs
Webinars
Live Training (Online)
In Person

Types of Training

Training Docs
Webinars
Live Training (Online)
In Person

Vendor Details

Company Name

Deequ

Website

github.com/awslabs/deequ

Vendor Details

Company Name

Scala

Website

www.scala-lang.org

Product Features

Product Features

Alternatives

Alternatives

Spark Streaming Reviews

Spark Streaming

Apache Software Foundation
MLlib Reviews

MLlib

Apache Software Foundation
Apache Spark Reviews

Apache Spark

Apache Software Foundation
Apache Groovy Reviews

Apache Groovy

The Apache Software Foundation
Apache Mahout Reviews

Apache Mahout

Apache Software Foundation