AWS Lake Formation Integrations

Amazon Simple Storage Service (Amazon S3), an object storage service, offers industry-leading scalability and data availability, security, performance, and scalability. Customers of all sizes and industries can use Amazon S3 to store and protect any amount data for a variety of purposes, including data lakes, websites and mobile applications, backup, restore, archive, enterprise apps, big data analytics, and IoT devices. Amazon S3 offers easy-to-use management tools that allow you to organize your data and set up access controls that are tailored to your business, organizational, or compliance needs. Amazon S3 is built for 99.999999999% (11 9,'s) of durability and stores data for millions applications for companies around the globe. You can scale your storage resources to meet changing demands without having to invest upfront or go through resource procurement cycles. Amazon S3 is designed to last 99.999999999% (11 9,'s) of data endurance.

Amazon Athena allows you to easily analyze data in Amazon S3 with standard SQL. Athena is serverless so there is no infrastructure to maintain and you only pay for the queries you run. Athena is simple to use. Simply point to your data in Amazon S3 and define the schema. Then, you can query standard SQL. Most results are delivered in a matter of seconds. Athena makes it easy to prepare your data for analysis without the need for complicated ETL jobs. Anyone with SQL skills can quickly analyze large-scale data sets. Athena integrates with AWS Glue Data Catalog out-of-the box. This allows you to create a unified metadata repositorie across multiple services, crawl data sources and discover schemas. You can also populate your Catalog by adding new and modified partition and table definitions. Schema versioning is possible.

Amazon Redshift is preferred by more customers than any other cloud data storage. Redshift powers analytic workloads for Fortune 500 companies and startups, as well as everything in between. Redshift has helped Lyft grow from a startup to multi-billion-dollar enterprises. It's easier than any other data warehouse to gain new insights from all of your data. Redshift allows you to query petabytes (or more) of structured and semi-structured information across your operational database, data warehouse, and data lake using standard SQL. Redshift allows you to save your queries to your S3 database using open formats such as Apache Parquet. This allows you to further analyze other analytics services like Amazon EMR and Amazon Athena. Redshift is the fastest cloud data warehouse in the world and it gets faster each year. The new RA3 instances can be used for performance-intensive workloads to achieve up to 3x the performance compared to any cloud data warehouse.

AWS App Mesh provides service mesh to facilitate communication between your services across different types of computing infrastructure. App Mesh provides visibility and high availability to your applications. Modern applications often include multiple services. Each service can be developed using different types of compute infrastructure such as Amazon EC2, Amazon ECS and Amazon EKS. It becomes more difficult to spot errors and redirect traffic after they occur, and to safely implement code changes. This was done by creating monitoring and control logic in your code and then redeploying your services whenever there were changes.

Amazon EMR is the market-leading cloud big data platform. It processes large amounts of data with open source tools like Apache Spark, Apache Hive and Apache HBase. EMR allows you to run petabyte-scale analysis at a fraction of the cost of traditional on premises solutions. It is also 3x faster than standard Apache Spark. You can spin up and down clusters for short-running jobs and only pay per second for the instances. You can also create highly available clusters that scale automatically to meet the demand for long-running workloads. You can also run EMR clusters from AWS Outposts if you have on-premises open source tools like Apache Spark or Apache Hive.

Amazon SageMaker Feature Store can be used to store, share and manage features for machine-learning (ML) models. Features are inputs to machine learning models that are used for training and inference. In an example, features might include song ratings, listening time, and listener demographics. Multiple teams may use the same features repeatedly, so it is important to ensure that the feature quality is high-quality. It can be difficult to keep the feature stores synchronized when features are used to train models offline in batches. SageMaker Feature Store is a secure and unified place for feature use throughout the ML lifecycle. To encourage feature reuse across ML applications, you can store, share, and manage ML-model features for training and inference. Any data source, streaming or batch, can be used to import features, such as application logs and service logs, clickstreams and sensors, etc.