Remove 2011 Remove Informatics Remove Metadata Remove Visualization
article thumbnail

Build efficient, cross-Regional, I/O-intensive workloads with Dask on AWS

AWS Big Data

The OpenSearch Service domain stores metadata on the datasets connected at the Regions. A key feature of Lustre is that only the file system’s metadata is synced. Each night at 0:00 UTC, a data sync job prompts the Lustre file system to resync with the attached S3 bucket, and pulls an up-to-date metadata catalog of the bucket.