Remove Columns Notes-on-NoSQL
article thumbnail

Data Modeling 301 for the cloud: data lake and NoSQL data modeling and design

erwin

For NoSQL, data lakes, and data lake houses—data modeling of both structured and unstructured data is somewhat novel and thorny. This blog is an introduction to some advanced NoSQL and data lake database design techniques (while avoiding common pitfalls) is noteworthy. But what exactly does NOSQL mean? Look at Figure 1 below.

article thumbnail

Data Modeling 101: OLTP data modeling, design, and normalization for the cloud

erwin

In fact, many current development efforts are opting for the newer, NoSQL databases (which I’ll cover in a subsequent blog, but are shown below in Figure 2 for context). For example, the NoSQL database MongoDB has documents and collections instead of tables and columns. Figure 2: Popular NoSQL database types.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Visualize Amazon DynamoDB insights in Amazon QuickSight using the Amazon Athena DynamoDB connector and AWS Glue

AWS Big Data

Amazon DynamoDB is a fully managed, serverless, key-value NoSQL database designed to run high-performance applications at any scale. Table metadata, such as column names and data types, is stored using the AWS Glue Data Catalog. The scalability and flexible data schema of DynamoDB make it well-suited for a variety of use cases.

article thumbnail

Data Modeling 401 for the cloud: Database design for serverless data-bases in the cloud

erwin

Well, erwin offers a simple way to do that instead as shown below (note that I chose Snowflake this time): Figure 6: Creating a new data model for Redshift in erwin Data Modeler. Look just under the target selection circled in red, note the four check boxes currently disabled. Examples of bad database design choices.

article thumbnail

Benefits of Enterprise Modeling and Data Intelligence Solutions

erwin

This user also noted, “I use the automatic diagramming features a lot. an EDW architect/data modeler who uses erwin DM at Royal Bank of Canada, works on diverse platforms, including Microsoft SQL Server, Oracle, DB2, Teradata and NoSQL. We do conceptual data modeling, which is very high-level and doesn’t have columns and tables.

article thumbnail

Build an Amazon Redshift data warehouse using an Amazon DynamoDB single-table design

AWS Big Data

Amazon DynamoDB is a fully managed NoSQL service that delivers single-digit millisecond performance at any scale. We discuss data model design for both NoSQL databases and SQL data warehouses. We have used generic attribute names, PK and SK, for our partition key and sort key columns. We use the following table.

article thumbnail

Themes and Conferences per Pacoid, Episode 8

Domino Data Lab

Paco Nathan ‘s latest column dives into data governance. I introduced these themes in “ Three surveys of AI adoption reveal key advice from more mature practices ” and explored them in even more detail in “ Episode 7 ” of this column. One other note: some people ask why this includes so much detail about security.