AWS Big Data

APRIL 3, 2024

licensed, 100% open-source data table format that helps simplify data processing on large datasets stored in data lakes. Data engineers use Apache Iceberg because it’s fast, efficient, and reliable at any scale and keeps records of how datasets change over time.

Data Lake 94

Data Lake Snapshot Metadata Data Architecture 94

Peter James Thomas

AUGUST 18, 2018

That was the Science, here comes the Technology… A Brief Hydrology of Data Lakes. Even back then, these were used for activities such as Analytics , Dashboards , Statistical Modelling , Data Mining and Advanced Visualisation. This is the essence of Convergent Evolution.

Data Lake 63

Data Lake Data Warehouse Data mining Statistics 63

AWS Big Data

MARCH 12, 2024

In recent years, data lakes have become a mainstream architecture, and data quality validation is a critical factor to improve the reusability and consistency of the data. Gonzalo Herreros is a Senior Big Data Architect on the AWS Glue team.

Data Quality 88

Data Quality Measurement Testing Visualization 88

Sisense

DECEMBER 11, 2019

With Itzik’s wisdom fresh in everyone’s minds, Scott Castle, Sisense General Manager, Data Business, shared his view on the role of modern data teams. Scott whisked us through the history of business intelligence from its first definition in 1958 to the current rise of Big Data. A true unicorn.

Data Lake 80

Data Lake Big Data Sales Data-driven 80

Domino Data Lab

AUGUST 8, 2019

Another key point: troubleshooting edge cases for models in production—which is often where ethics and data meet, as far as regulators are concerned—requires much more sophistication in statistics than most data science teams tend to have. It’s a quick way to clear the room. machine learning?

Data Science 71

Data Science Machine Learning Data Governance Statistics 71