Peter James Thomas

AUGUST 18, 2018

That was the Science, here comes the Technology… A Brief Hydrology of Data Lakes. Overlapping with the above, from around 2012, I began to get involved in also designing and implementing Big Data Architectures; initially for narrow purposes and later Data Lakes spanning entire enterprises.

Data Lake 63

Data Lake Data Warehouse Data mining Statistics 63

AWS Big Data

JUNE 6, 2023

Unless, of course, the rest of their data also resides in the Google Cloud. In this post we showcase how we used AWS Glue to move siloed digital analytics data, with inconsistent arrival times, to AWS S3 (our Data Lake) and our central data warehouse (DWH), Snowflake. It consists of full-day and intraday tables.

Analytics 55

Analytics Data Lake Testing Optimization 55

CIO Business Intelligence

MARCH 27, 2024

La data strategy e la data governance si basano non solo sulle tecnologie, ma anche sugli aspetti culturali e organizzativi: per questo, dal 2015, l’Istituto nazionale per l’assicurazione contro gli infortuni sul lavoro ha trasformato la sua funzione IT in un vero dipartimento digitale.

Data Governance 52

Data Governance Data Lake Data Strategy Data-driven 52

In(tegrate) the Clouds

DECEMBER 28, 2015

His predictions are as follows: Data Eats the World and Integration Strategies Will Drive Digital Transformation. Rising Data Lakes will Drown the Warehouse. I shared some of my 2016 predictions in my previous post and summarized the most popular 2015 SnapLogic blog posts here. Multi-Cloud is the New Reality.

Data Lake 45

Data Lake IoT Digital Transformation Strategy 45

CIO Business Intelligence

SEPTEMBER 6, 2022

It launched its first online-only brand, Very, in 2009 and finally abandoned its printed catalogs to go all-in online in 2015. He found a rich collection of data assets, including information on over 2.2 Understanding what data you’ve got locked in all these different stores is a big part of the jigsaw puzzle.”.

IT 98

IT Forecasting Data Lake Enterprise 98

AWS Big Data

NOVEMBER 17, 2023

Athena provides a simplified, flexible way to analyze petabytes of data where it lives. You can analyze data or build applications from an Amazon Simple Storage Service (Amazon S3) data lake and 30 data sources, including on-premises data sources or other cloud systems using SQL or Python.

Optimization 108

Optimization Statistics Metadata Data Lake 108

In(tegrate) the Clouds

DECEMBER 21, 2015

Merv Adrian (@merv) December 19, 2015. What is the most important news item about a software company that occurred in 2015 that belongs in the capsule, and why? The resurgence of Microsoft as a cloud company was big news in 2015. Who was the biggest tech disruptor in 2015? 2016 will be the year of the data lake.

Technology 45

Technology Internet of Things Digital Transformation Software 45

AWS Big Data

JULY 28, 2023

He joined AWS in 2019 and works with customers to provide architectural guidance for running scalable analytics solutions and data mesh architectures using AWS analytics services like Amazon EMR, Amazon Athena, AWS Glue, AWS Lake Formation, and Amazon DataZone. Big Data Architect on Amazon Athena. Let’s dive into the solution.

Big Data 76

Big Data Data Architecture Data Lake Interactive 76

Cloudera

DECEMBER 19, 2018

Big Data Technologies and Architectures. Dresner end-user research shows that big data use cases have seen a dramatic increase in adoption and have become a mainstream approach for supporting analytics. In 2015, only 17% of organizations surveyed had big data implementations.

Data Warehouse 54

Data Warehouse Analytics Big Data Data Architecture 54

AWS Big Data

FEBRUARY 1, 2023

With data volumes exhibiting a double-digit percentage growth rate year on year and the COVID pandemic disrupting global logistics in 2021, it became more critical to scale and generate near-real-time data. You can visually create, run, and monitor extract, transform, and load (ETL) pipelines to load data into your data lakes.

Optimization 52

Optimization Forecasting Data Lake Metadata 52

CIO Business Intelligence

MARCH 10, 2022

took over as CIO at University of Alabama-Birmingham in 2015, he confronted a “computer science museum,” as he calls it — instances of every operating system, storage device, and application on the market for the past 30 years. Next up: AI and data lake decisions. When Dr. Curtis Carver, Ph.D.,

IT 98

IT Data Lake Digital Transformation Data Governance 98

CIO Business Intelligence

AUGUST 12, 2022

in 2013, Alfa Aesar in 2015, Affymetrix and FEI Co. The rapid growth left the company highly dependent on fragmented, manual processes and disparate data sources and systems. The team also built a centralized data lake on AWS, Databricks, and Power BI. in 2016, and BD Advanced Bioprocessing in 2018. Catalyzing change.

IT 105

IT Data Lake Sales Interactive 105

AWS Big Data

OCTOBER 23, 2023

Modern applications store massive amounts of data on Amazon Simple Storage Service (Amazon S3) data lakes, providing cost-effective and highly durable storage, and allowing you to run analytics and machine learning (ML) from your data lake to generate insights on your data.

Data Lake 97

Data Lake Visualization Optimization Interactive 97

BizAcuity

MAY 10, 2022

2015: Google announces Google Kubernetes Engine for the cloud. Google launches BigQuery, its own data warehousing tool and Microsoft introduces Azure SQL Data Warehouse and Azure Data Lake Store. Data management solutions will need to keep up with the data demands of the next few years.

Data-driven 52

Data-driven IoT Unstructured Data Data Lake 52

BizAcuity

SEPTEMBER 5, 2022

Inability to get player level data from the operators. It does not make sense for most casino suppliers to opt for integrated data solutions like data warehouses or data lakes which are expensive to build and maintain. BizAcuity [ISO 9001:2015, 27001:2013 certified], is a data analytics consulting company.

Visualization 98

Visualization Analytics Data Warehouse Consulting 98

Cloudera

MAY 16, 2018

This example combines three types of unrelated data: Legal entity data: Two companies with completely unrelated business lines (coffee and waste management) merged together; Unstructured data: Fraudulent promotion campaigns took place through press releases and a fake stock-picking robot. Going Forward: Improved Economics.

Data Lake 42

Data Lake Risk Visualization Unstructured Data 42

Cloudera

DECEMBER 14, 2022

In 2015, OCBC began a multi-phased initiative with Cloudera focused on giving customers access to its banking services through an easy, convenient user interface that delivered targeted and tailored products and services. OCBC also won a Cloudera Data Impact Award 2022 in the Transformation category for the project.

Data Strategy 82

Data Strategy Strategy IT Contextual Data 82

CIO Business Intelligence

OCTOBER 11, 2022

The goal, she explained, is to knock down data silos between those groups, using multiple data lakes supported by strong security and governance, to drive positive impact across the supply chain, manufacturing, and the clinical trials of new drugs. . 1] Clinical Development Success Rates, 2006-2015.

Machine Learning 145

Machine Learning Data-driven Testing Data Science 145

Cloudera

JUNE 16, 2022

In 2015, Cloudera became one of the first vendors to provide enterprise support for Apache Kafka, which marked the genesis of the Cloudera Stream Processing (CSP) offering. Without context, streaming data is useless.”

Data Lake 89

Data Lake Manufacturing Metadata Dashboards 89