O'Reilly on Data

FEBRUARY 19, 2021

With more businesses migrating their data infrastructure to the cloud, as well as the increase of open source projects driving innovation in cloud data lakes, these will remain on the radar in 2021. Cloud data warehouse engineering develops as a particular focus as database solutions move more and more to the cloud.

Data Lake 290

Data Lake Data Warehouse Machine Learning Modeling 290

Octopai

JANUARY 8, 2020

From California’s new data privacy law going into full effect to potential new U.S. federal data privacy laws on top of an alphabet soup of global laws and regulations, the name of the game for 2020 is going to be “compliance.”. The California Consumer Privacy Act (CCPA) came into effect on January 1, 2020.

Metadata 54

Metadata Key Performance Indicator OLAP Forecasting 54

Octopai

JULY 19, 2020

Here is a brief overview of the state of the business data dictionary in 2020 and some best practices to which all data teams should adhere. Importance of a Data Dictionary Tool in BI. A data dictionary contains information regarding the data that exists in your company’s data warehouse (DWH).

Metadata 56

Metadata Data Warehouse Reporting Enterprise 56

Octopai

JULY 19, 2020

Here is a brief overview of the state of the business data dictionary in 2020 and some best practices to which all data teams should adhere. Importance of a Data Dictionary Tool in BI. A data dictionary contains information regarding the data that exists in your company’s data warehouse (DWH).

Metadata 52

Metadata Data Warehouse Reporting Enterprise 52

FineReport

JUNE 3, 2020

Data yang mendasar bertanggung jawab untuk memanajemen data, termasuk pengumpulan data, ETL, membangun gudang data, dll. Analisis data adalah tentang pengekstraksian data dari data warehouse dan menganalisisnya dengan metode analisis seperti kueri, OLAP, data mining, dan visualisasi data untuk menyimpulkan data.

OLAP 59

OLAP Business Intelligence Reporting Dashboards 59

AWS Big Data

MAY 17, 2023

In 2020, as gyms shuttered and people looked for ways to stay active from the safety of their homes, the company’s annual revenue soared from $915 million in 2019 to $4 billion in 2021. One group performed extract, transform, and load (ETL) operations to take raw data and make it available for analysis.

Data Warehouse 112

Data Warehouse Cost-Benefit Sales Data-driven 112

Smart Data Collective

JANUARY 22, 2020

However, according to Forbes research, unsecured Facebook databases leakages affected more than 419 million users.The principles of virtual technology pose potential threats to the information security of cloud computing associated with the use of shared data warehouses. In these times, data security is more important than ever.

Data Processing 57

Data Processing Measurement Risk Data Warehouse 57

Octopai

MAY 5, 2020

Octopai and Dataversity collaborated to conduct The 2020 Business Glossary Automation Survey. They found that manual data management is a process that can bleed hours from a BI team, and the time often turns into days, weeks and even months.

Metadata 52

Metadata Reporting Data Warehouse Management 52

AWS Big Data

AUGUST 31, 2023

Amazon Redshift is a fast, fully managed petabyte-scale cloud data warehouse that makes it simple and cost-effective to analyze all your data using standard SQL and your existing business intelligence (BI) tools. Amazon Redshift also supports querying nested data with complex data types such as struct, array, and map.

Data Lake 93

Data Lake Data Warehouse Metadata Data Architecture 93

Smart Data Collective

APRIL 8, 2020

sThe recent years have seen a tremendous surge in data generation levels , characterized by the dramatic digital transformation occurring in myriad enterprises across the industrial landscape. The amount of data being generated globally is increasing at rapid rates. The post How Will The Cloud Impact Data Warehousing Technologies?

Technology 134

Technology Data Warehouse Big Data Machine Learning 134

Sisense

JANUARY 1, 2020

We’ve collected the biggest posts of 2019 to give you a look at where the industry has been and where it’s going to give you the can’t-miss perspectives and how-to’s you need to start 2020 off strong. Speaking of building cutting-edge products, in 2020 embedding analytics is just the start. Build Analytics, Build the Future.

Analytics 98

Analytics Digital Transformation Data Warehouse Dashboards 98

Sisense

JULY 8, 2020

Dealing with Data is your window into the ways Data Teams are tackling the challenges of this new world to help their companies and their customers thrive. In recent years we’ve seen data become vastly more available to businesses. This has allowed companies to become more and more data driven in all areas of their business.

Data Warehouse 90

Data Warehouse Data Lake Data-driven Cost-Benefit 90

Andrew White

MARCH 22, 2021

Henry Cook scores his first “number 1” hit this year with this iteration of The Practical Logical Data Warehouse that was published in December 2020. Click here for an interactive PDF to connect to the notes directly.

Data Warehouse 52

Data Warehouse Analytics Data Analytics Interactive 52

Data Science 101

FEBRUARY 22, 2020

Amazon Redshift now supports Authentication with Microsoft Azure AD Redshift, a data warehouse, from Amazon now integrates with Azure Active Directory for login. This weeks news includes information about AWS working with Azure, time-series, detecting text in videos and more. This continues a trend of cloud companies working together.

Data Science 103

Data Science Forecasting Data Warehouse Metrics 103

CIO Business Intelligence

SEPTEMBER 12, 2022

‘Data engine on wheels’. To mine more data out of a dated infrastructure, Fazal first had to modernize NJ Transit’s stack from the ground up to be geared for business benefit. Data from that surfeit of applications was distributed in multiple repositories, mostly traditional databases.

Data Warehouse 113

Data Warehouse Predictive Analytics Data Lake IoT 113

CIO Business Intelligence

MAY 23, 2024

In the future, there are opportunities to make information even more easily accessible by allowing users to search for information directly from a data warehouse instead of going through traditional BI tools.

Digital Transformation 99

Digital Transformation Measurement Cost-Benefit Data Warehouse 99

CIO Business Intelligence

JULY 24, 2022

Rouch joins from IT services and consulting firm Class where she’d been CTO since March 2020. Alexis Rouch will join software vendor Nuix as CIO in August replacing Paul Keen who is leaving the company. Rouch brings more than 20 years of experience in both private and public sectors. IT Leadership

IT 90

IT Data Lake Digital Transformation Data Warehouse 90

Paul Blogs on BI

SEPTEMBER 8, 2021

Well firstly, if the main data warehouses, repositories, or application databases that BusinessObjects accesses are on premise, it makes no sense to move BusinessObjects to the cloud until you move its data sources to the cloud. Many software vendors, including SAP, offer cloud hosting for BusinessObjects and its data sources.

Data Warehouse 59

Data Warehouse Data Processing Data Lake Testing 59

FineReport

AUGUST 14, 2020

Top 10 Free and Open Source Reporting Tools in 2020. For popular reporting tools on the market, you can refer to: Best Reporting Tools List in 2020 and How to Choose. Based on the process from data to knowledge, a standard reporting system’s functional architecture is shown below. However, there is no service guarantee.

Reporting 98

Reporting Informatics OLAP Data Warehouse 98

Cloudera

JANUARY 20, 2021

Consider that Manufacturing’s Industry Internet of Things (IIOT) was valued at $161b with an impressive 25% growth rate, the Connected Car market will be valued at $225b by 2027 with a 17% growth rate, or that in the first three months of 2020, retailers realized ten years of digital sales penetration in just three months.

Digital Transformation 112

Digital Transformation Manufacturing Data Warehouse Predictive Analytics 112

CIO Business Intelligence

AUGUST 8, 2022

The UK-based accounting and tax consulting firm was one of few accountants in the UK that weathered the 2020 tax season without a hitch, thanks to its early bet on SaaS, Microsoft Azure, and software-defined networking. Two months ago, the firm completed its data warehouse migration to Azure, along with a portion on Amazon Web Services.

Cost-Benefit 91

Cost-Benefit Digital Transformation Testing Data Warehouse 91

Jet Global

SEPTEMBER 4, 2020

For more sophisticated multidimensional reporting functions, however, a more advanced approach to staging data is required. The Data Warehouse Approach. Data warehouses gained momentum back in the early 1990s as companies dealing with growing volumes of data were seeking ways to make analytics faster and more accessible.

Data Lake 88

Data Lake OLAP Data Warehouse Unstructured Data 88

Sisense

AUGUST 4, 2021

Sisense Explanations deepens your understanding of your data. Explanations originally debuted in Q4 of 2020 to provide customers with the ability to identify factors in their data that contribute significantly to changes in data over a period of time. Optimize your cloud data warehouse cost forecasting.

Dashboards 52

Dashboards Analytics Data Warehouse Forecasting 52

Alation

DECEMBER 15, 2022

March, 2020: Gartner names Alation a 2020 Gartner Peer Insights Customers’ Choice for Metadata Management Solutions. June 2020: Dresner Advisory Services names Alation the #1 data catalog in its Data Catalog End-User Market Study for the 4th time. May 2021: Inc Magazine names Alation a Best Workplace of 2021.

Metadata 52

Metadata Data Governance Data Quality Marketing 52

CIO Business Intelligence

APRIL 26, 2022

At least that has been the experience of Backcountry CTO Sridhar Nallani, who was hired in 2020 specifically to overhaul the online retailer’s digital presence. They wanted an assessment of the current state of technology at that time, in early 2020,” says Nallani, who began his evaluation in March 2020 and was later appointed CTO in August.

Data Lake 97

Data Lake Dashboards Recreation/Entertainment Sales 97

datapine

SEPTEMBER 27, 2022

The all-encompassing nature of this book makes it a must for a data bookshelf. 18) “The Data Warehouse Toolkit” By Ralph Kimball and Margy Ross. It is a must-read for understanding data warehouse design. Alan Beaulieu’s “Learning SQL” is another of our top database books for beginners. Viescas, Douglas J.

Business Intelligence 292

Business Intelligence Data Warehouse Data Processing Data mining 292

CIO Business Intelligence

FEBRUARY 24, 2023

By April 2020, with travel bans proliferating, the airline suffered losses of €1 million per hour. Getting there has been easier said than done for Lufthansa, which was among the first airlines to build a data warehouse for its customer data, but much of that technology is now decades old. “We

IT 140

IT Digital Transformation Data Warehouse Consulting 140

Cloudera

AUGUST 20, 2020

A Spark job was created for each data set to pull and filter data from the S3 bucket. These two Spark jobs transformed and loaded the clean data into a Hive data warehouse for retrieval. A third Spark job was created to process the data from the Hive data warehouse to create the two reports.

Data Warehouse 65

Data Warehouse Reporting Data Processing Management 65

CIO Business Intelligence

MARCH 22, 2022

Data about customers, supply chains, the economy, market trends, and competitors must be aggregated and cross-correlated from myriad sources. . But the sheer volume of the world’s data is expected to nearly triple between 2020 and 2025 to a whopping 180 zettabytes. This is where artificial intelligence (AI) comes in.

Analytics 97

Analytics Key Performance Indicator Data Warehouse Data-driven 97

CIO Business Intelligence

JUNE 21, 2023

We were one of the most impacted industries in the pandemic economy,” says Peck, who joined Sysco as EVP and chief information and digital officer in December 2020. The base engine for the e-commerce and data warehouse is all custom code. The pandemic forced us to review our company and the entire industry.”

IT 69

IT B2B Digital Transformation Sales 69

Cloudera

JANUARY 26, 2022

Network operating systems let computers communicate with each other; and data storage grew—a 5MB hard drive was considered limitless in 1983 (when compared to a magnetic drum with memory capacity of 10 kB from the 1960s). The amount of data being collected grew, and the first data warehouses were developed.

Data Processing 89

Data Processing IoT Cost-Benefit Digital Transformation 89

erwin

FEBRUARY 19, 2021

It harvests metadata from various data sources and maps any data element from source to target and harmonize data integration across platforms. With this accurate picture of your metadata landscape, you can accelerate Big Data deployments, Data Vaults, data warehouse modernization, cloud migration, etc.

Metadata 110

Metadata Management Data Quality Cost-Benefit 110

erwin

FEBRUARY 13, 2020

Data Governance Attitudes Are Shifting. The 2020 State of Data Governance and Automation (DGA) shows that attitudes about data governance and the drivers behind it are changing – arguably for the better. Regulatory compliance was the biggest driver for data governance implementation, according to the 2018 report.

Metadata 135

Metadata Data Governance Management Cost-Benefit 135

erwin

SEPTEMBER 3, 2020

To better understand and align data governance and enterprise architecture, let’s look at data at rest and data in motion and why they both have to be documented. Documenting data at rest involves looking at where data is stored, such as in databases, data lakes , data warehouses and flat files.

Data Governance 144

Data Governance Enterprise Risk Data Lake 144

CIO Business Intelligence

SEPTEMBER 6, 2022

When Steve Pimblett joined The Very Group in October 2020 as chief data officer, reporting to the conglomerate’s CIO, his task was to help the enterprise uncover value in its rich data heritage. The whole company rebranded as Very in 2020, the year Pimblett joined. Establishing a clear and unified approach to data.

IT 82

IT Forecasting Data Lake Enterprise 82

Jet Global

JANUARY 2, 2020

Data Warehouses Don’t Solve the Problem. To get the best out of their BI tools, businesses often call in the IT team to set up a data warehouse to transform their data into a structure more suited to reporting. This post originally appeared in Treasury Management International on January 2, 2020.

Finance 52

Finance Management Data Warehouse Reporting 52

Jedox

OCTOBER 22, 2020

This is because the data needed to answer the question was a) physically unavailable, b) too costly to acquire c) outdated by the time it was acquired, or d) some or all of the above. In 2020, I would argue that data is basically free, unlimited, and immediate.

Data Analytics 69

Data Analytics Analytics Unstructured Data Data mining 69