Ontotext

APRIL 10, 2024

The data ecosystem today is crowded with dazzling buzzwords, all fighting for investment dollars. A survey in 2021 found that a data company was being funded every 45 minutes. Data ecosystems have become jungles and in spite of all the technology, data teams are struggling to create a modern data experience.

Metadata 52

Metadata Data Lake Data Warehouse Data Quality 52

CIO Business Intelligence

APRIL 26, 2024

billion acquisition of data and analytics company Neustar in 2021, TransUnion has expanded into other services such as marketing, fraud detection and prevention, and robust analytical services. We’re modernizing existing products to get to this entire data analytics value chain.” But following its $3.1

Modeling 114

Modeling IT Machine Learning Data Governance 114

Cloudera

JANUARY 19, 2022

Gartner® recognized Cloudera in three recent reports – Magic Quadrant for Cloud Database Management Systems (DBMS), Critical Capabilities for Cloud Database Management Systems for Analytical Use Cases and Critical Capabilities for Cloud Database Management Systems for Operational Use Cases. 2021 Gartner Magic Quadrant for Cloud DBMS .

Reporting 91

Reporting Data Warehouse Data Lake Machine Learning 91

Cloudera

JANUARY 18, 2022

Each year, the Cloudera Data Impact Awards recognize organizations that have accomplished amazing things with innovative data solutions. . For 2021, the awards will include a new category: People First. As a result of this innovative data solution, the company helped customers while keeping its default rate low. .

Data Lake 97

Data Lake Digital Transformation Data-driven Dashboards 97

Cloudera

DECEMBER 14, 2021

But with growing demands, there’s a more nuanced need for enterprise-scale machine learning solutions and better data management systems. The 2021 Data Impact Awards aim to honor organizations who have shown exemplary work in this area. . In 2021, the finalists under this category include the following organizations.

Data Lake 112

Data Lake Machine Learning Big Data Data-driven 112

CIO Business Intelligence

JULY 24, 2022

Simon Herbert announced his departure from the New South Wales Department of Customer Service where he was the chief data officer since February 2021, having previously held the role of executive director of data and insights with the department for approximately three years. IT Leadership

IT 98

IT Data Lake Digital Transformation Data Warehouse 98

AWS Big Data

AUGUST 31, 2023

Tens of thousands of customers today use Amazon Redshift to analyze exabytes of data and run analytical queries, making it the most widely used cloud data warehouse. With Amazon Redshift, you can query the data in your S3 data lake using a central AWS Glue metastore from your Redshift data warehouse.

Data Lake 93

Data Lake Data Warehouse Metadata Data Architecture 93

AWS Big Data

JUNE 8, 2023

This data is often stored and analyzed using various tools, such as Amazon OpenSearch Service , a powerful search and analytics service offered by AWS. OpenSearch Service provides real-time insights into your data to support use cases like interactive log analytics, real-time application monitoring, website search, and more.

Data Lake 80

Data Lake Dashboards Metrics Testing 80

Cloudera

DECEMBER 11, 2020

This is what really stood out about the finalists of the Data Security and Governance category. These customers have embedded security and governance throughout their entire data and analytics lifecycle by design. Merck KGaA’s advanced analytics team had the solution. Driving innovation with secure and governed data .

Data Lake 98

Data Lake Cost-Benefit Unstructured Data Data Governance 98

CIO Business Intelligence

FEBRUARY 16, 2023

Selling the value of data transformation Iyengar and his team are 18 months into a three- to five-year journey that started by building out the data layer — corralling data sources such as ERP, CRM, and legacy databases into data warehouses for structured data and data lakes for unstructured data.

Unstructured Data 106

Unstructured Data Data Lake Prescriptive Analytics Digital Transformation 106

AWS Big Data

SEPTEMBER 13, 2023

The Analytics specialty practice of AWS Professional Services (AWS ProServe) helps customers across the globe with modern data architecture implementations on the AWS Cloud. Of those tables, some are larger (such as in terms of record volume) than others, and some are updated more frequently than others.

Data Lake 91

Data Lake Data Processing Metadata Snapshot 91

Cloudera

JUNE 7, 2023

To provide guidance to federal agencies, and in many ways lead the way for the private sector, the Cybersecurity and Infrastructure Security Agency (CISA) issued the initial Zero Trust Maturity Model (ZTMM) in 2021 with the intent to give agencies a conceptual roadmap to onboard to a shared zero-trust maturity model by 2024.

Metadata 84

Metadata Data Lake Optimization Modeling 84

Cloudera

AUGUST 18, 2021

Data processed at the edge or in the cloud, for instance, is not effective if it follows the traditional lifecycle of “ingest, process, land, and analyze.” If the data goes into a data lake before analysis, extracting it can get pretty complex and time-consuming.

Data Lake 89

Data Lake IoT Internet of Things Data-driven 89

CIO Business Intelligence

OCTOBER 1, 2022

P&G) has grown to become one of the world’s largest consumer goods manufacturers, with worldwide revenue of more than $76 billion in 2021 and more than 100,000 employees. It requires taking data from equipment sensors, applying advanced analytics to derive descriptive and predictive insights, and automating corrective actions. “We

Manufacturing 145

Manufacturing Digital Transformation IoT Internet of Things 145

CIO Business Intelligence

MAY 10, 2023

Yet if we come across an ERP that’s not necessarily mainstream, they’ll have challenges getting into the back end, and integrating and understanding the relational data to connect it to our central data lake. That’s going to be an ongoing technical risk that we’ll have and we need to overcome that.

Data-driven 119

Data-driven IT Digital Transformation Data Governance 119

AWS Big Data

APRIL 25, 2024

In the era of data, organizations are increasingly using data lakes to store and analyze vast amounts of structured and unstructured data. Data lakes provide a centralized repository for data from various sources, enabling organizations to unlock valuable insights and drive data-driven decision-making.

Optimization 65

Optimization Data Lake Cost-Benefit Reporting 65

DataKitchen

DECEMBER 7, 2021

Back by popular demand, we’ve updated our data nerd Gift Giving Guide to cap off 2021. We’ve kept some classics and added some new titles that are sure to put a smile on your data nerd’s face. Fail Fast, Learn Faster: Lessons in Data-Driven Leadership in an Age of Disruption, Big Data, and AI, by Randy Bean.

Data-driven 246

Data-driven Data Governance Big Data Data Science 246

Cloudera

JANUARY 24, 2022

In order to be considered for the Data for Good category, submissions must have addressed some of the most challenging issues affecting society and the planet, making what was impossible yesterday, possible today, and transforming the future. Winner of the Data Impact Awards 2021: Data for Good.

Data Lake 65

Data Lake Risk Machine Learning Data Collection 65

AWS Big Data

NOVEMBER 17, 2023

Amazon Athena is a serverless, interactive analytics service built on open source frameworks, supporting open table file formats. Athena provides a simplified, flexible way to analyze petabytes of data where it lives. He joined AWS in 2021 and has been working on multiple performance improvements on Athena. Pathik Shah is a Sr.

Optimization 112

Optimization Statistics Metadata Data Lake 112

Cloudera

DECEMBER 1, 2022

Full-stack observability is a critical requirement for effective modern data platforms to deliver the agile, flexible, and cost-effective environment organizations are looking for. For example, historically the process of acquiring data from the source systems to populate the data lake was plagued by schema drift.

Metrics 85

Metrics Data Quality Data Lake Statistics 85

IBM Big Data Hub

APRIL 25, 2023

In a prior blog , we pointed out that warehouses, known for high-performance data processing for business intelligence, can quickly become expensive for new data and evolving workloads. To do so, Presto and Spark need to readily work with existing and modern data warehouse infrastructures.

Optimization 56

Optimization Strategy Data Warehouse Cost-Benefit 56

AWS Big Data

NOVEMBER 9, 2023

It allows users to write data transformation code, run it, and test the output, all within the framework it provides. Use case The Enterprise Data Analytics group of a large jewelry retailer embarked on their cloud journey with AWS in 2021. Prantik specializes in architecting modern data and analytics platforms in AWS.

Data Warehouse 105

Data Warehouse Testing Data Quality Reporting 105

AWS Big Data

AUGUST 22, 2023

This post proposes an automated solution by using AWS Glue for automating the PostgreSQL data archiving and restoration process, thereby streamlining the entire procedure. It can also automatically scale resources to meet the requirements of your data processing job, providing a high level of abstraction and convenience.

Data Processing 88

Data Processing Testing Data Lake Data Integration 88

Alation

NOVEMBER 2, 2022

It also helped that other analytics companies in Thoma Bravo’s portfolio echoed that positive feedback. We had not seen that in the broader intelligence & data governance market.”. Indeed, Alation’s accelerating growth mirrors the faster pace of data and analytics today. Expanding the Data Intelligence Platform.

Data Governance 98

Data Governance Marketing Finance Data Lake 98

IBM Big Data Hub

FEBRUARY 2, 2023

In today’s world, data warehouses are a critical component of any organization’s technology ecosystem. They provide the backbone for a range of use cases such as business intelligence (BI) reporting, dashboarding, and machine-learning (ML)-based predictive analytics, that enable faster decision making and insights.

Data Warehouse 56

Data Warehouse Cost-Benefit Unstructured Data Data Architecture 56

erwin

JUNE 7, 2022

Designing databases for data warehouses or data marts is intrinsically much different than designing for traditional OLTP systems. In fact, many commonly accepted best practices for designing OLTP databases could well be considered worst practices for these purely analytical systems. Analytical. Business Focus.

Data Warehouse 52

Data Warehouse Modeling Sales Data Lake 52

AWS Big Data

MAY 24, 2023

When you build your transactional data lake using Apache Iceberg to solve your functional use cases, you need to focus on operational use cases for your S3 data lake to optimize the production environment. parquet 2021-11-01 06:00:10 6.1 parquet 2021-11-01 04:33:24 6.1 availability.

Data Lake 85

Data Lake Snapshot Metadata Optimization 85

AWS Big Data

NOVEMBER 29, 2023

This cloud service was a significant leap from the traditional data warehousing solutions, which were expensive, not elastic, and required significant expertise to tune and operate. Amazon Redshift Serverless, generally available since 2021, allows you to run and scale analytics without having to provision and manage the data warehouse.

Data Warehouse 101

Data Warehouse Data Lake Analytics Machine Learning 101

Cloudera

NOVEMBER 18, 2021

Given the way we have seen communities and workplace cultures come together and stand for change over what has been a disruptive 20 months, we are proud to introduce the People First category to the 2021 DIA. So, without further ado, it is with great delight that we officially publish the 2021 Data Impact Award winners!

Data Lake 78

Data Lake Cost-Benefit Digital Transformation Risk 78

DataKitchen

NOVEMBER 29, 2021

As a result, enterprises will examine their end-to-end data operations and analytics creation workflows. Instead of allowing technology to be a barrier to teamwork, leading data organizations in 2022 will further expand the automation of workflows to improve and facilitate communication and coordination between the groups.

Testing 245

Testing Data Lake Data Architecture Manufacturing 245

AWS Big Data

FEBRUARY 1, 2023

With data volumes exhibiting a double-digit percentage growth rate year on year and the COVID pandemic disrupting global logistics in 2021, it became more critical to scale and generate near-real-time data. You can use it for analytics, ML, and application development. Then we chose Amazon Athena as our query service.

Optimization 52

Optimization Forecasting Data Lake Metadata 52

AWS Big Data

FEBRUARY 22, 2023

In this post, we show how Ruparupa implemented an incrementally updated data lake to get insights into their business using Amazon Simple Storage Service (Amazon S3), AWS Glue , Apache Hudi , and Amazon QuickSight. An AWS Glue ETL job, using the Apache Hudi connector, updates the S3 data lake hourly with incremental data.

Data Lake 52

Data Lake Dashboards Cost-Benefit Metadata 52

IBM Big Data Hub

JULY 7, 2023

In 2021, a Dallas IT employee was fired for accidentally deleting 15 terabytes of Dallas police and other city files. Best practices for proactive data security Best cybersecurity practices mean ensuring your information security in many and varied ways and from many angles.

Risk 40

Risk Data Governance Data Lake Data-driven 40

Ontotext

MARCH 8, 2023

Gartner predicts that graph technologies will be used in 80% of data and analytics innovations by 2025, up from 10% in 2021. Graphs boost knowledge discovery and efficient data-driven analytics to understand a company’s relationship with customers and personalize marketing, products, and services.

Enterprise 52

Enterprise Knowledge Discovery Risk Data-driven 52

AWS Big Data

DECEMBER 15, 2023

Even after identification, it’s cumbersome to implement redaction, masking, or encryption of sensitive data at scale. In this post, we provide an automated solution to detect PII data in Amazon Redshift using AWS Glue. For our solution, we use Amazon Redshift to store the data.

Data Lake 103

Data Lake Data Warehouse Big Data Structured Data 103

CIO Business Intelligence

NOVEMBER 4, 2022

To achieve what the company would need going forward, McCowan knew Regeneron would have to undergo a major transformation and build a more enhanced data pipeline that could inject data from up to 1,000 data sources in “analytical ready formats” for both the business and the scientists to consume, the CIO says.

Data Lake 124

Data Lake IT Experimentation Data-driven 124

Cloudera

NOVEMBER 17, 2022

In 2021, HBLs customers digitally carried out over 330 Mn financial transactions valued at PKR 7 Tn) in payments, a growth of 30% over 2020. We needed a solution to manage our data at scale, to provide greater experiences to our customers. and primarily served regulatory reporting and internal analytics requirements.

Management 86

Management Data Lake Consulting Unstructured Data 86