AWS Big Data

FEBRUARY 16, 2024

Many customers are extending their data warehouse capabilities to their data lake with Amazon Redshift. They are looking to further enhance their security posture where they can enforce access policies on their data lakes based on Amazon Simple Storage Service (Amazon S3).

Data Lake 93

Data Lake Data Warehouse Testing Business Objectives 93

Cloudera

NOVEMBER 30, 2022

What is CDP Operational Database (COD). CDP Operational Database enables developers to quickly build future-proof applications that are architected to handle data evolution. It helps developers automate and simplify database management with capabilities like auto-scale, and is fully integrated with Cloudera Data Platform (CDP).

Snapshot 79

Snapshot Big Data Management Testing 79

AWS Big Data

AUGUST 16, 2023

Automated Data Analytics (ADA) on AWS is an AWS solution that enables you to derive meaningful insights from data in a matter of minutes through a simple and intuitive user interface. ADA offers an AWS-native data analytics platform that is ready to use out of the box by data analysts for a variety of use cases.

Data Analytics 72

Data Analytics Analytics Visualization Software 72

AWS Big Data

AUGUST 16, 2023

Apache Iceberg is an open table format for large datasets in Amazon Simple Storage Service (Amazon S3) and provides fast query performance over large tables, atomic commits, concurrent writes, and SQL-compatible table evolution. You can then provide one or multiple S3 paths where the Iceberg tables are located.

Data Lake 74

Data Lake Metadata Snapshot Management 74

AWS Big Data

MARCH 2, 2023

Many organizations are building data lakes to store and analyze large volumes of structured, semi-structured, and unstructured data. In addition, many teams are moving towards a data mesh architecture, which requires them to expose their data sets as easily consumable data products.

Data Lake 72

Data Lake Testing Interactive Unstructured Data 72

Cloudera

JANUARY 6, 2021

Python is used extensively among Data Engineers and Data Scientists to solve all sorts of problems from ETL/ELT pipelines to building machine learning models. Apache HBase is an effective data storage system for many workflows but accessing this data specifically through Python can be a struggle.

Machine Learning 131

Machine Learning Data Science Management Enterprise 131

Sisense

APRIL 17, 2020

We live in a world of data: there’s more of it than ever before, in a ceaselessly expanding array of forms and locations. Dealing with Data is your window into the ways Data Teams are tackling the challenges of this new world to help their companies and their customers thrive. What is a materialized view, anyway?

Data Warehouse 90

Data Warehouse Visualization Statistics Machine Learning 90

FineReport

DECEMBER 19, 2019

For super rookies, the first task is to understand what data analysis is. Data analysis is a type of knowledge discovery that gains insights from data and drives business decisions. From Google. One is how to gain insights from the data. Data is cold and can’t speak.

Knowledge Discovery 98

Knowledge Discovery Visualization Experimentation Reporting 98

Cloudera

NOVEMBER 10, 2021

Cloudera Data Platform (CDP) brings many improvements to customers by merging technologies from the two legacy platforms, Cloudera Enterprise Data Hub (CDH) and Hortonworks Data Platform (HDP). This blog post provides CDH users with a quick overview of Ranger as a Sentry replacement for Hadoop SQL policies in CDP.

Data Lake 74

Data Lake Management Metadata Modeling 74

Cloudera

OCTOBER 6, 2020

The Cloudera Operational Database (COD) is a managed dbPaaS solution available as an experience in Cloudera Data Platform (CDP). It offers multi-modal client access with NoSQL key-value using Apache HBase APIs and relational SQL with JDBC (via Apache Phoenix). MOB allows us to read/write values from 100k-10MB quickly. .

Data Processing 79

Data Processing Testing Management Modeling 79

AWS Big Data

JUNE 23, 2023

This blog post is co-written with Ori Nakar from Imperva. Events and many other security data types are stored in Imperva’s Threat Research Multi-Region data lake. Imperva harnesses data to improve their business outcomes. As part of their solution, they are using Amazon QuickSight to unlock insights from their data.

Data Lake 66

Data Lake Cost-Benefit Dashboards Data Warehouse 66

AWS Big Data

APRIL 26, 2023

This is a guest blog post co-written with Corey Johnson from Huron. Having an accurate and up-to-date inventory of all technical assets helps an organization ensure it can keep track of all its resources with metadata information such as their assigned oners, last updated date, used by whom, how frequently and more.

Metadata 52

Metadata Dashboards Visualization Consulting 52

Sisense

JULY 8, 2020

We live in a world of data: there’s more of it than ever before, in a ceaselessly expanding array of forms and locations. Dealing with Data is your window into the ways Data Teams are tackling the challenges of this new world to help their companies and their customers thrive.

Data Warehouse 90

Data Warehouse Data Lake Data-driven Cost-Benefit 90

AWS Big Data

OCTOBER 18, 2023

Amazon Redshift is a fast, fully managed, petabyte-scale data warehouse that provides the flexibility to use provisioned or serverless compute for your analytical workloads. Modern analytics is much wider than SQL-based data warehousing. You can isolate workloads using data sharing, while using the same underlying datasets.

Analytics 92

Analytics Data Warehouse Testing Dashboards 92

AWS Big Data

SEPTEMBER 13, 2023

The Analytics specialty practice of AWS Professional Services (AWS ProServe) helps customers across the globe with modern data architecture implementations on the AWS Cloud. In this post, we discuss a common use case in relation to operational data processing and the solution we built using Apache Hudi and AWS Glue.

Data Lake 87

Data Lake Data Processing Metadata Snapshot 87

AWS Big Data

NOVEMBER 6, 2023

Amazon EMR Studio is an integrated development environment (IDE) that makes it straightforward for data scientists and data engineers to develop, visualize, and debug data engineering and data science applications written in R, Python, Scala, and PySpark. We’re happy to introduce runtime roles for EMR Studio Workspaces.

Data Lake 90

Data Lake Sales Management Testing 90

AWS Big Data

MAY 30, 2023

Customers have been using data warehousing solutions to perform their traditional analytics tasks. Recently, data lakes have gained lot of traction to become the foundation for analytical solutions, because they come with benefits such as scalability, fault tolerance, and support for structured, semi-structured, and unstructured datasets.

Data Lake 76

Data Lake Data Analytics Analytics Data Processing 76

AWS Big Data

APRIL 26, 2024

To enable your workforce users for analytics with fine-grained data access controls and audit data access, you might have to create multiple AWS Identity and Access Management (IAM) roles with different data permissions and map the workforce users to one of those roles. We use Okta as the IdP for this demonstration.

Analytics 85

Analytics Data Lake Management Enterprise 85

AWS Big Data

NOVEMBER 8, 2023

Amazon SageMaker Studio is a fully integrated development environment (IDE) for machine learning (ML) that enables data scientists and developers to perform every step of the ML workflow, from preparing data to building, training, tuning, and deploying models.

Testing 83

Testing Modeling Management Machine Learning 83

AWS Big Data

OCTOBER 31, 2023

This blog post is co-written with James Sun from Snowflake. Customers rely on data from different sources such as mobile applications, clickstream events from websites, historical data, and more to deduce meaningful patterns to optimize their products, services, and processes.

Data Processing 86

Data Processing Management Publishing Testing 86

AWS Big Data

SEPTEMBER 7, 2023

Customers of all sizes and industries use Amazon Simple Storage Service (Amazon S3) to store data globally for a variety of use cases. Customers want to know how their data is being accessed, when it is being accessed, and who is accessing it. With exponential growth in data volume, centralized monitoring becomes challenging.

Metadata 95

Metadata Dashboards Metrics Visualization 95

CIO Business Intelligence

OCTOBER 19, 2023

Power BI is Microsoft’s interactive data visualization and analytics tool for business intelligence (BI). With Power BI, you can pull data from almost any data source and create dashboards that track the metrics you care about the most. Explore ‘What-ifs’ Like Excel, Power BI offers slicers for comparing scenarios.

Slice and Dice 126

Slice and Dice Scorecard Metrics Visualization 126

AWS Big Data

MARCH 3, 2023

Building data lakes from continuously changing transactional data of databases and keeping data lakes up to date is a complex task and can be an operational challenge. You can then apply transformations and store data in Delta format for managing inserts, updates, and deletes.

Data Lake 79

Data Lake Dashboards Metrics Metadata 79

Jet Global

FEBRUARY 8, 2021

Microsoft Power BI is a popular tool for designing visual dashboards that help everyone in your organization to better understand how the company is performing against key metrics. If you are moving from Microsoft Dynamics NAV, GP, or SL, you will need to adjust to a very different paradigm for reporting and analytics.

Reporting 98

Reporting Dashboards Cost-Benefit OLAP 98

datapine

NOVEMBER 11, 2021

a) Data Connectors Features. For a few years now, Business Intelligence (BI) has helped companies to collect, analyze, monitor, and present their data in an efficient way to extract actionable insights that will ensure sustainable growth. Your Chance: Want to take your data analysis to the next level? Table of Contents.

Business Intelligence 213

Business Intelligence Dashboards Interactive Visualization 213

AWS Big Data

JULY 27, 2023

DataBrew is a visual data preparation tool that enables you to clean and normalize data without writing any code. In DataBrew, a recipe is a set of data transformation steps that you can author interactively in its intuitive visual interface.

Visualization 78

Visualization Cost-Benefit Data Quality Interactive 78

AWS Big Data

JUNE 9, 2023

A modern data architecture enables companies to ingest virtually any type of data through automated pipelines into a data lake, which provides highly durable and cost-effective object storage at petabyte or exabyte scale. Apache Iceberg 1.2.0, and Delta Lake 2.3.0.

Data Lake 109

Data Lake Metadata Optimization Statistics 109

Jet Global

MARCH 8, 2021

It can be difficult to pull information from multiple NetSuite modules into a single, cohesive report. Spreadsheet Server from insightsoftware enables finance teams to build NetSuite reports directly inside Microsoft Excel, accessing up-to-date ERP information. But what if you could have the best of both worlds?

Reporting 98

Reporting Finance Operational Reporting Consulting 98

Alation

MAY 24, 2022

generally available on May 24, Alation introduces the Open Data Quality Initiative for the modern data stack, giving customers the freedom to choose the data quality vendor that’s best for them with the added confidence that those tools will integrate seamlessly with Alation’s Data Catalog and Data Governance application.

Data Quality 98

Data Quality Data Governance Metadata Metrics 98

Cloudera

NOVEMBER 13, 2020

Apache Impala is synonymous with high-performance processing of extremely large datasets, but what if our data isn’t huge? What if our queries are very selective? It turns out that Apache Impala scales down with data just as well as it scales up. In this case, reducing runtime from 930ms to 133ms for nearly a 7x improvement.

Optimization 142

Optimization Metadata Statistics Cost-Benefit 142

Jet Global

OCTOBER 22, 2020

The size and scope of business databases have grown as ERP functionality has evolved, businesses have increased their adoption of CRM and marketing automation, and collaboration networks have become more common. Let’s begin with an overview of how data analytics works for most business applications.

Modeling 52

Modeling OLAP Reporting Sales 52

FineReport

JULY 18, 2022

In an era full of data, data analysis allows us to discover the most useful information and make more scientific decisions for business operations. Data analysis tools are widely used by data analysts as well as non-professional business people to achieve better performance and higher efficiency. From FineReport.

Forecasting 52

Forecasting Dashboards Visualization Statistics 52

FineReport

MARCH 26, 2020

Graph makers are important techniques to visualize the data. FineReport is a data visualization tool for making graphs, reports, and dashboards. FineReport supports various types of data sources, including Excel. You can import your data from Excel to FineReport in batches. From Google. From Google.

Visualization 98

Visualization Dashboards Reporting Interactive 98

AWS Big Data

JANUARY 18, 2024

AWS Lake Formation and the AWS Glue Data Catalog form an integral part of a data governance solution for data lakes built on Amazon Simple Storage Service (Amazon S3) with multiple AWS analytics services integrating with them. The session also highlights Duke Energy’s journey with Lake Formation and the AWS Glue Data Catalog.

Data Lake 86

Data Lake Metadata Data Governance Statistics 86

AWS Big Data

APRIL 5, 2023

Amazon Redshift is a massively parallel processing (MPP), fully managed petabyte-scale data warehouse that makes it simple and cost-effective to analyze all your data using existing business intelligence tools. Solution overview The following diagram describes the solution architecture.

Data Warehouse 73

Data Warehouse Management Business Intelligence Testing 73

AWS Big Data

FEBRUARY 27, 2024

This post is co-written with Toney Thomas and Ben Vengerovsky from Bluestone. In the ever-evolving world of finance and lending, the need for real-time, reliable, and centralized data has become paramount. This platform became the hub for all data-related activities across the organization.

Data-driven 91

Data-driven Data Lake Data Quality Data Governance 91

Jet Global

APRIL 25, 2024

With multitudes of regulations surrounding everything from reporting to data security, organizations can quickly become overwhelmed. This ensures the independence of external auditors from the companies they audit. Whistleblowers are safeguarded from retaliation by their employers. insightsoftware is here to help.

Reporting 52

Reporting Risk Management Risk Software 52