AWS Big Data

DECEMBER 21, 2023

Movement of data across data lakes, data warehouses, and purpose-built stores is achieved by extract, transform, and load (ETL) processes using data integration services such as AWS Glue. AWS Glue provides both visual and code-based interfaces to make data integration effortless.

Analytics 98

Analytics IT Data Lake Visualization 98

Peter James Thomas

MAY 10, 2019

But the 5 questions I highlight are as follows: Why does my organisation need to embark on a Data Transformation – what will it achieve for us? Do I have the expertise and experience on hand to scope a Data Transformation and then deliver it? How long will a Data Transformation take and how much will it cost?

Data Transformation 50

Data Transformation Consulting Publishing Management 50

CIO Business Intelligence

JANUARY 12, 2023

Data is critical to success for universities. Data provides insights that support the overall strategy of the university. Data also lies at the heart of creating a secure, Trusted Research Environment to accelerate and improve research. Yet most universities struggle to collect, analyse, and activate their data resources.

Data Strategy 93

Data Strategy Strategy IT Consulting 93

Bruno Aziza

AUGUST 18, 2019

Although CIO’s and CDO’s aspire to be on the offensive in using data to drive revenue generation and business growth, it is defensive initiatives that are providing cover for forward-looking transformation ambitions.

Data Transformation 77

Data Transformation IT 77

IBM Big Data Hub

OCTOBER 24, 2017

If you’re holding an event for the very first time, what helps you gauge its success? At IBM Analytics University, we turned to social media analytics. Here’s a summary of what we learned from the experts and from Watson Analytics for Social Media.

Data Transformation 75

Data Transformation Analytics IT 75

Cloudera

APRIL 12, 2021

The United States Veterans Administration (VA) over the last decade underwent a massive enterprise-wide IT transformation, eliminating its fragmented shadow IT and adopting a centralized system capable of supporting the agency’s 400,000 employees and more effectively utilizing its $240 billion-plus annual budget.

Enterprise 52

Enterprise IT Digital Transformation Data Warehouse 52

AWS Big Data

DECEMBER 13, 2023

In addition to using native managed AWS services that BMS didn’t need to worry about upgrading, BMS was looking to offer an ETL service to non-technical business users that could visually compose data transformation workflows and seamlessly run them on the AWS Glue Apache Spark-based serverless data integration engine.

Metadata 90

Metadata Data Lake Visualization Data Transformation 90

CIO Business Intelligence

NOVEMBER 17, 2022

Data has become a top priority for businesses large and small, and while some companies have already established a digital strategy, many of them are just getting started. However, the ability to drive digital technology transformation is going to be the focus,” says Stephen Van Vreede, resume expert at IT Tech Exec.

Data Governance 123

Data Governance Data Transformation Strategy Reporting 123

CIO Business Intelligence

MARCH 4, 2024

In this way, data may just be the ultimate disruptor – a fact that the insurance industry knows all too well. As data volumes continue to increase alongside a correlating number of business requests, modern insurance data leaders face a nuanced set of challenges. Enter data mesh.

Insurance 95

Insurance Strategy Data Governance Data Integration 95

datapine

SEPTEMBER 29, 2022

What Is Data Quality Management (DQM)? Data quality management is a set of practices that aim at maintaining a high quality of information. It goes all the way from the acquisition of data and the implementation of advanced data processes, to an effective distribution of data.

Data Quality 241

Data Quality Metrics Data-driven Management 241

Analytics Vidhya

MAY 13, 2024

Their ability to capture long-range dependencies and handle sequential data effectively has made them a staple in every AI researcher and practitioner’s toolbox.

Machine Learning 260

Machine Learning Analytics IT Forecasting 260

CIO Business Intelligence

FEBRUARY 16, 2023

The company’s orthodontics business, for instance, makes heavy use of image processing to the point that unstructured data is growing at a pace of roughly 20% to 25% per month. For example, imaging data can be used to show patients how an aligner will change their appearance over time. “It

Unstructured Data 105

Unstructured Data Data Lake Prescriptive Analytics Digital Transformation 105

Dataiku

SEPTEMBER 23, 2021

We speak a lot about the ways we can use data, transform it, and create powerful models based on advanced machine learning techniques, but we sometimes forget where the data comes from initially.

Machine Learning 103

Machine Learning Data Transformation Modeling IT 103

MLWhiz

AUGUST 26, 2020

Pandas is one of the best data manipulation libraries in recent times. It lets you slice and dice, groupby, join and do any arbitrary data transformation. You can take a look at this post, which talks about handling most of the data manipulation cases using a straightforward, simple, and matter of fact way using Pandas.

Slice and Dice 131

Slice and Dice Data Transformation IT 131

DataKitchen

NOVEMBER 10, 2023

Solutions to Reign in the Chaos Implementing Data Observability Platforms: Tools like DataKitchen’s DataOps Observability provide an overarching view of the entire Data Journey. They enable continuous monitoring of data transformations and integrations, offering invaluable insights into data lineage and changes.

Data Quality 136

Data Quality Testing Data Lake Data Integration 136

AWS Big Data

NOVEMBER 9, 2023

Building a data platform involves various approaches, each with its unique blend of complexities and solutions. In this post, we delve into a case study for a retail use case, exploring how the Data Build Tool (dbt) was used effectively within an AWS environment to build a high-performing, efficient, and modern data platform.

Data Warehouse 106

Data Warehouse Testing Data Quality Reporting 106

Smart Data Collective

OCTOBER 20, 2021

In this new reality, leveraging processes like ETL (Extract, Transform, Load) or API (Application Programming Interface) alone to handle the data deluge is not enough. As per the TDWI survey, more than a third (nearly 37%) of people has shown dissatisfaction with their ability to access and integrate complex data streams.

Data Integration 122

Data Integration Machine Learning Big Data Data Transformation 122

DataKitchen

DECEMBER 20, 2020

Data-driven companies sense change through data analytics. Companies turn to their data organization to provide the analytics that stimulates creative problem-solving. Companies turn to their data organization to provide the analytics that stimulates creative problem-solving. – Leon C. Adapt or face decline.

Data-driven 147

Data-driven Manufacturing Data Architecture Data Analytics 147

Octopai

MARCH 31, 2021

Ever reflect on what it would be like to be a piece of data that enters your BI system? It ain’t easy being data. Then again, it ain’t easy to be a BI developer trying to track data through a stream of twists, turns, transformations, and multiple BI systems. Data Lineage by Tagging or Self-Contained Data Lineage.

Metadata 130

Metadata Data Transformation Business Intelligence Reporting 130

AWS Big Data

APRIL 26, 2023

In 2019, the BMW Group decided to re-architect and move its on-premises data lake to the AWS Cloud to enable data-driven innovation while scaling with the dynamic needs of the organization. For historic reasons, the required data for this aggregation step is siloed and represented differently in diverse systems.

Forecasting 124

Forecasting Manufacturing Data Lake Big Data 124

CIO Business Intelligence

JANUARY 24, 2024

Unfortunately, the road to data strategy success is fraught with challenges, so CIOs and other technology leaders need to plan and execute carefully. Here are some data strategy mistakes IT leaders would be wise to avoid. Overlooking these data resources is a big mistake. It will not be something they can ignore.

Data Strategy 136

Data Strategy Strategy Unstructured Data Data Governance 136

Cloudera

OCTOBER 19, 2021

Airflow has been adopted by many Cloudera Data Platform (CDP) customers in the public cloud as the next generation orchestration service to setup and operationalize complex data pipelines. Making the most commonly used as readily available as possible is critical to reduce development friction. .

Data Transformation 114

Data Transformation Interactive Machine Learning Testing 114

datapine

MAY 2, 2023

Table of Contents 1) Benefits Of Big Data In Logistics 2) 10 Big Data In Logistics Use Cases Big data is revolutionizing many fields of business, and logistics analytics is no exception. The complex and ever-evolving nature of logistics makes it an essential use case for big data applications. Did you know?

Big Data 275

Big Data Cost-Benefit Internet of Things Optimization 275

O'Reilly on Data

OCTOBER 19, 2021

Why: Data Makes It Different. In contrast, a defining feature of ML-powered applications is that they are directly exposed to a large amount of messy, real-world data which is too complex to be understood and modeled by hand. However, the concept is quite abstract. Can’t we just fold it into existing DevOps best practices?

IT 346

IT Testing Experimentation Software 346

Smart Data Collective

APRIL 29, 2020

What is data management? Data management can be defined in many ways. The techniques for managing organisational data in a standardised approach that minimises inefficiency. Extraction, Transform, Load (ETL). Data transformation. Data analytics and visualisation.

Management 83

Management Data Warehouse Digital Transformation Dashboards 83

CIO Business Intelligence

OCTOBER 18, 2022

The old stadium, which opened in 1992, provided the business operations team with data, but that data came from disparate sources, many of which were not consistently updated. The new Globe Life Field not only boasts a retractable roof, but it produces data in categories that didn’t even exist in 1992.

Data Transformation 141

Data Transformation Consulting Data Lake Reporting 141

AWS Big Data

APRIL 11, 2023

With the proliferation of IoT devices and the abundance of data generated by them, it has become possible to collect real-time data on inventory levels, customer behavior, and other key metrics. In the inventory management and forecasting solution, AWS Glue is recommended for data transformation.

Forecasting 78

Forecasting Management IoT Data-driven 78

Octopai

JUNE 22, 2023

Two prominent approaches have emerged: self-service data management and centralized data management. Each approach has its own merits and trade-offs, and understanding how to leverage data lineage within these frameworks can empower organizations and provide crucial control over their data assets.

Management 52

Management Data-driven Data Quality Data Governance 52

Jen Stirrup

NOVEMBER 30, 2021

In this session, we will start R right from the beginning, from installing R through to data transformation and integration, through to visualizing data by using R in PowerBI. Then, we will move towards powerful but simple to use datatypes in R such as data frames. If so, then I fast forward to the intermediate section.

Dashboards 91

Dashboards Visualization Data Transformation Publishing 91

CIO Business Intelligence

JANUARY 19, 2024

Data scientist is one of the hottest jobs in IT. Companies are increasingly eager to hire data professionals who can make sense of the wide array of data the business collects. If you’re looking to get into this lucrative field, or want to stand out from the competition, certification can be key.

Data Science 126

Data Science Machine Learning Predictive Modeling Experimentation 126

CIO Business Intelligence

JULY 5, 2022

What is the difference between business analytics and data analytics? Business analytics is a subset of data analytics. Data analytics is used across disciplines to find trends and solve problems using data mining , data cleansing, data transformation, data modeling, and more.

Business Analytics 135

Business Analytics Prescriptive Analytics Data mining Diagnostic Analytics 135

Cloudera

APRIL 19, 2022

Data holds incredible untapped potential for Australian organisations across industries, regardless of individual business goals, and all organisations are at different points in their data transformation journey with some achieving success faster than others. . More importantly, effective data strategies don’t stand still.

Data-driven 88

Data-driven Data Strategy Strategy Big Data 88

CIO Business Intelligence

JUNE 7, 2022

What is data analytics? Data analytics is a discipline focused on extracting insights from data. It comprises the processes, tools and techniques of data analysis and management, including the collection, organization, and storage of data. What are the four types of data analytics? Data analytics tools.

Data Analytics 135

Data Analytics Diagnostic Analytics Management Analytics 135

Octopai

OCTOBER 6, 2022

We’re not sure if data assets experience stress when they have to migrate to a new residence, but certainly all of the humans involved in the data migration process do! A smart data mapping methodology starts with taking stock of your data assets and determining what really needs to come with you. What should stay behind?

Testing 52

Testing Visualization Data Transformation Strategy 52

Ontotext

MARCH 20, 2024

Studies reveal that businesses lose significant time and opportunities due to missing integrations and poor data quality and accessibility. As Dan Vesset, group vice president at IDC, stated, “People spend 60% to 80% of their time trying to find data. It’s a huge productivity loss.”

Data-driven 52

Data-driven Strategy Sales Data Integration 52

AWS Big Data

MARCH 13, 2024

The solution consists of the following interfaces: IoT or mobile application – A mobile application or an Internet of Things (IoT) device allows the tracking of a company vehicle while it is in use and transmits its current location securely to the data ingestion layer in AWS. The ingestion approach is not in scope of this post.

Analytics 96

Analytics IoT Metadata Internet of Things 96