CIO Business Intelligence

JANUARY 19, 2024

The exam tests general knowledge of the platform and applies to multiple roles, including administrator, developer, data analyst, data engineer, data scientist, and system architect. Candidates for the exam are tested on ML, AI solutions, NLP, computer vision, and predictive analytics.

Data Science 125

Data Science Machine Learning Predictive Modeling Experimentation 125

Occam's Razor

FEBRUARY 7, 2022

Since you're reading a blog on advanced analytics, I'm going to assume that you have been exposed to the magical and amazing awesomeness of experimentation and testing. And yet, chances are you really don’t know anyone directly who uses experimentation as a part of their regular business practice. Wah wah wah waaah.

Experimentation 101

Experimentation Testing Optimization Marketing 101

Occam's Razor

MAY 22, 2006

This post is a primer on the delightful world of testing and experimentation (A/B, Multivariate, and a new term from me: Experience Testing). Experimentation and testing help us figure out we are wrong, quickly and repeatedly and if you think about it that is a great thing for our customers, and for our employers.

Experimentation 103

Experimentation Testing Optimization Measurement 103

CIO Business Intelligence

OCTOBER 5, 2023

Sandeep Davé knows the value of experimentation as well as anyone. As chief digital and technology officer at CBRE, Davé recognized early that the commercial real estate industry was ripe for AI and machine learning enhancements, and he and his team have tested countless use cases across the enterprise ever since.

Experimentation 128

Experimentation Strategy Machine Learning Interactive 128

CIO Business Intelligence

JUNE 15, 2023

BCG asked 12,898 frontline employees, managers, and leaders in large organizations around the world how they felt about AI: 61% listed curiosity as one of their two strongest feelings, 52% listed optimism, 30% concern, and 26% confidence. Despite BCG’s findings of optimism in the workforce, there’s a darker side.

Management 113

Management Experimentation Optimization Enterprise 113

Cloudera

OCTOBER 18, 2023

Portfolio Optimization Analyze a portfolio of investments and identify opportunities to optimize returns while managing risk. Code Development and Testing Assistance Code generation: One of the benefits of generative AI is that it can be used to generate code automatically, reducing the time and effort required by developers.

Cost-Benefit 77

Cost-Benefit Testing Machine Learning Optimization 77

Decision Management Solutions

MARCH 26, 2020

We’ve been blogging recently on Decision Optimization. The Customer Journey to Decision Optimization. Those trying to improve and optimize their decisions report various challenges. Experimentation at the beginning of your journey is essential to make sure you understand where you are starting.

Experimentation 72

Experimentation Recreation/Entertainment Optimization Testing 72

CIO Business Intelligence

SEPTEMBER 7, 2023

Innovation is about modernization, it’s about optimization,” said Dan Gisolfi, Distinguished Engineer, Head of Innovation and Intellectual Property at Discover Financial Services. “It So, how does a digital bank like Discover empower engineers to continuously generate, test, and launch new ideas?

Experimentation 97

Experimentation Digital Transformation Optimization Testing 97

Smart Data Collective

JUNE 29, 2022

Test Different Calls-to-Action. You will need to test different CTAs, which is going to require data analytics tools. Many email marketing solutions such as Hubspot and Aweber have analytics interfaces that make it easier to test different elements in your marketing funnels, such as CTAs. Test, Test, Test.

B2B 107

B2B Data-driven Marketing Strategy 107

CIO Business Intelligence

JUNE 14, 2023

Organization: AWS Price: US$300 How to prepare: Amazon offers free exam guides, sample questions, practice tests, and digital training. The exam tests general knowledge of the platform and applies to multiple roles, including administrator, developer, data analyst, data engineer, data scientist, and system architect.

Big Data 125

Big Data Data Analytics Analytics Predictive Modeling 125

CIO Business Intelligence

JUNE 28, 2023

As Belcorp considered the difficulties it faced, the R&D division noted it could significantly expedite time-to-market and increase productivity in its product development process if it could shorten the timeframes of the experimental and testing phases in the R&D labs.

Digital Transformation 103

Digital Transformation Cost-Benefit Informatics Data mining 103

CIO Business Intelligence

AUGUST 16, 2023

But today, Svevia is driving cross-sector digitization projects where new technology for increased safety for road workers and users is tested. Since the route optimization came into place, fewer emptyings are required, he notes. A third area to be optimized is the salting of roads during the winter.

Risk 98

Risk Cost-Benefit Digital Transformation Internet of Things 98

CIO Business Intelligence

MARCH 10, 2022

Fujitsu remains very much interested in the mainframe market, with a new model still on its roadmap for 2024, and a move under way to “shift its mainframes and UNIX servers to the cloud, gradually enhancing its existing business systems to optimize the experience for its end-users.”

Sales 128

Sales Testing Experimentation Data Processing 128

CIO Business Intelligence

NOVEMBER 7, 2022

A developing playbook of best practices for data science teams covers the development process and technologies for building and testing machine learning models. Have business leaders defined realistic success criteria and areas of low-risk experimentation? Are data science teams set up for success?

Machine Learning 127

Machine Learning Data Science Experimentation IoT 127

AWS Big Data

NOVEMBER 2, 2023

Solution overview GoDaddy’s intelligent compute platform envisions simplification of compute operations for all personas, without limiting power users, to ensure out-of-box cost and performance optimization for data and ML workloads. The following diagram shows a high-level illustration of the intelligent compute platform vision.

Cost-Benefit 87

Cost-Benefit Big Data Testing Optimization 87

CIO Business Intelligence

DECEMBER 19, 2023

If CIOs don’t improve conversions from pilot to production, they may find their investors losing patience in the process and culture of experimentation. And while static application security testing (SAST) was the top-rated tool for usefulness by 82% of respondents, only 28% claim these tools are used on at least 75% of their code base.

Digital Transformation 143

Digital Transformation Unstructured Data Machine Learning Risk Management 143

CIO Business Intelligence

JANUARY 9, 2024

We’re using our own databases, testing against our own needs, and building around specific problem sets. Retrieval Augmented Generation (RAG), which provides a way to optimize LLM output without altering the underlying LLM model, seems to be the best and most practical framework to do so.

Enterprise 117

Enterprise Experimentation Modeling Data-driven 117

CIO Business Intelligence

FEBRUARY 21, 2023

The firm’s connected brewery IoT platform, for instance, is being used for data ingestion and edge computing in breweries, enabling local teams to analyze, adjust, test and optimize production processes, with this in-turn allowing operations to leverage real-time and historical data to support the workers on the shop floor.

Digital Transformation 104

Digital Transformation Sales Experimentation Optimization 104

IBM Big Data Hub

APRIL 18, 2024

While leaders have some reservations about the benefits of current AI, organizations are actively investing in gen AI deployment, significantly increasing budgets, expanding use cases, and transitioning projects from experimentation to production. AGI wouldn’t just perceive its surroundings; it would understand them.

Cost-Benefit 89

Cost-Benefit Modeling Manufacturing Interactive 89

Octopai

OCTOBER 26, 2022

When DataOps principles are implemented within an organization, you see an increase in collaboration, experimentation, deployment speed and data quality. SPC is the continuous testing of the results of automated manufacturing processes. SPC tests can do the same thing for the data flowing through your pipelines.

Data Quality 52

Data Quality Data Analytics Analytics Manufacturing 52

Octopai

MAY 2, 2022

Common elements of DataOps strategies include: Collaboration between data managers, developers and consumers A development environment conducive to experimentation Rapid deployment and iteration Automated testing Very low error rates. Just-in-Time” manufacturing increases production while optimizing resources. Issue detected?

Manufacturing 87

Manufacturing Testing Experimentation Data Quality 87

CIO Business Intelligence

MARCH 7, 2023

Oliver Wittmaier, CIO and product owner at DB SYSTEL GmbH DB SYSTEL GmbH Content generation is also an area of particular interest to Michal Cenkl, director of innovation and experimentation at Mitre Corp. “I Michal Cenkl, director of innovation and experimentation, Mitre Corp. Mitre Corp. The technology also needs human oversight.

Enterprise 113

Enterprise IT Experimentation Unstructured Data 113

IBM Big Data Hub

DECEMBER 14, 2023

It is very easy to turn a terraform template into a deployable architecture and open the door to cost optimization, compliance management, self-service, standardization and repeatability. The extension of the CIO office’s dedicated data center to the IBM public cloud allowed for experimentation and growth with zero risk.

Experimentation 73

Experimentation Testing Software Management 73

CIO Business Intelligence

OCTOBER 9, 2023

Hyatt’s experimental mindset and listen-first approach are heavily applied to IT’s pursuit of innovation, he says. In the rush to innovate, teams can forget the basics, such as insufficient testing, so constant monitoring is crucial to ensure you’re providing value, adds TFCU’s Renganathan. He learned that the hard way.

Strategy 136

Strategy Technology Experimentation Testing 136

Occam's Razor

MARCH 23, 2021

This is very hard to do, we now have a proven seven-step experimentation process, with one of the coolest algorithms to pick matched-markets (normally the kiss of death of any large-scale geo experiment). The first component is a gloriously scaled global creative pre-testing program. Matched market tests. The slow music.

Analytics 131

Analytics Scorecard Strategy Testing 131

The Unofficial Google Data Science Blog

OCTOBER 7, 2015

A/B testing is used widely in information technology companies to guide product development and improvements. For questions as disparate as website design and UI, prediction algorithms, or user flows within apps, live traffic tests help developers understand what works well for users and the business, and what doesn’t.

Modeling 61

Modeling Experimentation Knowledge Discovery Testing 61

CIO Business Intelligence

OCTOBER 18, 2023

in concert with Microsoft’s AI-optimized Azure platform. Additionally, Flint Hill Resources is deploying the LLM-based platform for commodity trading optimization, while the US Missile Defense Agency is employing it to improve safety during steel manufacturing, according to C3. John Spottiswood, COO of Jerry, a Palo Alto, Calif.-based

Risk 141

Risk Manufacturing Enterprise Technology 141

DataRobot

JUNE 8, 2021

Because cluster analysis is an unsupervised algorithm, it does not attempt to select groups that optimize business goals. The researchers set out to test whether consumers are more resistant to healthcare delivered by AI providers because of concerns that the AI will neglect the unique characteristics of their case.

Data-driven 98

Data-driven Testing Marketing Experimentation 98

O'Reilly on Data

MARCH 31, 2020

This has serious implications for software testing, versioning, deployment, and other core development processes. The need for an experimental culture implies that machine learning is currently better suited to the consumer space than it is to enterprise companies.

Management 332

Management Machine Learning Experimentation Metrics 332

Cloudera

APRIL 9, 2021

To effectively leverage their predictive capabilities and maximize time-to-value these companies need an ML infrastructure that allows them to quickly move models from data pipelines, to experimentation and into the business. A/B testing). model packaging, deployment and serving. model monitoring. Train ML Models.

Machine Learning 98

Machine Learning Forecasting Manufacturing Predictive Analytics 98

DataRobot Blog

JANUARY 10, 2023

ML model builders spend a ton of time running multiple experiments in a data science notebook environment before moving the well-tested and robust models from those experiments to a secure, production-grade environment for general consumption. Capabilities Beyond Classic Jupyter for End-to-end Experimentation. Auto-scale compute.

Experimentation 52

Experimentation Machine Learning Data Science Modeling 52

Occam's Razor

APRIL 8, 2013

Sometimes, we escape the clutches of this sub optimal existence and do pick good metrics or engage in simple A/B testing. You're choosing only one metric because you want to optimize it. Testing out a new feature. Identify, hypothesize, test, react. You don’t need a beautiful beast to go out and test.

Metrics 156

Metrics KPI Analytics Key Performance Indicator 156

CIO Business Intelligence

JUNE 27, 2022

We rely heavily on automated testing. It’s not perfect by any means, and we are continuously breaking our own product, but it’s optimized for shipping new features to customers as quickly as we can. Tyson: That belief in your vision when it’s tested—that is tough! How do you get to that level of automation?

Software 113

Software Experimentation Testing Marketing 113

Occam's Razor

SEPTEMBER 19, 2011

We have to do Search Engine Optimization. Then they isolated regions of the country (by city, zip, state, dma pick your fave) into test and control regions. People in the test regions will participate in our hypothesis testing. So for variation #3, no catalogs or email were sent to the customers in the test group.

Measurement 119

Measurement Advertising Testing Marketing 119

Cloudera

FEBRUARY 16, 2022

They define each stage from data ingest, feature engineering, model building, testing, deployment and validation. By logging the performance of every combination of search parameters within an experiment, we can choose the optimal set of parameters when building a model. This supports automation, consistency and reproducibility.

Machine Learning 82

Machine Learning Modeling Metadata Recreation/Entertainment 82

Occam's Razor

OCTOBER 21, 2013

As an analyst, I was upset that this change would hurt my ability to analyze the effectiveness of my beloved search engine optimization (SEO) efforts – which are really all about finding the right users using optimal content strategies. These changes impact my AdWords spend sub-optimally. What Is Not Going Away.

Optimization 154

Optimization Reporting Experimentation Metrics 154

O'Reilly on Data

OCTOBER 19, 2021

ML apps need to be developed through cycles of experimentation: due to the constant exposure to data, we don’t learn the behavior of ML apps through logical reasoning but through empirical observation. However, none of these layers help with modeling and optimization. An Overarching Concern: Correctness and Testing.

IT 346

IT Testing Experimentation Software 346