CIO Business Intelligence

JULY 31, 2023

As vendors add generative AI to their enterprise software offerings, and as employees test out the tech, CIOs must advise their colleagues on the pros and cons of gen AI’s use as well as the potential consequences of banning or limiting it. Douglas Merrill, a partner at management consulting firm McKinsey & Co.,

Strategy 95

Strategy Risk Enterprise Risk Management 95

O'Reilly on Data

OCTOBER 13, 2020

In Bringing an AI Product to Market , we distinguished the debugging phase of product development from pre-deployment evaluation and testing. During testing and evaluation, application performance is important, but not critical to success. require not only disclosure, but also monitored testing. Debugging AI Products.

Management 244

Management Metrics Machine Learning Modeling 244

Decision Management Solutions

DECEMBER 17, 2021

It’s also critical to design and run experiments, champion/challenger as well as A/B testing, to see how robust these new signals are. He provides strategic consulting to companies of all sizes, working with clients in all sectors to adopt decision making technology.

Modeling 52

Modeling Experimentation Visualization Risk 52

Smarten

APRIL 18, 2023

While new medical techniques and tools can take time to refine and prove, doctors often leverage experimental techniques to save lives. It does not accommodate images and its security compliance has yet to be thoroughly tested. As these techniques are refined, they enter into the mainstream and become more common place.

Digital Transformation 52

Digital Transformation Experimentation ROI Technology 52

Domino Data Lab

AUGUST 6, 2021

Develop: includes accessing and preparing data and algorithms, researching and development of models and experimentation. During this part of development, data scientists begin creating models and conducting experiments to test their performance. The Deploy phase is where the tested model is transferred to a production environment.

Data Science 75

Data Science Testing Modeling Publishing 75

Domino Data Lab

JULY 28, 2021

The ability to quickly and freely innovate is key here, since this is where ideas are researched, discussed, tested, refined and then researched again. The Workbench is Domino’s notebook-based environment where data scientists can do their R&D and experimentation. Have a question? Get in touch with us.

Data Science 59

Data Science Enterprise Modeling Experimentation 59

Occam's Razor

SEPTEMBER 19, 2011

But if you have access to some or all of that (or can hire good external consultants), then your rewards will be very close to entering heaven. Then they isolated regions of the country (by city, zip, state, dma pick your fave) into test and control regions. People in the test regions will participate in our hypothesis testing.

Measurement 119

Measurement Advertising Testing Marketing 119

DataKitchen

APRIL 13, 2021

Testing and Data Observability. It orchestrates complex pipelines, toolchains, and tests across teams, locations, and data centers. Prefect Technologies — Open-source data engineering platform that builds, tests, and runs data workflows. Testing and Data Observability. Production Monitoring and Development Testing.

Testing 300

Testing Machine Learning Consulting Data Quality 300

Occam's Razor

AUGUST 22, 2011

Consultants, Analysts: Present Impactful Analysis, Insightful Reports. Five Reasons And Awesome Testing Ideas. Lab Usability Testing: What, Why, How Much. Build A Great Web Experimentation & Testing Program. Experimentation and Testing: A Primer. Interviewing Tip: Stress Test Critical Thinking.

KPI 124

KPI Metrics Measurement ROI 124

CIO Business Intelligence

MAY 9, 2024

Experimentation drives momentum: How do we maximize the value of a given technology? Via experimentation. This can be as simple as a Google Sheet or sharing examples at weekly all-hands meetings Many enterprises do “blameless postmortems” to encourage experimentation without fear of making mistakes and reprisal.

Enterprise 98

Enterprise Experimentation Sales Optimization 98

Ontotext

APRIL 3, 2024

Nimit Mehta: I think that 2024 is going to be a buckle-down year, but, at the same time, we’ll see a rapid explosion of experimentation. In a 1-hour demo, we were able to show that we could do in hours the work that was going to take 10 external consultants months to page through and find things. It’s open. It’s unsafe.”

Technology 59

Technology Risk Digital Transformation Measurement 59

CIO Business Intelligence

APRIL 24, 2024

Sales and marketing departments have long been at the forefront of embracing new technologies, and according to data provided by the Alexander Group, a revenue consultancy, 80% of hundreds of survey responses detailed that CROs have formally invested in AI for their marketing teams.

Sales 124

Sales Finance Experimentation Cost-Benefit 124

Occam's Razor

FEBRUARY 26, 2008

" Or " I proposed testing / surveys / competitive intelligence / Analysts but I was shot down." 1: Implement a Experimentation & Testing Program. # 1: Implement a Experimentation & Testing Program. Here is data from our latest test." And now you have no excuse to avoid testing.

Management 68

Management Experimentation Testing Strategy 68

Occam's Razor

DECEMBER 9, 2009

In this post let me share with you a common sense framework I use in my consulting engagements to figure out a home for web analysts. The four pronged real world tested probing and loaded with politics framework to find a home for Web Analytics: 1. How long has the company been doing web analytics, what is the landscape of tools?

Analytics 95

Analytics Data-driven Marketing Sales 95

bridgei2i

APRIL 28, 2020

My name is Aruna Babu and I’m a transformation consultant who spent a good part of the last decade crafting strategy that marries business, technology and user needs. And so that process with curation or identifying which data potentially is a leading indicator and then test those leading indicators. Transcript. Aruna: Hi there!

Enterprise 103

Enterprise Data Analytics Analytics Forecasting 103

CIO Business Intelligence

APRIL 18, 2022

While it’s critical for tech leaders to communicate throughout a digital project, it’s also important to communicate appropriately, says Rich Nanda, US strategy and analytics offerings leader, at Deloitte Consulting. Rich Nanda, US strategy and analytics offerings leader, Deloitte Consulting. Deloitte Consulting. “In

Digital Transformation 145

Digital Transformation Dashboards Cost-Benefit Consulting 145

CIO Business Intelligence

MARCH 5, 2024

Many other platforms, such as Coveo’s Relative Generative Answering , Quickbase AI , and LaunchDarkly’s Product Experimentation , have embedded virtual assistant capabilities but don’t brand them copilots. Today, top AI-assistant capabilities delivering results include generating code, test cases, and documentation.

Cost-Benefit 114

Cost-Benefit Advertising Experimentation Software 114

O'Reilly on Data

JULY 25, 2023

Swift Papers felt like a well-scoped project to test how well AI handles a realistic yet manageable real-world programming task. I also installed the latest VS Code (Visual Studio Code) with GitHub Copilot and the experimental Copilot Chat plugins, but I ended up not using them much. That is the basic premise of my project.

Consulting 246

Consulting Interactive Software IT 246

CIO Business Intelligence

SEPTEMBER 19, 2023

When they look at a new problem, they start by gathering loads of third-party data and benchmarking through consulting firms. They should rather manage through experimentation. The process of greenlighting would involve how to allocate the initial small investment and human resources to test the idea.

Digital Transformation 125

Digital Transformation Uncertainty Testing Enterprise 125

Occam's Razor

OCTOBER 21, 2013

If you want to stress test this,… go back to your 2011 (pre- not provided ) data for paid and organic and see what you can find. Controlled experimentation. Now its time for the SEO Consultant's awesomely awesome SEO strategy implementation. I would humbly suggest not. Still non-individualized. One product line.

Optimization 154

Optimization Reporting Experimentation Metrics 154

O'Reilly on Data

MARCH 23, 2023

It’s by far the most convincing example of a conversation with a machine; it has certainly passed the Turing test. You could even create digital clones of yourself 5 that could stand in for you in consulting gigs and other business situations. Every user of ChatGPT needs to know its limitations, precisely because it feels so magical.

IT 262

IT Modeling Testing Risk 262

DataKitchen

JANUARY 17, 2022

Testing and validating analytics took as long or longer than creating the analytics. The business analysts creating analytics use the process hub to calculate metrics, segment/filter lists, perform predictive modeling, “what if” analysis and other experimentation. QC is extraordinarily time-consuming unless it is automated.

Experimentation 130

Experimentation Data Lake Marketing Predictive Modeling 130

Occam's Razor

NOVEMBER 12, 2006

The problem is that you are there just to look at the car, maybe take it for a test drive. Focus on the Why (use Surveys or Lab Usability or Experimentation & Testing for example). You have not yet saved up enough to buy a new car. You really don’t want to be sold. What do you think?

Measurement 99

Measurement Analytics Optimization Marketing 99

Occam's Razor

JUNE 6, 2007

Experimentation & Testing (A/B, Multivariate, you name it). What ideas to test first on your site? Should you hire Consultants (and if so when and what to look for and expect)? The book takes a stand on issues, makes choices and cuts through the fog/FUD, in an attempt to make your life a tiny bit easier.

Analytics 60

Analytics Metrics Marketing Dashboards 60

Alation

DECEMBER 14, 2021

These systems offer numerous web-centric features that bolster customer service and engagement, provide server scalability during periods of fluctuating traffic, and allow easy experimentation with new technologies and promotional strategies. Cloud testing. Optimized business continuity. Let’s start with some simple definitions.

Cost-Benefit 52

Cost-Benefit Data Processing Optimization Consulting 52

Occam's Razor

MARCH 23, 2010

Part of it fueled by some Consultants. If I go to a conference and hear that doing test and control experiments is a great way to measure cannibalization by paid search links on well ranked organic keywords, then I can just run a small test myself and see if it works for me. Usually at least a test. Likely not.

Analytics 118

Analytics Consulting Metrics Experimentation 118

CIO Business Intelligence

DECEMBER 6, 2023

As well as a process that includes human review, and encourages experimentation and thorough evaluation of AI suggestions, guardrails need to be put in place as well to stop tasks from being fully automated when it’s not appropriate. Human reviewers should be trained to critically assess AI output, not just accept it at face value.”

IT 130

IT Risk Management Interactive Modeling 130

Occam's Razor

AUGUST 12, 2013

We have fought valiant battles, paid expensive consultants, purchased a crazy amount of software, and achieved an implementation high that is quickly, followed by a " gosh darn it where is my return on investment from all this? There are few things more complicated in analytics (all analytics, big data and huge data!) Or we could not.)

Modeling 161

Modeling Optimization Marketing Interactive 161

Occam's Razor

SEPTEMBER 13, 2016

Hypothesis development and design of experimentation. Respondents included both in-house digital professionals and analysts (56%) and supply-side respondents, including agencies, consultants and vendors (44%)." If these 50 pass the sniff test, send the survey. . + Pattern recognition and understanding trends. Carpe Diem!

Modeling 127

Modeling Reporting Strategy Consulting 127

Occam's Razor

SEPTEMBER 15, 2014

Media-Mix Modeling/Experimentation. There are mobile app analytics solutions that also provide built in A/B testing and/or surveying capabilities and/or push notifications to individual users and/or capturing and analysis of personally identifiable information (PII) etc. I encourage you to use a consultant to help.

Metrics 141

Metrics Reporting Analytics Marketing 141

Occam's Razor

AUGUST 13, 2012

A lot of people buy tools and consulting and go love crazy with attribution modeling. If you want to make the smartest decisions about your budget allocation then leveraging the time tested methodology of media mix modeling (at its core powered by controlled experiments) is the only way to go. We have many course pages.

Modeling 124

Modeling Metrics Data Quality Data-driven 124

CIO Business Intelligence

FEBRUARY 9, 2024

Consultancies and tech vendors often play up the transformative power of gen AI but pay less attention to its shortcomings. Inside your organization, whether within the IT department or business units, be sure to emphasize and allow considerable time for testing and experimentation before going live.

IT 134

IT Experimentation Risk Testing 134

Occam's Razor

FEBRUARY 7, 2011

If you are a consultant then identifying opportunities is a smidgen harder, but you can use your experience with other clients to quantify value. please refer to the controlled experimentation section, page 205, in the book for more. ." Post Testing: Visits 30k. But there is no alternative. If you have Web Analytics 2.0

Analytics 94

Analytics Measurement Metrics Predictive Analytics 94

Occam's Razor

JANUARY 28, 2013

I scroll down the page and see the package, offer for free consultation and the happy family: But there is no direct indication of what the monthly price will be. But there is more to the Security Choice landing page than just passing the all-important transparency test. Being wary of the phone hard sell, I just click the back button.

Marketing 164

Marketing Insurance Visualization IT 164

Occam's Razor

JANUARY 7, 2014

Consulting. Second… well there is no second, it is all about the big action and getting a big impact on your bottom-line from your big investment in analytics processes, consulting, people and tools. 5: 80% of your external consulting spend is focused super-hard analysis problems. #4: An Analysis Ninjas' work does.

Data-driven 140

Data-driven Consulting Reporting Marketing 140

DataRobot

JUNE 2, 2021

A recent report by technology research and consulting firm Omdia, “Selecting an Enterprise MLOps Platform, 2021,” could not have been clearer when stating that “investing in MLOps will be necessary for companies that aim to transform their businesses by using AI technologies.”

Experimentation 52

Experimentation Machine Learning Reporting Modeling 52

CIO Business Intelligence

AUGUST 1, 2023

Abhijit Mazumder, CIO of Tata Consultancy Services, says, “Transformation priorities should fundamentally link to business priorities and what any respective organization is trying to achieve. What stops employees from trying a tool and pasting proprietary or other confidential information into their prompts?

Digital Transformation 98

Digital Transformation Unstructured Data Strategy Experimentation 98