CIO Business Intelligence

OCTOBER 5, 2023

Sandeep Davé knows the value of experimentation as well as anyone. As chief digital and technology officer at CBRE, Davé recognized early that the commercial real estate industry was ripe for AI and machine learning enhancements, and he and his team have tested countless use cases across the enterprise ever since.

Experimentation 125

Experimentation Strategy Machine Learning Interactive 125

Dataiku

MARCH 25, 2024

One limitation observed while testing the LENS approach, particularly in VQA, is its heavy reliance on the output of the first modules, namely CLIP and BLIP captions. Here is a figure showing a comparison of extraction from the same web document: Comparison between image-text pairs (left) and interleaved image-text documents (right).

Visualization 132

Visualization Modeling Experimentation Testing 132

CIO Business Intelligence

DECEMBER 19, 2023

Create these six generative AI workstreams CIOs should document their AI strategy for delivering short-term productivity improvements while planning visionary impacts. If CIOs don’t improve conversions from pilot to production, they may find their investors losing patience in the process and culture of experimentation.

Digital Transformation 142

Digital Transformation Unstructured Data Machine Learning Risk Management 142

AWS Big Data

AUGUST 21, 2023

Lexical search looks for words in the documents that appear in the queries. Background A search engine is a special kind of database, allowing you to store documents and data and then run queries to retrieve the most relevant ones. OpenSearch Service supports a variety of search and relevance ranking techniques.

Data Processing 89

Data Processing Experimentation Visualization Metrics 89

CIO Business Intelligence

JULY 28, 2023

In addition to bottom-line benefits, employees are often inspired and motivated by innovation – seeking job opportunities that encourage experimentation and embrace new ideas. With these factors in mind, here are five steps CIOs and IT leaders can take to drive innovation and future-proof their organization. If not, move on to the next!

IT 98

IT Experimentation Digital Transformation Marketing 98

CIO Business Intelligence

APRIL 14, 2023

In fact, it’s likely your organization has a large number of employees currently experimenting with generative AI, and as this activity moves from experimentation to real-life deployment, it’s important to be proactive before unintended consequences happen.

Risk 121

Risk Experimentation Marketing Risk Management 121

Smarten

MAY 17, 2023

Create a Sandbox Environment If you are in the business of technology, you probably have a robust sandbox environment in which you can use new tools and leverage opportunities with test data to understand the value of tools like Azure OpenAI, GPT 3.x Creating Summary Data for Unstructured Documents (PDFs, HTML, Websites, etc.)

Digital Transformation 52

Digital Transformation Experimentation Risk Testing 52

CIO Business Intelligence

MARCH 7, 2023

Vince Kellen understands the well-documented limitations of ChatGPT, DALL-E and other generative AI technologies — that answers may not be truthful, generated images may lack compositional integrity, and outputs may be biased — but he’s moving ahead anyway. Michal Cenkl, director of innovation and experimentation, Mitre Corp.

Enterprise 115

Enterprise IT Experimentation Unstructured Data 115

AWS Big Data

JANUARY 9, 2024

Lexical search In lexical search, the search engine compares the words in the search query to the words in the documents, matching word for word. Semantic search doesn’t match individual query terms—it finds documents whose vector embedding is near the query’s embedding in the vector space and therefore semantically similar to the query.

Cost-Benefit 88

Cost-Benefit Visualization Modeling Machine Learning 88

AWS Big Data

MAY 2, 2023

Test the feature To test this feature, run the producer DAG. Removal of experimental Smart Sensors. For detailed release documentation with sample code, visit the Apache Airflow v2.4.0 How dynamic task mapping works Let’s see an example using the reference code available in the Airflow documentation. Airflow v2.4.0

Testing 97

Testing Experimentation Management Metadata 97

CIO Business Intelligence

JUNE 7, 2023

KAUST Smart partners with companies and organizations to develop, test, and pilot technologies and to take advantage of our unique city environment.

Digital Transformation 102

Digital Transformation Experimentation Technology Testing 102

CIO Business Intelligence

APRIL 4, 2022

The early days of the pandemic taught organizations like Avery Dennison the power of agility and experimentation. The team was helped with live augmented reality annotations to document each step. “We Employee crowdsourcing can yield breakthrough ideas. We are now making the solution available to more factories,” he says.

Experimentation 133

Experimentation Interactive Business Objectives Manufacturing 133

CIO Business Intelligence

OCTOBER 18, 2023

We’re seeing lots and lots of pilots,” says Gartner AI analyst Arun Chandrasekaran, who notes content creation, document summarization, sentiment analysis, and enterprise search chief among the initial use cases. A recent survey of nearly 1,000 IT decision-makers conducted by Foundry underscores this. “As

Risk 138

Risk Manufacturing Enterprise Technology 138

Domino Data Lab

AUGUST 6, 2021

The process of doing data science is about learning from experimentation failures, but inadvertent errors can create enormous risks in model implementation. Outputs for a new problem might not be consistent with the model’s original intent for a different problem without careful research and testing. Model implementation. Operations.

Risk Management 64

Risk Management Risk Modeling Enterprise 64

CIO Business Intelligence

AUGUST 17, 2023

We’re testing ChatGPT at an individual level,” he says. In general, we see a small number of organizations using generative AI based on a strategy or plan, shaped by clear policies, and a lot of grassroots experimentation, but that’s almost always happening in a strategy vacuum.” Medica’s O’Brien issues a caution as well.

Risk 95

Risk Cost-Benefit Strategy Experimentation 95

Domino Data Lab

APRIL 7, 2019

Other use cases may involve returning the most appropriate answer to a question, finding the most relevant documents for a query or classifying the input document itself. A good NLP library will make it easy to both train your own NLP models and integrate with the downstream ML or DL pipeline.

Deep Learning 110

Deep Learning Machine Learning Experimentation Modeling 110

The Data Visualisation Catalogue

MARCH 3, 2019

This experimental visualisation uses a polar layout and extends into into 3D with a cylindrical form. A spherical variation was also tested out: Source: The Design Space of Implicit Hierarchy Visualization: A Survey, p. A spherical variation was also tested out: Source: The Design Space of Implicit Hierarchy Visualization: A Survey, p.

Experimentation 40

Experimentation Visualization Testing IT 40

Domino Data Lab

AUGUST 6, 2021

Develop: includes accessing and preparing data and algorithms, researching and development of models and experimentation. During this part of development, data scientists begin creating models and conducting experiments to test their performance. The Deploy phase is where the tested model is transferred to a production environment.

Data Science 75

Data Science Testing Modeling Publishing 75

CIO Business Intelligence

JULY 31, 2023

As vendors add generative AI to their enterprise software offerings, and as employees test out the tech, CIOs must advise their colleagues on the pros and cons of gen AI’s use as well as the potential consequences of banning or limiting it. Some companies have lifted their bans and are allowing limited use of the technology; others have not.

Strategy 97

Strategy Risk Enterprise Risk Management 97

IBM Big Data Hub

APRIL 18, 2024

While leaders have some reservations about the benefits of current AI, organizations are actively investing in gen AI deployment, significantly increasing budgets, expanding use cases, and transitioning projects from experimentation to production. Code (62%) : Gen AI helps developers write code more efficiently and with fewer errors.

Cost-Benefit 88

Cost-Benefit Modeling Manufacturing Interactive 88

DataRobot Blog

JANUARY 10, 2023

ML model builders spend a ton of time running multiple experiments in a data science notebook environment before moving the well-tested and robust models from those experiments to a secure, production-grade environment for general consumption. Capabilities Beyond Classic Jupyter for End-to-end Experimentation. Auto-scale compute.

Experimentation 52

Experimentation Machine Learning Data Science Modeling 52

CIO Business Intelligence

MAY 1, 2024

Pilots can offer value beyond just experimentation, of course. McKinsey reports that industrial design teams using LLM-powered summaries of user research and AI-generated images for ideation and experimentation sometimes see a reduction upward of 70% in product development cycle times.

Cost-Benefit 129

Cost-Benefit Metrics Insurance Measurement 129

Occam's Razor

APRIL 8, 2013

Sometimes, we escape the clutches of this sub optimal existence and do pick good metrics or engage in simple A/B testing. Testing out a new feature. If you have access to existing data, take some time to document what the current performance looks like. Identify, hypothesize, test, react. But it is not routine.

Metrics 156

Metrics KPI Analytics Key Performance Indicator 156

Domino Data Lab

DECEMBER 4, 2020

Domino Lab supports both interactive and batch experimentation with all popular IDEs and notebooks (Jupyter, RStudio, SAS, Zeppelin, etc.). Once all packages have been imported, we can move on to loading our test data. We can then proceed with pharmacokinetic modeling, testing the goodness of fit of various models. References.

Metrics 59

Metrics Data Science Knowledge Discovery Measurement 59

Occam's Razor

AUGUST 22, 2011

Convert Data Skeptics: Document, Educate & Pick Your Poison. Five Reasons And Awesome Testing Ideas. Lab Usability Testing: What, Why, How Much. Build A Great Web Experimentation & Testing Program. Experimentation and Testing: A Primer. Interviewing Tip: Stress Test Critical Thinking.

KPI 124

KPI Metrics Measurement ROI 124

Insight

MARCH 12, 2020

To collect these genre tags and other metadata, I took advantage of the well-documented Goodreads API. I tested several different flavors of BERT for use as synopsis classifiers before settling on the DistilBERT model from Hugging Face. On my test set, this approach resulted in~75–95% accuracy and ~.65 In other words, if 0.1%

Modeling 59

Modeling Metadata Publishing Sales 59

CIO Business Intelligence

APRIL 24, 2024

We’ve been doing proof-of-value and different test cases on efficiency opportunities within our organization as it relates to AI,” he says. A third gen AI product, BenefitsGPT, isn’t yet commercially available, but is currently being tested by three other Blue Cross Blue Shield organizations.

Sales 127

Sales Finance Experimentation Cost-Benefit 127

CIO Business Intelligence

MARCH 5, 2024

Many other platforms, such as Coveo’s Relative Generative Answering , Quickbase AI , and LaunchDarkly’s Product Experimentation , have embedded virtual assistant capabilities but don’t brand them copilots. Today, top AI-assistant capabilities delivering results include generating code, test cases, and documentation.

Cost-Benefit 119

Cost-Benefit Advertising Experimentation Software 119

CIO Business Intelligence

APRIL 5, 2023

Midjourney, ChatGPT, Bing AI Chat, and other AI tools that make generative AI accessible have unleashed a flood of ideas, experimentation and creativity. That turns generic documentation into conversational programming where the AI can take your data and show you how to write a query, for example.

Modeling 102

Modeling Testing Cost-Benefit Experimentation 102

DataRobot Blog

MARCH 16, 2023

This means they need the tools that can help with testing and documenting the model, automation across the entire pipeline and they need to be able to seamlessly integrate the model into business critical applications or workflows. Assured Compliance and Governance – DataRobot has always been strong on ensuring governance.

Experimentation 98

Experimentation Data-driven Modeling Metadata 98

Occam's Razor

DECEMBER 9, 2009

The four pronged real world tested probing and loaded with politics framework to find a home for Web Analytics: 1. After a lot of experimentation and failures I have come to realize that often (if above conditions are met) Marketing is the best organization for Web Analytics to be in. Are there standard tools deployed? You are out man!

Analytics 95

Analytics Data-driven Marketing Sales 95

O'Reilly on Data

MARCH 23, 2023

It’s by far the most convincing example of a conversation with a machine; it has certainly passed the Turing test. Be very careful about documents that require any sort of precision. Still, I would want a human lawyer to review anything it produced; legal documents require precision. But it is an amazing analytic engine.”

IT 262

IT Modeling Testing Risk 262

O'Reilly on Data

OCTOBER 13, 2020

In Bringing an AI Product to Market , we distinguished the debugging phase of product development from pre-deployment evaluation and testing. During testing and evaluation, application performance is important, but not critical to success. require not only disclosure, but also monitored testing. Debugging AI Products.

Management 244

Management Metrics Machine Learning Modeling 244

Rocket-Powered Data Science

OCTOBER 16, 2020

We build models to test our understanding, but these models are not “one and done.” Images, text, documents, audio, video and all the apps on your phone, all the things you search for on the internet? They are part of a cycle of learning. What you see with your eyes? That’s data. What you hear with your ears? That’s all data.

Digital Transformation 142

Digital Transformation Experimentation Data Strategy Strategy 142

DataRobot

DECEMBER 16, 2021

Take advantage of DataRobot’s wide range of options for experimentation. DataRobot’s Text AI clears the way for you to test various text and NLP techniques (such as “bag-of-words” models, tf-idf, cosine similarity, FastText, TinyBert, NLTK, spaCy, stop word removal, stemming, lemmatization, and many more). It is part of our new 7.3

Experimentation 98

Experimentation Unstructured Data Deep Learning Modeling 98

AWS Big Data

JULY 26, 2023

The vector engine supports a wide range of use cases across various domains, including image search, document search, music retrieval, product recommendation, video search, location-based search, fraud detection, and anomaly detection. After the collection is successfully created, you can create the vector index.

Metadata 52

Metadata Cost-Benefit Testing Metrics 52

O'Reilly on Data

JULY 25, 2023

Swift Papers felt like a well-scoped project to test how well AI handles a realistic yet manageable real-world programming task. I also installed the latest VS Code (Visual Studio Code) with GitHub Copilot and the experimental Copilot Chat plugins, but I ended up not using them much. I saw an example for Node.js

Consulting 246

Consulting Interactive Software IT 246