O'Reilly on Data

MARCH 31, 2020

But there’s a host of new challenges when it comes to managing AI projects: more unknowns, non-deterministic outcomes, new infrastructures, new processes and new tools. The need for an experimental culture implies that machine learning is currently better suited to the consumer space than it is to enterprise companies.

Management 339

Management Machine Learning Experimentation Metrics 339

AWS Big Data

AUGUST 21, 2023

For the demo, we’re using the Amazon Titan foundation model hosted on Amazon Bedrock for embeddings, with no fine tuning. It similarly codes the query as a vector and then uses a distance metric to find nearby vectors in the multi-dimensional space. With OpenSearch’s Search Comparison Tool , you can compare the different approaches.

Data Processing 92

Data Processing Visualization Experimentation Metrics 92

Occam's Razor

MAY 22, 2006

This post is a primer on the delightful world of testing and experimentation (A/B, Multivariate, and a new term from me: Experience Testing). Experimentation and testing help us figure out we are wrong, quickly and repeatedly and if you think about it that is a great thing for our customers, and for our employers. Counter claims?

Experimentation 103

Experimentation Testing Optimization Measurement 103

AWS Big Data

MAY 2, 2023

If your updates to a dataset triggers multiple subsequent DAGs, then you can use the Airflow metric max_active_tasks_per_dag to control the parallelism of the consumer DAG and reduce the chance of overloading the system. The workflow steps are as follows: The producer DAG makes an API call to a publicly hosted API to retrieve data.

Testing 101

Testing Experimentation Management Metadata 101

AWS Big Data

JANUARY 9, 2024

It similarly codes the query as a vector and then uses a distance metric to find nearby vectors in the multi-dimensional space to find matches. This functionality was initially released as experimental in OpenSearch Service version 2.4, This is also called embedding the text into the vector space.

Visualization 92

Visualization Cost-Benefit Modeling Machine Learning 92

Occam's Razor

DECEMBER 9, 2009

Specifically: Who owns web analytics / who it reports to from a org structure perspective. Let me hasten to add that this, web analytics ownership, does not exist in a vacuum. If your overall web business is misaligned from an org perspective then honestly there is no hope for you, regardless of where analytics sits.].

Analytics 95

Analytics Data-driven Marketing Sales 95

Business Over Broadway

MAY 22, 2019

I was invited as a guest in a weekly tweet chat that is hosted by Annette Franz and Sue Duris. According to Gartner, companies need to adopt these practices: build culture of collaboration and experimentation; start with a 3-way partnership among executives leading digital initiative, line of business and IT. So, become data literate.

Machine Learning 40

Machine Learning Technology Digital Transformation Data Science 40