O'Reilly on Data

MARCH 31, 2020

This has serious implications for software testing, versioning, deployment, and other core development processes. You might establish a baseline by replicating collaborative filtering models published by teams that built recommenders for MovieLens, Netflix, and Amazon. But this is a best-case scenario, and it’s not typical.

Management 332

Management Machine Learning Experimentation Metrics 332

The Unofficial Google Data Science Blog

OCTOBER 7, 2015

A/B testing is used widely in information technology companies to guide product development and improvements. For questions as disparate as website design and UI, prediction algorithms, or user flows within apps, live traffic tests help developers understand what works well for users and the business, and what doesn’t.

Modeling 61

Modeling Experimentation Knowledge Discovery Testing 61

Data Science and Beyond

APRIL 5, 2021

Well, no one has compiled a meta-post of my public work from 2020 (that I know of), so it’s finally time to publish it myself. My main "day job" focus in 2020 was on being the tech lead for Automattic’s new experimentation platform (ExPlat). Remote work. Subscribe to data.blog to get updates!

Experimentation 61

Experimentation Testing Publishing Measurement 61

Octopai

OCTOBER 26, 2022

When DataOps principles are implemented within an organization, you see an increase in collaboration, experimentation, deployment speed and data quality. SPC is the continuous testing of the results of automated manufacturing processes. SPC tests can do the same thing for the data flowing through your pipelines.

Data Quality 52

Data Quality Data Analytics Analytics Manufacturing 52

AWS Big Data

JANUARY 9, 2024

This functionality was initially released as experimental in OpenSearch Service version 2.4, To foster an open ecosystem, we created a framework to empower partners to easily build and publish AI connectors. We encourage search practitioners to begin testing the search methods available in order to find the right fit for your use case.

Cost-Benefit 90

Cost-Benefit Visualization Modeling Machine Learning 90

Cloudera

FEBRUARY 16, 2022

They define each stage from data ingest, feature engineering, model building, testing, deployment and validation. It is also possible to create your own AMP and publish it in the AMP catalogue for consumption. The ML researchers in Cloudera’s Fast Forward Labs develop and maintain each published AMP.

Machine Learning 81

Machine Learning Modeling Metadata Recreation/Entertainment 81

Insight

MARCH 12, 2020

There was only one problem: literary agents, the gatekeepers of the publishing industry, kept rejecting the book?—?often Galbraith eventually opted to publish Cuckoo’s Calling through an acquaintance of sorts. but the publishing industry failed to see it. often without even looking at it. In other words, Galbraith had chops?—?but

Modeling 59

Modeling Metadata Publishing Sales 59

DataRobot

APRIL 19, 2021

There is some recently published research about the ability of data scientists to discover errors. These manipulations were designed to test whether the data scientists depended on the reasonability of the explanations or simply the existence of visualizations.

Machine Learning 52

Machine Learning Visualization Data-driven Data Science 52

The Unofficial Google Data Science Blog

JULY 22, 2020

Another reason to use ramp-up is to test if a website's infrastructure can handle deploying a new arm to all of its users. The website wants to make sure they have the infrastructure to handle the feature while testing if engagement increases enough to justify the infrastructure.

Experimentation 95

Experimentation Statistics Testing Strategy 95

Insight

APRIL 28, 2020

Screening Data Scientists Like a Pro: By the Numbers If you’re designing an interview process for the first time, it’s tempting to design a long and perfectly precise screening process so you’re blown away by those most battle-tested candidates who interview onsite.

Data-driven 53

Data-driven Data Science Experimentation Measurement 53

Occam's Razor

FEBRUARY 26, 2008

" Or " I proposed testing / surveys / competitive intelligence / Analysts but I was shot down." 1: Implement a Experimentation & Testing Program. # 1: Implement a Experimentation & Testing Program. Here is data from our latest test." And now you have no excuse to avoid testing.

Management 68

Management Experimentation Testing Strategy 68

CIO Business Intelligence

SEPTEMBER 19, 2023

Columbia University professor David Rogers, author of Digital Transformation Playbook and The Digital Transformation Roadmap , published in September, says it doesn’t have to be that way. They should rather manage through experimentation. They skip the planning process, sketch out the vision in one week and build the first tests.

Digital Transformation 130

Digital Transformation Uncertainty Testing Enterprise 130

DataRobot Blog

MARCH 16, 2023

We’ve tightened the loop between ML data prep , experimentation and testing all the way through to putting models into production. Secure, Seamless, and Scalable ML Data Preparation and Experimentation Now DataRobot and Snowflake customers can maximize their return on investment in AI and their cloud data platform.

Modeling 52

Modeling Experimentation Machine Learning Data-driven 52

CIO Business Intelligence

APRIL 5, 2023

Midjourney, ChatGPT, Bing AI Chat, and other AI tools that make generative AI accessible have unleashed a flood of ideas, experimentation and creativity. Testing is another area that tends to get neglected, so automated unit test generation will help you get much broader test coverage.

Modeling 111

Modeling Testing Cost-Benefit Experimentation 111

AWS Big Data

JULY 26, 2023

From preview to GA and beyond Today, we are excited to announce the preview of the vector engine, making it available for you to begin testing it out immediately. We recognize that many of you are in the experimentation phase and would like a more economical option for dev-test.

Metadata 52

Metadata Cost-Benefit Testing Metrics 52

Occam's Razor

JUNE 6, 2007

I am thrilled to say that my book Web Analytics: An Hour A Day has been published and is now widely available. Experimentation & Testing (A/B, Multivariate, you name it). What ideas to test first on your site? Thrilled is perhaps understating it, I am giddy like a schoolgirl. There I said it. Clicks and outcomes.

Analytics 60

Analytics Metrics Marketing Dashboards 60

The Unofficial Google Data Science Blog

APRIL 16, 2019

by MICHAEL FORTE Large-scale live experimentation is a big part of online product development. In fact, this blog has published posts on this very topic. This means a small and growing product has to use experimentation differently and very carefully. This blog post is about experimentation in this regime.

Experimentation 68

Experimentation Sales Metrics Measurement 68

CIO Business Intelligence

DECEMBER 6, 2023

But these Guardian polls appear to have been published on Microsoft properties with millions of visitors by automated systems with no human approval required. Generative AI can certainly make developers more productive, too, whether exploring a new code base, filling in boilerplate code, autocompleting functions, or generating unit tests.

IT 133

IT Risk Management Interactive Modeling 133

O'Reilly on Data

JULY 25, 2023

My student and I recently published a research paper on this topic, which we summarized in our Radar article Teaching Programming in the Age of ChatGPT. Swift Papers felt like a well-scoped project to test how well AI handles a realistic yet manageable real-world programming task. using “22” for the year 2022).

Consulting 246

Consulting Interactive Software IT 246

Domino Data Lab

JULY 28, 2021

The ability to quickly and freely innovate is key here, since this is where ideas are researched, discussed, tested, refined and then researched again. The Workbench is Domino’s notebook-based environment where data scientists can do their R&D and experimentation. Have a question? Get in touch with us.

Data Science 59

Data Science Enterprise Modeling Experimentation 59

DataRobot Blog

FEBRUARY 15, 2023

The DataRobot AI catalog fosters collaboration by providing users a system of record for datasets, the ability to publish and share datasets with colleagues, tag datasets, and manage the lineage of the dataset throughout the entire project. This helps with getting more creative with your experimentation.

Modeling 52

Modeling Machine Learning Cost-Benefit Metrics 52

Domino Data Lab

MAY 8, 2019

So much work in machine learning – either on the academic side which is focused on publishing papers or the industry side which is focused on ROI – tends to emphasize: How much predictive power (precision, recall) does the model have? If you invest enough time into modeling, you can often find relatively simple models for a given problem.

Machine Learning 105

Machine Learning Data Science Modeling Visualization 105

datapine

FEBRUARY 4, 2020

A daily marketing report will also allow you for faster experimentation: running small operations to answer small questions. With this marketing report template, you can get a clear overview of all the content stages before and after publishing. from your campaigns, various tests, and mistakes.

Reporting 280

Reporting Marketing Advertising Metrics 280

Sisense

MAY 18, 2021

However, as Deven states, avoiding data insights and going with your gut is like choosing all the wrong answers on a test despite your professor giving you the right ones. When you discover data that means something, you need to be agile enough to make experimental changes.”. Data can’t help your marketing efforts if you won’t let it.

Marketing 52

Marketing Data Analytics Analytics Metrics 52

Occam's Razor

OCTOBER 23, 2006

Be incessantly focussed on your company customers and dragging their voice to the table (for example via experimentation and testing or via open ended survey questions). Get competitive data (we are at x% of zz metric and our competition is at x+9% of zz metric). 4 Proactive insights rather than reactive. 1: Got Process?

Data-driven 117

Data-driven Metrics KPI Reporting 117

CIO Business Intelligence

APRIL 15, 2024

Given the speed required, Lowden established a specialized team for the project to encourage a culture of experimentation and “moving fast to learn fast.” “You The Tax Institute studies and analyzes the constantly shifting landscape of federal and state tax laws and publishes articles on how to deal with them.

Testing 101

Testing Experimentation Data Quality Machine Learning 101

Occam's Razor

JANUARY 9, 2012

Lack of loyalty shows simply re-publishing AP stories is useless. Allocate some of your aforementioned 15% budget to experimentation and testing. . #1 Customer expectations on the web are insane, will get super-insane. We expect more. High bounce rates show how horrible slow-loading websites are.

Marketing 140

Marketing B2B Measurement Risk 140

The Unofficial Google Data Science Blog

OCTOBER 12, 2017

Yet when we use these tools to explore data and look for anomalies or interesting features, we are implicitly formulating and testing hypotheses after we have observed the outcomes. We must correct for multiple hypothesis tests. Make experimentation cheap and understand the cost of bad decisions. We ought not dredge our data.

Experimentation 61

Experimentation Testing Statistics Metrics 61

Occam's Razor

NOVEMBER 2, 2015

Higher Order Bits: Human vs. Business, Success KPIs, S-T-D-C Framework, MoR Test. It is pronounced the more test. It is an acronym for a test I often use in my consulting engagements. It stands for: Money off Roof test. Google SMB channel on Facebook fails (massively) the MoR test. Facebook for Businesses.

B2B 167

B2B Metrics Testing Recreation/Entertainment 167

Occam's Razor

APRIL 29, 2013

If the simple A/B (test/control) experiment demonstrates that delivering display banner ad impressions to the test group delivers increased revenue, buy impressions to your heart's content. And I'll be extra sweet to you, the display/video impressions don't even have to be last click!

Marketing 166

Marketing Metrics Advertising Measurement 166

Occam's Razor

OCTOBER 12, 2017

The tiny downside of this is that our parents likely never had to invest as much in constant education, experimentation and self-driven investment in core skills. The first two are from editions of my newsletter, The Marketing – Analytics Intersect (it goes out weekly, and is now my primary publishing channel, sign up!).

Marketing 136

Marketing Analytics Machine Learning Strategy 136