article thumbnail

6 trends framing the state of AI and ML

O'Reilly on Data

Our analysis of ML- and AI-related data from the O’Reilly online learning platform indicates: Unsupervised learning surged in 2019, with usage up by 172%. Deep learning cooled slightly in 2019, slipping 10% relative to 2018, but deep learning still accounted for 22% of all AI/ML usage.

article thumbnail

ChatGPT, the rise of generative AI

CIO Business Intelligence

A transformer is a type of AI deep learning model that was first introduced by Google in a research paper in 2017. ChatGPT was trained with 175 billion parameters; for comparison, GPT-2 was 1.5B (2019), Google’s LaMBDA was 137B (2021), and Google’s BERT was 0.3B (2018). What is ChatGPT? ChatGPT is a product of OpenAI.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Interview with: Sankar Narayanan, Chief Practice Officer at Fractal Analytics

Corinium

It is also important to have a strong test and learn culture to encourage rapid experimentation. A playbook for this is to run multiple experiments in parallel and create ‘MVPs’ (fail/learn fast), as well as incorporate feedback mechanisms to enable an improvement loop, and scaling the ones that show the fastest path to ROI.

Insurance 250
article thumbnail

AI Adoption in the Enterprise 2021

O'Reilly on Data

We’ll look at this later, but being able to reproduce experimental results is critical to any science, and it’s a well-known problem in AI. In contrast, in our 2018 report, Asia was behind in mature practices, though it had a markedly higher number of respondents in the “early adopter” or “exploring” stages. Bottlenecks to AI adoption.

article thumbnail

Deep Learning Illustrated: Building Natural Language Processing Models

Domino Data Lab

Many thanks to Addison-Wesley Professional for providing the permissions to excerpt “Natural Language Processing” from the book, Deep Learning Illustrated by Krohn , Beyleveld , and Bassens. The excerpt covers how to create word vectors and utilize them as an input into a deep learning model. Introduction.

article thumbnail

Themes and Conferences per Pacoid, Episode 11

Domino Data Lab

AutoPandas was created at UC Berkeley RISElab and the general idea is described in the NeurIPS 2018 paper “ Neural Inference of API Functions from Input–Output Examples ” by Rohan Bavishi, Caroline Lemieux, Neel Kant, Roy Fox, Koushik Sen, and Ion Stoica. Program Synthesis Papers at ICLR 2018 ” – Illia Polosukhin (2018-05-01).

Metadata 105
article thumbnail

Topics to watch at the Strata Data Conference in New York 2019

O'Reilly on Data

So, we used a form of the Term Frequency-Inverse Document Frequency (TF/IDF) technique to identify and rank the top terms in this year’s Strata NY proposal topics—as well as those for 2018, 2017, and 2016. 2) is unchanged from Strata NY 2018, it’s up three places from Strata NY 2017—and eight places relative to 2016. 221) to 2019 (No.

IoT 20