IBM
Gen AI Foundational Models for NLP & Language Understanding

Early bird sale! Unlock 10,000+ courses from Google, IBM, and more for 50% off. Save today.

IBM

Gen AI Foundational Models for NLP & Language Understanding

Joseph Santarcangelo
Fateme Akbari

Instructors: Joseph Santarcangelo

12,446 already enrolled

Included with Coursera Plus

Gain insight into a topic and learn the fundamentals.
4.4

(119 reviews)

Intermediate level

Recommended experience

9 hours to complete
3 weeks at 3 hours a week
Flexible schedule
Learn at your own pace
Gain insight into a topic and learn the fundamentals.
4.4

(119 reviews)

Intermediate level

Recommended experience

9 hours to complete
3 weeks at 3 hours a week
Flexible schedule
Learn at your own pace

What you'll learn

  • Explain how one-hot encoding, bag-of-words, embeddings, and embedding bags transform text into numerical features for NLP models

  • Implement Word2Vec models using CBOW and Skip-gram architectures to generate contextual word embeddings

  • Develop and train neural network-based language models using statistical N-Grams and feedforward architectures

  • Build sequence-to-sequence models with encoder–decoder RNNs for tasks such as machine translation and sequence transformation

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

5 assignments

Taught in English

See how employees at top companies are mastering in-demand skills

 logos of Petrobras, TATA, Danone, Capgemini, P&G and L'Oreal

Build your subject-matter expertise

This course is available as part of
When you enroll in this course, you'll also be asked to select a specific program.
  • Learn new concepts from industry experts
  • Gain a foundational understanding of a subject or tool
  • Develop job-relevant skills with hands-on projects
  • Earn a shareable career certificate

There are 2 modules in this course

In this module, you will explore the foundational techniques and tools that enable machines to understand and process human language. You will learn about one-hot encoding, bag-of-words, embeddings, and embedding bags. You’ll begin by converting text into numerical features, move into document categorization using TorchText, and continue through to model training with PyTorch. The module also introduces you to language modeling using N-Gram models, both statistically and through neural networks. The hands-on labs will reinforce your learning by walking you through implementations in Python using PyTorch and related libraries.

What's included

7 videos4 readings3 assignments3 app items1 plugin

In this module, you will explore advanced neural techniques for language representation and understanding. You’ll begin by learning how Word2Vec models capture word semantics using context-based prediction. Then you’ll transition into sequence-to-sequence modeling with recurrent neural networks (RNNs) and encoder-decoder architectures, which enable tasks like translation. You’ll also investigate how to evaluate generated text using established NLP metrics and reflect on ethical concerns surrounding word embeddings. The labs will provide hands-on practice with Word2Vec integration and sequence models. In addition, the comprehensive cheat sheet and glossary will serve as quick-reference tools to reinforce your understanding of key models and concepts.

What's included

6 videos5 readings2 assignments3 app items3 plugins

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.

Instructors

Instructor ratings
4.3 (23 ratings)
Joseph Santarcangelo
IBM
35 Courses1,982,745 learners

Offered by

IBM

Explore more from Machine Learning

Why people choose Coursera for their career

Felipe M.
Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

4.4

119 reviews

  • 5 stars

    74.01%

  • 4 stars

    14.96%

  • 3 stars

    3.14%

  • 2 stars

    0%

  • 1 star

    7.87%

Showing 3 of 119

TK
5

Reviewed on Mar 6, 2025

SG
5

Reviewed on Mar 25, 2025

Coursera Plus

Open new doors with Coursera Plus

Unlimited access to 10,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Frequently asked questions