This course introduces you to the Transformer architecture and the Bidirectional Encoder Representations from Transformers (BERT) model. You learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it is used to build the BERT model. You also learn about the different tasks that BERT can be used for, such as text classification, question answering, and natural language inference. This course is estimated to take approximately 45 minutes to complete.
Transformer Models and BERT Model
Transformer Models and BERT Model
Instructor: Google Cloud Training
11,147 already enrolled
Included with 
Gain insight into a topic and learn the fundamentals.
4.1
(119 reviews)
Advanced level
Designed for those already in the industry
1 hour to complete
Flexible schedule
Learn at your own pace
What you'll learn
Understand the main components of the Transformer architecture.
Learn how a BERT model is built using Transformers.
Use BERT to solve different natural language processing (NLP) tasks.
Skills you'll gain
Details to know
Shareable certificate
Add to your LinkedIn profile
Assessments
1 assignment
Taught in English
See how employees at top companies are mastering in-demand skills
There is 1 module in this course
In this module you will learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it is used to build the BERT model. You also learn about the different tasks that BERT can be used for, such as text classification, question answering, and natural language inference.
What's included
2 videos1 reading1 assignment
Earn a career certificate
Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.
Instructor
Instructor ratings
4.3 (25 ratings)Offered by
Explore more from Cloud Computing
Status: Free Trial
Status: PreviewGoogle Cloud
Status: Preview
Status: PreviewGoogle Cloud
Why people choose Coursera for their career
Felipe M.
Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."
Learner reviews
4.1
119 reviews
- 5 stars
57.98%
- 4 stars
20.16%
- 3 stars
7.56%
- 2 stars
5.88%
- 1 star
8.40%
Showing 3 of 119
WC
4
Reviewed on Mar 13, 2024
Excellent and concise presentation of Transformer and BERT models. The course designer may consider adding programming assignments to illustrate the concepts and to reinforce student learning.
RR
5
Reviewed on Jul 22, 2025
it is a short but very effective video. the content is crisp and easy to understand if you have decent understanding of NN.
NK
4
Reviewed on May 14, 2025
I am looking for free resources for experimentation, or a lighter model that can run on my laptop.
Open new doors with Coursera Plus
Unlimited access to 10,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription
Advance your career with an online degree
Earn a degree from world-class universities - 100% online
Join over 3,400 global companies that choose Coursera for Business
Upskill your employees to excel in the digital economy
Frequently asked questions
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
If you subscribed, you get a 7-day free trial during which you can cancel at no penalty. After that, we don’t give refunds, but you can cancel your subscription at any time. See our full refund policy.
More questions
Financial aid available,