Show all

Natural Language Processing II

In this course, we will follow up on the basic Natural Language Processing course with more advanced topics.
Level
Designed for participants with basic knowledge and experience
intermediate
Course length
1 day
Language
 cz  eu
Course code
PU22110123
Machine Learning
Category:
Do you want this tailor-made course to your company? Contact us

Courses with lecturer

Term
Language
Place
Form
?
How and where the course takes place.
Price without VAT
Open term
?
We will agree on a specific date together. This is a non-binding order.
Language
Place
online
Form
virtual classroom
?
Online training with a lecturer at a specific time.
Code of the course: PU22110123-0001
Price without VAT
4 990 Kč
Open term
?
We will agree on a specific date together. This is a non-binding order.
Language
Place
online
Form
virtual classroom
?
Online training with a lecturer at a specific time.
Code of the course: PU22110123-0002
Price without VAT
4 990 Kč

Course description

We will mainly focus on data preprocessing and the latest applications of deep learning in text processing. It will mainly be about the architecture of neural networks built on the so-called Transformers. Using the transfer learning method, we will show how large pre-trained neural networks can be used for various practical applications.

Required knowledge

  • Basic knowledge of Python programming
  • High School Mathematics
  • Course-level knowledge of machine learning Introduction to Machine Learning
  • Course-level knowledge Natural Language Processing

Course content

Preprocessing of text data
  • Character encoding and unicode normalization
  • Traditional tokenization (simple methods, Spacy, Moses)
  • Subword tokenization (byte-pair encoding, wordpiece, sentencepiece)
  • Data cleaning (deduplication, removal of text ballast)
Word embeddings
  • General principles
  • Implementation of the skip-gram model
Machine translation with recurrent networks
  • LSTM and GRU memory cells
  • Implementation of machine translation using recurrent networks
Transformers
  • Attention is all you need
  • Transformer architecture
  • GPT2
  • BERT
  • XLNET
Examples of transfer learning for natural language processing
  • Classification of texts
  • Recognizing named entities
  • Question answering

Lecturers

Jiří Materna
Jiří Materna

He is a machine learning specialist with experience in its applications in industry since 2007. Between 2008 and 2017, he worked at Seznam.cz, of which the last 7 years as head of the research department. He now works as a freelancer, offers the development of custom machine learning solutions, organizes the Machine Learning Prague conference and writes the ML Guru blog. 

Do you want this tailor-made course for your company?

Contact us

News with the course

Náhledový obrázek novinky
Artificial intelligence (AI) 15. 11. 2024
The practical application of AI: HubSpot increased lead conversion rate

HubSpot is an American software development company. It has 8,000 employees and branches in several countries around the world. Processes related to lead generation and qualification were time-consuming and not always efficient, reducing sales productivity.

Náhledový obrázek novinky
Artificial intelligence (AI) 17. 10. 2024

AI in practice: DHL has accelerated the delivery of parcels

DHL is one of the largest logistics companies in the world. It provides transportation and delivery of parcels in many countries. However, route planning, warehouse management and demand forecasting were difficult and often inefficient.

Náhledový obrázek novinky
Artificial intelligence (AI) 12. 9. 2024
The practical application of AI: Microsoft increases financial prediction accuracy by 20%

Microsoft, a global tech giant, faced challenges with its complex financial processes, which involved extensive financial planning and analysis (FP&A). Traditional methods were time-consuming and sometimes inaccurate, leading to delayed decisions and potential financial risks.

Previous courses

Do you want this tailor-made course for your company?

Contact us

News with the course

Náhledový obrázek novinky
Artificial intelligence (AI) 15. 11. 2024
The practical application of AI: HubSpot increased lead conversion rate

HubSpot is an American software development company. It has 8,000 employees and branches in several countries around the world. Processes related to lead generation and qualification were time-consuming and not always efficient, reducing sales productivity.

Náhledový obrázek novinky
Artificial intelligence (AI) 17. 10. 2024

AI in practice: DHL has accelerated the delivery of parcels

DHL is one of the largest logistics companies in the world. It provides transportation and delivery of parcels in many countries. However, route planning, warehouse management and demand forecasting were difficult and often inefficient.

Náhledový obrázek novinky
Artificial intelligence (AI) 12. 9. 2024
The practical application of AI: Microsoft increases financial prediction accuracy by 20%

Microsoft, a global tech giant, faced challenges with its complex financial processes, which involved extensive financial planning and analysis (FP&A). Traditional methods were time-consuming and sometimes inaccurate, leading to delayed decisions and potential financial risks.

Why with us