No prior experience with computer vision is assumed, although previous knowledge of visual computing or signal processing will be helpful. The following skills are necessary for this class:

• Math: Linear algebra, vector calculus, and probability. Linear algebra is the most important.
• Data structures: Students will write code that represents images as feature and geometric constructions.
• Programming: A good working knowledge. All lecture code and project starter code will be Python, and Pytorch for Deep Learning, but student familiar with other frameworks such as tensorflow is ok. 

Computer Vision today is everywhere in our society and images have become pervasive, with applications in several sectors; just to mention some in: apps, drones, healthcare and precision medicine, precision agricolture, searching, understanding, control in robotics and self-driving cars.

The course introduces the basics of image formation, reconstruction and inferring motion models, as well as camera calibration theory and practice.

Recent developments in neural networks (Deep Learning) have considerably boosted the performance of the visual recognition systems in tasks such as: classification, localisation, detection, segmentation etc. Students will learn the building blocks of a general convolutional neural network, the way how it is trained and optimized, how to prepare a dataset and how to measure the final performance.

Upon completion of this course, students will:

1. Be familiar with both the theoretical and practical aspects of computing with images;
2. Have described the foundation of image formation, measurement, and analysis;
3. Have implemented common methods for robust image matching and alignment;
4. Understand the geometric relationships between 2D images and the 3D world;
5. Have gained exposure to object and scene recognition and categorization from images;
6. Grasp the principles of state-of-the-art deep neural networks; and
7. Developed the practical skills necessary to build computer vision applications.

Teaching is based on theoretical and practical lectures. The student will write in python algorithms taught in class

Oral session. The student will explain the developed project and shall answer two or more questions regarding theoretical aspects of the studied topics

The student must develop a project by choosing a practical simple application with some algorithms done during the course. The choice is at total disposal of the student, as well as the fact of developing it in group os solo. In group setting the students must proof their own activities developed in the common project application.

The final examination is based on oral assessment of the topics covered during lectures.

For the LAB practice, students may use for the deep learning development the Google Colab or Cloud Platform.

Introduction to Computer Vision

Camera models and colors

Image Filtering

Fourier - image pyramids and blending

Detecting Corners

2D and 3D geometric primitives - Projections

Operations with images

Image Alignment - warping, homography estimation direct linear transform robust motion estimation with Ransac - perspective n point problem. Registration examples: face recognition, medical imaging

Camera Calibration - distortion models and compensations - linear methods for camera parameters. Calibration with a checkerboard

LAB - SIFT and camera calibration

Multiview geometry - Epipolar geometry, position error estimation, stereo rig, Essential matrix estimation, rectification, Reconstruction, correspondense problem, weak calibration and ransac estimation of fundamental matrix

Image Classification - Key nearest neighbor, linear classifiers

LAB - Canny edge detection, Hough Transform

Image Classification - loss functions, optimization with stochastic gradient descent

neural networks

LAB - Introduction to Pytorch framework

backpropagation, computational graphs and gradient estimation

Image Classification - Convolutional Neural Network architecture

Normalization; Image Classification - CNN architectures (Alexnet, VGG, GoogleNet, ResNET, DenseNet, SENet, EfficientNet), Siamese Architectures (applications to face verification, people and vehicle re-identification)

LAB - CNN

Recurrent networks- RNN, LSTM, GRU
Language modeling
Sequence-to-sequence
Image captioning

Attention Multimodal attention
Self-Attention
Transformers

Object detection Transfer learning
Object detection task
R-CNN detector
Non-Max Suppression (NMS)
Mean Average Precision (mAP)
Single-stage vs two-stage detectors
YOLO
Region Proposal Networks (RPN), Anchor Boxes
Two-Stage Detectors: Fast R-CNN, Faster R-CNN
Feature Pyramid Networks

LAB - Object detection

Object segmentation - Single-Stage Detectors: RetinaNet, FCOS
Semantic segmentation
Instance segmentation
Keypoint estimation

LAB - Deep Learning application to segmentation

Generative Models
Supervised vs Unsupervised learning
Discriminative vs Generative models
Autoregressive models
Variational Autoencoders

Motion estimation, Optical flow

Diffusion models

3D Vision - 3D shape representations
Depth estimation
3D shape prediction
Voxels, Pointclouds, SDFs, Meshes
Implicit functions, NeRF

Videos
Video classification
Early / Late fusion
3D CNNs
Two-stream networks
Transformer-based models

Reinforcement learning

 

There is no requirement to buy a book. The goal of the course is to be self contained, but sections from the following textbooks will be suggested for more formalization and information.

The primary course text will be Rick Szeliski’s draft Computer Vision: Algorithms and Applications 2nd Edition 2022; we will use an online copy (fill the form) at this link. 

We will be using Piazza for all course notes, homework and final project. 

A copy and link will be provided in website.  

A textbook for Deep Learning with Pytorch script can be accessed at this link

Deep Learning, MIT Press book, Ian Goodfellow and Yoshua Bengio and Aaron Courville

 

 

 

No prior experience with computer vision is assumed, although previous knowledge of visual computing or signal processing will be helpful. The following skills are necessary for this class:

• Math: Linear algebra, vector calculus, and probability. Linear algebra is the most important.
• Data structures: Students will write code that represents images as feature and geometric constructions.
• Programming: A good working knowledge. All lecture code and project starter code will be Python, and Pytorch for Deep Learning, but student familiar with other frameworks such as tensorflow is ok. 

Computer Vision today is everywhere in our society and images have become pervasive, with applications in several sectors; just to mention some in: apps, drones, healthcare and precision medicine, precision agricolture, searching, understanding, control in robotics and self-driving cars.

The course introduces the basics of image formation, reconstruction and inferring motion models, as well as camera calibration theory and practice.

Recent developments in neural networks (Deep Learning) have considerably boosted the performance of the visual recognition systems in tasks such as: classification, localisation, detection, segmentation etc. Students will learn the building blocks of a general convolutional neural network, the way how it is trained and optimized, how to prepare a dataset and how to measure the final performance.

Upon completion of this course, students will:

1. Be familiar with both the theoretical and practical aspects of computing with images;
2. Have described the foundation of image formation, measurement, and analysis;
3. Have implemented common methods for robust image matching and alignment;
4. Understand the geometric relationships between 2D images and the 3D world;
5. Have gained exposure to object and scene recognition and categorization from images;
6. Grasp the principles of state-of-the-art deep neural networks; and
7. Developed the practical skills necessary to build computer vision applications.

Teaching is based on theoretical and practical lectures. The student will write in python algorithms taught in class

Oral session. The student will explain the developed project and shall answer two or more questions regarding theoretical aspects of the studied topics

The student must develop a project by choosing a practical simple application with some algorithms done during the course. The choice is at total disposal of the student, as well as the fact of developing it in group os solo. In group setting the students must proof their own activities developed in the common project application.

The final examination is based on oral assessment of the topics covered during lectures.

For the LAB practice, students may use for the deep learning development the Google Colab or Cloud Platform.

Introduction to Computer Vision

Image Formation

2D and 3D geometric primitives - Projections

Color perception, color spaces and processing

Image Filtering

LAB Introduction to Python and Operations with images

interpolation, optimization, image pyramids and blending

Machine learning

LAB (pytorch basics? Dataloaders, ML?, T-sne?)

 loss functions, optimization with stochastic gradient descent

backpropagation and neural networks, computational graphs and gradient estimation

Convolutional Neural Network, CNN activation functions, data preprocessing, weight normalization, batch normalization, monitoring the learning process, hyperparameter optimization, Regularization (Dropout, drop connect, fractional pooling, cotout, mixup)

CNN architectures (Alexnet, VGG, GoogleNet, ResNET, DenseNet,  SENet, EfficientNet), Siamese Architectures (applications to face verification, people and vehicle re-identification)

LAB CNN

Recurrent neural networks, Attention mechanisms

Object detection and segmentation

LAB - object detection - segmentation

Generative Models

edges, feature matching Ransac and alignment

Optical flow, 3D, Depth perception and stereo

SLAM/SfM

Camera Calibration - distortion models and compensations - linear methods for camera parameters. Calibration with a checkerboard

LAB camera calib

3D shapes 

 

There is no requirement to buy a book. The goal of the course is to be self contained, but sections from the following textbooks will be suggested for more formalization and information.

The primary course text will be Rick Szeliski’s draft Computer Vision: Algorithms and Applications 2nd Edition 2022; we will use an online copy (fill the form) at this link. 

We will be using Piazza for all course notes, homework and final project. 

A copy and link will be provided in website.  

A textbook for Deep Learning with Pytorch script can be accessed at this link

Deep Learning, MIT Press book, Ian Goodfellow and Yoshua Bengio and Aaron Courville

 

 

 

No prior experience with computer vision is assumed, although previous knowledge of visual computing or signal processing will be helpful. The following skills are necessary for this class:

• Math: Linear algebra, vector calculus, and probability. Linear algebra is the most important.
• Data structures: Students will write code that represents images as feature and geometric constructions.
• Programming: A good working knowledge. All lecture code and project starter code will be Python, and Pytorch for Deep Learning, but student familiar with other frameworks such as tensorflow is ok. 

Computer Vision today is everywhere in our society and images have become pervasive, with applications in several sectors; just to mention some in: apps, drones, healthcare and precision medicine, precision agricolture, searching, understanding, control in robotics and self-driving cars.

The course introduces the basics of image formation, reconstruction and inferring motion models, as well as camera calibration theory and practice.

Recent developments in neural networks (Deep Learning) have considerably boosted the performance of the visual recognition systems in tasks such as: classification, localisation, detection, segmentation etc. Students will learn the building blocks of a general convolutional neural network, the way how it is trained and optimized, how to prepare a dataset and how to measure the final performance.

Upon completion of this course, students will:

1. Be familiar with both the theoretical and practical aspects of computing with images;
2. Have described the foundation of image formation, measurement, and analysis;
3. Have implemented common methods for robust image matching and alignment;
4. Understand the geometric relationships between 2D images and the 3D world;
5. Have gained exposure to object and scene recognition and categorization from images;
6. Grasp the principles of state-of-the-art deep neural networks; and
7. Developed the practical skills necessary to build computer vision applications.

Teaching is based on theoretical and practical lectures. The student will write in python algorithms taught in class

Oral session. The student will explain the developed project and shall answer two or more questions regarding theoretical aspects of the studied topics

The student must develop a project by choosing a practical simple application with some algorithms done during the course. The choice is at total disposal of the student, as well as the fact of developing it in group os solo. In group setting the students must proof their own activities developed in the common project application.

The final examination is based on oral assessment of the topics covered during lectures.

For the LAB practice, students may use for the deep learning development the Google Colab or Cloud Platform.

Introduction to Computer Vision

Image Formation

2D and 3D geometric primitives - Projections

image enhancement

LAB Introduction to Python and Operations with images

Color perception, color spaces and processing

Image Filtering

image pyramids and blending

Local feature detector

LAB SIFT with MatLab Find image rotation & scale SURF Object Detection

Image Alignment I- warping, homography estimation direct linear transform

Image Alignment II- robust motion estimation with Ransac - perspective n point problem. Registration examples: face recognition, medical imaging

Camera Calibration - distortion models and compensations - linear methods for camera parameters. Calibration with a checkerboard

LAB Mosaicking with SURF Face Detection and Tracking (Nose Skin) Face Detection and Tracking withKanade - Lucas - Tomasi feature tracker

Motion Analysis and background modelling, application to intelligent videosurveillance 

Multiview geometry - Epipolar geometry, position error estimation, stereo rig, Essential matrix estimation, rectification, Reconstruction, correspondense problem, weak calibration and ransac estimation of fundamental matrix

LAB - Camera calibration

Image Classification - Key nearest neighbor, linear classifiers

Image Classification - loss functions, optimization with stochastic gradient descent

LAB - Stereo calibration and reconstruction

Image Classification - backpropagation and neural networks, computational graphs and gradient estimation

Image Classification - Convolutional Neural Network architecture

Image Classification - CNN activation functions, data preprocessing, weight normalization, batch normalization, monitoring the learning process, hyperparameter optimization, Regularization (Dropout, drop connect, fractional pooling, cotout, mixup)

Image Classification - CNN activation functions, data preprocessing, weight normalization, batch normalization, monitoring the learning process, hyperparameter optimization, Regularization (Dropout, drop connect, fractional pooling, cotout, mixup)

Image Classification - Object detection and Image segmentation with Convolutional neural networks. Introduction to auto-encoders

LAB - Introduction to Pytorch framework

LAB - Deep learning applications to object detection (Yolo and Faster R-CNN)

LAB - Deep Learning application to segmentation with mark R-CNN

 

There is no requirement to buy a book. The goal of the course is to be self contained, but sections from the following textbooks will be suggested for more formalization and information.

The primary course text will be Rick Szeliski’s draft Computer Vision: Algorithms and Applications; we will use an online copy of the June 19th draft.  A copy and link will be provided in website.  The secondary  text is Forsyth and Ponce, Computer Vision: A Modern Approach (new Edition coming out in 2020)

Deep Learning, MIT Press book, Ian Goodfellow and Yoshua Bengio and Aaron Courville

 

 

No prior experience with computer vision is assumed, although previous knowledge of visual computing or signal processing will be helpful. The following skills are necessary for this class:

• Math: Linear algebra, vector calculus, and probability. Linear algebra is the most important.
• Data structures: Students will write code that represents images as feature and geometric constructions.
• Programming: A good working knowledge. All lecture code and project starter code will be Python, and Pytorch for Deep Learning, but student familiar with other frameworks such as tensorflow is ok. 

Computer Vision today is everywhere in our society and images have become pervasive, with applications in several sectors; just to mention some in: apps, drones, healthcare and precision medicine, precision agricolture, searching, understanding, control in robotics and self-driving cars.

The course introduces the basics of image formation, reconstruction and inferring motion models, as well as camera calibration theory and practice.

Recent developments in neural networks (Deep Learning) have considerably boosted the performance of the visual recognition systems in tasks such as: classification, localisation, detection, segmentation etc. Students will learn the building blocks of a general convolutional neural network, the way how it is trained and optimized, how to prepare a dataset and how to measure the final performance.

Upon completion of this course, students will:

1. Be familiar with both the theoretical and practical aspects of computing with images;
2. Have described the foundation of image formation, measurement, and analysis;
3. Have implemented common methods for robust image matching and alignment;
4. Understand the geometric relationships between 2D images and the 3D world;
5. Have gained exposure to object and scene recognition and categorization from images;
6. Grasp the principles of state-of-the-art deep neural networks; and
7. Developed the practical skills necessary to build computer vision applications.

Teaching is based on theoretical and practical lectures. The student will write in python algorithms taught in class

Oral session. The student will explain the developed project and shall answer two or more questions regarding theoretical aspects of the studied topics

The student must develop a project by choosing a practical simple application with some algorithms done during the course. The choice is at total disposal of the student, as well as the fact of developing it in group os solo. In group setting the students must proof their own activities developed in the common project application.

The final examination is based on oral assessment of the topics covered during lectures.

For the LAB practice, students may use for the deep learning development the Google Colab or Cloud Platform.

Introduction to Computer Vision

Image Formation

2D and 3D geometric primitives - Projections

image enhancement

LAB Introduction to Python and Operations with images

Color perception, color spaces and processing

Image Filtering

image pyramids and blending

Local feature detector

LAB SIFT with MatLab Find image rotation & scale SURF Object Detection

Image Alignment I- warping, homography estimation direct linear transform

Image Alignment II- robust motion estimation with Ransac - perspective n point problem. Registration examples: face recognition, medical imaging

Camera Calibration - distortion models and compensations - linear methods for camera parameters. Calibration with a checkerboard

LAB Mosaicking with SURF Face Detection and Tracking (Nose Skin) Face Detection and Tracking withKanade - Lucas - Tomasi feature tracker

Motion Analysis and background modelling, application to intelligent videosurveillance 

Multiview geometry - Epipolar geometry, position error estimation, stereo rig, Essential matrix estimation, rectification, Reconstruction, correspondense problem, weak calibration and ransac estimation of fundamental matrix

LAB - Camera calibration

Image Classification - Key nearest neighbor, linear classifiers

Image Classification - loss functions, optimization with stochastic gradient descent

LAB - Stereo calibration and reconstruction

Image Classification - backpropagation and neural networks, computational graphs and gradient estimation

Image Classification - Convolutional Neural Network architecture

Image Classification - CNN activation functions, data preprocessing, weight normalization, batch normalization, monitoring the learning process, hyperparameter optimization, Regularization (Dropout, drop connect, fractional pooling, cotout, mixup)

Image Classification - CNN activation functions, data preprocessing, weight normalization, batch normalization, monitoring the learning process, hyperparameter optimization, Regularization (Dropout, drop connect, fractional pooling, cotout, mixup)

Image Classification - Object detection and Image segmentation with Convolutional neural networks. Introduction to auto-encoders

LAB - Introduction to Pytorch framework

LAB - Deep learning applications to object detection (Yolo and Faster R-CNN)

LAB - Deep Learning application to segmentation with mark R-CNN

 

There is no requirement to buy a book. The goal of the course is to be self contained, but sections from the following textbooks will be suggested for more formalization and information.

The primary course text will be Rick Szeliski’s draft Computer Vision: Algorithms and Applications; we will use an online copy of the June 19th draft.  A copy and link will be provided in website.  The secondary  text is Forsyth and Ponce, Computer Vision: A Modern Approach (new Edition coming out in 2020)

Deep Learning, MIT Press book, Ian Goodfellow and Yoshua Bengio and Aaron Courville

 

 

The goal of image processing class is to provide the fundamentals of developing an intelligent machine vision system. The goal is to study and analyse images and videos to understand their content and derive 3D information. Problems in this field concern the identification of 3D shapes of an acquired scene, to determine how objects move, and recognize objects through the analysis of still images or a sequence of them (ie through static and / or time-varying information). The course provides an introduction to classical image processing techniques and end up to introduce the Deep Learning methodologies that are nowadays at the basis of all the disrupting innovations in several sectors: self-driving cars, security for face recognition and behaviour understanding, precision medicine and agricolture etc

at the end of the course the student will be able to:
be familiar with the theoretical and practical aspects of image processing; have acquired the basics of the image formation process and understand the relationships between the 2D and 3D world; have acquired the essential ingredients to develop a processing pipeline to locate, recognize and track objects of interest.
Having acquired the basic principles of Deep Neural Networks (Deep Learning) and transfer learning in order to build intelligent vision systems

Introduzione ai sistemi di visione artificiale (2 ore); Formazione dell’immagine (3 ore); Geometria proiettiva 2D e 3D (3 ore); Miglioramento della qualità delle immagini (2 ore); analisi delle immagini a colori (2 ore); Filtraggio nello spazio e nel dominio delle frequenze (4 ore); Piramidi Gaussiane e Laplaciane (3 ore); Local feature detector (4 ore); Allineamento (4 ore); Segmentazione (3 ore); analisi della tessitura (2 ore); analisi del movimento (4 ore); structure from motion (2 ore); multi-view geometry (2); Riconoscimento automatico (2) Deep Learning (8 ore); Tracking (2 ore).

[1] Richard Szeliski, Computer Vision: Algorithms and Applications, Springer 2010.

[2] Deep Learning, by Goodfellow, Bengio, and Courville.

[2] Dictionary of Computer Vision and Image Processing, by Fisher et al. Note: Full text is available in 'Online Resources' section.