Skip to content

CSC 561: Neural Networks and Deep Learning (Spring 2024)

Acknowledgements

This class is being funded by a TensorFlow and Google AI award to support machine learning courses and diversity programs.

Placeholder

During the semester students will have access to NVIDIA's Deep Learning Institute materials.

Placeholder

Description

Recent advances in Neural Networks and Deep Learning have made it possible to develop computational solutions to complex tasks usually performed by humans. Nowadays, well-trained Deep Learning architectures are able to achieve comparable or superhuman performance in complex tasks such as image classification/recognition, natural language understanding, speech recognition, machine translation, game playing, autonomous driving, and so forth.

In this course students will learn the fundamentals of deep learning architectures, including convolutional networks, recurrent neural networks, graph neural networks, transformers, and generative AI. Along the way, this course will also provide a basic introduction to basic machine learning topics, such as, supervised/unsupervised learning, gradient descent, generalization and overfitting, regularization, and model selection.

The course is open to advanced undergraduate students and graduate students. Students are expected to have good programming skills (preferably Python) and taken courses on machine learning, probability, statistics and linear algebra.

Course Info

  • Instructor: Prof. Marco Alvarez
  • Lectures: TTh 2-3:15p @ CBLS 152
  • Office Hours: T 3:30-4:30p @ Tyler 255

Support Tools and Technology

Students enrolled in this course are required to have access to the following tools to enhance their learning experience and facilitate communication.

Placeholder Ed Discussion: hosts forums for discussions, polls, and quizzes, providing opportunities for students to interact with classmates and instructors, share insights, and test their understanding of key concepts [Ed Help].

Placeholder Gradescope: simplifies assignment submissions and grading, ensuring clear and consistent feedback from instructors. Students can review their graded work, visualize feedback points, and gain insights into their strengths and areas for improvement [Gradescope Help Center].

Effective utilization of these tools is key to optimize the learning experience. Students should familiarize themselves with each platform, actively participate in Ed Discussion and submit assignments through Gradescope by the designated deadlines.

All students are automatically registered to use the above tools. To ensure seamless access, students should rely on their primary eCampus email address as their login for all three platforms.

Grading

  • Homework Assignments (20%)
  • Midterm Exam (25%)
  • Technical Presentation (20%)
  • Final Project (35%)

Final letter grades are determined based on the cutoffs below. The final letter grade corresponds to the highest cutoff value that is less than or equal to the final grade. For example, a final grade of 93.5 would result in an A-.

A    A-    B+    B    B-    C+    C    C-    D+    D    F
94   90    87    83   80    77    73   70    67    60   0

Homework Assignments

Homework assignments are individual work, unless explicitly stated otherwise in the assignment's instructions. Students have approximately 7-10 days to complete each assignment, with specific due dates indicated on the course website.

Late submissions are not accepted. To maximize learning and gain valuable feedback, students are strongly encouraged to bring their code, solutions, or questions to the instructor's office hours prior to the due date.

Midterm Exam

The course includes a midterm examination. This individual evaluation is administered in-person and designed to be open-book, allowing students to consult any printed materials. However, electronic devices are strictly prohibited during the examinations.

To ensure fairness and equal opportunity, the provision of make-up exams is limited to rare cases where official documentation substantiates extenuating circumstances.

Technical Presentation

Students collaborate in teams of two to delve deeper into a specific research paper. Exceptions to team formation may be granted under special circumstances with written permission from the instructor.

To facilitate exploration and expertise development, the instructor provides a curated list of potential research papers from which teams can make their selection. Each team's mission is to thoroughly study and master their chosen paper, and subsequently engage the class through a well-prepared presentation.

These presentations take place at a workshop by the end of the semester, with each team allotted a maximum of 20 minutes to showcase their insights and findings. Students are expected to deliver their presentation in the form of a set of professionally crafted slides, that visually complement their chosen paper.

This collaborative project provides a valuable opportunity for students to refine their communication skills, deepen their understanding of a specialized topic, and contribute to the collective learning experience of the class.

Final Project

This project is completed in teams of two students. Teams can propose their own project topic or ask the instructors to provide potential ideas. Most projects require auxiliary reading and consistent programming effort throughout the semester. Exceptional projects are eligible for significant extra credit. Each team delivers a progress report, a final report, and a live presentation.

Academic Integrity and Large Language Models (LLMs)

While collaborative discussions and peer learning are encouraged for gaining insights, students must prioritize academic integrity, particularly concerning their written work and source code. Sharing solutions with others, copying another student's work, or using uncredited LLM-generated code is strictly prohibited. These actions constitute plagiarism, a serious offense with significant consequences outlined in the University's Academic Honesty Procedures.

Students are encouraged to employ LLMs responsibly and ethically when utilizing them for homework assignments. While LLMs are powerful tools to aid in research, understanding, and generating content, it is imperative that students produce original work in their assignments. Simply copying and pasting content generated by LLMs without proper understanding or attribution constitutes academic dishonesty.

Students should use LLMs as aids to enhance their comprehension of the subject matter, providing insights and ideas that contribute to the development of their own work.

Disability Accommodations

Any student with a documented disability is welcome to contact the instructor as early in the semester as possible to arrange reasonable accommodations. As part of this process, students are advised to initially contact the Disability Services for Students Office, located in room 302 of the Memorial Union (401-874-2098).

Religious Holidays

It is the policy of the University of Rhode Island to accord students, on an individual basis, the opportunity to observe their traditional religious holidays. Students desiring to observe a holiday of special importance must provide written notification to the instructor.