Advances in Deep Learning

Title		Materials	References
Getting Started
	Welcome to Advances in Deep Learning	Slides

Introduction
	Structures of Deep Networks	Slides
	Training Deep Networks	Slides
	Modern GPU Architectures	Slides Materials

Advanced Training
	Training Large Models	Slides
	Mixed Precision Training	Slides	[1]
	Distributed Training	Slides	[2] [3]
	Zero Redundancy Training	Slides	[4]
	Low-Rank Adapters	Slides	[5]
	Quantization	Slides	[6] [7] [8]
	Quantized Low-Rank Adapters	Slides	[9]
	Low-Rank Projections	Slides	[10]
	Checkpointing	Slides	[11]
	FlashAttention	Slides	[12] [13] [14]
	Open-Source Infrastructure for Model Training	Slides Materials	[15] [16]

Generative Models
	Generative Models	Slides
	Variational Auto Encoders	Slides	[17]
	Generative Adversarial Networks	Slides	[18] [19] [20]
	Flow-Based Models	Slides	[21] [22] [23]
	Auto-Regressive Generation	Slides	[24] [25] [26] [27]
	Vector Quantization	Slides	[28] [29] [30]
	Dall-E	Slides	[28] [31] [32] [33] [34] [35] [36]
	Diffusion Models	Slides	[37] [38] [39]
	Latent Diffusion and State-of-the-Art Models	Slides	[40] [31] [41] [42] [43] [44] [45] [46]
	Which Generative Model Should I Use?	Slides

Large Language Models
	Large Language Models	Slides
	Architectures	Slides	[47] [48] [49] [50] [51] [52] [53] [54] [32] [55] [56] [57] [58] [59]
	Generation	Slides Materials	[51] [60] [61]
	Instruction Tuning	Slides
	RLHF	Slides	[62] [63] [64]
	Dpo	Slides	[62] [65]
	Tasks and Datasets	Slides	[66] [67] [68] [69] [70] [71] [72] [73] [74]
	Efficient LLM Training and Inference	Slides
	Sequence Parallelism	Slides	[75] [76] [77] [78]
	Page Attention	Slides	[79] [80] [81]
	Speculative Decoding	Slides	[82] [83]
	Open-Source Infrastructure for LLMs	Slides	[84] [85] [86] [87] [88] [89]
	Tool Use	Slides	[90] [91] [92]
	Structured Outputs	Slides
	Constrained Decoding	Slides	[93] [94] [95]
	Long Context	Slides	[96] [97] [98]
	Retrieval Augmented Generation	Slides	[99] [100] [101] [102] [103]
	Structured Dialogues	Slides	[104] [105] [55] [106] [107] [108] [109] [110] [111]
	Limitations of LLMs	Slides	[112] [113] [114] [115]
	Bonus - Reinforcement Learning and LLMs	Slides	[116] [117] [118] [119] [120]

Computer Vision
	Computer Vision	Slides
	Image Classification	Slides	[121] [122] [123] [124] [125] [126] [127] [128] [129] [130] [131] [132] [133] [134] [135]
	Object Detection	Slides	[136] [137] [138] [139] [140] [141] [142] [143] [144]
	Segmentation	Slides	[145] [146] [147] [148] [149] [150] [151] [152] [153] [154] [155]
	Open-Vocabulary Recognition	Slides	[156] [157] [158]
	Vision Language Models - Image Captioning	Slides	[156] [159] [160] [161] [162]
	Early Vision Language Models	Slides	[163] [164] [165] [166] [167] [168] [169] [170] [171] [172] [173] [174] [175]
	Current Vision Language Models	Slides	[176] [177] [178] [179] [180] [181] [182] [183] [184]

End of Class
	End of Class	Slides

References