Artem Kirsanov
Artem Kirsanov
  • Видео 32
  • Просмотров 5 145 249
The Most Important Algorithm in Machine Learning
Shortform link:
shortform.com/artem
In this video we will talk about backpropagation - an algorithm powering the entire field of machine learning and try to derive it from first principles.
OUTLINE:
00:00 Introduction
01:28 Historical background
02:50 Curve Fitting problem
06:26 Random vs guided adjustments
09:43 Derivatives
14:34 Gradient Descent
16:23 Higher dimensions
21:36 Chain Rule Intuition
27:01 Computational Graph and Autodiff
36:24 Summary
38:16 Shortform
39:20 Outro
USEFUL RESOURCES:
Andrej Karpathy's playlist: ruclips.net/p/PLAqhIrjkxbuWI23v9cThsA9GvCAUhRvKZ&si=zBUZW5kufVPLVy9E
Jürgen Schmidhuber's blog on the history of backprop:
people.idsia.ch/~juergen/who-invented-backpropagation.html
CREDI...
Просмотров: 288 569

Видео

My Strategy To Consume Information Effectively
Просмотров 34 тыс.9 месяцев назад
For a FREE trial and 20% discount to Shortform go to shortform.com/artem And to download the Shortform AI browser extension, visit bit.ly/45DCpuM My name is Artem, I'm a neuroscience PhD student at NYU. In this video I talk about how I use summaries to consume knowledge from books and video lectures. Patreon: www.patreon.com/artemkirsanov Twitter: ArtemKRSV Github: github.com/ArtemK...
How I make science animations
Просмотров 692 тыс.10 месяцев назад
To try everything Brilliant has to offer-free-for a full 30 days, visit brilliant.org/ArtemKirsanov/ The first 200 of you will get 20% off Brilliant’s annual premium subscription. My name is Artem, I'm a neuroscience PhD student at NYU. In this long-requested video I share the creative process behind my videos - what software I use and break down some of my previous animations. Patreon: www.pat...
Building Blocks of Memory in the Brain
Просмотров 231 тыс.11 месяцев назад
To try everything Brilliant has to offer-free-for a full 30 days, visit brilliant.org/ArtemKirsanov/ The first 200 of you will get 20% off Brilliant’s annual premium subscription. My name is Artem, I'm a computational neuroscience student and researcher. In this video we discuss engrams - fundamental units of memory in the brain. We explore what engrams are, how memory is allocated, where it is...
Can We Build an Artificial Hippocampus?
Просмотров 194 тыс.Год назад
To try everything Brilliant has to offer-free-for a full 30 days, visit brilliant.org/ArtemKirsanov/ The first 200 of you will get 20% off Brilliant’s annual premium subscription. My name is Artem, I'm a computational neuroscience student and researcher. In this video we discuss the Tolman-Eichenbaum Machine - a computational model of a hippocampal formation, which unifies memory and spatial na...
How Your Brain Organizes Information
Просмотров 515 тыс.Год назад
To try everything Brilliant has to offer-free-for a full 30 days, visit brilliant.org/ArtemKirsanov/ The first 200 of you will get 20% off Brilliant’s annual premium subscription. My name is Artem, I'm a computational neuroscience student and researcher. In this video we talk about cognitive maps - internal models of outside world that the brain to generate flexible behavior that is generalized...
Brain Criticality - Optimizing Neural Computations
Просмотров 207 тыс.Год назад
To try everything Brilliant has to offer-free-for a full 30 days, visit brilliant.org/ArtemKirsanov/. The first 200 of you will get 20% off Brilliant’s annual premium subscription. My name is Artem, I'm a computational neuroscience student and researcher. In this video we talk about the concept of critical point - how the brain might optimize information processing by hovering near a phase tran...
Dendrites: Why Biological Neurons Are Deep Neural Networks
Просмотров 218 тыс.Год назад
Keep exploring at brilliant.org/ArtemKirsanov/ Get started for free, and hurry-the first 200 people get 20% off an annual premium subscription. My name is Artem, I'm a computational neuroscience student and researcher. In this video we will see why individual neurons essentially function like deep convolutional neural networks, equipped with insane information processing capabilities as well as...
A Map of Social Space in Your Brain
Просмотров 31 тыс.Год назад
Shortform link: shortform.com/artem My name is Artem, I'm a computational neuroscience student and researcher. In this video we talk about how hippocampus serves a "social map", representing information about conspecific individuals at different levels of abstraction. Patreon: www.patreon.com/artemkirsanov Twitter: ArtemKRSV OUTLINE: 00:00 Introduction 03:30 Overview of physical pla...
Theta rhythm: A Memory Clock
Просмотров 102 тыс.Год назад
Shortform link: shortform.com/artem My name is Artem, I'm a computational neuroscience student and researcher. In this video we talk about theta rhythm - a rhythmic pattern of brain activity (4-12 Hz), which is essential for memory encoding and retrieval. REFERENCES (in no particular order): 1. Hummos A, Nair SS. An integrative model of the intrinsic hippocampal theta rhythm. Lytton WW, editor....
Wavelets: a mathematical microscope
Просмотров 607 тыс.Год назад
Wavelet transform is an invaluable tool in signal processing, which has applications in a variety of fields - from hydrodynamics to neuroscience. This revolutionary method allows us to uncover structures, which are present in the signal but are hidden behind the noise. The key feature of wavelet transform is that it performs function decomposition in both time and frequency domains. In this vid...
Self-study computational neuroscience | Coding, Textbooks, Math
Просмотров 120 тыс.2 года назад
Shortform link: shortform.com/artem This video is based on the article medium.com/neurotechx/how-to-get-started-in-computational-neuroscience-dde4b1817ccd My name is Artem, I'm a computational neuroscience student and researcher. In this video I share my experience on getting started with computational neuroscience. We will talk about programming languages, learning to code, recommended textboo...
Logarithmic nature of the brain 💡
Просмотров 224 тыс.2 года назад
Shortform link: shortform.com/artem My name is Artem, I'm a computational neuroscience student and researcher. In this video we will talk about the fundamental role of lognormal distribution in neuroscience. First, we will derive it through Central Limit Theorem, and then explore how it support brain operations on many scales - from cells to perception. REFERENCES: 1.Buzsáki, G. & Mizuseki, K. ...
How to overcome study procrastination | 3 powerful tips
Просмотров 14 тыс.2 года назад
Shortform link: shortform.com/artem In this video I'll talk about 3 amazing tips, which help you to overcome study procrastination. My name is Artem, I'm a computational neuroscience student and researcher. Socials: Twitter: ArtemKRSV OUTLINE: 00:00 Introduction 00:53 Shortform message 01:55 Why we procrastinate 03:10 Yin Yang technique 06:10 Time-based mindset 08:05 Spacing out 10:...
Your brain is moving along the surface of the torus 🤯
Просмотров 117 тыс.2 года назад
Shortform link: shortform.com/artem In this video we will explore a very interesting paper published in Nature in 2022, which describes the hidden torus in the neuronal activity of cells in the entorhinal cortex, known as grid cells. Place cell video: ruclips.net/video/iV-EMA5g288/видео.html Neural manifolds video: ruclips.net/video/QHj9uVmwA_0/видео.html My name is Artem, I'm a computational n...
My university note-taking | Zettelkasten & more
Просмотров 50 тыс.2 года назад
My university note-taking | Zettelkasten & more
How to REMEMBER what you read 🧠
Просмотров 22 тыс.2 года назад
How to REMEMBER what you read 🧠
Memory Consolidation: Time Machine of the Brain
Просмотров 39 тыс.2 года назад
Memory Consolidation: Time Machine of the Brain
Zettelkasten workflow for research papers | Zotero & Obsidian link
Просмотров 120 тыс.2 года назад
Zettelkasten workflow for research papers | Zotero & Obsidian link
How to Effectively Teach Yourself ANYTHING
Просмотров 34 тыс.2 года назад
How to Effectively Teach Yourself ANYTHING
Place cells: How your brain creates maps of abstract spaces
Просмотров 53 тыс.2 года назад
Place cells: How your brain creates maps of abstract spaces
My simple note-taking setup | Zettelkasten in Obsidian | Step-by-step guide
Просмотров 664 тыс.2 года назад
My simple note-taking setup | Zettelkasten in Obsidian | Step-by-step guide
How to read papers effectively | Research reading technique
Просмотров 34 тыс.2 года назад
How to read papers effectively | Research reading technique
Mind mapping tutorial for students | Tips & Software
Просмотров 30 тыс.2 года назад
Mind mapping tutorial for students | Tips & Software
How to choose a note-taking app | Zettelkasten | Notion vs Roam vs Obsidian
Просмотров 48 тыс.2 года назад
How to choose a note-taking app | Zettelkasten | Notion vs Roam vs Obsidian
Neural manifolds - The Geometry of Behaviour
Просмотров 266 тыс.2 года назад
Neural manifolds - The Geometry of Behaviour
How to focus when studying from home
Просмотров 14 тыс.2 года назад
How to focus when studying from home
Your brain CAN'T Multitask - Here's why
Просмотров 14 тыс.2 года назад
Your brain CAN'T Multitask - Here's why
Interleaving vs Spaced repetition | Study hacks
Просмотров 20 тыс.2 года назад
Interleaving vs Spaced repetition | Study hacks
Understanding note-taking | Zettelkasten
Просмотров 109 тыс.3 года назад
Understanding note-taking | Zettelkasten

Комментарии

  • @LivingG6170
    @LivingG6170 2 часа назад

    fuck can you shut that background music so we can focus

  • @gulamahsan5902
    @gulamahsan5902 6 часов назад

    Gr8t Job.. my 12th grade mathematics marks suggest I am good at differentail calculus.. now you made me realizse its true..

  • @alexstephenson9005
    @alexstephenson9005 9 часов назад

    UPDATE: all you need to do for date and time to work is insert: {{date}} {{time}}. Also if this is your first obsidian/zettelkasten step up video (😅I've only been using obsidian for about 2 hours now), you need to have a new note (ctrl + N) open before you can add the template (custom hotkey)

  • @dylanmenzies3973
    @dylanmenzies3973 15 часов назад

    kind of of long winded - the insight for back prop can be distilled much more consisely. It depends on the symmetry of the wy terms in the activation functions. y dt/dw = w dt/dy

  • @MathiasDurrenberger
    @MathiasDurrenberger 17 часов назад

    Good work

  • @krishnagupta31
    @krishnagupta31 19 часов назад

    this is the most intuitive video I have ever come across. Amazing work!!!!!

  • @theorder4592
    @theorder4592 День назад

    What's the difference in neurology in imagined events and remembered events? I've seen that much of our memories are false and imagined so I'm wondering what actually constitutes as a memory and why do we believe some things are really memories and some aren't?

  • @davispeixoto
    @davispeixoto День назад

    This channel is pure gold.

  • @pablodelafuente4810
    @pablodelafuente4810 День назад

    This is a brillant explanation

  • @AndreaBetterle
    @AndreaBetterle День назад

    amazing product, both in terms of clarity and in terms of esthetics/graphics!

  • @under88Me
    @under88Me 2 дня назад

    You spell 'g' as 'jay' which is actually 'j'

  • @aryaprashanth1742
    @aryaprashanth1742 2 дня назад

    I am nerdy af lmao gokg okgok

  • @YTWhiteRabbit
    @YTWhiteRabbit 2 дня назад

    Your videos are absolutely wonderful and great source of inspiration. This one is especially interesting because the amount of information published is overwhelming and clearly we need good tools to deal with it. I would also ask if you have seen the new AI driven research tool called scite AI? Here is a blurb from there "about" section: "Assistant is a conversational tool made by scite that lets you ask questions in simple language and get answers backed by real, up to date references. Think of like ChatGPT with real, up to date references, tailor-made for anyone discovering, understanding, or writing research." I am writing my first journal paper at the moment and I find this tool an incredible boost to my productivity. In a sense, scite helps me sift through mountains of data and find the information I need WHEN I need it. I would love it if you would make a review video of scite, I think you and community would benefit from it. Otherwise, please keep up the great work!!

  • @Priya_dancelover
    @Priya_dancelover 2 дня назад

    good work👏

  • @gustitriandiwinata6397
    @gustitriandiwinata6397 3 дня назад

    More please

  • @Limofeus
    @Limofeus 3 дня назад

    Incredibly useful and intuitive, amazing video!

  • @user-lz1yb6qk3f
    @user-lz1yb6qk3f 3 дня назад

    Артём, а в каком университете ты работаешь?

  • @OuailOucherif
    @OuailOucherif 3 дня назад

    A piece of art !

  • @grimsk
    @grimsk 4 дня назад

    아 이분.. 언제나 취향저격...

  • @pentachronic
    @pentachronic 4 дня назад

    Excellent video. Thanks for this.

  • @mdshupto183
    @mdshupto183 4 дня назад

    best

  • @sanketgadge9060
    @sanketgadge9060 4 дня назад

    Thank you for the great video

  • @grimsk
    @grimsk 5 дней назад

    1년 전에 봤으나 다시 봐도 이 채널의 진가를 알 수 있다.

  • @grimsk
    @grimsk 5 дней назад

    와, 미치겠다

  • @TurinBeats
    @TurinBeats 5 дней назад

    Waiting patiently for the second video 🫰♥️. Much love from Kenya, thank you for making me understand back propagation. Started watching your channel because of Obsidian, stayed for the AI lessons 🫰.

  • @davidc1179
    @davidc1179 5 дней назад

    0:10 what do they have in common? Matrix multiplication.

  • @visunashokkumar1782
    @visunashokkumar1782 5 дней назад

    Man this knowledge is Gold for me

  • @lettuan1982
    @lettuan1982 5 дней назад

    Really enjoyed this video! Great work!

  • @alanjk5092
    @alanjk5092 6 дней назад

    3:00 - 4:52 4:52 - 7:49

  • @johnkramer5886
    @johnkramer5886 6 дней назад

    Brilliant!

  • @woddenhorse
    @woddenhorse 7 дней назад

    Amazing Visualisation 🔥🔥

  • @LeifBent
    @LeifBent 7 дней назад

    what an incredibly helpful video!! thank you so much for this

  • @JJEvita
    @JJEvita 7 дней назад

    "This self-similarity when a system as a whole resembles some of its parts at any scale is a typical property of fractals."

  • @luizz_k
    @luizz_k 7 дней назад

    the suspense is killing me, I need new video naw feed me

  • @slehar
    @slehar 7 дней назад

    Trivial quibble: Matplotlib is not a "lib-rary" (rhymes with "bib-rary" but a liiiibrary (rhymes with briiiibery), so matplotlib should be pronounced "matplotliiiib" not "matplotlib". Otherwise great stuff! (And .gif is not a "jif" but a "Graphical Image Format" G-G-G-Gif! Pet peeves)

  • @mmontesbr
    @mmontesbr 8 дней назад

    Basis for DL, not all ML, right?

  • @ExtantFrodo2
    @ExtantFrodo2 8 дней назад

    Other than the "finger sausage" trick (which seems is defocusing your attention), if you impose different images on each eye you will definitely find your attention swinging from one to the other rather than multi-tasking(merging) the visual fields.

  • @vaggo9611
    @vaggo9611 8 дней назад

    great one

  • @JJEvita
    @JJEvita 8 дней назад

    Grid cells are located in entorhinal cortex. They also form a torus. The trajetory of the grid cells are corresponsive to the trajetory of place cells which are located in hippocampus. -- This is what I learn from this lesson.

  • @JJEvita
    @JJEvita 8 дней назад

    "Trajectories the mouse was taking during the day at night recapitulate during the shark wave ripple. And that means that the same place cells were activated one atfer another as if representing the same trajectory only their order was reversed and the time scale of the entire thing was much smaller."

  • @JJEvita
    @JJEvita 8 дней назад

    "How intrinsic dimension and topology of the neural activity manifold inform us of data being encoded inside the circuit." "The activity of a real group of neurons inside the real mouse just running around is localized to a one dimentioned ring though granted quite a convoluted one. And the state of the network discribed by the point on this ring at every instance of time directly corresponds to the animal's head direction that is just by looking at the experimental data we record from the brain, not seeing the mouse at all. We can difinitely say which direction it is facing." It is amazing. I couldn't imagine the structure and the function. How does the state of the network finally leads to the body movement, say heading? May I say every single function or decision that a man has is a one-dimentional ring or two-dimentional slice? If so, how dangerous the brain surgeries are. Mr. Kirsanov, what is the goal of the neuroscience?

  • @JJEvita
    @JJEvita 8 дней назад

    Place cells: I frequently get lost in places even around the home. The number of place cells in my brain might be so small or they are used for other functions.

  • @arnoldpalmer-fv7pf
    @arnoldpalmer-fv7pf 8 дней назад

    This is incredible

  • @DrBFromEarth
    @DrBFromEarth 8 дней назад

    This is even kinda better than 3blue 1brown. Great work sir. Subscribed for more 😊

  • @oscarhurtado7107
    @oscarhurtado7107 8 дней назад

    How do you add RUclips videos to Zotero and what do you include in those references?

  • @luisalfonsohernandez9239
    @luisalfonsohernandez9239 8 дней назад

    I can’t believe the quality of this video 👏👏👏

  • @vazquez-borsetti
    @vazquez-borsetti 8 дней назад

    With the pandemic, I slowly started to perform more and more data analysis with python and R, I guess I am computational neuroscientist now ….

  • @walterfranciscoespinozacas776
    @walterfranciscoespinozacas776 9 дней назад

    Excellent explanation! Thank you so much!

  • @HuckleberryHim
    @HuckleberryHim 9 дней назад

    Can't imagine how much suffering and torture was involved in all that research, it honestly hurts to think about.

  • @ElizavetaZimina-fw5sd
    @ElizavetaZimina-fw5sd 9 дней назад

    Very nice topic and idea.Very informative, very humble, keep up the awesome videos. I will follow you