Lecun推薦的一首關於深度學習界的詩(我覺得可以變成rap)
** War of the (Sub)Words **
My grammar is better
Than the world's leader
Check how my transformer
Will slam on twitter
After laughing at n-gram
you fear my neural program
Against momentum or Adam
your elocution is a sham
Softmax at high temperature
Is mistaken for literature
My 6-layer architecture
Threaten your culture
Fear how word embedding
Could bring the world ending
Worse than global warming
Check my verbal warning
I understand your devotion
Against self-attention
When my residual connection
Threaten your civilization
I am over the singularity
I feel your insecurity
My super low perplexity
Give me invincibility
Powerless is the police
In front of my synthesis
You fear for appocalypse
Before the next neurIPS.
同時也有10000部Youtube影片,追蹤數超過2,910的網紅コバにゃんチャンネル,也在其Youtube影片中提到,...
momentum 深度學習 在 DeepBelief.ai 深度學習 Facebook 的最佳解答
微軟開源的深度學習平台CNTK 1.5版正式公布,主要是強化了BrainScript(深度學習網路定義語言)的彈性之外,同時也利用了稱為區塊動量(block momentum)的技術可以根據GPU進行平行加速,讓一直目前所有深度學習框架中計算速度最快的CNTK,這次又狠甩對手十幾條街...
https://github.com/Microsoft/CNTK