Henry AI Labs
Thanks for watching! Please Subscribe!
Content Links:
Decision Transformer: https://arxiv.org/pdf/2106.01345.pdf
Trajectory Transformer (Sergey Levine’s Twitter Thread): https://twitter.com/svlevine/status/1400547882973863939
Toward Generalized Sim-to-Real Transfer Robot Learning: https://ai.googleblog.com/2021/06/toward-generalized-sim-to-real-transfer.html
Consistency in LMs: https://arxiv.org/pdf/2102.01017.pdf
Implicit Representations of Meaning in Neural Language Models: https://arxiv.org/pdf/2106.00737.pdf
Database Reasoning Over Text: https://arxiv.org/pdf/2106.01074.pdf
Splinter: https://arxiv.org/abs/2101.00438
Zero-shot Fact Verification by Claim Generation: https://arxiv.org/abs/2105.14682
NLU Data Collection: https://arxiv.org/abs/2106.00794
Item Response Theory: https://arxiv.org/pdf/2106.00840.pdf
Extrapolating to Unnatural Language Processing with GPT-3’s In-Context Learning: https://ai.stanford.edu/blog/in-context-learning/
Com2Sense: https://twitter.com/paperswithdata/status/1400436060677681158
Self-Attention Between Datapoints: https://arxiv.org/abs/2106.02584
Attention Free Transformer: https://arxiv.org/pdf/2105.14103.pdf
Vision Transformers Outperform ResNets (with SAM) :https://arxiv.org/pdf/2106.01548.pdf
Contrastive Representation Learning: https://lilianweng.github.io/lil-log/2021/05/31/contrastive-representation-learning.html
ByT5 in HuggingFace: https://twitter.com/huggingface/status/1399793113850421255
JAX in HuggingFace Transformers: https://github.com/huggingface/transformers/tree/master/examples/flax/text-classification
HF Few-Shot GPT-Neo: https://huggingface.co/blog/few-shot-learning-gpt-neo-and-inference-api
KCE Video Classification UCF101: https://keras.io/examples/vision/video_classification/
KCE Survey: https://twitter.com/fchollet/status/1399873538085986309
NAACL 2021 Best Papers: https://2021.naacl.org/blog/best-paper-awards/
ICML 2021 Papers: https://icml.cc/Conferences/2021/AcceptedPapersInitial
Facebook AI Drone Videos: https://twitter.com/facebookai/status/1399824029272338432
Chapters
0:00 AI Weekly Update!
11:32 Decision Transformer
21:15 Trajectory Transformer
22:30 Sim-to-Real Transfer
25:35 Consistency in LMs
27:36 Meaning in LMs
29:41 Database Reasoning over Text
31:30 Few-Shot QA (Splinter)
33:07 Zero-Shot Fact Verification
34:59 NLU Data Collection
37:15 Unnatural Language Processing with GPT3
39:39 Com2Sense
40:22 Self-Attention Between Datapoints
43:10 Attention Free Transformer
44:48 Vision Transformers and SAM
47:07 Contrastive Representation Learning
49:06 ByT5 in HuggingFace
50:01 JAX meets HF Transformers
51:04 Few-Shot with GPT-Neo
51:34 KCE UCF101
52:39 KCE Survey
52:48 NAACL Best papers
53:36 ICML 2021 Papers
53:56 Drone Videos
54:13 Thanks for watching!