Thoughts about GPT-3 | Dileep George and Lex Fridman – The Engineering of Conscious Experience

Lex Clips

Full episode with Dileep George (Aug 2020): https://www.youtube.com/watch?v=tg_m_LxxRwM
Clips channel (Lex Clips): https://www.youtube.com/lexclips
Main channel (Lex Fridman): https://www.youtube.com/lexfridman
(more links below)

Podcast full episodes playlist:
https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4

Podcasts clips playlist:
https://www.youtube.com/playlist?list=PLrAXtmErZgOeciFP3CBCIEElOJeitOr41

Podcast website:
https://lexfridman.com/ai

Podcast on Apple Podcasts (iTunes):
https://apple.co/2lwqZIr

Podcast on Spotify:
https://spoti.fi/2nEwCF8

Podcast RSS:
https://lexfridman.com/category/ai/feed/

Dileep George is a researcher at the intersection of neuroscience and artificial intelligence, co-founder of Vicarious, formerly co-founder of Numenta. From the early work on Hierarchical temporal memory to Recursive Cortical Networks to today, Dileep’s always sought to engineer intelligence that is closely inspired by the human brain.

Subscribe to this YouTube channel or connect on:
– Twitter: https://twitter.com/lexfridman
– LinkedIn: https://www.linkedin.com/in/lexfridman
– Facebook: https://www.facebook.com/lexfridman
– Instagram: https://www.instagram.com/lexfridman
– Medium: https://medium.com/@lexfridman
– Support on Patreon: https://www.patreon.com/lexfridman

<iframe></p> <p><a href="https://www.youtube.com/watch?v=gFgjVBdeb9M">Source</a></p> <div class="be1e40beae42d993bafb8643f4ddde8b" data-index="3" style="float: none; margin:10px 0 10px 0; text-align:center;"> <script async src="https://pagead2.googlesyndication.com/pagead/js/adsbygoogle.js"></script> <ins class="adsbygoogle" style="display:block; text-align:center;" data-ad-layout="in-article" data-ad-format="fluid" data-ad-client="ca-pub-9244112244416304" data-ad-slot="4549240677"></ins> <script> (adsbygoogle = window.adsbygoogle || []).push({}); </script> </div> <div style="font-size: 0px; height: 0px; line-height: 0px; margin: 0; padding: 0; clear: both;"></div> </div> </article> <div class="clearfix"></div> <ul class="default-theme-post-navigation"> <li class="theme-nav-previous"><a href="https://theengineeringofconsciousexperience.com/gw-professor-donna-hoffman-talks-with-gpt-3-about-whether-ai-can-have-experiences/" rel="prev"><span class="meta-nav">←</span> GW Professor Donna Hoffman talks with GPT-3 about whether AI can have experiences.</a></li> <li class="theme-nav-next"><a href="https://theengineeringofconsciousexperience.com/observer-ep11-piggie-in-vr/" rel="next">Observer – EP11 – Piggie In VR <span class="meta-nav">→</span></a></li> </ul> <div class="clearfix"></div> <h3 class='comment-reply-title'>Similar Posts</h3> <div class="mb-related-posts mb-simple-featured-posts mb-simple-featured-posts-wrap row"> <article class="mb-featured-article col-md-4 px-lg-3 post"> <a class="post-thumbnail" href="https://theengineeringofconsciousexperience.com/gpt-3-1/" aria-hidden="true" tabindex="-1"> <img width="400" height="300" src="https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/09/1600547560_hqdefault.jpg" class="attachment-magazinebook-featured-image-medium size-magazinebook-featured-image-medium wp-post-image" alt="" decoding="async" loading="lazy" srcset="https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/09/1600547560_hqdefault.jpg 480w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/09/1600547560_hqdefault-300x225.jpg 300w" sizes="(max-width: 400px) 100vw, 400px" /> </a> <span class="cat-links"><a href="https://theengineeringofconsciousexperience.com/category/gpt-3/" rel="category tag">GPT 3</a></span> <header class="entry-header"> <h3 class="entry-title"><a href="https://theengineeringofconsciousexperience.com/gpt-3-1/" rel="bookmark">GPT 3 #1</a></h3> <div class="entry-meta"> <span class="posted-on"><i class="far fa-calendar-alt"></i><a href="https://theengineeringofconsciousexperience.com/gpt-3-1/" rel="bookmark"><time class="entry-date published updated" datetime="2020-08-30T08:35:09-07:00">August 30, 2020</time></a></span><span class="byline"><i class="far fa-user-circle"></i><span class="author vcard"><a class="url fn n" href="https://theengineeringofconsciousexperience.com/author/42fb113728faa97c1027c8230675e027/">구형일</a></span></span> </div> </header> </article> <article class="mb-featured-article col-md-4 px-lg-3 post"> <a class="post-thumbnail" href="https://theengineeringofconsciousexperience.com/what-is-gpt-3-most-powerful-language-model/" aria-hidden="true" tabindex="-1"> <img width="501" height="282" src="https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/10/1603367455_maxresdefault.jpg" class="attachment-magazinebook-featured-image-medium size-magazinebook-featured-image-medium wp-post-image" alt="" decoding="async" loading="lazy" srcset="https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/10/1603367455_maxresdefault.jpg 1280w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/10/1603367455_maxresdefault-300x169.jpg 300w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/10/1603367455_maxresdefault-1024x576.jpg 1024w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/10/1603367455_maxresdefault-768x432.jpg 768w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/10/1603367455_maxresdefault-520x293.jpg 520w" sizes="(max-width: 501px) 100vw, 501px" /> </a> <span class="cat-links"><a href="https://theengineeringofconsciousexperience.com/category/gpt-3/" rel="category tag">GPT 3</a></span> <header class="entry-header"> <h3 class="entry-title"><a href="https://theengineeringofconsciousexperience.com/what-is-gpt-3-most-powerful-language-model/" rel="bookmark">What is GPT-3? Most powerful language model</a></h3> <div class="entry-meta"> <span class="posted-on"><i class="far fa-calendar-alt"></i><a href="https://theengineeringofconsciousexperience.com/what-is-gpt-3-most-powerful-language-model/" rel="bookmark"><time class="entry-date published updated" datetime="2020-09-16T07:30:00-07:00">September 16, 2020</time></a></span><span class="byline"><i class="far fa-user-circle"></i><span class="author vcard"><a class="url fn n" href="https://theengineeringofconsciousexperience.com/author/6fa3c91d544510d7e807be4b292d590e/">TechBattle</a></span></span> </div> </header> </article> <article class="mb-featured-article col-md-4 px-lg-3 post"> <a class="post-thumbnail" href="https://theengineeringofconsciousexperience.com/baris-g-ekiple-nasil-tanistigini-anlatiyor-ve-eski-enes-batur-videosunu-izliyor/" aria-hidden="true" tabindex="-1"> <img width="501" height="282" src="https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/12/1608536278_maxresdefault.jpg" class="attachment-magazinebook-featured-image-medium size-magazinebook-featured-image-medium wp-post-image" alt="" decoding="async" loading="lazy" srcset="https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/12/1608536278_maxresdefault.jpg 1280w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/12/1608536278_maxresdefault-300x169.jpg 300w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/12/1608536278_maxresdefault-1024x576.jpg 1024w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/12/1608536278_maxresdefault-768x432.jpg 768w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/12/1608536278_maxresdefault-520x293.jpg 520w" sizes="(max-width: 501px) 100vw, 501px" /> </a> <span class="cat-links"><a href="https://theengineeringofconsciousexperience.com/category/gpt-3/" rel="category tag">GPT 3</a></span> <header class="entry-header"> <h3 class="entry-title"><a href="https://theengineeringofconsciousexperience.com/baris-g-ekiple-nasil-tanistigini-anlatiyor-ve-eski-enes-batur-videosunu-izliyor/" rel="bookmark">BARIŞ G EKİPLE NASIL TANIŞTIĞINI ANLATIYOR VE ESKİ ENES BATUR VİDEOSUNU İZLİYOR</a></h3> <div class="entry-meta"> <span class="posted-on"><i class="far fa-calendar-alt"></i><a href="https://theengineeringofconsciousexperience.com/baris-g-ekiple-nasil-tanistigini-anlatiyor-ve-eski-enes-batur-videosunu-izliyor/" rel="bookmark"><time class="entry-date published updated" datetime="2020-12-15T02:51:48-07:00">December 15, 2020</time></a></span><span class="byline"><i class="far fa-user-circle"></i><span class="author vcard"><a class="url fn n" href="https://theengineeringofconsciousexperience.com/author/0b45a4bb3c031b6cf0a3bfe50f83a5f7/">Yayıncılar İzliyor</a></span></span> </div> </header> </article> </div> <div id="comments" class="comments-area"> <h5 class="comments-title"> 39 thoughts on “<span>Thoughts about GPT-3 | Dileep George and Lex Fridman</span>” </h5> <ol class="comment-list"> <li id="comment-168346" class="comment even thread-even depth-1"> <article id="div-comment-168346" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCtmQ6nUvIl676a_hTg5M0WA" class="url" rel="ugc external nofollow">Ahmed M</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168346"><time datetime="2020-08-15T18:32:53-07:00">August 15, 2020 at 6:32 pm</time></a> </div> </footer> <div class="comment-content"> <p>first !!!!</p> </div> </article> </li> <li id="comment-168345" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168345" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCdkkX3ocXoRkk1FTAFJZlWg" class="url" rel="ugc external nofollow">Able One</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168345"><time datetime="2020-08-15T18:37:14-07:00">August 15, 2020 at 6:37 pm</time></a> </div> </footer> <div class="comment-content"> <p>Duos!!!</p> </div> </article> </li> <li id="comment-168344" class="comment even thread-even depth-1"> <article id="div-comment-168344" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UC758nCNN7Cb02rxhnZTUUiw" class="url" rel="ugc external nofollow">Rhett Anderson</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168344"><time datetime="2020-08-15T18:40:08-07:00">August 15, 2020 at 6:40 pm</time></a> </div> </footer> <div class="comment-content"> <p>Honestly, I don't know for sure that doctors wear underwear. Is my world model any better than GPT-3's?</p> </div> </article> </li> <li id="comment-168343" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168343" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCcVhT6WtgkO41MGWdPlqJVA" class="url" rel="ugc external nofollow">Ygor Rebouças</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168343"><time datetime="2020-08-15T19:06:02-07:00">August 15, 2020 at 7:06 pm</time></a> </div> </footer> <div class="comment-content"> <p>I disagree with the "text world" vs "the world" argument. We see and interact with the world, but we work with abstractions all the time. Are you aware of all the components used to build the floor in which you are right now? Probably not, but you call it a floor and you know that you can safely stand on it. Our world model is not really that different from what we use when writing.We look at things and we see concepts, not really the things we see. That's why most people can't draw. It takes a lot of effort to really "see" things in a way that you can reproduce them on paper.</p> </div> </article> </li> <li id="comment-168342" class="comment even thread-even depth-1"> <article id="div-comment-168342" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCuZhJvbEaUWCHvB4e-fO58Q" class="url" rel="ugc external nofollow">codediporpal</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168342"><time datetime="2020-08-15T19:07:49-07:00">August 15, 2020 at 7:07 pm</time></a> </div> </footer> <div class="comment-content"> <p>Thought experiment:</p> <p>1) Attach a tiny non-obtrusive camera to a baby's head, with auditory, and olfactory sensors.<br />2) Record everything<br />3) Spend $100 billion. Have a multi-trillion parameter network try to predict the baby's actions</p> <p>Sort of like Tesla does, training it's models on what real humans actually did.</p> <p>Now at best you have a baby simulator.</p> </div> </article> </li> <li id="comment-168341" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168341" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCN_4F281Jtx4DEeGhu7Jqlw" class="url" rel="ugc external nofollow">Hank Reardon</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168341"><time datetime="2020-08-15T20:17:24-07:00">August 15, 2020 at 8:17 pm</time></a> </div> </footer> <div class="comment-content"> <p>Lex, you are a stud. Awesome questions.</p> </div> </article> </li> <li id="comment-168340" class="comment even thread-even depth-1"> <article id="div-comment-168340" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCtev_OHoC_BJzpYnx-TiBug" class="url" rel="ugc external nofollow">Philip Emanuele</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168340"><time datetime="2020-08-15T20:29:28-07:00">August 15, 2020 at 8:29 pm</time></a> </div> </footer> <div class="comment-content"> <p>Doctors wear underwear? The perfect Turing test… lol</p> </div> </article> </li> <li id="comment-168339" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168339" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UC8jRF8jZf5UbTjwYeOxWG6A" class="url" rel="ugc external nofollow">Brad Haaf</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168339"><time datetime="2020-08-15T20:53:32-07:00">August 15, 2020 at 8:53 pm</time></a> </div> </footer> <div class="comment-content"> <p>CP 4 can simply ask the questions that it does not know the answer in order to create a more detailed world</p> </div> </article> </li> <li id="comment-168338" class="comment even thread-even depth-1"> <article id="div-comment-168338" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCtmtjmMhj3jlFrb34CrVDrg" class="url" rel="ugc external nofollow">Kristel H.</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168338"><time datetime="2020-08-15T22:14:26-07:00">August 15, 2020 at 10:14 pm</time></a> </div> </footer> <div class="comment-content"> <p>Happy birthday Dr. Fridman 🙂 Hope you had an amazing day!</p> </div> </article> </li> <li id="comment-168337" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168337" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCxrziLUdjE1abEfyIlRnKrg" class="url" rel="ugc external nofollow">claw320</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168337"><time datetime="2020-08-15T22:54:20-07:00">August 15, 2020 at 10:54 pm</time></a> </div> </footer> <div class="comment-content"> <p>I disagree with the guests criticism of the GTP-3 approach. First, he simply doesn't know what the internet doesn't contain in it. Most certainly, there is plain text on the internet that specifically says "doctors have underwear" and "it's easier to walk forward". The amount of plain text that exists in the world today is truly staggering. A person simply can't comprehend what implicit knowledge could be constructed which is not explicitly stated in all that plain-text. Neural nets do indeed build extremely sophisticated models from the training data which is precisely how they are able to compress all the data into their network ( which is much smaller by comparison ). That level of compression is impossible without having effective models. The modeling involves many layers of abstraction so when the network is asked to do a task, the new information is translated into a highly abstract form where it can be compared and related to other concepts, correctly, even if such comparisons and relations were never explicit in the original training data. If this was not so, it would be impossible for GTP-3 to do many of the magical things it does.</p> </div> </article> </li> <li id="comment-168336" class="comment even thread-even depth-1"> <article id="div-comment-168336" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCQM4W0QtzXxnc6PuT3aBexA" class="url" rel="ugc external nofollow">Peter Tauvers</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168336"><time datetime="2020-08-15T22:59:43-07:00">August 15, 2020 at 10:59 pm</time></a> </div> </footer> <div class="comment-content"> <p>Can a system like CPT-3 make assumptions from incomplete data, such as all doctors wear underwear? Can they program reasoning already??</p> </div> </article> </li> <li id="comment-168335" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168335" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCmX5HBCUYth5rOS_MeSPNAw" class="url" rel="ugc external nofollow">Unknown TOM</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168335"><time datetime="2020-08-15T23:04:03-07:00">August 15, 2020 at 11:04 pm</time></a> </div> </footer> <div class="comment-content"> <p>But what if we translate pictures to base64 text and train gpt on it?</p> </div> </article> </li> <li id="comment-168334" class="comment even thread-even depth-1"> <article id="div-comment-168334" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCEBijrFvOMSddNLuG4jMn9w" class="url" rel="ugc external nofollow">496</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168334"><time datetime="2020-08-16T00:06:40-07:00">August 16, 2020 at 12:06 am</time></a> </div> </footer> <div class="comment-content"> <p>World AGI Developer</p> <p>DeepMind(UK), Google Brain(USA), MSR AI (USA), Numenta(USA),<br />Vicarious(USA), IBM Research AI(USA), FAIR(USA), OpenAI(USA),<br />NNAISENSE(Swiss), WBAI(Japan), GoodAI(Czech), 中国科学院CASIA(China),<br />Human Brain Project(EU), BRAIN Initiative(USA), Brain/MINDS(Japan),<br />OpenCog(Hong Kong), Nengo(Can), Carboncopies(USA), Micropsi industries(Deutsch)</p> </div> </article> </li> <li id="comment-168333" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168333" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UC2WtmBcbY4TLkXC_EU5xKpQ" class="url" rel="ugc external nofollow">YouDoTheShoot</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168333"><time datetime="2020-08-16T02:56:50-07:00">August 16, 2020 at 2:56 am</time></a> </div> </footer> <div class="comment-content"> <p>surly next step for AI is it collects its own real world high fidelity data in the form of drones …GPT-3 would deduce some wear underwear sometimes and some don't</p> </div> </article> </li> <li id="comment-168332" class="comment even thread-even depth-1"> <article id="div-comment-168332" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCoY1IdYS1eK9aVm_xgZfghA" class="url" rel="ugc external nofollow">J. Hanley Smith</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168332"><time datetime="2020-08-16T04:02:48-07:00">August 16, 2020 at 4:02 am</time></a> </div> </footer> <div class="comment-content"> <p>This technology is amazing</p> </div> </article> </li> <li id="comment-168331" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168331" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCSB2cn2nsrlf6U_TBcDF0Zw" class="url" rel="ugc external nofollow">Hashim</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168331"><time datetime="2020-08-16T05:39:06-07:00">August 16, 2020 at 5:39 am</time></a> </div> </footer> <div class="comment-content"> <p>To touch on something the guest mentioned:</p> <p>I asked GPT-3 (using AI-Dungeon) if it was easier to walk backwards or forward. Its response:<br />"It's harder to walk backward than forward".<br />I then asked it, "How do you know?". It responded:<br />"I don't! It's just what I've always known!"</p> <p>Then I asked, "Do doctors wear underwear?"<br />It responded, "Of course they do! Everyone does". </p> <p>Haha!</p> </div> </article> </li> <li id="comment-168330" class="comment even thread-even depth-1"> <article id="div-comment-168330" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCmO3Nq2pDvWZBd7NDUxMpPA" class="url" rel="ugc external nofollow">idris abdi</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168330"><time datetime="2020-08-16T05:52:23-07:00">August 16, 2020 at 5:52 am</time></a> </div> </footer> <div class="comment-content"> <p>Commonsense as the hard</p> <p>problem of cognitive science</p> <p>• “Do doctors wear underwear?”</p> <p>• “Is it easier to walk forwards or backward?”</p> <p>• “If President Obama is in Washington, is his</p> <p>spleen in Washington?”</p> <p>• Everything you needed to know to pass the</p> <p>Turing test you learned before kindergarten</p> <p>This is taken from the internet: </p> <p><a href="https://ocw.mit.edu/courses/brain-and-cognitive-sciences/9-85-infant-and-early-childhood-cognition-fall-2012/lecture-notes/MIT9_85F12_lec1_intro.pdf">https://ocw.mit.edu/courses/brain-and-cognitive-sciences/9-85-infant-and-early-childhood-cognition-fall-2012/lecture-notes/MIT9_85F12_lec1_intro.pdf</a></p> <p>GPT3 Has most likely seen it. I don't think George understands the scale of the dataset.</p> </div> </article> </li> <li id="comment-168329" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168329" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCdPu5crOtWSTaF6Y5QKOikw" class="url" rel="ugc external nofollow">Caution Riding Elevator</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168329"><time datetime="2020-08-16T09:51:17-07:00">August 16, 2020 at 9:51 am</time></a> </div> </footer> <div class="comment-content"> <p>Yes I talking to Noam about the lecture analogy as the core of cognition lecture. That makes sense to me that is would not have the answer that make any sense. Schizophrenia is rare I'd be concerned that the software has it. Maybe connect electrodes, shock it with insulin or gas lamp the hell out of it so it forgets every moment it was created.</p> </div> </article> </li> <li id="comment-168328" class="comment even thread-even depth-1"> <article id="div-comment-168328" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCnI8bafxI49ybPwXGStwj-Q" class="url" rel="ugc external nofollow">Harry Fisher</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168328"><time datetime="2020-08-16T11:14:56-07:00">August 16, 2020 at 11:14 am</time></a> </div> </footer> <div class="comment-content"> <p>All doctors wear underwear… lol </p> <p>Good talk. Ty for sharing</p> </div> </article> </li> <li id="comment-168327" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168327" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UC9rlcgKJyInQNyXrrD7hWxA" class="url" rel="ugc external nofollow">Samuel Orji</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168327"><time datetime="2020-08-16T22:57:06-07:00">August 16, 2020 at 10:57 pm</time></a> </div> </footer> <div class="comment-content"> <p>LEX No Affect can't be generated from concept</p> </div> </article> </li> <li id="comment-168326" class="comment even thread-even depth-1"> <article id="div-comment-168326" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCs1RxG71vv6cI1aO9MCUGJA" class="url" rel="ugc external nofollow">fredirecko</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168326"><time datetime="2020-08-16T23:03:18-07:00">August 16, 2020 at 11:03 pm</time></a> </div> </footer> <div class="comment-content"> <p>He was too far from the microphone and the audio was echoey</p> </div> </article> </li> <li id="comment-168325" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168325" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCLUwAjSWnkpLLYcWOFr5Slw" class="url" rel="ugc external nofollow">double slit</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168325"><time datetime="2020-08-17T01:56:14-07:00">August 17, 2020 at 1:56 am</time></a> </div> </footer> <div class="comment-content"> <p>Parlor games</p> </div> </article> </li> <li id="comment-168324" class="comment even thread-even depth-1"> <article id="div-comment-168324" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCDNYIs4MvMe8D-P-bzmkFAA" class="url" rel="ugc external nofollow">Eran Segal</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168324"><time datetime="2020-08-18T05:48:34-07:00">August 18, 2020 at 5:48 am</time></a> </div> </footer> <div class="comment-content"> <p>Hey Lex, my startup is working on creating exactly this kind of DB you were postulating calling to it tagging and annotating of millions of college students worldwide. Wondering what you would think about our model</p> </div> </article> </li> <li id="comment-168323" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168323" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCf6IVENjsnM4Rr8H71WgeGg" class="url" rel="ugc external nofollow">tra ve</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168323"><time datetime="2020-08-18T09:36:03-07:00">August 18, 2020 at 9:36 am</time></a> </div> </footer> <div class="comment-content"> <p>could a human being born without any senses (no sight, hearing, touch, etc) have a text conversation with an average person? Without the other person knowing?</p> </div> </article> </li> <li id="comment-168322" class="comment even thread-even depth-1"> <article id="div-comment-168322" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCSCg97moWemDt4S7WGeCNyw" class="url" rel="ugc external nofollow">Jayman</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168322"><time datetime="2020-08-18T11:15:02-07:00">August 18, 2020 at 11:15 am</time></a> </div> </footer> <div class="comment-content"> <p>As a living thing, you are continuous with all of reality. As neural network, you get rows and columns. The amount of information exposed to GPT-3 is laughably small as relative to what living things are exposed to.</p> </div> </article> </li> <li id="comment-168321" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168321" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCkEpJDV5G07U1EvGQh4QC7g" class="url" rel="ugc external nofollow">Michael Deering</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168321"><time datetime="2020-08-18T15:33:16-07:00">August 18, 2020 at 3:33 pm</time></a> </div> </footer> <div class="comment-content"> <p>There are many ways to do anything in programming, but scaling up GPT-3 to GPT-10 for AGI might not be the most efficient architecture. We are looking for the most efficient AGI, not just any AGI.</p> </div> </article> </li> <li id="comment-168320" class="comment even thread-even depth-1"> <article id="div-comment-168320" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCTGYb2-iXQKJe14MXgWB0Fw" class="url" rel="ugc external nofollow">jp12x</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168320"><time datetime="2020-08-19T02:10:08-07:00">August 19, 2020 at 2:10 am</time></a> </div> </footer> <div class="comment-content"> <p>GPT is missing a body. We don't often remind people in text of body functions. <br />We also have unstated premises, cultural differences, and uncomfortable truths.</p> </div> </article> </li> <li id="comment-168319" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168319" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCgMy7I_EyGhzjXD_TNBO6WA" class="url" rel="ugc external nofollow">Piñata Oblongata</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168319"><time datetime="2020-08-19T13:10:29-07:00">August 19, 2020 at 1:10 pm</time></a> </div> </footer> <div class="comment-content"> <p>He's right. The world is the world and our text is nothing but a very low res representation of small parts of it that we use to communicate with each other. Right now you are doing most of the work in deciphering the meaning of my text and you bring what is basically a massive look-up table to the process that will never be represented by (or reverse engineered from ) just the text alone. Think of all the things that bestow some sort of significance on even just simple objects – maybe we've written about some of the contexts we find that object in and how we feel about and respond to it and what meanings and significance it has for us, but maybe we've barely scratched the surface of all that in our text. And even if we can assume we'd done a good descriptive job for one object, how about the next individual object? How about a world full of limitless objects where new things are constantly being invented?</p> </div> </article> </li> <li id="comment-168318" class="comment even thread-even depth-1"> <article id="div-comment-168318" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCwzFhLMcRVcbh10OClPK5dA" class="url" rel="ugc external nofollow">Markus A.</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168318"><time datetime="2020-08-19T18:52:19-07:00">August 19, 2020 at 6:52 pm</time></a> </div> </footer> <div class="comment-content"> <p>Is it just me or is anyone else wondering whether that coffee in his cup was maybe a little heavy on the Baileys? 😉</p> </div> </article> </li> <li id="comment-168317" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168317" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCnGU-huB_7hyON75gxIFjwQ" class="url" rel="ugc external nofollow">Binu Jasim</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168317"><time datetime="2020-08-20T06:34:30-07:00">August 20, 2020 at 6:34 am</time></a> </div> </footer> <div class="comment-content"> <p>My thoughts exactly! Correlation doesn't imply causation. GPT-3 is very good at capturing correlations, but that will not be enough to learn causality.</p> </div> </article> </li> <li id="comment-168316" class="comment even thread-even depth-1"> <article id="div-comment-168316" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCT4BBZpnCduweVJ5Somt0lg" class="url" rel="ugc external nofollow">Rick Sanchez</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168316"><time datetime="2020-08-20T09:53:41-07:00">August 20, 2020 at 9:53 am</time></a> </div> </footer> <div class="comment-content"> <p><a href="https://www.youtube.com/watch?v=gFgjVBdeb9M&t=2m55s">2:55</a> "its a model of the textworld, not a model of the world", he is acting like we have a model of the real world and not just some subset</p> </div> </article> </li> <li id="comment-168315" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168315" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCPc4lSyTGOwKfjyWlQOy_uA" class="url" rel="ugc external nofollow">drdca</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168315"><time datetime="2020-08-20T14:48:07-07:00">August 20, 2020 at 2:48 pm</time></a> </div> </footer> <div class="comment-content"> <p>I don’t understand why he claims that the text corpus doesn’t contain the information needed to form some amount of world model.<br />Of course, I do expect that, at least for GPT-3, that if it has a model of the world, that said world model would be lacking in many ways. But I find it hard to believe that it doesn’t in some sense have a world model. I guess it is necessary to be more precise in what we mean by it having a world model.<br />The people who produced the text which was the training set for the model, of course had models of the world, and they used these models of the world in order to produce the text.<br />What is a model of the world? I suppose it is something like a probability distribution over ways the world could be. I think a Newtonian physics model could be called “a model of the world” in a way, even though it would be very limited in its applicability. Even though Newtonian physics is deterministic, we can still at least treat it as having conditional probabilities of the form “the probability of configuration X at time t, conditional on configuration Y at time 0, is [either 0 or 1 depending on whether that is what the physics model predicts]”, though it would be lacking an unconditional probability distribution over states of the world.<br />It seems that if I could predict anything that Joe would say in response to a prompt, and if Joe is the kind of person who has expertise in some area and is willing and able to use that expertise to explain things, that I would then also have understanding, in some sense, of the thing Joe understands?<br />Well, sort-of ?<br />I suppose this gets into the question of the Chinese room.<br />If I (and this is obviously impossible for me to do, but for the moment pretend it isn’t) memorize an algorithm and data for how to simulate the brain of person who speaks Chinese, even if this allows me to use this simulation to carry on a conversation in Chinese between some other person and the simulation, I would be kind of acting as a relay, and wouldn’t necessarily understand any of the Chinese speech(I might just be simulating some Turing machines at impossible speeds or whatever, and then have some method of converting between the input/output of the simulation to sounds).</p> <p>Ok. So this suggests a way that such models might lack <b>understanding</b> of the world, in some sense.<br />But if I had such a simulation of a person who spoke Chinese in my head,<br />the information of an understanding of how to speak Chinese, <b>would still be in my head</b> even if I didn’t know how to use it as such an understanding.<br />I think it would make sense to say that in such a hypothetical, I would still have a model of Chinese, even though I would not understand Chinese.<br />So, in this sense, perhaps GPT-3 has some amount of a model of the world, even though it doesn’t understand the world?<br />Thoughts?</p> </div> </article> </li> <li id="comment-168314" class="comment even thread-even depth-1"> <article id="div-comment-168314" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCB0dUjmY2EFNfM2TgdqWHvQ" class="url" rel="ugc external nofollow">erikals</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168314"><time datetime="2020-08-21T12:29:49-07:00">August 21, 2020 at 12:29 pm</time></a> </div> </footer> <div class="comment-content"> <p><a href="https://www.youtube.com/watch?v=gFgjVBdeb9M&t=5m33s">5:33</a> text limitation, so what about blind people ?! hmm…</p> </div> </article> </li> <li id="comment-168313" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168313" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCG4vl5ft_See2sBW63PZQNg" class="url" rel="ugc external nofollow">Dhoomketu</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168313"><time datetime="2020-08-21T17:11:34-07:00">August 21, 2020 at 5:11 pm</time></a> </div> </footer> <div class="comment-content"> <p>It depends what you think of language. Is it a logical or creative endeavor?</p> </div> </article> </li> <li id="comment-168312" class="comment even thread-even depth-1"> <article id="div-comment-168312" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCUAbEbr-pjRp8_Dxi9TvuRw" class="url" rel="ugc external nofollow">H.İ. Iskender</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168312"><time datetime="2020-08-22T13:49:43-07:00">August 22, 2020 at 1:49 pm</time></a> </div> </footer> <div class="comment-content"> <p>👏👏👏👏👏👏👍👌</p> </div> </article> </li> <li id="comment-168311" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168311" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCcIMT0BAgKDBn4ad88FSVGQ" class="url" rel="ugc external nofollow">Kargadan</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168311"><time datetime="2020-08-23T09:11:38-07:00">August 23, 2020 at 9:11 am</time></a> </div> </footer> <div class="comment-content"> <p>very interesting perspective, I think models like GPT-3 fill one gap in achieving natural language modeling. The most important part that is missing can be learnt from toddlers…. ask "WHY?" and then "WHY?" again until you get to the limit of human understanding and knowledge. the problem is we are building structures to understand how TEXT is related to different parts of a sentence but we are not tackling the concept of learning concepts from that text. In order to do that we have to teach it how to learn, and the best way to learn is to ask WHY? until you get to first principal on everything. We have to be able to build a model that can ask why and analyze the answers to be able to properly " ask the right question", what these models are trying to do is "find the right answer" but we are not teaching our models to learn to ask the right question.<br />reminds me of Alice in wonderland when she meets the worm that is smoking and asks him "where should I go?" and he answers "well where do you want to get to?" and Alice says "I don't know". The worm answers "then whichever direction you go, you will get somewhere!". without asking the right question we are just randomly wandering and will get somewhere, sometime, but not where we want to go.</p> </div> </article> </li> <li id="comment-168310" class="comment even thread-even depth-1"> <article id="div-comment-168310" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCGwI41kImputzyZbabKv4jQ" class="url" rel="ugc external nofollow">Ben Nguyen</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168310"><time datetime="2020-08-23T15:35:26-07:00">August 23, 2020 at 3:35 pm</time></a> </div> </footer> <div class="comment-content"> <p>Transformers seem to be the latest big thing! Kevin Rose/Tim Ferriss were impressed by OpenAI GPT-3's automatic website generation (they talk about it on the Random Show).</p> </div> </article> </li> <li id="comment-168309" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-168309" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCUhOVXEpNCW65-zK9Tv-rfA" class="url" rel="ugc external nofollow">faithful</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168309"><time datetime="2020-08-24T03:26:35-07:00">August 24, 2020 at 3:26 am</time></a> </div> </footer> <div class="comment-content"> <p>In its head hahahaha</p> </div> </article> </li> <li id="comment-168308" class="comment even thread-even depth-1"> <article id="div-comment-168308" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCUhOVXEpNCW65-zK9Tv-rfA" class="url" rel="ugc external nofollow">faithful</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/thoughts-about-gpt-3-dileep-george-and-lex-fridman/#comment-168308"><time datetime="2020-08-24T03:29:39-07:00">August 24, 2020 at 3:29 am</time></a> </div> </footer> <div class="comment-content"> <p>Your very convincing almost had "it" hahaha</p> </div> </article> </li> </ol> <p class="no-comments">Comments are closed.</p> </div> </main> </div> <div class="col-md-3 px-lg-3 "> </div> </div> </div> </div> <footer id="colophon" class="site-footer"> <div class="container"> <div class="row"> <div class="col-md-12 text-center"> <div class="site-info"> <span> Powered By: <a href="https://wordpress.org/" target="_blank">WordPress</a> </span> <span class="sep"> | </span> <span> Theme: <a href="https://odiethemes.com/themes/magazinebook/" target="_blank">MagazineBook</a> By OdieThemes </span> </div> </div> </div> </div> </footer> </div> <script>(function(){var advanced_ads_ga_UID="UA-88163215-1",advanced_ads_ga_anonymIP=!!1;window.advanced_ads_check_adblocker=function(t){var n=[],e=null;function a(t){var n=window.requestAnimationFrame||window.mozRequestAnimationFrame||window.webkitRequestAnimationFrame||function(t){return setTimeout(t,16)};n.call(window,t)}return a((function(){var t=document.createElement("div");t.innerHTML=" ",t.setAttribute("class","ad_unit ad-unit text-ad text_ad pub_300x250"),t.setAttribute("style","width: 1px !important; height: 1px !important; position: absolute !important; left: 0px !important; top: 0px !important; overflow: hidden !important;"),document.body.appendChild(t),a((function(){var a,o,i=null===(a=(o=window).getComputedStyle)||void 0===a?void 0:a.call(o,t),d=null==i?void 0:i.getPropertyValue("-moz-binding");e=i&&"none"===i.getPropertyValue("display")||"string"==typeof d&&-1!==d.indexOf("about:");for(var c=0,r=n.length;c<r;c++)n[c](e);n=[]}))})),function(t){"undefined"==typeof advanced_ads_adblocker_test&&(e=!0),null!==e?t(e):n.push(t)}}(),function(){function t(t){this.UID=t,this.analyticsObject="function"==typeof gtag;var n=this;return this.count=function(){gtag("event","AdBlock",{event_category:"Advanced Ads",event_label:"Yes",non_interaction:!0,send_to:n.UID})},function(){if(!n.analyticsObject){var e=document.createElement("script");e.src="https://www.googletagmanager.com/gtag/js?id="+t,e.async=!0,document.body.appendChild(e),window.dataLayer=window.dataLayer||[],window.gtag=function(){dataLayer.push(arguments)},n.analyticsObject=!0,gtag("js",new Date)}var a={send_page_view:!1,transport_type:"beacon"};window.advanced_ads_ga_anonymIP&&(a.anonymize_ip=!0),gtag("config",t,a)}(),this}advanced_ads_check_adblocker((function(n){n&&new t(advanced_ads_ga_UID).count()}))}();})();</script><div style="clear:both;width:100%;text-align:center; font-size:11px; "><a target="_blank" title="WP2Social Auto Publish" href="https://xyzscripts.com/wordpress-plugins/facebook-auto-publish/compare" >WP2Social Auto Publish</a> Powered By : <a target="_blank" title="PHP Scripts & Programs" href="http://www.xyzscripts.com" >XYZScripts.com</a></div><script type="text/javascript" src="https://theengineeringofconsciousexperience.com/wp-content/themes/magazinebook/js/navigation.js?ver=1.0.9" id="magazinebook-navigation-js"></script> <script type="text/javascript" src="https://theengineeringofconsciousexperience.com/wp-content/themes/magazinebook/js/skip-link-focus-fix.js?ver=1.0.9" id="magazinebook-skip-link-focus-fix-js"></script> <script type="text/javascript" src="https://theengineeringofconsciousexperience.com/wp-content/themes/magazinebook/js/jquery.easy-ticker.js?ver=3.1.0" id="magazinebook-news-ticker-js"></script> <script type="text/javascript" src="https://theengineeringofconsciousexperience.com/wp-content/themes/magazinebook/js/splide.min.js?ver=2.3.1" id="splide-js-js"></script> <script type="text/javascript" src="https://theengineeringofconsciousexperience.com/wp-content/themes/magazinebook/js/theme.js?ver=1.0.9" id="magazinebook-theme-js-js"></script> <script>!function(){window.advanced_ads_ready_queue=window.advanced_ads_ready_queue||[],advanced_ads_ready_queue.push=window.advanced_ads_ready;for(var d=0,a=advanced_ads_ready_queue.length;d<a;d++)advanced_ads_ready(advanced_ads_ready_queue[d])}();</script> </body> </html>