How GPT3 works, and its limitations. – The Engineering of Conscious Experience

Arthur Facredyn

A video covering how gpt-3 works, its limitations, and how to get access.

Join the waiting list:
https://openai.com/blog/openai-api/
Send an email to:
gdb@openai.com
Video that explains how to get access:
https://www.youtube.com/watch?v=7_c3zjpDvqg

by Arthur Facredyn

<iframe></p> <p><a href="https://www.youtube.com/watch?v=Y0MMK8GCCrQ">Source</a></p> <div class="be1e40beae42d993bafb8643f4ddde8b" data-index="3" style="float: none; margin:10px 0 10px 0; text-align:center;"> <script async src="https://pagead2.googlesyndication.com/pagead/js/adsbygoogle.js"></script> <ins class="adsbygoogle" style="display:block; text-align:center;" data-ad-layout="in-article" data-ad-format="fluid" data-ad-client="ca-pub-9244112244416304" data-ad-slot="4549240677"></ins> <script> (adsbygoogle = window.adsbygoogle || []).push({}); </script> </div> <div style="font-size: 0px; height: 0px; line-height: 0px; margin: 0; padding: 0; clear: both;"></div> </div> </article> <div class="clearfix"></div> <ul class="default-theme-post-navigation"> <li class="theme-nav-previous"><a href="https://theengineeringofconsciousexperience.com/mathematics-language-of-gods-common-mans-knowledge-ascension-talks/" rel="prev"><span class="meta-nav">←</span> Mathematics – Language of Gods || Common Man's Knowledge || Ascension Talks</a></li> <li class="theme-nav-next"><a href="https://theengineeringofconsciousexperience.com/how-to-be-an-upstander-instead-of-a-bystander/" rel="next">How to be an upstander instead of a bystander <span class="meta-nav">→</span></a></li> </ul> <div class="clearfix"></div> <h3 class='comment-reply-title'>Similar Posts</h3> <div class="mb-related-posts mb-simple-featured-posts mb-simple-featured-posts-wrap row"> <article class="mb-featured-article col-md-4 px-lg-3 post"> <a class="post-thumbnail" href="https://theengineeringofconsciousexperience.com/shot-in-the-dark-ac-dc-dodge-ad-teaser-2-but-an-ai-attemps-to-continue-the-songs-openai-jukebox/" aria-hidden="true" tabindex="-1"> <img width="400" height="300" src="https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/10/1602091162_hqdefault.jpg" class="attachment-magazinebook-featured-image-medium size-magazinebook-featured-image-medium wp-post-image" alt="" decoding="async" loading="lazy" srcset="https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/10/1602091162_hqdefault.jpg 480w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/10/1602091162_hqdefault-300x225.jpg 300w" sizes="(max-width: 400px) 100vw, 400px" /> </a> <span class="cat-links"><a href="https://theengineeringofconsciousexperience.com/category/gpt-3/" rel="category tag">GPT 3</a></span> <header class="entry-header"> <h3 class="entry-title"><a href="https://theengineeringofconsciousexperience.com/shot-in-the-dark-ac-dc-dodge-ad-teaser-2-but-an-ai-attemps-to-continue-the-songs-openai-jukebox/" rel="bookmark">Shot In The Dark AC/DC Dodge AD Teaser 2 but an AI Attemps to continue the songs (OpenAI Jukebox)</a></h3> <div class="entry-meta"> <span class="posted-on"><i class="far fa-calendar-alt"></i><a href="https://theengineeringofconsciousexperience.com/shot-in-the-dark-ac-dc-dodge-ad-teaser-2-but-an-ai-attemps-to-continue-the-songs-openai-jukebox/" rel="bookmark"><time class="entry-date published updated" datetime="2020-10-05T21:07:57-07:00">October 5, 2020</time></a></span><span class="byline"><i class="far fa-user-circle"></i><span class="author vcard"><a class="url fn n" href="https://theengineeringofconsciousexperience.com/author/44f9e85dfe8ebd7308acf581158c62b1/">leonardog27</a></span></span> </div> </header> </article> <article class="mb-featured-article col-md-4 px-lg-3 post"> <a class="post-thumbnail" href="https://theengineeringofconsciousexperience.com/is-gpt-3-overhyped-or-will-it-help-seos/" aria-hidden="true" tabindex="-1"> <img width="501" height="282" src="https://theengineeringofconsciousexperience.com/wp-content/uploads/2021/05/1620780430_maxresdefault.jpg" class="attachment-magazinebook-featured-image-medium size-magazinebook-featured-image-medium wp-post-image" alt="" decoding="async" loading="lazy" srcset="https://theengineeringofconsciousexperience.com/wp-content/uploads/2021/05/1620780430_maxresdefault.jpg 1280w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2021/05/1620780430_maxresdefault-300x169.jpg 300w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2021/05/1620780430_maxresdefault-1024x576.jpg 1024w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2021/05/1620780430_maxresdefault-768x432.jpg 768w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2021/05/1620780430_maxresdefault-520x293.jpg 520w" sizes="(max-width: 501px) 100vw, 501px" /> </a> <span class="cat-links"><a href="https://theengineeringofconsciousexperience.com/category/gpt-3/" rel="category tag">GPT 3</a></span> <header class="entry-header"> <h3 class="entry-title"><a href="https://theengineeringofconsciousexperience.com/is-gpt-3-overhyped-or-will-it-help-seos/" rel="bookmark">Is GPT-3 Overhyped (Or Will It Help SEOs?)</a></h3> <div class="entry-meta"> <span class="posted-on"><i class="far fa-calendar-alt"></i><a href="https://theengineeringofconsciousexperience.com/is-gpt-3-overhyped-or-will-it-help-seos/" rel="bookmark"><time class="entry-date published updated" datetime="2020-12-24T07:39:14-07:00">December 24, 2020</time></a></span><span class="byline"><i class="far fa-user-circle"></i><span class="author vcard"><a class="url fn n" href="https://theengineeringofconsciousexperience.com/author/8b6fda009c0d056a8e7a371340228e48/">Eric Siu - Leveling up</a></span></span> </div> </header> </article> <article class="mb-featured-article col-md-4 px-lg-3 post"> <a class="post-thumbnail" href="https://theengineeringofconsciousexperience.com/%d0%bc%d0%be%d0%b8-%d0%b2%d1%80%d0%b0%d0%b3%d0%b8-%d0%bf%d1%80%d0%b8%d1%80%d0%be%d0%b4%d0%b0-%d1%8d%d0%bd%d1%82%d1%80%d0%be%d0%bf%d0%b8%d1%8f-%d0%b8-%d1%81%d0%bc%d0%b5%d1%80%d1%82/" aria-hidden="true" tabindex="-1"> <img width="501" height="282" src="https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/12/1607834462_maxresdefault.jpg" class="attachment-magazinebook-featured-image-medium size-magazinebook-featured-image-medium wp-post-image" alt="" decoding="async" loading="lazy" srcset="https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/12/1607834462_maxresdefault.jpg 1280w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/12/1607834462_maxresdefault-300x169.jpg 300w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/12/1607834462_maxresdefault-1024x576.jpg 1024w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/12/1607834462_maxresdefault-768x432.jpg 768w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/12/1607834462_maxresdefault-520x293.jpg 520w" sizes="(max-width: 501px) 100vw, 501px" /> </a> <span class="cat-links"><a href="https://theengineeringofconsciousexperience.com/category/gpt-3/" rel="category tag">GPT 3</a></span> <header class="entry-header"> <h3 class="entry-title"><a href="https://theengineeringofconsciousexperience.com/%d0%bc%d0%be%d0%b8-%d0%b2%d1%80%d0%b0%d0%b3%d0%b8-%d0%bf%d1%80%d0%b8%d1%80%d0%be%d0%b4%d0%b0-%d1%8d%d0%bd%d1%82%d1%80%d0%be%d0%bf%d0%b8%d1%8f-%d0%b8-%d1%81%d0%bc%d0%b5%d1%80%d1%82/" rel="bookmark">«МОИ ВРАГИ – ПРИРОДА, ЭНТРОПИЯ и СМЕРТЬ»: интервью с нейросетью | Александр Панчин</a></h3> <div class="entry-meta"> <span class="posted-on"><i class="far fa-calendar-alt"></i><a href="https://theengineeringofconsciousexperience.com/%d0%bc%d0%be%d0%b8-%d0%b2%d1%80%d0%b0%d0%b3%d0%b8-%d0%bf%d1%80%d0%b8%d1%80%d0%be%d0%b4%d0%b0-%d1%8d%d0%bd%d1%82%d1%80%d0%be%d0%bf%d0%b8%d1%8f-%d0%b8-%d1%81%d0%bc%d0%b5%d1%80%d1%82/" rel="bookmark"><time class="entry-date published updated" datetime="2020-12-06T04:16:39-07:00">December 6, 2020</time></a></span><span class="byline"><i class="far fa-user-circle"></i><span class="author vcard"><a class="url fn n" href="https://theengineeringofconsciousexperience.com/author/bad5cb36d38090e4e03c41a810a1928c/">Alexander Panchin</a></span></span> </div> </header> </article> </div> <div id="comments" class="comments-area"> <h5 class="comments-title"> 5 thoughts on “<span>How GPT3 works, and its limitations.</span>” </h5> <ol class="comment-list"> <li id="comment-232311" class="comment even thread-even depth-1"> <article id="div-comment-232311" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCUW2neXECACXmBsaVjqIdTA" class="url" rel="ugc external nofollow">CreativeCraft -</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/how-gpt3-works-and-its-limitations/#comment-232311"><time datetime="2021-01-04T05:27:55-07:00">January 4, 2021 at 5:27 am</time></a> </div> </footer> <div class="comment-content"> <p><b>plays pigstep without any minecraft in the video</b></p> </div> </article> </li> <li id="comment-232310" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-232310" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCV-MI7NGalLki73ruSnpq4w" class="url" rel="ugc external nofollow">adrianx26</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/how-gpt3-works-and-its-limitations/#comment-232310"><time datetime="2021-01-07T10:22:45-07:00">January 7, 2021 at 10:22 am</time></a> </div> </footer> <div class="comment-content"> <p>it is possible with gpt3 to "help" gpt-2 to evolve ?</p> </div> </article> </li> <li id="comment-232309" class="comment even thread-even depth-1"> <article id="div-comment-232309" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCdOvggdQSQFyW73VgGD3Tcg" class="url" rel="ugc external nofollow">MrSchweppes</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/how-gpt3-works-and-its-limitations/#comment-232309"><time datetime="2021-01-25T06:53:13-07:00">January 25, 2021 at 6:53 am</time></a> </div> </footer> <div class="comment-content"> <p>Is it possible to connect GPT-3 to S3 for example where your store a bunch of books, and let GPT-3 answer questions based on these books?<br />Or connect it to some index of documents?<br />Like Amazon Lex can be connected to Elastic Search.<br />Do you think Microsoft will make something like that? Microsoft has exclusively licensed the GPT-3 LM, as you probably know.<br />I think it is possible to connect MS QnA maker with Azure Cognitive Search.</p> </div> </article> </li> <li id="comment-232308" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-232308" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCuHgYysp5aHn4U1LGhf4onA" class="url" rel="ugc external nofollow">Luis M</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/how-gpt3-works-and-its-limitations/#comment-232308"><time datetime="2021-02-25T15:23:24-07:00">February 25, 2021 at 3:23 pm</time></a> </div> </footer> <div class="comment-content"> <p>This is one of the best videos I have ever seen talking about how GPT-3 works and its limitations. Nice explanation!😁<br />Thanks 😄👍</p> </div> </article> </li> <li id="comment-232307" class="comment even thread-even depth-1"> <article id="div-comment-232307" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href="https://www.youtube.com/channel/UCI-6C0UkUL4wHRiNSWV9umw" class="url" rel="ugc external nofollow">Naionel</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/how-gpt3-works-and-its-limitations/#comment-232307"><time datetime="2021-03-15T12:03:54-07:00">March 15, 2021 at 12:03 pm</time></a> </div> </footer> <div class="comment-content"> <p>Is it possible to somehow integrate GPT-3 with Godot?</p> </div> </article> </li> </ol> <p class="no-comments">Comments are closed.</p> </div> </main> </div> <div class="col-md-3 px-lg-3 "> </div> </div> </div> </div> <footer id="colophon" class="site-footer"> <div class="container"> <div class="row"> <div class="col-md-12 text-center"> <div class="site-info"> <span> Powered By: <a href="https://wordpress.org/" target="_blank">WordPress</a> </span> <span class="sep"> | </span> <span> Theme: <a href="https://odiethemes.com/themes/magazinebook/" target="_blank">MagazineBook</a> By OdieThemes </span> </div> </div> </div> </div> </footer> </div> <script>(function(){var advanced_ads_ga_UID="UA-88163215-1",advanced_ads_ga_anonymIP=!!1;window.advanced_ads_check_adblocker=function(t){var n=[],e=null;function a(t){var n=window.requestAnimationFrame||window.mozRequestAnimationFrame||window.webkitRequestAnimationFrame||function(t){return setTimeout(t,16)};n.call(window,t)}return a((function(){var t=document.createElement("div");t.innerHTML=" ",t.setAttribute("class","ad_unit ad-unit text-ad text_ad pub_300x250"),t.setAttribute("style","width: 1px !important; height: 1px !important; position: absolute !important; left: 0px !important; top: 0px !important; overflow: hidden !important;"),document.body.appendChild(t),a((function(){var a,o,i=null===(a=(o=window).getComputedStyle)||void 0===a?void 0:a.call(o,t),d=null==i?void 0:i.getPropertyValue("-moz-binding");e=i&&"none"===i.getPropertyValue("display")||"string"==typeof d&&-1!==d.indexOf("about:");for(var c=0,r=n.length;c<r;c++)n[c](e);n=[]}))})),function(t){"undefined"==typeof advanced_ads_adblocker_test&&(e=!0),null!==e?t(e):n.push(t)}}(),(()=>{function t(t){this.UID=t,this.analyticsObject="function"==typeof gtag;var n=this;return this.count=function(){gtag("event","AdBlock",{event_category:"Advanced Ads",event_label:"Yes",non_interaction:!0,send_to:n.UID})},function(){if(!n.analyticsObject){var e=document.createElement("script");e.src="https://www.googletagmanager.com/gtag/js?id="+t,e.async=!0,document.body.appendChild(e),window.dataLayer=window.dataLayer||[],window.gtag=function(){dataLayer.push(arguments)},n.analyticsObject=!0,gtag("js",new Date)}var a={send_page_view:!1,transport_type:"beacon"};window.advanced_ads_ga_anonymIP&&(a.anonymize_ip=!0),gtag("config",t,a)}(),this}advanced_ads_check_adblocker((function(n){n&&new t(advanced_ads_ga_UID).count()}))})();})();</script><div style="clear:both;width:100%;text-align:center; font-size:11px; "><a target="_blank" title="WP2Social Auto Publish" href="https://xyzscripts.com/wordpress-plugins/facebook-auto-publish/compare" >WP2Social Auto Publish</a> Powered By : <a target="_blank" title="PHP Scripts & Programs" href="http://www.xyzscripts.com" >XYZScripts.com</a></div><script type="text/javascript" src="https://theengineeringofconsciousexperience.com/wp-content/themes/magazinebook/js/navigation.js?ver=1.0.9" id="magazinebook-navigation-js"></script> <script type="text/javascript" src="https://theengineeringofconsciousexperience.com/wp-content/themes/magazinebook/js/skip-link-focus-fix.js?ver=1.0.9" id="magazinebook-skip-link-focus-fix-js"></script> <script type="text/javascript" src="https://theengineeringofconsciousexperience.com/wp-content/themes/magazinebook/js/jquery.easy-ticker.js?ver=3.1.0" id="magazinebook-news-ticker-js"></script> <script type="text/javascript" src="https://theengineeringofconsciousexperience.com/wp-content/themes/magazinebook/js/splide.min.js?ver=2.3.1" id="splide-js-js"></script> <script type="text/javascript" src="https://theengineeringofconsciousexperience.com/wp-content/themes/magazinebook/js/theme.js?ver=1.0.9" id="magazinebook-theme-js-js"></script> <script>!function(){window.advanced_ads_ready_queue=window.advanced_ads_ready_queue||[],advanced_ads_ready_queue.push=window.advanced_ads_ready;for(var d=0,a=advanced_ads_ready_queue.length;d<a;d++)advanced_ads_ready(advanced_ads_ready_queue[d])}();</script> </body> </html>