Recursively summarize text of any length with GPT-3 – The Engineering of Conscious Experience

David Shapiro

Patreon: https://www.patreon.com/daveshap (Discord via Patreon)
Substack: https://daveshap.substack.com/ (Free Mailing List)
LinkedIn: https://www.linkedin.com/in/dave-shap-automator/
GitHub: https://github.com/daveshap

<iframe></p> <p><a href="https://www.youtube.com/watch?v=fflkFtIwQXo">Source</a></p> <div class="be1e40beae42d993bafb8643f4ddde8b" data-index="3" style="float: none; margin:10px 0 10px 0; text-align:center;"> <script async src="https://pagead2.googlesyndication.com/pagead/js/adsbygoogle.js"></script> <ins class="adsbygoogle" style="display:block; text-align:center;" data-ad-layout="in-article" data-ad-format="fluid" data-ad-client="ca-pub-9244112244416304" data-ad-slot="4549240677"></ins> <script> (adsbygoogle = window.adsbygoogle || []).push({}); </script> </div> <div style="font-size: 0px; height: 0px; line-height: 0px; margin: 0; padding: 0; clear: both;"></div> </div> </article> <div class="clearfix"></div> <ul class="default-theme-post-navigation"> <li class="theme-nav-previous"><a href="https://theengineeringofconsciousexperience.com/java-api-for-sql-data-definition-language-sql/" rel="prev"><span class="meta-nav">←</span> Java API for SQL Data Definition Language – SQL</a></li> <li class="theme-nav-next"><a href="https://theengineeringofconsciousexperience.com/semantics-meaning-in-hindi-semantics-ka-matlab-kya-hota-hai-word-meaning-in-hindi/" rel="next">Semantics meaning in hindi | semantics ka matlab kya hota hai | word meaning in hindi <span class="meta-nav">→</span></a></li> </ul> <div class="clearfix"></div> <h3 class='comment-reply-title'>Similar Posts</h3> <div class="mb-related-posts mb-simple-featured-posts mb-simple-featured-posts-wrap row"> <article class="mb-featured-article col-md-4 px-lg-3 post"> <a class="post-thumbnail" href="https://theengineeringofconsciousexperience.com/%eb%b9%84%ec%a0%91%ec%a7%80%ea%b3%84%ed%86%b5-%ec%a7%80%eb%9d%bd%eb%b3%b4%ed%98%b8%ec%8b%9c%ec%8a%a4%ed%85%9c-%ea%b2%80%ed%86%a0%ec%95%88%eb%82%b4page-102/" aria-hidden="true" tabindex="-1"> <img width="400" height="300" src="https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/11/1605585248_hqdefault.jpg" class="attachment-magazinebook-featured-image-medium size-magazinebook-featured-image-medium wp-post-image" alt="" loading="lazy" srcset="https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/11/1605585248_hqdefault.jpg 480w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2020/11/1605585248_hqdefault-300x225.jpg 300w" sizes="(max-width: 400px) 100vw, 400px" /> </a> <span class="cat-links"><a href="https://theengineeringofconsciousexperience.com/category/gpt-3/" rel="category tag">GPT 3</a></span> <header class="entry-header"> <h3 class="entry-title"><a href="https://theengineeringofconsciousexperience.com/%eb%b9%84%ec%a0%91%ec%a7%80%ea%b3%84%ed%86%b5-%ec%a7%80%eb%9d%bd%eb%b3%b4%ed%98%b8%ec%8b%9c%ec%8a%a4%ed%85%9c-%ea%b2%80%ed%86%a0%ec%95%88%eb%82%b4page-102/" rel="bookmark">비접지계통 지락보호시스템 검토안내(Page 102)</a></h3> <div class="entry-meta"> <span class="posted-on"><i class="far fa-calendar-alt"></i><a href="https://theengineeringofconsciousexperience.com/%eb%b9%84%ec%a0%91%ec%a7%80%ea%b3%84%ed%86%b5-%ec%a7%80%eb%9d%bd%eb%b3%b4%ed%98%b8%ec%8b%9c%ec%8a%a4%ed%85%9c-%ea%b2%80%ed%86%a0%ec%95%88%eb%82%b4page-102/" rel="bookmark"><time class="entry-date published updated" datetime="2020-11-14T01:02:52-07:00">November 14, 2020</time></a></span><span class="byline"><i class="far fa-user-circle"></i><span class="author vcard"><a class="url fn n" href="https://theengineeringofconsciousexperience.com/author/492e27dc3950752dd81d03e80edbe0ae/">김세용 발송배전</a></span></span> </div> </header> </article> <article class="mb-featured-article col-md-4 px-lg-3 post"> <a class="post-thumbnail" href="https://theengineeringofconsciousexperience.com/this-ai-got-me-a-date-on-tinder/" aria-hidden="true" tabindex="-1"> <img width="501" height="282" src="https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/12/1670039737_maxresdefault.jpg" class="attachment-magazinebook-featured-image-medium size-magazinebook-featured-image-medium wp-post-image" alt="" loading="lazy" srcset="https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/12/1670039737_maxresdefault.jpg 1280w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/12/1670039737_maxresdefault-300x169.jpg 300w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/12/1670039737_maxresdefault-1024x576.jpg 1024w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/12/1670039737_maxresdefault-768x432.jpg 768w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/12/1670039737_maxresdefault-549x309.jpg 549w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/12/1670039737_maxresdefault-470x264.jpg 470w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/12/1670039737_maxresdefault-233x131.jpg 233w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/12/1670039737_maxresdefault-230x129.jpg 230w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/12/1670039737_maxresdefault-360x203.jpg 360w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/12/1670039737_maxresdefault-100x56.jpg 100w" sizes="(max-width: 501px) 100vw, 501px" /> </a> <span class="cat-links"><a href="https://theengineeringofconsciousexperience.com/category/gpt-3/" rel="category tag">GPT 3</a></span> <header class="entry-header"> <h3 class="entry-title"><a href="https://theengineeringofconsciousexperience.com/this-ai-got-me-a-date-on-tinder/" rel="bookmark">This AI got me a date on Tinder</a></h3> <div class="entry-meta"> <span class="posted-on"><i class="far fa-calendar-alt"></i><a href="https://theengineeringofconsciousexperience.com/this-ai-got-me-a-date-on-tinder/" rel="bookmark"><time class="entry-date published updated" datetime="2022-09-29T13:39:10-07:00">September 29, 2022</time></a></span><span class="byline"><i class="far fa-user-circle"></i><span class="author vcard"><a class="url fn n" href="https://theengineeringofconsciousexperience.com/author/anthony_riera/">Anthony Riera</a></span></span> </div> </header> </article> <article class="mb-featured-article col-md-4 px-lg-3 post"> <a class="post-thumbnail" href="https://theengineeringofconsciousexperience.com/tajmid-bolgesi-sniperghost-warrior-contracts-2-3-bolum-turkce-yama/" aria-hidden="true" tabindex="-1"> <img width="501" height="282" src="https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/09/1664076492_maxresdefault.jpg" class="attachment-magazinebook-featured-image-medium size-magazinebook-featured-image-medium wp-post-image" alt="" loading="lazy" srcset="https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/09/1664076492_maxresdefault.jpg 1280w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/09/1664076492_maxresdefault-300x169.jpg 300w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/09/1664076492_maxresdefault-1024x576.jpg 1024w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/09/1664076492_maxresdefault-768x432.jpg 768w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/09/1664076492_maxresdefault-549x309.jpg 549w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/09/1664076492_maxresdefault-470x264.jpg 470w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/09/1664076492_maxresdefault-233x131.jpg 233w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/09/1664076492_maxresdefault-230x129.jpg 230w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/09/1664076492_maxresdefault-360x203.jpg 360w, https://theengineeringofconsciousexperience.com/wp-content/uploads/2022/09/1664076492_maxresdefault-100x56.jpg 100w" sizes="(max-width: 501px) 100vw, 501px" /> </a> <span class="cat-links"><a href="https://theengineeringofconsciousexperience.com/category/gpt-3/" rel="category tag">GPT 3</a></span> <header class="entry-header"> <h3 class="entry-title"><a href="https://theengineeringofconsciousexperience.com/tajmid-bolgesi-sniperghost-warrior-contracts-2-3-bolum-turkce-yama/" rel="bookmark">TAJMİD BÖLGESİ | SNİPER;GHOST WARRİOR CONTRACTS 2 / 3.BÖLÜM TÜRKÇE YAMA</a></h3> <div class="entry-meta"> <span class="posted-on"><i class="far fa-calendar-alt"></i><a href="https://theengineeringofconsciousexperience.com/tajmid-bolgesi-sniperghost-warrior-contracts-2-3-bolum-turkce-yama/" rel="bookmark"><time class="entry-date published updated" datetime="2021-07-02T01:00:06-07:00">July 2, 2021</time></a></span><span class="byline"><i class="far fa-user-circle"></i><span class="author vcard"><a class="url fn n" href="https://theengineeringofconsciousexperience.com/author/smurfdad/">SMURFDAD</a></span></span> </div> </header> </article> </div> <div id="comments" class="comments-area"> <h5 class="comments-title"> 20 thoughts on “<span>Recursively summarize text of any length with GPT-3</span>” </h5> <ol class="comment-list"> <li id="comment-317984" class="comment even thread-even depth-1"> <article id="div-comment-317984" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UCksm0LJgJn7BzyKEI0UBX7Q' rel='external nofollow ugc' class='url'>Muhammed Çağrı Kartal</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317984"><time datetime="2022-05-29T12:33:06-07:00">May 29, 2022 at 12:33 pm</time></a> </div> </footer> <div class="comment-content"> <p>thank you so much</p> </div> </article> </li> <li id="comment-317983" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-317983" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UCwyQkEUBIINrfGtzOrugkEQ' rel='external nofollow ugc' class='url'>Alan Tennant</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317983"><time datetime="2022-05-29T17:27:35-07:00">May 29, 2022 at 5:27 pm</time></a> </div> </footer> <div class="comment-content"> <p>thank you 🙂</p> <p>I'm super <i>not</i> corporate, and/but this seems essential, chunks depend on surrounding chunks for further summarisation 🙂 clearly yes thank you.</p> </div> </article> </li> <li id="comment-317982" class="comment even thread-even depth-1"> <article id="div-comment-317982" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UC-PRvpgLuafPD2-6ebgVsKQ' rel='external nofollow ugc' class='url'>Soham Sarkar</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317982"><time datetime="2022-05-31T10:46:49-07:00">May 31, 2022 at 10:46 am</time></a> </div> </footer> <div class="comment-content"> <p>this was really cool but doesnt feel economically viable with the token usage no?</p> </div> </article> </li> <li id="comment-317981" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-317981" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UC0_a8SNpTFkmVv5SLMs1CIA' rel='external nofollow ugc' class='url'>Rohan-Paul-AI</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317981"><time datetime="2022-05-31T17:26:18-07:00">May 31, 2022 at 5:26 pm</time></a> </div> </footer> <div class="comment-content"> <p>Just found your Channel and your Plan with this series. This is super impressive. Thanks for doing it. 💯</p> </div> </article> </li> <li id="comment-317980" class="comment even thread-even depth-1"> <article id="div-comment-317980" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UCVtj1U2h8WAzauYHoAmQd5A' rel='external nofollow ugc' class='url'>rerere284</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317980"><time datetime="2022-06-01T19:19:34-07:00">June 1, 2022 at 7:19 pm</time></a> </div> </footer> <div class="comment-content"> <p>I don't know if it was the intention of the video but I wound up reading the whole summary by using . and , to frame by frame though the summary. I guess I know what the book version of Alice in Wonderland is now.</p> </div> </article> </li> <li id="comment-317979" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-317979" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UCksm0LJgJn7BzyKEI0UBX7Q' rel='external nofollow ugc' class='url'>Muhammed Çağrı Kartal</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317979"><time datetime="2022-06-03T22:48:10-07:00">June 3, 2022 at 10:48 pm</time></a> </div> </footer> <div class="comment-content"> <p>hello, I am afraid we can lose some key concepts maybe while connecting the chunks, can you please share what you think about this worry ?</p> </div> </article> </li> <li id="comment-317978" class="comment even thread-even depth-1"> <article id="div-comment-317978" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UCOiKXCIc__TtOYodWVCnv9Q' rel='external nofollow ugc' class='url'>Vulnerable Growth</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317978"><time datetime="2022-07-03T11:00:35-07:00">July 3, 2022 at 11:00 am</time></a> </div> </footer> <div class="comment-content"> <p>Have you ever tried improving the summarization by adding the context before and after a chunk? I’ll probably try this myself, but I wonder if the summarization could be improved if you feed the model some “key points” from the text along with every chunk. You can imagine that if you want a high-quality summarization, it would be good for the model to be able to point out things like “what happened to Alice here was foreshadowed when she was doing x.” Or something like that. For more academic texts, it might be something like relating concepts that were introduced in the text at different places in the text. Instead of just giving the definition of concept A, the model includes some additional info about how it relates to concept B even though it was not included in the chunk.</p> <p>My guess is that you’d have to run a few different prompts across the text (though you could use a language model from huggingface to save some cash for some of the tasks) and then use the outputs as input to the general summarization. Like, use a model to extract the most important concepts from a paper (maybe make use of metadata and such), then store all the concepts in some way so that you can use them during summarization.</p> <p>Any thoughts on this?</p> </div> </article> </li> <li id="comment-317977" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-317977" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UCGYeHdvEQ6Z8KHVWQ2OGWsw' rel='external nofollow ugc' class='url'>Test me</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317977"><time datetime="2022-10-15T02:29:46-07:00">October 15, 2022 at 2:29 am</time></a> </div> </footer> <div class="comment-content"> <p>super useful to say the least, thank you so much mate</p> </div> </article> </li> <li id="comment-317976" class="comment even thread-even depth-1"> <article id="div-comment-317976" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UC3lCsY5f0sYb-GzyAWkB8eg' rel='external nofollow ugc' class='url'>B.s.M</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317976"><time datetime="2022-11-27T12:53:18-07:00">November 27, 2022 at 12:53 pm</time></a> </div> </footer> <div class="comment-content"> <p>Why not just paste whatever scientific article in openai playground and summarize? I am just a beginner. Thank you</p> </div> </article> </li> <li id="comment-317975" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-317975" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UCjc7bphtp60xLwt8A3v0I_g' rel='external nofollow ugc' class='url'>Wim den Herder</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317975"><time datetime="2022-12-26T22:25:43-07:00">December 26, 2022 at 10:25 pm</time></a> </div> </footer> <div class="comment-content"> <p>One of my dreams was to be able to click on parts of a summary and then it would expand it into bigger summaries. (the opposite direction). You would have to know which part in the summary corresponds to the original chunk, but that would be a supercool idea!</p> </div> </article> </li> <li id="comment-317974" class="comment even thread-even depth-1"> <article id="div-comment-317974" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UCU1EeWDpiZBaYBS5EwN3EbQ' rel='external nofollow ugc' class='url'>Steve Finkelstein</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317974"><time datetime="2023-01-12T06:51:04-07:00">January 12, 2023 at 6:51 am</time></a> </div> </footer> <div class="comment-content"> <p>When you're breaking into chunks in this fashion, don't you risk cutting in the middle of a word/sentence which can impact summarization of that chunk?</p> </div> </article> </li> <li id="comment-317973" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-317973" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UCl7IQcJ3RxXAw-twuJYSF2w' rel='external nofollow ugc' class='url'>react stuff react</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317973"><time datetime="2023-01-15T09:09:01-07:00">January 15, 2023 at 9:09 am</time></a> </div> </footer> <div class="comment-content"> <p>45 iterations of api use? total cost ? just curious 👀 as if you proof read the summarized content. rewrite manually. check and then do the final work. check again and again. </p> <p>to make it perfect and to stnadard</p> </div> </article> </li> <li id="comment-317972" class="comment even thread-even depth-1"> <article id="div-comment-317972" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UC21LgApp8WLsZgj5iGxUpJw' rel='external nofollow ugc' class='url'>Derek E</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317972"><time datetime="2023-01-18T16:10:41-07:00">January 18, 2023 at 4:10 pm</time></a> </div> </footer> <div class="comment-content"> <p>Works very well! Thank you – excellent tutorial</p> </div> </article> </li> <li id="comment-317971" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-317971" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UCjA_o1d0Yprisi7k8dQ2Atw' rel='external nofollow ugc' class='url'>Dan</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317971"><time datetime="2023-02-25T11:43:36-07:00">February 25, 2023 at 11:43 am</time></a> </div> </footer> <div class="comment-content"> <p>When Dave brought up that calculator to make a division query my head was brought back down to earth. "I'm really okay," I said to myself.</p> </div> </article> </li> <li id="comment-317970" class="comment even thread-even depth-1"> <article id="div-comment-317970" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UCEnDxGmpsv1KQtkBgWY5Ldg' rel='external nofollow ugc' class='url'>Ariel Romero</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317970"><time datetime="2023-03-12T08:09:27-07:00">March 12, 2023 at 8:09 am</time></a> </div> </footer> <div class="comment-content"> <p>thanks you</p> </div> </article> </li> <li id="comment-317969" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-317969" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UCPLecBI0RzD65asjic5FSVw' rel='external nofollow ugc' class='url'>NİMET SEKMAN</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317969"><time datetime="2023-04-05T00:40:04-07:00">April 5, 2023 at 12:40 am</time></a> </div> </footer> <div class="comment-content"> <p>I AM A STUDENT. I WANT TO GET THE PDF BOOKS I HAVE IN HAND IN SUMMARY, CAN YOU PLEASE HELP ME? I DON'T KNOW HOW TO INSTALL THIS SYSTEM, WHAT ARE THE PROCESSING STEPS. I NEED HELP FROM YOU</p> </div> </article> </li> <li id="comment-317968" class="comment even thread-even depth-1"> <article id="div-comment-317968" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UCaSkYvmMPrxKZa2iPRXPnjw' rel='external nofollow ugc' class='url'>Ramiro Muniz</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317968"><time datetime="2023-05-04T22:54:32-07:00">May 4, 2023 at 10:54 pm</time></a> </div> </footer> <div class="comment-content"> <p>Thank you for this, I no zero python but this makes me want to know it! I look forward to trying this out on my academic books. Question, have you made an updated video on this process?</p> </div> </article> </li> <li id="comment-317967" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-317967" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UChJjfMU2w__wik_Kc_-VYuw' rel='external nofollow ugc' class='url'>Real Talker 101</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317967"><time datetime="2023-05-29T09:20:52-07:00">May 29, 2023 at 9:20 am</time></a> </div> </footer> <div class="comment-content"> <p>I have a case usage of needing 2 million words distilled down to 10k, what / where can I find mass word input for such summerization? Or what is a workaround for me to arrive at this context output desire? I was trying to upload either a PDF and or have a link that I could just copy paste over into chat GPT, but I have the free version and it tells me it can't read links, what can I do? I'm obviously not trying to have the entire 2 million at once, but that is the end game result over time I desire.</p> </div> </article> </li> <li id="comment-317966" class="comment even thread-even depth-1"> <article id="div-comment-317966" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UCe-0DKfSnsUGu6gDY4IBs8Q' rel='external nofollow ugc' class='url'>Ashwati Menon</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317966"><time datetime="2023-08-03T00:56:41-07:00">August 3, 2023 at 12:56 am</time></a> </div> </footer> <div class="comment-content"> <p>is there a quick way of getting reports summarised, like huge pdfs with ton load of data in1 page?</p> </div> </article> </li> <li id="comment-317965" class="comment odd alt thread-odd thread-alt depth-1"> <article id="div-comment-317965" class="comment-body"> <footer class="comment-meta"> <div class="comment-author vcard"> <b class="fn"><a href='https://www.youtube.com/channel/UC-GwPUiBZ0s4UzEPITQF86Q' rel='external nofollow ugc' class='url'>Nicola</a></b> <span class="says">says:</span> </div> <div class="comment-metadata"> <a href="https://theengineeringofconsciousexperience.com/recursively-summarize-text-of-any-length-with-gpt-3/#comment-317965"><time datetime="2023-08-17T06:10:14-07:00">August 17, 2023 at 6:10 am</time></a> </div> </footer> <div class="comment-content"> <p>Hi @davidshapiroautomator , thanks for the video. Wondering what is including the the openaiapikey file – is it just the key?</p> </div> </article> </li> </ol> <p class="no-comments">Comments are closed.</p> </div> </main> </div> <div class="col-md-3 px-lg-3 "> </div> </div> </div> </div> <footer id="colophon" class="site-footer"> <div class="container"> <div class="row"> <div class="col-md-12 text-center"> <div class="site-info"> <span> Powered By: <a href="https://wordpress.org/" target="_blank">WordPress</a> </span> <span class="sep"> | </span> <span> Theme: <a href="https://odiethemes.com/themes/magazinebook/" target="_blank">MagazineBook</a> By OdieThemes </span> </div> </div> </div> </div> </footer> </div> <script>(function(){var advanced_ads_ga_UID="UA-88163215-1",advanced_ads_ga_anonymIP=!!1;window.advanced_ads_check_adblocker=function(t){var n=[],e=null;function a(t){var n=window.requestAnimationFrame||window.mozRequestAnimationFrame||window.webkitRequestAnimationFrame||function(t){return setTimeout(t,16)};n.call(window,t)}return a((function(){var t=document.createElement("div");t.innerHTML=" ",t.setAttribute("class","ad_unit ad-unit text-ad text_ad pub_300x250"),t.setAttribute("style","width: 1px !important; height: 1px !important; position: absolute !important; left: 0px !important; top: 0px !important; overflow: hidden !important;"),document.body.appendChild(t),a((function(){var a,o,i=null===(a=(o=window).getComputedStyle)||void 0===a?void 0:a.call(o,t),d=null==i?void 0:i.getPropertyValue("-moz-binding");e=i&&"none"===i.getPropertyValue("display")||"string"==typeof d&&-1!==d.indexOf("about:");for(var c=0,r=n.length;c<r;c++)n[c](e);n=[]}))})),function(t){"undefined"==typeof advanced_ads_adblocker_test&&(e=!0),null!==e?t(e):n.push(t)}}(),function(){function t(t){this.UID=t,this.analyticsObject="function"==typeof gtag;var n=this;return this.count=function(){gtag("event","AdBlock",{event_category:"Advanced Ads",event_label:"Yes",non_interaction:!0,send_to:n.UID})},function(){if(!n.analyticsObject){var e=document.createElement("script");e.src="https://www.googletagmanager.com/gtag/js?id="+t,e.async=!0,document.body.appendChild(e),window.dataLayer=window.dataLayer||[],window.gtag=function(){dataLayer.push(arguments)},n.analyticsObject=!0,gtag("js",new Date)}var a={send_page_view:!1,transport_type:"beacon"};window.advanced_ads_ga_anonymIP&&(a.anonymize_ip=!0),gtag("config",t,a)}(),this}advanced_ads_check_adblocker((function(n){n&&new t(advanced_ads_ga_UID).count()}))}();})();</script><div style="clear:both;width:100%;text-align:center; font-size:11px; "><a target="_blank" title="WP2Social Auto Publish" href="https://xyzscripts.com/wordpress-plugins/facebook-auto-publish/compare" >WP2Social Auto Publish</a> Powered By : <a target="_blank" title="PHP Scripts & Programs" href="http://www.xyzscripts.com" >XYZScripts.com</a></div><script type='text/javascript' src='https://theengineeringofconsciousexperience.com/wp-content/plugins/bluehost-wordpress-plugin/vendor/newfold-labs/wp-module-ecommerce/includes/wpnavbar.js?ver=1.0' id='nfd_wpnavbar_setting-js'></script> <script type='text/javascript' src='https://theengineeringofconsciousexperience.com/wp-content/themes/magazinebook/js/navigation.js?ver=1.0.9' id='magazinebook-navigation-js'></script> <script type='text/javascript' src='https://theengineeringofconsciousexperience.com/wp-content/themes/magazinebook/js/skip-link-focus-fix.js?ver=1.0.9' id='magazinebook-skip-link-focus-fix-js'></script> <script type='text/javascript' src='https://theengineeringofconsciousexperience.com/wp-content/themes/magazinebook/js/jquery.easy-ticker.js?ver=3.1.0' id='magazinebook-news-ticker-js'></script> <script type='text/javascript' src='https://theengineeringofconsciousexperience.com/wp-content/themes/magazinebook/js/splide.min.js?ver=2.3.1' id='splide-js-js'></script> <script type='text/javascript' src='https://theengineeringofconsciousexperience.com/wp-content/themes/magazinebook/js/theme.js?ver=1.0.9' id='magazinebook-theme-js-js'></script> <script>!function(){window.advanced_ads_ready_queue=window.advanced_ads_ready_queue||[],advanced_ads_ready_queue.push=window.advanced_ads_ready;for(var d=0,a=advanced_ads_ready_queue.length;d<a;d++)advanced_ads_ready(advanced_ads_ready_queue[d])}();</script> </body> </html>