Reviews are a goldmine of data for ecommerce sites, yet many businesses fail to fully harness their potential. Often, reviews are collected but left underutilized, despite being some of the most valuable user-generated content available. They provide authentic insights from real customers who have experienced your products firsthand, making them an invaluable resource for creating descriptions that resonate. By using generative AI, you can transform these reviews into powerful product descriptions. Using tools like Screaming Frog’s integration with OpenAI allows seamless extraction of customer feedback and converts it into compelling, SEO-friendly content through ChatGPT. This guide will walk you through the process step by step.
1. Retrieve Reviews from Your Website
To start with, we need to extract reviews from your website. For years, Screaming Frog has had a Custom Extraction feature that allows you to extract anything you want. However, with recent updates, they’ve made this even easier. First, navigate to Configuration > Custom > Custom Extraction > Add. You’ll see a new field added to the table, which you should name “Reviews.” Then, click the “Globe” icon. This allows you to create a custom extract using their interactive features.
Once you click that icon, you’ll be brought to Screaming Frog’s visual editor. Insert a sample product page URL in the URL bar. Once it’s loaded, scan through the page to find where your reviews are, and click on that area. In the Suggestions section, you’ll see Screaming Frog automatically suggest regex or CSS commands to extract the text. However, you’ll likely need to adjust the settings to extract the exact text you need. Use the Rendered HTML Preview to ensure all your review content is being captured accurately.
At this point, perform test crawls and check the Custom Extraction section in Screaming Frog to verify that the text is being extracted correctly before proceeding to the next step. Once you have confirmed the accuracy of the extracted reviews, you are ready to move on to the next phase of the process.
2. Link Screaming Frog to OpenAI
Now that Screaming Frog has successfully extracted our reviews, the next step is to take that valuable data a step further by linking Screaming Frog to OpenAI. To begin, ensure Screaming Frog can store the HTML by navigating to Configuration > Spider > Extraction and checking both “Store HTML” and “Store Rendered” HTML. These settings will make sure Screaming Frog can save the HTML content needed for further processing.
Next, configure Screaming Frog to connect to OpenAI by adding your OpenAI API key. You can do this by going to Configuration > API Access > AI > OpenAI, where you will find an option to add your key. This connection allows Screaming Frog to communicate with OpenAI’s servers and utilize the GPT-3 model to transform review data into product descriptions.
With the API key in place, Screaming Frog is now officially linked to OpenAI, and the reviews you extracted can be analyzed by ChatGPT to create compelling, SEO-friendly product descriptions. Having successfully linked Screaming Frog to OpenAI, the groundwork is set for generating your descriptions through the next step.
3. Set Up Your Prompt
Once Screaming Frog is linked to OpenAI, you need to set up your prompt configuration. Start by going to the Prompt Configuration tab and clicking Add. Name your prompt “Product Descriptions.” In the Page Text dropdown, select Custom Extraction > Reviews. This configuration enables Screaming Frog to send the text extracted from reviews to OpenAI for processing.
Now, you’ll need to craft your custom prompt. Enter it in the provided field. For example: “Below, I’m giving you all of the reviews of a particular product on my site. Based on these reviews, please write a description of the product.” By setting up this specific prompt, you’re guiding the AI to focus on the review data and generate a relevant product description.
Before running a full crawl, it’s essential to test the output to verify that the generated descriptions meet your expectations. You can do this by clicking the Play button next to the prompt. This will open up the OpenAI Prompt Tester where you can input a sample page and directly see the results produced by the AI. Adjust the prompt as necessary to refine the output until you are satisfied with the descriptions generated from your review data. Once your prompt is fine-tuned, you are ready to initiate the full crawl.
4. Initiate Your Crawl
With everything configured, it’s time to start crawling your website to generate new product descriptions based on the extracted reviews. Insert your home page URL into Screaming Frog in “Spider” mode and initiate the crawl. If your site uses JavaScript to load reviews, make sure to enable JavaScript crawling to ensure Screaming Frog renders that content accurately.
The crawling process will take some time depending on the size of your website and the number of product pages it has. Once the crawl is complete, navigate to AI > Product Description in the right-side bar to find your new product descriptions. These descriptions should now be populated with the AI-generated content based on the reviews extracted from your website, thus providing you with fresh, SEO-friendly product descriptions.
Each product page will now feature a product description created from real customer feedback, ensuring the descriptions are accurate, engaging, and tailored to user experiences. Continue to monitor the generated descriptions and be prepared to make any necessary adjustments.
5. Evaluate the Output
Ecommerce sites often overlook the immense value in customer reviews, missing out on robust, untapped insights. Although businesses frequently collect reviews, they seldom leverage them fully, despite reviews being among the most genuine user-generated content. These reviews are firsthand accounts from real customers who have used the products, making them a priceless resource for crafting engaging descriptions. By implementing generative AI, you can transform these reviews into captivating product descriptions. One effective method is using Screaming Frog’s integration with OpenAI. This setup effortlessly gathers customer feedback and uses ChatGPT to convert it into compelling, SEO-friendly content. This comprehensive guide will walk you through the entire process, ensuring you can harness the full power of customer reviews. By taking advantage of these tools, you can create dynamic, relatable product descriptions that echo the authentic experiences of your customers, fostering a stronger connection and boosting your site’s performance.
