Test crawl settings - Fluid Topics - Latest

Fluid Topics Configuration and Administration Guide
Category
Reference Guides
Audience
public
Version
Latest

Web browsers provide crawlers with tools to access the content of a website that is not displayed, but is nevertheless available to crawlers.

It is not necessary to enable crawl on the portal to perform this test procedure.

Prepare the content

The following lines show the OD1000 Time Machine User Guide DITA bookmap where the Category and Product metadata are set and the Introduction to Time Machines topic is referred to:

<?xml version="1.0" ?>
<!DOCTYPE bookmap PUBLIC '-//OASIS//DTD DITA BookMap//EN' 'bookmap.dtd'>
<bookmap xml:lang="en-US" linking="none">
  <booktitle>
    <mainbooktitle>OD1000 User Guide</mainbooktitle>
  </booktitle>
  <bookmeta>
    <othermeta name="Category" content="TechDoc"/>
    <othermeta name="Product" content="OD1000"/>
  </bookmeta>
  <chapter>
    <topicref href="intro_to_time_machines.dita"/>
        ...
  </chapter>
</bookmap>

The following lines show the Introduction to Time Machines DITA topic from the OD1000 Time Machine User Guide DITA map with a description set in a shortdesc element:

<?xml version="1.0" ?>
<!DOCTYPE topic PUBLIC '-//OASIS//DTD DITA Topic//EN' 'topic.dtd'>
<topic id="intro_to_time_machines">
  <title>Introduction to Time Machines</title>
  <shortdesc>This section introduces the concept of time traveling and how presents a short history of time machine development.</shortdesc>
  <body>
    <p>Time travel has always been one of the biggest dream of mankind! Our time machines allow you to travel in time easily and safely.</p>
  </body>
</topic>

Prepared content is uploaded to Fluid Topics.

Configure the tenant

In the Administration > Integrations > Web Search Engines interface, the Category and Product metadata elements are selected to be displayed next to the document title:

An interface for managing what metadata keys appear in web search engines results for Fluid Topics documents. Three metadata keys are shown: 'Title (topic or document)', 'Category', and 'Product', each with up and down arrows for reordering and an 'X' for removal. At the bottom, there's an 'Add a metadata' dropdown menu pre-filled with 'dita:ditaval' and a button to create a new one.

Example of a test procedure running Chrome 73

  1. In the browser menu, select More Tools > Developer Tools.

    A browser screenshot showing the process of accessing 'Developer Tools' in Google Chrome. The dropdown menu on the right displays options, with 'More Tools' highlighted. A submenu with 'Developer Tools' is also highlighted.

    The Developer Tools interface opens.

  2. Select the Network tab.

  3. In the menu, select More tools > Network conditions.

    The developer tools interface in Google Chrome with a focus on the 'More tools' menu. The 'More tools' option is highlighted, and its sub-menu is expanded. The cursor is on the 'Network conditions' option.

    The Network conditions screen is displayed.

  4. Clear the Selected automatically option and enter the name of a crawl bot, for example, Google Bot.

    The 'Network conditions' menu in Google Chrome. The 'User agent' section has a check box labeled 'Select automatically' which is unchecked.

  5. Open the Introduction to Time Machines topic in the Fluid Topics portal.

  6. Refresh the Reader page.

    In the Developer Tools interface, information about crawling is displayed in the head element of the HTML page:

    • The topic metadata are displayed next to the title as set in the Web Search Engines interface.

    • The topic description is displayed in the meta element, as set in the content.

      <html>
    <head>
        <meta http-equiv="content-type" content="text/html; charset=utf-8">
        <title>Introduction to Time Machines</title>
        <link rel="canonical"
href="http://oleandor.fluidtopics.com/r/Introduction-to-Time-Machines">
        <meta name="description" content="This section introduces the concept of time traveling and how presents a short history of time machine development.">
    </head>
</html>

It is also possible to consult the description in the topic's Metadata journal.

A topic metadata interface. The ft:description field is highlighted with a red border, and has a value of 'This section introduces the concept of time traveling and how presents a short history of time machine development'.