Web browsers provide crawlers with tools to access the content of a website that is not displayed, but is nevertheless available to crawlers.
It is not necessary to enable crawl on your portal to perform this test procedure.
Prepare the content
The following lines show the OD1000 Time Machine User Guide DITA bookmap where the Category and Product metadata are set and the Introduction to Time Machines topic is referred to:
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE bookmap PUBLIC "-//OASIS//DTD DITA BookMap//EN" "bookmap.dtd">
<bookmap xml:lang="en-US" linking="none">
<booktitle>
<mainbooktitle>OD1000 User Guide</mainbooktitle>
</booktitle>
<bookmeta>
<othermeta name="Category" content="TechDoc"/>
<othermeta name="Product" content="OD1000"/>
</bookmeta>
<chapter>
<topicref href="intro_to_time_machines.dita"/>
...
</chapter>
</bookmap>
The following lines show the Introduction to Time Machines DITA topic from the OD1000 Time Machine User Guide DITA map with a description set in a shortdesc element:
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE topic PUBLIC "-//OASIS//DTD DITA Topic//EN" "topic.dtd">
<topic id="intro_to_time_machines">
<title>Introduction to Time Machines</title>
<shortdesc>This section introduces the concept of time traveling and how presents a short history of time machine development.</shortdesc>
<body>
<p>Time travel has always been one of the biggest dream of mankind! Our time machines allow you to travel in time easily and safely.</p>
</body>
</topic>
Prepared content is uploaded to Fluid Topics.
Configure the tenant
In the Administration > Integrations > Web Search Engines interface, the Category and Product metadata elements are selected to be displayed next to the document title:
Example of a test procedure running Chrome 73
- In the browser menu, select More Tools > Developer Tools.
The Developer Tools interface opens.
- Select the Network tab.
- In the menu, select More tools > Network conditions.
The Network conditions screen is displayed.
- Clear the Selected automatically option and enter the name of a crawl bot, for example, Google Bot.
- Open the Introduction to Time Machines topic in the Fluid Topics portal.
- Refresh the Reader page.
In the Developer Tools interface, information about crawling is displayed in the head element of the HTML page:
- The topic metadata are displayed next to the title as set in the Web Search Engines interface.
- The topic description is displayed in the meta element, as set in the content.
<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=utf-8">
<title>Introduction to Time Machines</title>
<link rel="canonical"
href="http://oleandor.fluidtopics.com/r/Introduction-to-Time-Machines">
<meta name="description" content="This section introduces the concept of time traveling and how presents a short history of time machine development.">
</head>
</html>
It is also possible to consult the description in the topic's Metadata journal.
