When Microsoft bought FAST, they were in the process of developing improvements to their search solution, code named Mars.  Among the improvements were graphical interfaces for the flow engines for Query (IMS) and Content Processing (CTS). These were packaged and sold As FSIS, Fast Search for Internet Sites. SharePoint 2013 has integrated the pipeline workflow from CTS and IMS, and is using it internally. There is, however, no (apparent) option for configuring the flows by the end user. Of course, there is no nice graphical wizards for drawing up the pipeline steps as in FSIS.

Buried deep down in the folders of SharePoint, there is a file called ceresshell.ps1.  Ceres is a dwarf planet circulating between Mars and Jupiter. Incidentally, we can use the Ceres shell to gain access to the configurations of the internal SharePoint flows. Once Mars was reached, the team behind SharePoint search kept on pushing into space, until they reached solid ground on the next planet, Ceres.

So what is the Ceres shell, and what can it do? Looking at the contents of the file, it is a powershell script that loads some snap ins.

Add-PSSnapin hostcontrollerpssnapin
Add-pssnapin junopssnapin
Add-pssnapin searchcorepssnapin
Add-pssnapin enginepssnapin
Add-pssnapin analysisenginepssnapin

So, we start up a SharePoint powershell session as Farm administrator, and load in the Ceres shell.

PS> & "C:\Program Files\Microsoft Office Servers\15.0\Search\Scripts\ceresshell.ps1"

Now the Ceres cmdlets have been loaded up and are ready to use.

Before we can have any fun with this, we need to connect to the “system”.

Connect-System  -ServiceIdentity (Get-SPEnterpriseSearchService).ProcessIdentity

Once connected to the system, we need to connect to the “engine”

Connect-Engine

Now we are ready. To get a list of all flows available for inspection, type

Get-Flow

To show the flow configuration for a single flow:

Get-Flow Microsoft.CrawlerIndexingSubFlow

Here is a part of that file

<OperatorGraph name="Microsoft.CrawlerIndexingSubFlow" xmlns="http://schemas.microsoft.com/ceres/studio/2009/10/flow">

<Parameters />

<Operators>

<Operator name="MarsWriter" type="Microsoft.Ceres.ContentEngine.Operators.BuiltIn.MarsWriter">

<Properties>

<Property name="callbackType" value=""Completed"" />

<Property name="callbackWarningField" value=""ParsingErrors"" />

<Property name="commitInterval" value="1" />

<Property name="crawledPropertyBuckets" value="["content"]" />

<Property name="defaultMaxIndexSize" value="524288" />

<Property name="defaultMaxResultSize" value="16384" />

<Property name="idField" value=""externalId"" />

<Property name="managedPropertiesListName" value=""ManagedProperties"" />

<Property name="managedPropertyBuckets" value="["ManagedPropertiesBucket"]" />

<Property name="marsCallbackInfoProperty" value=""marsLinkDBSynchronization"" />

<Property name="provideCallbacks" value="True" />

<Property name="siteCollectionIdField" value=""sitecollectionid"" />

<Property name="tenantIdField" value=""tenantId"" />

<Property name="truncatedFlagField" value=""IsPartiallyProcessed"" />

</Properties>

</Operator>

<Operator name="SubFlowInput" type="Microsoft.Ceres.ContentEngine.Operators.BuiltIn.SubFlow.SubFlowInput">

<Targets>

<Target>

<operatorMoniker name="/Microsoft.CrawlerIndexingSubFlow/MarsWriter" />

Interesting, isn’t it? There seems to be some configurable values for stuff like “defaultMaxResultSize”.

Now you see how you can open the Ceres shell, and look at the flow configurations.

Next post will show you how you can modify values in the existing flows.