AI-Powered Segmentation in Marketo with OpenAI

Job titles often vary significantly, even within the same industry and even for identical job functions. The task of sorting these titles becomes even more complex for international organizations dealing with multiple languages. However, leveraging AI can greatly simplify the process. In Marketo, creating segments involves defining smart list rules for each segment. Without AI, you would need to create hundreds of manual rules to categorize job titles, a labor-intensive and error-prone process. But by utilizing OpenAI, the tedious task of sorting can be automated and segments can be defined by a simple rule: For each segment – each individual’s job role should match the segment name.

In Marketo, you start with all records in the default segmentation since no specific rules have been qualified yet. The aim is to use OpenAI to assign each record a role corresponding to the segment they belong to.

For this process, all the records have a job title but no role value, which will be updated through OpenAI.

The smart list portion of our smart campaign in Marketo will use a simple filter – the job title should not be empty. This way, we know OpenAI has something to work with.

The campaign flow consists of two steps:

1. Workaround for Token Support: Currently, self-service flow steps do not support tokens in the fields. To overcome this, create a custom field called ‘OpenAI prompts’, which gets updated with a ‘changed data value’ step before being sent to OpenAI.
2. Send Prompt Action: This is where you send the prompt to OpenAI and receive the response. Here, you set the AI model (GPT-3.5 Turbo, the latest available as of writing this), and specify where to store the response (the ‘lead role’ field, in this case). A temperature of zero instructs the model to return exact segments without getting creative.

If you don’t have the Send OpenAI Prompt action you can get it here.

Crafting the prompt correctly is vital to get the desired response from the AI. In this scenario, the prompt instructs OpenAI to return a category without any quotes or additional text by categorizing the job title (using the job title token) into one of the segments. Before deploying, test your prompts using the chat GPT web interface to ensure they deliver the expected results.

Return only the category without any quotes or any additional text categorize the job title {{lead.Job Title}} into one of the following categories: Accounting/Finance, Administration, Analyst/Research, Design/Engineering, Education/Teaching, Healthcare/Medical, Human Resources, Information Technology, Legal, Marketing/Sales, Science/Laboratory, Social Services

Your smart campaign is now ready to run. Schedule it and let OpenAI do the work!

After giving OpenAI sufficient time to process the data, revisit your smart list. All records should now be populated with a role.

The segmentation should show that all the records have been assigned to the correct segment, leaving no records in the default segment.

While integrating OpenAI with Marketo, there are a few best practices to keep in mind:

• Beware of Hallucinations: GPT models can sometimes return confidently incorrect results. Hence, testing your prompts and strategically wording them is crucial.
• Understand Model Limitations: GPT models are trained up to a certain date. For instance, OpenAI models are only trained up to late 2022. Thus, be mindful of these limitations while creating prompts.
• Specify the Desired Format: The more specific you are with the format, the better the results. Without clear instructions, the model may deliver unexpected results.
• Test Thoroughly: Testing and verifying prompts is crucial to get accurate results in the desired format.
• Fine-tune the Model: You can train a GPT model on specific data to get a custom model tailored to your needs. However, don’t include any sensitive or personally identifiable data in the prompts as it may end up in the knowledge base of future models.

Through this demonstration, we can see how OpenAI’s GPT models, when integrated with Marketo, can efficiently sort job titles into their respective segments. By reducing manual labor and improving accuracy, OpenAI is truly revolutionizing segmentation in marketing automation. I hope this gives you some great ideas for how to use OpenAI to segment your own database. Feel free to reach out on LinkedIn if you have questions or let me know what you’re using OpenAI for in your organization.

This demo was originally presented as part of our webinar Unleashing the power of ChatGPT directly in your Marketo smart campaigns. You can watch the recording here