AI-Powered Segmentation in Marketo with OpenAI

Academy | Blog post

AI-Powered Segmentation in Marketo with OpenAI

31 July, 2023

|

|

Estimated 3 minutes read

Overview

Segmentation is a powerful tool within Marketo. When set up correctly, it enables us to target and personalize every other aspect of our campaigns. However, navigating through enormous amounts of data to create well-defined segments can be a boring and daunting task. But what if we could assign this tedious chore to an AI model that can execute it efficiently? By leveraging OpenAI's GPT models in conjunction with Marketo, this is no longer just wishful thinking but a reality. This blog post aims to walk you through the process of utilizing OpenAI for sorting job titles into specific segments in Marketo, successfully navigating the challenges of title diversity and multilingual data.

Harnessing AI for Marketo Segmentation

Job titles often vary significantly, even within the same industry and even for identical job functions. The task of sorting these titles becomes even more complex for international organizations dealing with multiple languages. However, leveraging AI can greatly simplify the process. In Marketo, creating segments involves defining smart list rules for each segment. Without AI, you would need to create hundreds of manual rules to categorize job titles, a labor-intensive and error-prone process. But by utilizing OpenAI, the tedious task of sorting can be automated and segments can be defined by a simple rule: For each segment – each individual’s job role should match the segment name.


A Walkthrough of the Segmentation Process

In Marketo, you start with all records in the default segmentation since no specific rules have been qualified yet. The aim is to use OpenAI to assign each record a role corresponding to the segment they belong to.
Empty Segmentation

For this process, all the records have a job title but no role value, which will be updated through OpenAI.

Segmentation Smart List With No Roles


Creating a Smart Campaign

The smart list portion of our smart campaign in Marketo will use a simple filter – the job title should not be empty. This way, we know OpenAI has something to work with.

The campaign flow consists of two steps:

  1. Workaround for Token Support: Currently, self-service flow steps do not support tokens in the fields. To overcome this, create a custom field called ‘OpenAI prompts’, which gets updated with a ‘changed data value’ step before being sent to OpenAI.
  2. Send Prompt Action: This is where you send the prompt to OpenAI and receive the response. Here, you set the AI model (GPT-3.5 Turbo, the latest available as of writing this), and specify where to store the response (the ‘lead role’ field, in this case). A temperature of zero instructs the model to return exact segments without getting creative.

If you don’t have the Send OpenAI Prompt action you can get it here.


Crafting the OpenAI Prompt

Crafting the prompt correctly is vital to get the desired response from the AI. In this scenario, the prompt instructs OpenAI to return a category without any quotes or additional text by categorizing the job title (using the job title token) into one of the segments. Before deploying, test your prompts using the chat GPT web interface to ensure they deliver the expected results.

Return only the category without any quotes or any additional text categorize the job title {{lead.Job Title}} into one of the following categories: Accounting/Finance, Administration, Analyst/Research, Design/Engineering, Education/Teaching, Healthcare/Medical, Human Resources, Information Technology, Legal, Marketing/Sales, Science/Laboratory, Social Services

Your smart campaign is now ready to run. Schedule it and let OpenAI do the work!


Checking the Results

After giving OpenAI sufficient time to process the data, revisit your smart list. All records should now be populated with a role.

The segmentation should show that all the records have been assigned to the correct segment, leaving no records in the default segment.


Best Practices and Limitations

While integrating OpenAI with Marketo, there are a few best practices to keep in mind:

  • Beware of Hallucinations: GPT models can sometimes return confidently incorrect results. Hence, testing your prompts and strategically wording them is crucial.
  • Understand Model Limitations: GPT models are trained up to a certain date. For instance, OpenAI models are only trained up to late 2022. Thus, be mindful of these limitations while creating prompts.
  • Specify the Desired Format: The more specific you are with the format, the better the results. Without clear instructions, the model may deliver unexpected results.
  • Test Thoroughly: Testing and verifying prompts is crucial to get accurate results in the desired format.
  • Fine-tune the Model: You can train a GPT model on specific data to get a custom model tailored to your needs. However, don’t include any sensitive or personally identifiable data in the prompts as it may end up in the knowledge base of future models.

Conclusion

Through this demonstration, we can see how OpenAI’s GPT models, when integrated with Marketo, can efficiently sort job titles into their respective segments. By reducing manual labor and improving accuracy, OpenAI is truly revolutionizing segmentation in marketing automation. I hope this gives you some great ideas for how to use OpenAI to segment your own database. Feel free to reach out on LinkedIn if you have questions or let me know what you’re using OpenAI for in your organization.


Webinar

This demo was originally presented as part of our webinar Unleashing the power of ChatGPT directly in your Marketo smart campaigns. You can watch the recording here

SIGN UP FOR OUR NEWSLETTER

Josh Arrington

Maketo Champion & CMTO

Marketing technology consultant & full stack developer specializing in marketing automation, strategy and highly effective campaign execution. Recently named Marketo Champion by Adobe. Over 18 years of experience working with companies to identify the right mix of marketing technologies and putting them to work with profitable purpose.

See LinkedIn Profile