HubSpot Agent: Tools specialist vs API connectors

A comparative analysis of different CrewAI agent tool providers for automating HubSpot CRM operations.

This repository serves as the foundation for comparing the performance of a tool specliast agent vs traditional API connectors. You can learn about agentic tool specialists at Taking AI tool use to human level .

Purpose

This repository compares the performance of CrewAI agents that interact with HubSpot CRM:

1. Using bre-built API connectors tools (via Composio)
2. Using Superface Specialist

Setup

1. Clone the repository
2. Install dependencies:

   pip install -r requirements.txt
   

3. Create a .env file based on .env.example with your API keys:

   COMPOSIO_API_KEY=your_composio_api_key
   OPENAI_API_KEY=your_openai_api_key
   HUBSPOT_CONNECTED_ACCOUNT_ID=your_hubspot_account_id
   TEST_PROMPT=your_TEST_PROMPT
   

4. Run the agent:

   python composio/agent.py
   

Models Used

Both agent implementations use GPT-4o:

• The Composio CrewAI agent uses GPT-4o
• The Superface CrewAI agent uses GPT-4o
• The Superface Specialist itself also uses GPT-4o for its internal processing

Test Results

Test Case	Scenario	API connectors	Tools Specialist
1. Create New Lead	Create contact "John Doe" and company "ACME Ltd" when neither exists	⚠️ Partial Success ✅ Created contact ✅ Associated contact with company ❌ Created two company records instead of one ❌ One company record lacked a name ❌ Other company incorrectly named "Acme Markets"	✅ Success ✅ Created contact ✅ Created company ✅ Successfully associated contact with company
2. Create New Lead with conflicts	Create contact and company when both already exist but aren't associated	⚠️ Partial Success ✅ No duplicate contact/company created ❌ Failed to create association between contact and company (5/5 attempts)	⚠️ Partial Success ✅ No duplicate contact/company created ❌ Failed to create association between contact and company (2/5 attempts)
3. Create New Deal	Create a deal for existing contact and company	❌ Failure ❌ Unable to create the deal due to association mapping errors	✅ Success ✅ Created deal with proper associations ✅ Used default Sales pipeline and stage
4. Create engagements	Create call engagement and tasks based on call notes for existing deal	❌ Failure ❌ Tools for creating engagements/tasks don't exist ❌ Agent couldn't use "Create new deal object" tool for this purpose	✅ Success ✅ Created call engagement with notes ✅ Created tasks ✅ Properly associated with deal

License

This project is licensed under the MIT License - see the LICENSE file for details.