API Rates for bulk-transferring data from other system

brendanc at January 18th, 2016 13:13 — #1

Hi,

We are looking to bring across all our historical data from an external system. Bringing across the contacts is fine - we can prepare a CSV and import from there. However we also wish to bring across the equivalent of Notes, Calls, Deals, etc, and the CSV importer doesn't support this.

The best way we can do this is by copying over records using individual HTTP requests, but we do not want to reach the API threshold before we are booted out. Is the rate limit published or does anyone have any advice on this type of issue? I imagine our current method will potentially exceed the 5 requests per second.

Thanks,

Brendan

cillian at January 19th, 2016 04:48 — #2

Hi Brendan,

Glad to hear you are converting to OnePageCRM - we are glad to have you on board!

You are correct that using the API is probably the best way to copy all of your data across to the system using one method. However, notes and calls can be imported from CSV, so you could use CSV to import:
- Contacts
- Notes
- Calls

You would then have to use the API to add deals to the already existing contacts in the CRM.

I should also point out that we have a limit on the number of contacts in the system we can hold, we allow each account to have 50k contacts.

I can also point out that our rate limit is 10 requests per second for extended periods.

Hope this helps.

Best regards,
Cillian

brendanc at January 19th, 2016 06:40 — #3

Thanks a lot Cillian,

Have the process all sorted and we are using the PHP usleep method to reduce the request times to logical batches. All looking great so far too in terms of the data that's imported.

usleep method:
http://www.w3schools.com/php/func_misc_usleep.asp

Brendan