LinkedIn Ads
This page contains the setup guide and reference information for the LinkedIn Ads source connector.
Prerequisites
- A LinkedIn Ads account with permission to access data from accounts you want to sync.
Setup guide
We recommend using Oauth2.0 authentication for Airbyte Cloud, as this significantly simplifies the setup process, and allows you to authenticate your account directly from the Airbyte UI.
Set up LinkedIn Ads authentication (Airbyte Open Source)
To authenticate the connector in Airbyte Open Source, you will need to create a Linkedin developer application and obtain one of the following credentials:
-
OAuth2.0 credentials, consisting of:
- Client ID
- Client Secret
- Refresh Token (expires after 12 months)
-
Access Token (expires after 60 days)
You can follow the steps laid out below to create the application and obtain the necessary credentials. For an overview of the LinkedIn authentication process, see the official documentation.
Create a LinkedIn developer application
-
Log in to LinkedIn with a developer account.
-
Navigate to the Apps page and click the Create App icon. Fill in the fields below:
- For App Name, enter a name.
- For LinkedIn Page, enter your company's name or LinkedIn Company Page URL.
- For Privacy policy URL, enter the link to your company's privacy policy.
- For App logo, upload your company's logo.
- Check I have read and agree to these terms, then click Create App. LinkedIn redirects you to a page showing the details of your application.
-
You can verify your app using the following steps:
-
Click the Settings tab. On the App Settings section, click Verify under Company. A popup window will be displayed. To generate the verification URL, click on Generate URL, then copy and send the URL to the Page Admin (this may be you). Click on I'm done. If you are the administrator of your Page, simply run the URL in a new tab (if not, an administrator will have to do the next step). Click on Verify.
-
To display the Products page, click the Product tab. For Marketing Developer Platform, click Request access. A popup window will be displayed. Review and Select I have read and agree to these terms. Finally, click Request access.
-
Authorize your app
-
To authorize your application, click the Auth tab. Copy the Client ID and Client Secret (click the open eye icon to reveal the client secret). In the Oauth 2.0 settings, click the pencil icon and provide a redirect URL for your app.
-
Click the OAuth 2.0 tools link in the Understanding authentication and OAuth 2.0 section on the right side of the page.
-
Click Create token.
-
Select the scopes you want to use for your app. We recommend using the following scopes:
r_emailaddress
r_liteprofile
r_ads
r_ads_reporting
r_organization_social
-
Click Request access token. You will be redirected to an authorization page. Use your LinkedIn credentials to log in and authorize your app and obtain your Access Token and Refresh Token.
These tokens will not be displayed again, so make sure to copy them and store them securely.
If either of your tokens expire, you can generate new ones by returning to LinkedIn's Token Generator. You can also check on the status of your tokens using the Token Inspector.
Set up the LinkedIn Ads connector in Airbyte
- Log in to your Airbyte Cloud or Airbyte Open Source account.
- In the left navigation bar, click Sources. In the top-right corner, click + New source.
- Find and select LinkedIn Ads from the list of available sources.
- For Source name, enter a name for the LinkedIn Ads connector.
- To authenticate:
For Airbyte Cloud
- Select OAuth2.0 from the Authentication dropdown, then click Authenticate your LinkedIn Ads account. Sign in to your account and click Allow.
For Airbyte Open Source
- Select an option from the Authentication dropdown:
- OAuth2.0: Enter your Client ID, Client Secret and Refresh Token. Please note that the refresh token expires after 12 months.
- Access Token: Enter your Access Token. Please note that the access token expires after 60 days.
- For Start Date, use the provided datepicker or enter a date programmatically in the format YYYY-MM-DD. Any data before this date will not be replicated.
- (Optional) For Account IDs, you may optionally provide a space separated list of Account IDs to pull data from. If you do not specify any account IDs, the connector will replicate data from all accounts accessible using your credentials.
- (Optional) For Custom Ad Analytics Reports, you may optionally provide one or more custom reports to query the LinkedIn Ads API for. By defining custom reports, you can better align the data pulled form LinkedIn Ads with your particular needs. To add a custom report:
- Click on Add.
- Enter a Report Name. This will be used as the stream name during replication.
- Select a Pivot Category from the dropdown. This defines the main dimension by which the report data will be grouped or segmented.
- Select a Time Granularity to group the data in your report by time. The options are:
ALL
: Data is not grouped by time, providing a cumulative view.DAILY
: Returns data grouped by day. Useful for closely monitoring short-term changes and effects.MONTHLY
: Returns data grouped by month. Ideal for evaluating monthly goals or observing seasonal patterns.YEARLY
: Returns data grouped by year. Ideal for high-level analysis of long-term trends and year-over-year comparisons.
- Click Set up source and wait for the tests to complete.
Supported sync modes
The LinkedIn Ads source connector supports the following sync modes:
- Full Refresh - Overwrite
- Full Refresh - Append
- Incremental Sync - Append
- Incremental Sync - Append + Deduped
Supported streams
- Accounts
- Account Users
- Campaign Groups
- Campaigns
- Creatives
- Conversions
- Ad Analytics by Campaign
- Ad Analytics by Creative
- Ad Analytics by Impression Device
- Ad Analytics by Member Company Size
- Ad Analytics by Member Country
- Ad Analytics by Member Job Function
- Ad Analytics by Member Job Title
- Ad Analytics by Member Industry
- Ad Analytics by Member Region
- Ad Analytics by Member Company
For Ad Analytics Streams such as Ad Analytics by Campaign
and Ad Analytics by Creative
, the pivot
column name is renamed to pivotValue
to handle the data normalization correctly and avoid name conflicts with certain destinations. This field contains the ID of the associated entity as a URN. Please refer to the LinkedIn documentation for the format of the URN value for the Ad Analytics streams.
Performance considerations
LinkedIn Ads has Official Rate Limits for API Usage, more information here. Rate limited requests will receive a 429 response. These limits reset at midnight UTC every day. In rare cases, LinkedIn may also return a 429 response as part of infrastructure protection. API service will return to normal automatically. In such cases, you will receive the following error message:
"Caught retriable error '<some_error> or null' after <some_number> tries. Waiting <some_number> seconds then retrying..."
This is expected when the connector hits the 429 - Rate Limit Exceeded HTTP Error. If the maximum available API requests capacity is reached, you will have the following message:
"Max try rate limit exceeded..."
After 5 unsuccessful attempts - the connector will stop the sync operation. In such cases check your Rate Limits on this page > Choose your app > Analytics.
Data type map
Integration Type | Airbyte Type | Notes |
---|---|---|
number | number | float number |
integer | integer | whole number |
date | string | FORMAT YYYY-MM-DD |
datetime | string | FORMAT YYYY-MM-DDThh:mm: ss |
array | array | |
boolean | boolean | True/False |
string | string |
Reference
Config fields reference
Changelog
Expand to review
Version | Date | Pull Request | Subject |
---|---|---|---|
2.1.8 | 2024-07-09 | 41315 | Update dependencies |
2.1.7 | 2024-07-06 | 40868 | Update dependencies |
2.1.6 | 2024-06-25 | 40331 | Update dependencies |
2.1.5 | 2024-06-22 | 39998 | Update dependencies |
2.1.4 | 2024-06-16 | 0 | Fix README commands, change spec from json to yaml, fix schema states to object |
2.1.3 | 2024-06-06 | 39240 | [autopull] Upgrade base image to v1.2.2 |
2.1.2 | 2024-05-07 | 36648 | Schema descriptions |
2.1.1 | 2024-05-07 | 38013 | Fix an issue where the Accounts stream did not correctly handle provided account IDs |
2.1.0 | 2024-04-30 | 37573 | Update API version to 202404 ; add cursor-based pagination |
2.0.0 | 2024-04-24 | 37531 | Change primary key for Analytics Streams |
1.0.1 | 2024-03-28 | 34152 | Proceed pagination if return less than expected |
1.0.0 | 2024-04-10 | 36927 | Update primary key for Analytics Streams |
0.8.0 | 2024-03-19 | 36267 | Pin airbyte-cdk version to ^0 |
0.7.0 | 2024-02-20 | 35465 | Per-error reporting and continue sync on stream failures |
0.6.8 | 2024-02-09 | 35086 | Manage dependencies with Poetry |
0.6.7 | 2024-01-11 | 34152 | Prepare for airbyte-lib |
0.6.6 | 2024-01-15 | 34222 | Use stream slices for Analytics streams |
0.6.5 | 2023-12-15 | 33530 | Fix typo in Pivot Category list |
0.6.4 | 2023-10-19 | 31599 | Base image migration: remove Dockerfile and use the python-connector-base image |
0.6.3 | 2023-10-13 | 31396 | Fix pagination for reporting |
0.6.2 | 2023-08-23 | 31221 | Increase max time between messages to 24 hours |
0.6.1 | 2023-08-23 | 29600 | Update field descriptions |
0.6.0 | 2023-08-22 | 29721 | Add Conversions stream |
0.5.0 | 2023-08-14 | 29175 | Add Custom report Constructor |
0.4.0 | 2023-08-08 | 29175 | Add analytics streams |
0.3.1 | 2023-08-08 | 29189 | Fix empty accounts field |
0.3.0 | 2023-08-07 | 29045 | Add new fields to schemas; convert datetime fields to rfc3339 |
0.2.1 | 2023-05-30 | 26780 | Reduce records limit for Creatives Stream |
0.2.0 | 2023-05-23 | 26372 | Migrate to LinkedIn API version: May 2023 |
0.1.16 | 2023-05-24 | 26512 | Removed authSpecification from spec.json in favour of advancedAuth |
0.1.15 | 2023-02-13 | 22940 | Specified date formatting in specification |
0.1.14 | 2023-02-03 | 22361 | Turn on default HttpAvailabilityStrategy |
0.1.13 | 2023-01-27 | 22013 | For adDirectSponsoredContents stream skip accounts which are part of organization |
0.1.12 | 2022-10-18 | 18111 | For adDirectSponsoredContents stream skip accounts which are part of organization |
0.1.11 | 2022-10-07 | 17724 | Retry 429/5xx errors when refreshing access token |
0.1.10 | 2022-09-28 | 17326 | Migrate to per-stream states. |
0.1.9 | 2022-07-21 | 14924 | Remove additionalProperties field from schemas |
0.1.8 | 2022-06-07 | 13495 | Fixed base-normalization issue on Destination Redshift caused by wrong casting of pivot column |
0.1.7 | 2022-05-04 | 12482 | Update input configuration copy |
0.1.6 | 2022-04-04 | 11690 | Small documentation corrections |
0.1.5 | 2021-12-21 | 8984 | Update connector fields title/description |
0.1.4 | 2021-12-02 | 8382 | Modify log message in rate-limit cases |
0.1.3 | 2021-11-11 | 7839 | Added OAuth support |
0.1.2 | 2021-11-08 | 7499 | Remove base-python dependencies |
0.1.1 | 2021-10-02 | 6610 | Fix for Campaigns/targetingCriteria transformation, coerced Creatives/variables/values to string by default |
0.1.0 | 2021-09-05 | 5285 | Initial release of Native LinkedIn Ads connector for Airbyte |