Not able to download help articles using incremental endpoints | Community
Skip to main content

Not able to download help articles using incremental endpoints

  • March 14, 2024
  • 2 replies
  • 0 views
A

In a recurring job, we are using incremental endpoint under help_center group to download the help articles updated after certain time. Since, for first run of job, we need to download all the articles available, we are using 0 as start_time. But, this is not returning all the articles as we only get 1300 articles even after going through all the pages until next_page is null.

Endpoint used -  /api/v2/help_center/incremental/articles.json?start_time=0

We know that there are around 4400 articles as we get all of them when we download them one by one for all locales using /api/v2/help_center/{locale}/articles.json?page[size]=100

Could you please explain how incremental endpoint works and what can we do if we want to download all the articles data.

    2 replies

    Greg29
    • Greg29
    • March 18, 2024

    Hi Ankit! It's definitely odd to see that the offset paginated data is returning significantly fewer articles than with cursor pagination. Do you notice any patterns with the missing articles? Are they from a specific time period or certain locales? 

    It is worth noting that we recommend using cursor pagination over offset pagination for a variety of reasons and you are getting the correct data with cursor pagination. Take a look at this article to see how to achieve the same results with cursor pagination so that you can continue moving forward with that method.

    A
    • Ankit13
    • Author
    • March 19, 2024

    Hi Greg, we came to know that the incremental endpoint does not return all the translations of articles, it returns article in source locale only. So, in our case (i.e. getting updated articles for all locales) was not possible using incremental endpoint. 

    We are suggested to use the locale specific endpoint  /api/v2/help_center/{locale}/articles.json and then picking only updated articles after comparing the updated_at field. 

    thank you for your help!

    Terms & ConditionsCookie settingsAccessibility statement