As soon as a partner's cache is clear, Marfeel crawls their site following our protocol.
As a standard, Marfeel crawls and updates home pages every 3-5 minutes because they're the ones most frequently updated. Less regularly updated sections are crawled every 24 hours.
Marfeel crawlers are engineered with built-in intelligence that detect frequently updated pages to crawl them more regularly.
When a home page is crawled all the articles linked from it are updated incrementally. If the home page or section contain a new article it will be picked and extracted immediately.