UNPKG

semantic-crawler

Version:

Priority based Semantic Web Crawler.

42 lines (29 loc) 1.34 kB
# semantic-crawler > **A nodejs module to extract links from Google, Bing etc..** ![logo](https://assets.gitlab-static.net/uploads/-/system/project/avatar/4981495/semantic-crawler.png) [![version](https://img.shields.io/npm/v/semantic-crawler.svg)](https://www.npmjs.org/package/semantic-crawler) [![downloads](https://img.shields.io/npm/dt/semantic-crawler.svg)](https://www.npmjs.org/package/semantic-crawler) [![node](https://img.shields.io/node/v/semantic-crawler.svg)](https://nodejs.org/) [![status](https://gitlab.com/autokent/semantic-crawler/badges/master/pipeline.svg)](https://gitlab.com/autokent/semantic-crawler/pipelines) ## Installation `npm install semantic-crawler` ## Usage ### Crawl ```js const swc = require('semantic-crawler'); swc.crawl("http://science.sciencemag.org/").then(function(result){ console.log(result); }); ## Options ### Default Options ```js let default_options={ count: 10 }; ``` ## Test `mocha` or `npm test` > check test folder and QUICKSTART.js for extra usage. ## Contact me on WhatsApp > For discussing about the package. [![WhatsApp](https://img.shields.io/badge/style-WhatsApp-green.svg?style=flat&label=0%20506%20304%2024%2080)](https://api.whatsapp.com/send?phone=905063042480&text=Hi%2C%0ALet%27s%20talk%20about%20semantic-crawler)