UNPKG

website-to-json

Version:

Converts all websites to JSON data

29 lines (23 loc) 991 B
## Nightmare integration https://github.com/segmentio/nightmare is an automated web browser based on electron. It's similar to phantomjs but simplier and faster. The way of working is similar as usual. You only need to provide instance of Nightmare to wtj to make it working: ```js var Nightmare = require('nightmare'); var nightmare = Nightmare({ // responsible for showing browser show: true }); var wtj = require('website-to-json') return wtj.extractUrl('http://www.imdb.com/title/tt0111161/', { nightmare: nightmare, // recipes are necessary for extracting instructions // you can take from another examples recipes: recipes, fields: ['data', 'meta', 'social'], }) .then(function(res) { console.log(res); }) ``` Please remember to close nightmare instance when you finish your work. The current solution works good on desktop. If you want it as `headless` it's recommended to install `Xvfb`. You'll find more info here https://github.com/segmentio/nightmare/issues