@apify-scrapers/shared/README.md

Shared utilities and constants for Apify scrapers

# @apify-scrapers/shared

Shared utilities and constants for Apify e-commerce scrapers.

## Installation

```bash
npm install @apify-scrapers/shared
```

## Usage

### Import utilities

```javascript
import { 
    detectPlatform, 
    getNextPageUrl, 
    extractProductId, 
    normalizeProductUrl, 
    convertToCSV, 
    cleanProductData 
} from '@apify-scrapers/shared';
```

### Import constants

```javascript
import { 
    PLATFORM_SELECTORS, 
    DEFAULT_CONFIG 
} from '@apify-scrapers/shared';
```

### Import specific modules

```javascript
// Import only utilities
import { convertToCSV } from '@apify-scrapers/shared/utils';

// Import only constants
import { PLATFORM_SELECTORS } from '@apify-scrapers/shared/constants';
```

## API Reference

### Utilities

#### `detectPlatform(url)`
Detects the e-commerce platform from a URL.

#### `getNextPageUrl(url, pageNum, platform)`
Generates the next page URL for pagination.

#### `extractProductId(productUrl)`
Extracts product ID from a product URL.

#### `normalizeProductUrl(productUrl, baseUrl)`
Normalizes product URLs to absolute URLs.

#### `convertToCSV(data, options)`
Converts data array to CSV format.

#### `cleanProductData(productData)`
Cleans and standardizes product data.

### Constants

#### `PLATFORM_SELECTORS`
CSS selectors for different e-commerce platforms (Shopee, Lazada).

#### `DEFAULT_CONFIG`
Default configuration for scrapers.

## Supported Platforms

- **Shopee**: Singapore, Malaysia, Indonesia, Philippines, Thailand, Vietnam
- **Lazada**: Singapore, Malaysia, Indonesia, Philippines, Thailand, Vietnam

## License

MIT