Show HN: Multiple web search providers via one TypeScript package

1 month ago 5

A unified TypeScript SDK for integrating with multiple web search providers through a single, consistent interface.

The Search SDK provides a standardized way to interact with various search APIs, allowing developers to easily switch between providers or use multiple providers simultaneously without changing application code.

npm install @plust/search-sdk
import { google, webSearch } from '@plust/search-sdk'; // Configure the Google search provider with your API key and Search Engine ID const configuredGoogle = google.configure({ apiKey: 'YOUR_GOOGLE_API_KEY', cx: 'YOUR_SEARCH_ENGINE_ID' }); // Search using the configured provider async function search() { const results = await webSearch({ query: 'TypeScript SDK', maxResults: 5, provider: configuredGoogle }); console.log(results); } search();
  • Unified API for working with multiple search providers
  • Standardized result format across all providers
  • Comprehensive type safety with TypeScript
  • Configurable search parameters (pagination, safe search, language, etc.)
  • Detailed error handling with provider-specific troubleshooting
  • Built-in debugging capabilities

Supported Search Providers

The SDK currently supports the following search APIs:

Each search provider needs to be configured before use:

import { google, webSearch } from '@plust/search-sdk'; const googleProvider = google.configure({ apiKey: 'YOUR_GOOGLE_API_KEY', cx: 'YOUR_SEARCH_ENGINE_ID' }); const results = await webSearch({ query: 'React hooks tutorial', maxResults: 10, provider: googleProvider });
import { serpapi, webSearch } from '@plust/search-sdk'; const serpProvider = serpapi.configure({ apiKey: 'YOUR_SERPAPI_KEY', engine: 'google' // Optional, defaults to 'google' }); const results = await webSearch({ query: 'TypeScript best practices', maxResults: 10, provider: serpProvider });
import { brave, webSearch } from '@plust/search-sdk'; const braveProvider = brave.configure({ apiKey: 'YOUR_BRAVE_API_KEY' }); const results = await webSearch({ query: 'privacy-focused browsers', maxResults: 10, safeSearch: 'moderate', provider: braveProvider });
import { exa, webSearch } from '@plust/search-sdk'; const exaProvider = exa.configure({ apiKey: 'YOUR_EXA_API_KEY', model: 'keyword', // Optional, defaults to 'keyword' includeContents: true // Optional, defaults to false }); const results = await webSearch({ query: 'machine learning papers', provider: exaProvider });
import { tavily, webSearch } from '@plust/search-sdk'; const tavilyProvider = tavily.configure({ apiKey: 'YOUR_TAVILY_API_KEY', searchDepth: 'comprehensive', // Optional, defaults to 'basic' includeAnswer: true // Optional, defaults to false }); const results = await webSearch({ query: 'climate change evidence', maxResults: 15, provider: tavilyProvider });
import { searxng, webSearch } from '@plust/search-sdk'; const searxngProvider = searxng.configure({ baseUrl: 'http://127.0.0.1:8080/search', additionalParams: { // Optional additional parameters for SearXNG categories: 'general', engines: 'google,brave,duckduckgo' }, apiKey: '' // Not needed for most SearXNG instances }); const results = await webSearch({ query: 'open source software', provider: searxngProvider });
import { duckduckgo, webSearch } from '@plust/search-sdk'; // DuckDuckGo doesn't require an API key, but you can configure other options const duckduckgoProvider = duckduckgo.configure({ searchType: 'text', // Optional: 'text', 'images', or 'news' useLite: false, // Optional: use lite version for lower bandwidth region: 'wt-wt' // Optional: region code }); // Text search const textResults = await webSearch({ query: 'privacy focused search', maxResults: 10, provider: duckduckgoProvider }); // Image search const imageProvider = duckduckgo.configure({ searchType: 'images' }); const imageResults = await webSearch({ query: 'landscape photography', maxResults: 10, provider: imageProvider }); // News search const newsProvider = duckduckgo.configure({ searchType: 'news' }); const newsResults = await webSearch({ query: 'latest technology', maxResults: 10, provider: newsProvider });

Arxiv is a repository of electronic preprints of scientific papers. It does not require an API key for its public API.

import { arxiv, webSearch } from '@plust/search-sdk'; // Arxiv doesn't require an API key, but you can configure other options. const arxivProvider = arxiv.configure({ sortBy: 'relevance', // Optional: 'relevance', 'lastUpdatedDate', 'submittedDate' sortOrder: 'descending' // Optional: 'ascending', 'descending' }); const results = await webSearch({ query: 'cat:cs.AI AND ti:transformer', // Example: Search for "transformer" in title within Computer Science AI category // Alternatively, search by ID list: // idList: '2305.12345v1,2203.01234v2', provider: arxivProvider, maxResults: 5 });

The webSearch function accepts these standard options across all providers:

Option Type Description
query string The search query text. For Arxiv, this can be a complex query using field prefixes (e.g., au:del_maestro AND ti:checkerboard).
idList string (Arxiv specific) A comma-delimited list of Arxiv IDs to fetch.
maxResults number Maximum number of results to return.
language string Language code for results (e.g., 'en')
region string Country/region code (e.g., 'US'). For DuckDuckGo, use format like 'wt-wt', 'us-en'.
safeSearch 'off' | 'moderate' | 'strict' Content filtering level (Not applicable to Arxiv). For DuckDuckGo, 'moderate' is default.
page number Result page number (for pagination). Arxiv uses start (offset) instead.
start number (Arxiv specific) The starting index for results (pagination offset).
sortBy 'relevance' | 'lastUpdatedDate' | 'submittedDate' (Arxiv specific) Sort order for results.
sortOrder 'ascending' | 'descending' (Arxiv specific) Sort direction.
searchType 'text' | 'images' | 'news' (DuckDuckGo specific) The type of search to perform.
timeout number Request timeout in milliseconds.

All providers return results in this standardized format:

interface SearchResult { url: string; // The URL of the search result title: string; // Title of the web page snippet?: string; // Brief description or excerpt domain?: string; // The source website domain publishedDate?: string; // When the content was published provider?: string; // The search provider that returned this result raw?: unknown; // Raw provider-specific data }

The SDK includes built-in debugging capabilities to help diagnose issues:

import { google, webSearch } from '@plust/search-sdk'; const results = await webSearch({ query: 'TypeScript SDK', // provider: configuredGoogle, // Example provider // debug: { enabled: true, logRequests: true, logResponses: true } } });

The SDK provides detailed error messages with troubleshooting suggestions:

Search with provider 'google' failed: Google search failed: Request failed with status: 400 Bad Request - Invalid Value Troubleshooting: This is likely due to invalid request parameters. Check your query and other search options. Make sure your Google API key is valid and has the Custom Search API enabled. Also check if your Search Engine ID (cx) is correct.

webSearch(options: WebSearchOptions): Promise<SearchResult[]>

Performs a web search using the specified provider and options.

const results = await webSearch({ query: 'TypeScript tutorial', maxResults: 10, language: 'en', region: 'US', safeSearch: 'moderate', page: 1, provider: googleProvider });

MIT

Read Entire Article