AWS Architecture Blog

Tag: Search Engine

Figure 3: Overall Architecture

Scaling up a Serverless Web Crawler and Search Engine

Introduction Building a search engine can be a daunting undertaking. You must continually scrape the web and index its content so it can be retrieved quickly in response to a user’s query. The goal is to implement this in a way that avoids infrastructure complexity while remaining elastic. However, the architecture that achieves this is […]