In this demo, Ricardo Ferreira, Developer Advocate for AWS, demonstrates how to use Amazon Q to troubleshoot and fix data pipeline issues. He walks through the process of identifying a problem where the wrong number of documents are being stored in OpenSearch, and uses Amazon Q to find a solution. By leveraging Amazon Q's knowledge, Ricardo is able to quickly identify the need to set the 'ignore_malformed' parameter in the index configuration, resolving the issue and ensuring all 5,000 documents are properly stored.

00:00 - Introduction
00:20 - Replicating the bug
01:54 - Using Bulk API in Opensearch
02:35 - Troubleshooting in the IDE
04:05 - Setting parameter in index configuration
06:14 - Conclusion