> ## Documentation Index
> Fetch the complete documentation index at: https://docs.useparagon.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Ingestion for RAG

> Build robust data pipelines that continuously feed your RAG system with fresh, structured data from your users' apps.

## Overview

Build durable background pipelines to ingest all of your users' existing 3rd-party data, and stream new updates in real-time. Paragon's Workflows product provides a powerful solution for managing data ingestion pipelines for RAG applications.

## Fully-Managed Authentication

Paragon handles all authentication seamlessly, from OAuth flows to token refresh, while keeping your users' credentials secure. Your engineering team can focus on building great products, not managing authentication.

<CardGroup cols={2}>
  <Card title="Out-of-the-Box Portal" href="/connect-portal/connect-portal-customization" img="https://mintcdn.com/paragon/XNDe-bFT_2yOxy1A/assets/Connect%20Portal%20Example.png?fit=max&auto=format&n=XNDe-bFT_2yOxy1A&q=85&s=ea077ca594510fbb1025bbc0bf57b247" width="1280" height="887" data-path="assets/Connect Portal Example.png">
    Quickly enable your users to connect their apps with a pre-built, customizable portal—no code required.
  </Card>

  <Card title="Build-Your-Own Portal" href="/connect-portal/headless-connect-portal" img="https://mintcdn.com/paragon/7RZyQGncIlY8Xl4A/assets/Headless%20Connect%20Portal%20Example.png?fit=max&auto=format&n=7RZyQGncIlY8Xl4A&q=85&s=85aab30677a0aaf3e4fde8e74f4f71bb" width="2292" height="1584" data-path="assets/Headless Connect Portal Example.png">
    Leverage your own UI to create a fully custom integration experience tailored to your product.
  </Card>
</CardGroup>

## Product Highlight: Workflows

<Frame>
  <img src="https://mintcdn.com/paragon/867oBBVpxd2C3zc4/assets/Workflows%20Header.png?fit=max&auto=format&n=867oBBVpxd2C3zc4&q=85&s=ef4b61a29edec924d8580d9b711d54d6" alt="Page cover image" width="2798" height="874" data-path="assets/Workflows Header.png" />
</Frame>

Workflows are purpose-built for high-volume data ingestion, with built-in features for rate limiting, error handling, and more. With Workflows, you can ingest data from any source, and stream new updates in real-time.

<Card title="Discover Workflows" href="/workflows/overview" horizontal icon={<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="#6747e7" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right-icon lucide-arrow-right"><path d="M5 12h14"/><path d="m12 5 7 7-7 7"/></svg>}>
  Learn more about building, managing, and optimizing workflows in our comprehensive overview.
</Card>

## Observability

<Frame>
  <img src="https://mintcdn.com/paragon/jCM_Y_j0HttScr1R/assets/Editing%20and%20Replaying%20Tasks%20in%20Paragon%20Connect.png?fit=max&auto=format&n=jCM_Y_j0HttScr1R&q=85&s=e9f256e9b310e5447d74e4f9863d81ae" alt="Page cover image" width="2150" height="770" data-path="assets/Editing and Replaying Tasks in Paragon Connect.png" />
</Frame>

View detailed logs for every step in your ingestion pipeline for all of your customers with the **Monitoring** page.

<Card title="Discover Monitoring" href="/monitoring/overview" horizontal icon={<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="#6747e7" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right-icon lucide-arrow-right"><path d="M5 12h14"/><path d="m12 5 7 7-7 7"/></svg>}>
  Learn more about viewing execution history in our comprehensive overview.
</Card>

## Monitoring

<Frame>
  <img src="https://mintcdn.com/paragon/867oBBVpxd2C3zc4/assets/Viewing%20Event%20Destinations%20in%20Paragon%20Connect.png?fit=max&auto=format&n=867oBBVpxd2C3zc4&q=85&s=d14f905183e1da779bb204f7060835d4" alt="Page cover image" width="1818" height="612" data-path="assets/Viewing Event Destinations in Paragon Connect.png" />
</Frame>

Send error logs to any of the services your team uses internally for monitoring your own application with Event Destinations.

<Card title="Discover Event Destinations" href="/monitoring/event-destinations" horizontal icon={<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="#6747e7" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-arrow-right-icon lucide-arrow-right"><path d="M5 12h14"/><path d="m12 5 7 7-7 7"/></svg>}>
  Learn more about sending logs to the services your team uses internally.
</Card>

## Wrapping Up

Our team has built solutions that empower our customers to build out integrations for RAG ingestion use cases. To learn more about how Paragon can enable your application to perform actions across integrations and our exciting new AI-focused features, [book a demo](https://www.useparagon.com/book-demo) or reach out to your Customer Success Manager to schedule some time with our team.

### Next Steps

1. [Sign up for Paragon](https://dashboard.useparagon.com/signup)
2. [Book a technical demo](https://calendly.com/useparagon/paragon-technical-demo) to see how we can help scale your RAG pipeline.
