metadata-ingestion-framework


InfoLibrarian™ Ingestion Framework

What is the Ingestion Framework?

  • Connects to over 300 sources including cloud, data warehouses, BI tools, ETL engines, code, and legacy apps
  • Extracts technical metadata, schema, lineage, job definitions, transformations, and configurations
  • Built-in API and SDK for writing custom scanners and automating onboarding
  • Supports batch, scheduled, and streaming metadata ingestion
  • Feeds metadata directly into the InfoLibrarian™ Metadata Fabric for governance and enrichment


Included Connectors

From SQL, Oracle, and Snowflake to Tableau, Informatica, SSIS, and .NET code — explore available ingestion adapters. View Adapter List



Build Your Own Scanners

Contact us for SDK access and help building custom ingestion workflows.



Connect, ingest, and transform metadata from any system—on-prem or cloud. InfoLibrarian™ helps you unify and govern metadata at scale with our proven adapters and extensible SDKs.

Explore the Metadata Fabric

One Framework. Unlimited Integration.

InfoLibrarian™ Metadata Ingestion Framework lets you ingest metadata from files, databases, APIs, pipelines, and cloud platforms—transforming and enriching it into a central metadata fabric that powers governance, lineage, and analytics.

Whether you're orchestrating ingestion across Snowflake, Databricks, or legacy systems, our architecture ensures scalability, flexibility, and auditability.



Why It Matters

  • ✔️ Massive Adapter Library — Ingest from 100+ systems, including Snowflake, S3, Oracle, MongoDB, Kafka, SQL Server, DBT, Glue, and more
  • ✔️ SDK + APIs — Extend, embed, or script your own ingestion pipelines using .NET, Python, or REST
  • ✔️ Model + Transform — Reshape ingested metadata into business models, data product definitions, or governance views
  • ✔️ Push + Pull — Stream in from external tools or publish structured metadata to downstream platforms
  • ✔️ Govern at Ingestion — Validate structure, semantics, and lineage before metadata reaches your warehouse or catalog


Start Smarter Metadata Integration

Deliver trusted metadata faster. InfoLibrarian™ provides the tooling and guidance to help you onboard, transform, and govern your metadata with confidence.

Book a Strategy Session
Browse Supported Adapters & Integration Options
  • big-dataTraditional & Big Data
  • etl-tools ETL & Big Data Pipelines
  • processes Data & ML Operations
  • metadata-classifiers-stitchers-mappers-taxonomy-builders Classifiers & Stitchers
  • web-services Web Services & API's
  • XMI-CWM-Dublin Core Metadata Standards

InfoLibrarian™ Classic Universal Adapters Bundle!

We've bundled a set of the most common and useful point and click adapters with every version of the product. The standard adapter bundle enables you to configure crawling of metadata from most sources in most environments. Once metadata is onboarded, the portal will provide search, impact analysis results. Below is a list of the adapters included with the product:


  • Import adapter for Oracle, SQL Server and OLEDB-ODBC-JDBC sources.
  • Excel adapter for tabular metadata from Excel documents).
  • ANSI SQL Adapter (Relational).
  • Oracle DeepScan Metadata Adapter (Relational).
  • SQLServer DeepScan Metadata Adapter (Relational).
  • DB2 DeepScan Adapter (Relational).
  • XMI Universal Adapter (XMI-CWM payloads).
  • JSON/XML Transformer (JSON/XML payloads).
  • InfoLibrarian™ Metadata Canonicalizer.
  • Bulk Processing Optimized API.
  • Command Line Interface for Usage (CLI).

^ Back to Top

The InfoLibrarian™ name, logos, software, documentation, and site content are proprietary to InfoLibrarian Corporation
and protected under international copyright and intellectual property laws. Unauthorized reproduction or distribution is strictly prohibited.

The names of companies and products mentioned herein may be the trademarks of their respective owners.

Close this window


Log In To Account



USER NAME * (This will be your email address) Forgot User Name

PASSWORD * (6 characters minimum, 25 maximum) Forgot Password




Don't Have An Account?




Terms of Use | Privacy Policy