Skip to main content

Documentation Index

Fetch the complete documentation index at: https://openmetadata-codex-fix-python-sdk-doc-examples.mintlify.app/llms.txt

Use this file to discover all available pages before exploring further.

Getting Started: Day 1

Get started with your OpenMetadata service in a few simple steps:
  1. Set up a Data Connector: Connect your data sources to begin collecting metadata.
  2. Ingest Metadata: Run the metadata ingestion process to gather and push data insights.
  3. Invite Users: Add team members to collaborate and manage metadata together.
  4. Explore the Features: Dive into OpenMetadata’s extensive feature set to unlock the full potential of your data.
Ready to begin? Let’s get started!

Step 1: Set up a Data Connector

Once you have logged into your OpenMetadata instance, set up a data connector to start ingesting metadata. OpenMetadata provides 90+ turnkey connectors for a wide range of services, including:
  • Databases
  • Dashboards
  • Messaging services
  • Pipelines
  • ML models
  • Storage services
  • Other metadata services
For custom data sources, metadata ingestion can also be set up via API. There’s two options on how to set up a data connector:
  1. Run the connector in OpenMetadata: In this scenario, an IP will be provided when you add the service. You must allow access to this IP in your data sources.
https://mintcdn.com/openmetadata-codex-fix-python-sdk-doc-examples/uCWIv8gHzYv5aEPg/public/images/icons/data-discovery.svg?fit=max&auto=format&n=uCWIv8gHzYv5aEPg&q=85&s=34da4f6159ba33ba28550e20661e2e3c

Run the connector in OpenMetadata

Guide to start ingesting metadata seamlessly from your data sources.
  1. Run the connector in your infrastructure or on a local machine:: This hybrid model allows organizations to run metadata ingestion components within their own infrastructure. This ensures that OpenMetadata’s managed service doesn’t need direct access to the underlying data. Only metadata is collected locally and securely transmitted to the platform, maintaining data privacy and security.

Step 2: Ingest Metadata

Once the connector is set up, configure a metadata ingestion pipeline to import metadata into OpenMetadata on a regular schedule.
  • Navigate to Settings > Services > Databases and select the service you added.
Ingestion Navigation
  • Go to the Agents tab and click Add Metadata Agent.
Adding Ingestion
  • Configure any required settings or filters for the ingestion process. Documentation is available in the side panel for reference.
Configure Ingestion
  • Schedule the pipeline to ingest metadata at regular intervals.
Schedule Ingestion
  • In addition to metadata ingestion, you can set up pipelines for lineage, profiler data, or dbt information.
  • Once the metadata ingestion is completed, the ingested data assets can be viewed under the Explore section in the main menu.
Ingested Data
  • You can repeat these steps to ingest metadata from other data sources as needed.

Step 3: Invite Users After Setting Up SMTP

SMTP Configuration

To invite users you will need to ensure that you have an SMTP server available. With the information for your SMTP server you can configure OpenMetadata to send email alerts by updating the details from the UI. To update the details from the UI, navigate to Settings > Preferences > Email Email Configuration
If you encounter issues connecting to the SMTP server, ensure that the correct Certificate Authority (CA) is configured to trust the SMTP host. Additionally, use the DNS hostname instead of the IP address in the SMTP server endpoint configuration to avoid certificate validation errors.

Inviting Users

After metadata has been ingested into OpenMetadata, you can invite users to collaborate on the data and assign different roles.
  • Go to Settings > Team & User Management > Users.
Users Navigation
  • Click Add User, then enter their email and other required details to grant access to the platform.
Adding New User
  • Organize users into different Teams, and assign them specific Roles.
  • Users inherit access permissions from their assigned teams and roles.
  • Admin access can be granted to users who need full access to all settings, including the ability to invite new users.
Users Profile
  • New users will receive an email invitation to set up their accounts.

Step 4: Explore Features of OpenMetadata

OpenMetadata offers a comprehensive platform for data teams to:
  • Break down data silos
  • Securely share data assets across various sources
  • Foster collaboration around trusted data
  • Establish a documentation-first data culture within your organization
Explore these features and unlock the full potential of your data using OpenMetadata.
https://mintcdn.com/openmetadata-codex-fix-python-sdk-doc-examples/uCWIv8gHzYv5aEPg/public/images/icons/data-discovery.svg?fit=max&auto=format&n=uCWIv8gHzYv5aEPg&q=85&s=34da4f6159ba33ba28550e20661e2e3c

Data Discovery

Discover the right data assets to make timely business decisions.
https://mintcdn.com/openmetadata-codex-fix-python-sdk-doc-examples/uCWIv8gHzYv5aEPg/public/images/icons/data-collaboration.svg?fit=max&auto=format&n=uCWIv8gHzYv5aEPg&q=85&s=700efbdb7b5886e214dbdd2599fb560e

Data Collaboration

Foster data team collaboration to enhance data understanding.
https://mintcdn.com/openmetadata-codex-fix-python-sdk-doc-examples/uCWIv8gHzYv5aEPg/public/images/icons/data-quality.svg?fit=max&auto=format&n=uCWIv8gHzYv5aEPg&q=85&s=9e7a03c6723df35c39be6f15e0595b0c

Data Quality & Observability

Trust your data with quality tests & monitor the health of your data systems.
https://mintcdn.com/openmetadata-codex-fix-python-sdk-doc-examples/uCWIv8gHzYv5aEPg/public/images/icons/data-lineage.svg?fit=max&auto=format&n=uCWIv8gHzYv5aEPg&q=85&s=5c8f620b6328fb4fc1f2d473b09d3d54

Data Lineage

Trace the path of data across tables, pipelines, and dashboards.
https://mintcdn.com/openmetadata-codex-fix-python-sdk-doc-examples/uCWIv8gHzYv5aEPg/public/images/icons/data-insights.svg?fit=max&auto=format&n=uCWIv8gHzYv5aEPg&q=85&s=51febbd77b3304a6c9f579c7f424580d

Data Insights

Define KPIs and set goals to proactively hone the data culture of your company.
https://mintcdn.com/openmetadata-codex-fix-python-sdk-doc-examples/uCWIv8gHzYv5aEPg/public/images/icons/data-governance.svg?fit=max&auto=format&n=uCWIv8gHzYv5aEPg&q=85&s=597bcdac1715331291b88575538db52c

Data Governance

Enhance your data platform governance using OpenMetadata.

Deep Dive into OpenMetadata: Guides for Admins and Data Users

https://mintcdn.com/openmetadata-codex-fix-python-sdk-doc-examples/lOAUY-upFIHRrmiI/public/images/icons/administration.svg?fit=max&auto=format&n=lOAUY-upFIHRrmiI&q=85&s=19f229d6c1c554b28829105de88d26d1

Admin Guide

Admin users can get started with OpenMetadata with just three quick and easy steps & know-it-all with the advanced guides.
https://mintcdn.com/openmetadata-codex-fix-python-sdk-doc-examples/uCWIv8gHzYv5aEPg/public/images/icons/steward.svg?fit=max&auto=format&n=uCWIv8gHzYv5aEPg&q=85&s=10717c186e4a564181dd2cc97f0a533d

Guide for Data Users

Get to know the basics of OpenMetadata and about the data assets that you can explore in the all-in-one platform.