How do I import data to FeatureBase Community?

February 1, 2024 ยท View on GitHub

{: .no_toc}

This overview explains the process of importing data to FeatureBase using three methods:

  • CSV
  • SQL
  • Apache Kafka

{% include page-toc.md %}

Before you begin

{% include /com-install/com-install-before-begin.md %}

What are ingesters?

Ingesters are used to:

  • retrieve data from a specified upstream data source
  • transform the data to the FeatureBase bit-columnar format
  • write that data to target database tables.

{: .note} Tables defined by ingest source files are created if they do not already exist.

Perform data modeling

{% include /concepts/summary-data-modeling.md %}

Import data

You can import data to FeatureBase running three types of ingester processes:

  • CSV ingest
  • SQL ingest
  • Kafka ingest

CSV ingest

Learn how to build CSV source files and the ingest flags you use to import your data.

SQL import method

Learn how to define your SQL source and ingest flags to import the data.

Kafka import methods

Learn how to define Avro and Static Schema source files and valid ingest flags to import your data.

Troubleshooting