cwiqduck

What is cwiqduck?

cwiqduck extension overrides DuckDB's Filesystem Interface. When loaded, this extension changes the behavior of read operations within CWIQ FS.

How does cwiqduck work?

Once loaded, cwiqduck checks if the file in question is within CWIQ FS. If so, the extension redirects DuckDB to the blob storage URL for that file. Then, the httpfs module does the read for that file instead. Diagram below visualizes the extension's capabilities.

Getting Started

cwiqduck currently does not add any user-defined function. Instead, it tries to convert DuckDB's reads within CWIQ FS to a URL provided by the blob storage provider (such as Amazon S3).

 
INSTALL httpfs;
INSTALL cwiqduck FROM community;
LOAD cwiqduck;
cwiqduck extension enabled

Dependencies

• httpfs

Limitation

The cwiqduck extension does not support any non-Linux platform. Moreover, this extension will not handle any filesystem operations outside CWIQ FS mount.