QlikSenseInitialandIncremetalDataLoadProcess-ETL
June 15, 2025 ยท View on GitHub
This repository contains Qlik Sense load script logic to manage full and incremental loading of product inventory data from an Access database into QVD files. It also maintains a simple log mechanism to track task execution.
๐ Script Structure
The main components are organized as Qlik Sense subroutines:
โ
CheckLogFile
- Checks whether the
LogFile.qvdexists. - If not, it creates a new log file to track ETL runs.
๐ฆ InitialLoad
- Performs a full load from the Access database if no previous log entry for the task exists.
- Stores data in
ProductInventory.qvd. - Logs the task metadata (start/end time, row count, etc.).
๐ IncrementalLoad
- Loads only new records based on the
StockOutDatefield. - Merges new and existing data into
ProductInventory.qvd. - Appends a new entry to the log file for traceability.
๐ง Requirements
- Qlik Sense (Desktop or Enterprise)
- Data source: Access DB (
StockManagement_Incremental.accdb) - Data connection:
ProductInventory - Folder connection:
lib://my_data/
๐ Execution Order
call CheckLogFile;
call InitialLoad;
call IncrementalLoad;