Semi Automatic Method for Designing ETL Processes
Ahmed KABIRI, Dalila CHIADMI
Journal of Information & Systems Management, Vol. 4, No. 4, 2014.
DOI: 
Link: 
Abstract:
Data warehouse (DW) has been widely recognized as an effective solution for integrating diverse sources. In this environment, Extraction-Transformation-Loading (ETL) processes constitute the integration layer which aims to pull data
from data sources to targets, via a set of transformations. ETL is responsible for the extraction of data, their cleaning,
conforming and loading into the target. At the beginning of DW project, one of the most important tasks is to construct conceptual design of ETL processes. Several solutions have been proposed to support ETL designer in this task. Nevertheless few methods have accompanied these proposals. In this paper, we present a method for modeling and organizing ETL processes based on our experience in real world. More precisely, we suggest modularizing an ETL process into six modules. Namely, Technical Check, Semantic Check, Standardization & Cleaning, Mapping, Particular Processing and Rejects Management Bus. The proposed approach takes four inputs and produces, exactly via ENGINE device, a conceptual model
of ETL processes using a graphical notation of our framework KANTARA. Finally, we give guidelines how to construct our method inputs.