Background
The development of the Statistics Data Warehouse (StatsDW®) by the Department of Statistics Malaysia (DOSM) began in 2009 with a preliminary study on the requirements for an Enterprise Data Warehouse (EDW). The objective of this study was to identify the long-term requirements for establishing an integrated statistical data ecosystem capable of supporting multi-sectoral data needs and evidence-based decision-making across Malaysia.
In 2012, a comprehensive study report was completed, detailing the technical, operational and business requirements, as well as the financial implications of the proposed initiative. This report served as the primary reference for the planning and implementation of subsequent development phases.
Between 2013 and 2014, DOSM focused on developing a detailed implementation roadmap and technical architecture plan. This phase included technology assessments, infrastructure planning, business process analysis and functional system design. The findings and recommendations from these activities paved the way for the development of StatsDW Phase I, which commenced in 2015 and was successfully deployed in 2016.
StatsDW Phase I introduced seven core modules designed to support data dissemination, analysis and visualization:
• Visualization
• Time Series
• Location Intelligence
• eDataBank
• MyLab
• Analytics
• Mobile Apps
Following the implementation of Phase I, an impact and usage assessment was conducted in 2017 to evaluate system performance, user adoption and overall effectiveness. In 2018, DOSM undertook a comprehensive enhancement study, including Proof of Concept (POC), Proof of Technology (POT) and the preparation of proposal and technical documentation to support the next phase of development.
Based on the outcomes of these studies, the development of StatsDW 2.0 commenced in 2019 with the objective of expanding statistical subject matter coverage, strengthening inter-agency data integration and modernizing data management capabilities. StatsDW 2.0 was successfully launched in 2022 and introduced four enhanced core modules:
• Smart Data Partnership (SDP)
• Smart Data Lake Management (SDLM)
• Smart Data Communication (SDC)
• Management Module (MM)
In 2024, further enhancement initiatives were undertaken to strengthen the capabilities of StatsDW 2.0. These enhancements focused on several strategic areas, including:
• Introduction of additional functionalities to improve usability and operational efficiency across the four core modules.
• Strengthening data integration security through integration with the MyGDX platform.
• Collaboration with Subject Matter Divisions (SMDs) through the implementation of six guided use cases to support data-driven statistical production and analysis.
• Development of MyMETS as a dedicated data dissemination platform for trade-related statistics.
Building upon these achievements, DOSM officially launched the StatsDW 2.0 Enhancement in June 2026. This enhancement marked another significant milestone in the evolution of the national statistical data infrastructure by introducing advanced capabilities aimed at improving data governance, metadata standardization and interoperability across statistical systems.
A key feature of the enhancement was the introduction of a new core module, the Metadata Module (MDM), which serves as a centralized repository for managing statistical metadata. The module enables standardized documentation of datasets, indicators, classifications, methodologies, concepts, definitions and data lineage, thereby improving data quality, consistency, discoverability and governance across the statistical ecosystem. The Metadata Module also supports greater interoperability between DOSM and Other Government Agencies (OGAs), facilitating more efficient data sharing and integration while ensuring compliance with national data governance standards.
With the inclusion of the Metadata Module, StatsDW 2.0 Enhancement now comprises five strategic core modules:
• Smart Data Partnership (SDP)
• Smart Data Lake Management (SDLM)
• Smart Data Communication (SDC)
• Management Module (MGM)
• Metadata Management (MDM)
Overall, the evolution of StatsDW from 2009 to 2026 demonstrates DOSM’s continuous commitment to transforming Malaysia’s national statistical data infrastructure through the adoption of modern technologies, integrated data management practices and innovative digital solutions. This initiative supports the Government’s agenda of strengthening data-driven policymaking and aligns with the Malaysia MADANI framework, particularly the core value of Innovation (Daya Cipta), while contributing towards the achievement of the Sustainable Development Goals (SDGs) 2030.