March, 98
INTRODUCTION Data Warehousing is one of the key IT developments of the current decade. Businesses are building dedicated infrastructures for Business Intelligence systems to fulfill a long standing need of the business community to be able to view historical data to analyze long term trends, track profitability and other parameters by different business dimensions. This document illustrates the experience of Wipro Infotech in Data Warehousing and Data Mining. Wipro Infotech has over 25 person years' experience in the area of Data Warehousing for clients both in India and abroad. Currently, there are over 25 professionals involved in Data Warehousing activities. Wipro has identified Data warehousing as one of the major thrust area. Wipro has setup a dedicated team for expertise generation in the area of Data Warehousing. Wipro has also signed up alliances with number of partners in data warehousing and data mining areas. Formal training from Data Warehousing vendors to the Wipro staff. Lab for tool evaluation, proof of concept application development has been carried out. Wipro has recently bagged the largest Data Warehousing projects in India for National Stock Exchange. This is the second largest Data Warehouse to be implemented by any stock exchange in the world, after NASDAQ and has an initial size of over 500 GB.
OUR EXPERTISE IN DATA WAREHOUSING Wipro set up a dedicated lab for building expertise in the data warehousing and data mining. The core team has been drawn from various business units. These consultants have background skills of data modeling, extraction and analysis, database management and performance tuning. They have experience in variety of domain areas like manufacturing, finance, healthcare, sales and banking. The mission of the Technology center is "to further the knowledge and practice of the evolving technologies to the on-going, as well as, the new businesses." The major activities of the Data Warehousing lab are:
Wipro is one of the largest System Integration service providers in India. We have alliances with all the leading vendors in the area of the Data Warehousing. Wipro partners with these vendors on various projects. The relationship covers joint marketing effort, project execution and training of Wipro consultants on the tools and solutions provided by these vendors. Some of our leading partners are: Data Warehousing
Data Mining
WIPRO has over two years experience in executing and consulting on Data Warehouse projects in the areas of data acquisition, data analysis, data modeling and implementation. WIPRO teams have been involved in data warehousing projects for health care and manufacturing industries. National Stock Exchange of India The National Stock Exchange of India Limited (NSEIL) is the largest securities trading network in the world providing a nation-wide trading facility with equal access to investors all over the country using VSAT technology. The daily turnover on the Exchange is the highest in the country today. The NSE has emerged as a model exchange that has provided fully automated screen based trading with a high degree of transparency, speed and efficiency to individual transactions on real time basis. NSE is building a data warehouse in multiple phases to cover various analysis needs of the users. The Phase I which is currently going on deals with Risk Containment for the clearing corporation associated with the exchange. The core function of the Clearing corporation is to clear and settle trades executed on an exchange and being fully responsible for managing the clearing and settlement of trades. By separating the clearing entity from the exchange, the risk is transferred from the exchange to the clearing corporation. The Clearing Corporation guarantees financial settlement for settlement obligations it clears and settles. In order to guarantee settlement the clearing corporation has many risk containment measures to smoothen the settlement procedures and to manage major defaults. Wipro team is involved in all phases of the Data Warehouse right from Requirements Analysis, Technical Architecture design, Tool selection, Data Extraction, Metadata management and OLAP. The Data Warehouse is being built using Oracle8 as the central Data Warehouse, Oracle Express as the OLAP engine, Designer/2000 as modeling tool and Business Objects 4.1 as the querying and reporting tool. This Data Warehouse will start with approximately 500GB of data in the first phase and will be one of the largest stock exchange data warehouses in the world. A leading healthcare organization in New England The data warehousing project for health care organization involved data modeling, design and implementation of a data warehouse. The subject areas taken up for implementation included encounters, claims, pharmacy, customers and providers. The data warehouse was implemented on Sybase 10 SQL Server. A team of 15 persons including data architects, analysts, DBAs and user representatives were involved in the project. WIPRO was involved in providing Consultancy for data analysis, data modeling and evolving data modeling standards.It has over two years experience in executing and consulting on Data related projects. A manufacturing organization in US The data warehousing project for the manufacturing organization involved conceptualization, methodology formulation, data analysis, data modeling, Metadata analysis, design and implementation. The subject areas taken up for implementation were sales, invoicing and finance. The data warehouse was implemented on Microsoft SQL Server and Oracle. A team of 8 persons including data architects, analysts, DBAs and user representatives were involved in the project. WIPRO was involved in developing the methodology, selecting and guiding the pilot project, data modeling, design and implementation. A Health Maintenance Organisation in Massachusetts Wipro consultants are involved in the development of a data warehouse covering subject areas like Claims, Business Line analysis, Member analysis, Independent Practitioners, Procedures, Pharmacies, Risk Analysis etc. This data warehouse is being built using Red Brick as the database and Platinum's Forest and Trees as the Query Analysis. Wipro consultants are involved in the Data Extraction and load, Database management and application development for the end users. The source of information is TAHP MASTER Turbo Image Database. Several HP3000 based jobs run monthly to create and FTP data for REDBRICK. These extraction jobs are combination of Cognos PowerHouse, Suprtool, and COBOL.
Data Warehouse projects requires various skills right from hardware selection, set up of physical infrastructure, data modeling, Large Database Management (VLDBs), Source system analysis, Metadata Repository, OLAP, MQE and Data Mining. Wipro offers services only in the following areas: Source System Analysis Legacy System Expertise: Wipro has extensive experience in legacy systems. Wipro has done extensive work in various hardware platforms like mainframes, AS/400, UNIX and Digital. Wipro has a strong pool of consultants who are well versed in OLTP platforms like DB2, IMS, VSAM, Oracle, Sybase, and Informix environment.
Domain Expertise: Wipro consultants have experience in various application domains like manufacturing, healthcare, finance, sales and marketing, telecommunications and can be of great value while doing source system analysis.
Wipro provides services for data acquisition. With extensive experience with different hardware and OLTP platforms we have a strong pool of consultants who are well versed with data acquisition expertise. Wipro have experienced and trained consultants in the following data acquisition tools.
Data Modeling Data Warehouses follow different data modeling techniques like star schema, snow flake schema, constellation, etc which are optimized for complex query processing. Wipro has large pool of consultants with strong background of data modeling. We have expertise in the following data modeling tools
Data Warehouse Administration and Tuning Data Warehouse administration involves different tasks like data warehouse database management, tools configuration for data warehouse administration and tuning of the data warehouse database. Wipro has expertise in all of these areas and has a large pool of consultants well versed with the following popular data warehouse databases both in administration and tuning.
Application Development - OLAP/MQE/Reporting Wipro has been doing application development using variety of tools and has solid experience in reporting applications. Wipro consultants have worked on number of OLAP and Managed Query Environments and have expertise in the following
Metadata Repository Metadata repository is the information directory that helps in navigating through the data in data warehouse. Wipro can help in implementation of metadata repositories. Wipro consultants are trained and have expertise in the following metadata repositories
Data Warehouse Access through Web Data warehouse implementers are leveraging advancement in Web/internet related technologies to expand the user base of data warehouses. Wipro has considerably high level of expertise in these categories
Data Mining Data mining is the process of discovering hidden patterns in the data. Data in data warehouses are exploited by using data mining tools. Wipro consultants are well versed in different algorithms and techniques used by these data mining tools and can help clients in evaluating, selecting and deployment of such data mining tools which is "best fit" for their requirements. Wipro has expertise and knowledge of following data mining products
Data Warehousing projects need close interaction with end users, DBAs, OLTP analysts, and tool providers. However there are significant advantages in carrying out a part of these projects offshore like
Wipro propose to have a model of execution of data warehouse services with all analysts and team leads at the customer site and program development to be done at offshore development center. Specifically, Wipro proposes to carry out the following activities at offshore.
Activities like Database Administration, Data Modeling, and some part of Source System Offshore Onsite Coordination Offshore model requires coordination effort on the part of team leads. The team leads interface with end users, onsite analysts and the offshore team and are also responsible for smooth flow of communication between the teams. The offshore model :
Wipro follows its spiral methodology for Data Warehousing projects. This methodology closely follows the iterative nature of the Data Warehousing projects. The Iterative Model is based on the principle of progressively building more complete versions of the system. This approach reduces the risk of failure of large projects, starts delivering benefits quickly to the users and ensures that the expectations gap between the users and the systems team is controlled by periodically synchronizing users and systems with each iteration. The Data Warehouse development follows an Iterative life cycle process. Each Iterative cycle has Analysis, Design, Implementation and Test Phases. During the first Iteration, objectives, alternatives, and constraints are defined and risks are identified and analyzed. The customer evaluates each iteration and makes suggestions for modifications. Based on customer inputs, the next phase of planning and analysis occur. At each loop around the Iteration, the culmination of risk analysis results in a "go, no-go" decision. The Iterative path continues with each path taking the developer towards a more complete model of the system.
|
