function and mechanism of new and present rdes rdes with countrystat - function and mechanism of new...

RDES with CountrySTAT- Function and Mechanism of New and Present RDESFunction and Mechanism of New and Present RDES -

Takeshi HAGINO

Agricultural Statistics Expert

GCP/RAS/184/JPN

Function and Mechanism of Function and Mechanism of New and Present RDESNew and Present RDES

TopicTopic

1. Introduction

2. Function of RDES- Outline of the present RDES- Outline of the new RDES with CountrySTAT

3. Mechanism of CountrySTAT- Requirements for constructing the database with

CountrySTAT- Component of RDES with CountrySTAT- Data Conversion- On-going Development

IntroductionIntroduction

RDES has been operating since March 2003.

http://www.faorap-apcas.org

Participating Countries (16)

Bangladesh, Bhutan, Cambodia, China, Fiji, India, Indonesia, Iran, Lao PDR, Myanmar, Nepal, Pakistan, Philippines, Sri Lanka, Thailand and Viet Nam

Function of RDESFunction of RDES

• RDES is a unitary statistical Information system on Food and Agricultural Statistics in APCAS countries.

- Database of APCAS countries- Gateway for internet website (Portal website)


Database of APCAS countriesDatabase of APCAS countries

1. More than 200 records are stored based on the same standard (Definition of Unit, Items, format, etc).

2. Main data are production of crops and livestock (it is settled 19 core data), which are sub-national and historical based.


A Portal Website on Food and Agricultural A Portal Website on Food and Agricultural Statistics in APCAS countriesStatistics in APCAS countries

1. It has been showing the Country Profile, Contact address of the national Focal Point and hyperlinks for related organizations for statistics in each country.

2. RDES also show the external hyperlinks to related database/organizations/associations for Agricultural Statistics and Food Security Information on the top page of website, such as the FAOSTAT, UNSTAT, etc.

<16 participating countries>Bangladesh Lao PDRBhutan MyanmarCambodia NepalChina PakistanFiji PhilippinesIndia Sri LankaIndonesia ThailandIran Viet Nam

<Other APCAS countries>AustraliaJapan (Donor)MalaysiaRepublic of KoreaUnited States of America

The Project covered The Project covered countriescountries

RDES RDES (Regional Data Exchange System)

Major Agricultural Statistics Data

1.19 core commodities of the sub-regional agricultural production data, such as Rice Paddy, Wheat, Cattle, etc.

2.Other data (Agricultural Population, price, etc)

3.Use the same standard (Unit, definition of data item, data format, etc)

Country Profile of the Agricultural Statistics

Gateway to the related statistical organization’s webpage and DB

RDES (Regional Data Exchange System) RDES (Regional Data Exchange System)

A Portal Website on Food and Agricultural Statistics in APCAS CountriesA Portal Website on Food and Agricultural Statistics in APCAS Countries

Data Input

Feedback

New ZealandFranceUnited Kingdom

APCAS Countries not APCAS Countries not covered by RDEScovered by RDES

UsersSearch the information

Get the informationRDES RDES

(Regional Data Exchange System)

Major Agricultural Statistics Data

1.19 core commodities of the sub-regional agricultural production data, such as Rice Paddy, Wheat, Cattle, etc.

2.Other data (Agricultural Population, price, etc)

3.Use the same standard (Unit, definition of data item, data format, etc)

Country Profile of the Agricultural Statistics

Gateway to the related statistical organization’s webpage and DB


1. Front page

The RDES front page provides information about the project and links to relevant projects documents. The menu of the left side of the page links to country pages as well as to related external sites.


2. Country pages

Country page provides a link to the regional data exchange system of a country (Database), Country profiles, documents related to the country and related external links.


3. Database- RDES is an interactive web-based system for

uploading, storing and downloading/viewing statistical data files.

- Each participating country has its own independent database which records the description and location of the statistical data files.

- The system accepts the following file types: Microsoft Excel, Microsoft Word, Microsoft PowerPoint, Adobe Acrobat PDFs, etc.

- Use of MS-Excel is highly recommended because they are able to modify the data easily more than the other types of files, such as re-tabulation, making a graph, calculation and so on.

Outline of the new RDES with CountrySTATOutline of the new RDES with CountrySTAT • CountrySTAT, which is developed by FAO

Headquarters, is a statistical information system designed to aid in the progress of strategic decision-making for food and agriculture policy at national level.

• The software of CountrySTAT is based on PC-AXIS technology with Scandinavian countries, and it has advantage for re-tabulation, mapping and making a graph more than the other statistical software or database.

• In addition, the software of CountrySTAT is also functional if it is used for Regional Statistical Database as a basic system and tools on the website.

Outline of the new RDES with CountrySTATOutline of the new RDES with CountrySTAT

• Front page

The new RDES’s front page provides information about the project, links to database and links to relevant website.

Outline of the new RDES with CountrySTATOutline of the new RDES with CountrySTAT • “Navigation”

Navigation links to the data on new RDES. It is classified into three categories, Country Data, Selected Indicator in APCAS and All data.

• “Search Box”To put the word in Search Box, it is easy to find the required data. For example, if the user needs the data of rice on RDES, the user just puts the word of “rice” in this box, then new RDES system find out all the data of Rice on database.

• LinksThere are two categories of external links. “RDES Links” is shown the hyperlink to Present RDES External link and Country page on RDES. “CountrySTAT Links” is the gateway which is relating the CountrySTAT, such as CountrySTAT website on FAO, PC-Axis website, etc.

Outline of the new RDES with CountrySTATOutline of the new RDES with CountrySTAT

DatabaseDatabase Function Function

- Data Query (Select part)After choosing the data, the screen proceeds to the webpage of Data Query. The data was selected by the users, required time, elements, etc.

- Result as Table, Graph and MapOn the basis of the users’ selection, the new RDES shows the result, inter alia; (1) Table with re-tabulation and aggregation (2) 10 forms of graphs, and (3) Four styles of electric files such as PX-files, MS-Excel, CSV and SDMX (Statistical Data and Metadata Exchange).

Search InterfaceSearch Interface

Results on WebResults on Web

Results in ExcelResults in Excel

Results in CSVResults in CSV

Results in XML (SDMX)Results in XML (SDMX)

Results in ChartsResults in Charts

Results in MapsResults in Maps

Mechanism of Mechanism of the the new RDES new RDES with CountrySTATwith CountrySTAT

Mechanism of Mechanism of the the new RDES with CountrySTATnew RDES with CountrySTAT

• The software of CountrySTAT is based on PC-AXIS technology with Scandinavian countries, and it has advantage for re-tabulation, mapping and making a graph more than the other statistical software or database. Very useful for the Users!

• On the other hand, using the CountrySTAT need only the minimum requirements to construct the database


• Requirements for constructing the constructing the database with CountrySTATdatabase with CountrySTAT

- The basic system of CountrySTAT is quite simple.

- All the people who have a little knowledge of IT can construct the database with CountrySTAT as their own database system.


• Requirement of basic hardware and basic hardware and softwaresoftware

- CountrySTAT needs the minimum installation of hardware and software of PC although it is necessary of PC on the Internet webserver.

- It is also available to use on the low specification computer as independent database system.


• CPU:CPU: Pentium III or more high performance CPU, compatible with IBM-PC. In case of RDES, it can be operated on old architect (Mobile Pentium III, 866Mhz)So it is enough for the operation of CountrySTAT by single cored CPU.

• Size of hard disk (HDD):Size of hard disk (HDD):Though it depends on the size of statistics and map, cheapest HDD (Maybe 40GB) is enough for CountrySTAT. In case of new RDES, it is only needed about 150MB of disk space.

• OS (Operation System):OS (Operation System):Windows NT, 2000 and XP with IIS 4.0 or latest version (It is also available to operate under Linux with “Chili Soft ASP”)


• PX-Software:PX-Software:

PC-AXIS, PC-Map, PX-Excel, PC-Make, PX-Edit and PX-Web

• The software which can edit the ASP and The software which can edit the ASP and related files:related files:

Text editor and Web construct software such as “Microsoft Visual Studio .NET”.

In the case of new RDES, “Microsoft Front page” and “Text Editor” for programming are enough.


• Requirement of the Requirement of the knowledge of IT knowledge of IT TechnologyTechnology

- Any person who has the knowledge of HTML is capable of basic construction the database based on the CountrySTAT software

- However, the knowledge of GIS is needed for the map option when you make your country map information as initial set-up.

- To study the basic component and operation of CountrySTAT, the time required is only 5 days.


• Component of RDES with CountrySTAT

- The major component of CountrySTAT is sustained by ASP file, which works on IIS technology with MS-Windows Server. To change/modify some of ASP file as well as change the parameters, the developer of database with CountrySTAT is easy to customise for their requests.

- One of the important file is “Globa2.asp” which is the parameter files on CountrySTAT.

- And it also needed some ASP-files, “index.asp” and related ASP.files to modify for the outlook of database, add the logo-types, etc. It is almost the same as html, so it can be easy to modify in each developer.

Thank you!!Thank you!!

Takeshi HAGINO

Agricultural Statistics Expert

GCP/RAS/184/JPN

RDES with CountrySTAT- Metadata of RDESMetadata of RDES -

TopicTopic

• Introduction

• Philosophy of Metadata on RDES1. Fundamental Metadata of each survey2. Metadata which was added when it would be

issued/made public3. Metadata as a portal website on Food and

Agricultural Statistics

• Development of Metadata on RDES


100 ?


100Example:

- “100” is data, and with no additional context is meaningless.

- With the additional “Metadata" of giving “100” a meaningful name of "Zip Code", you can then understand that “100” represents Tokyo, Japan.

- Or, if it is added the unit of “meter” to “100”, “100” becomes as the distance.

Metadata is data about information

http://en.wikipedia.org/wiki/Zip_Code


There are also more sophisticated definitions such as:

- "Metadata is structured, encoded data that describe characteristics of information-bearing entities to aid in the identification, discovery, assessment, and management of the described entities." and;

- "Metadata” is a set of optional structured descriptions that are publicly available to explicitly assist in locating objects.

Reference: Wikipedia (http://en.wikipedia.org)


The man who is standing in front of the Tank.


The man who is standing in front of the Tank.

He took this photo in Bangkok

Name: Takeshi HAGINO

Nationality: Japanese

Occupation: FAO officer

Location: Bangkok, Thailand

Title: Agricultural Statistics Expert of the Project, GCP/RAS/184/JPN

Etc….


Without the less/inaccurate Metadata

Cannot reply the needs of Users

- Confusion, collapse

- Misleads

- Loosing the confidential

- Etc.

With the full/acculate Metadata

Can reply the needs of UsersTo be happy !!


Metadata have to be a compass of the Data

What is the appropriate Metadata concept What is the appropriate Metadata concept for RDES as the Database and a portal for RDES as the Database and a portal website on Food and Agricultural Stat.?website on Food and Agricultural Stat.?

Philosophy of Metadata of RDESPhilosophy of Metadata of RDES

As a basic condition……• Metadata should be helpful, reasonable for the

Users

Then• To consider the Metadata on RDES, it should be

the maximum number of Metadata on RDES based on the basis of the function, statistical database and portal website.


• There are 2 types of the users;1. Heavy Users

It means that the user who analyze the statistical data from individual questionnaire, such as re-calculation, etc.

2. Normal Users

It means the the users who only analyze the data from the result, such as monitoring, classification, etc.


<Major Component as Database and Portal Website><Major Component as Database and Portal Website>

• Fundamental Metadata of each survey (data)

• Metadata which was added when it would issue/make public

• Metadata as a portal website on Food and Agricultural Statistics


Heavy Users (*1) Normal Users (*2)

1. Fundamental Metadata of each survey (*3)(1) Name of the Survey (Title of Statistics) High High Yes Rice Production, Agricultural Census, etc.

(2) Objectives/Purpose of the collection Middle Middle - to caluculate the government price, To monitor the trend, etc

(3) Questionnaire High Low -(4) Survey's object and number High Low - Object: farmer, agro-industry, agricultural cooperatives, etc.

Number: real number, ratio, etc.

(5) Geographical area, location guidance High High Yes name of city, province, etc.

(6) Reporting period High High Yes daily, monthly, quarterly, yearly, etc.

(7) Definition of data item and unit High High Yes Item: FAO definition, International clasification, national definition, etc.Unit: MT, kg (weight); ha, Rye (area), kg/ha, bushels (yield), national currency(price), etc.

(8) Sampling process High Low - Random Sampling, Significance sampling, Stratification Sample, etc.

(9) Accuracy High Middle - standard error, standard deviation, variance, etc.

(10) Methodology of data collection High Low - interview by enumerator, mail, actual mesurement by enumerator, etc.

(11) Methodology of totaling High Low - To show/explain the process of calculation, etc.

2. Metadata which was added when it would beissued/made public(1) Data table format N.A. N.A. Yes(2) Information of Data file format High High Yes paper (book), electric file (CSV, MS-Excel, PDF, etc.)

(3) Other information (footnote and reference) High High Yes the reason of missing, lacking the data, merge/divide the range of region, level,etc.

(4) Date of Publication High High Yes(as a upload

date)

3. Metadata as a portal website of Food andAgricultural Statistics(1) Contact High High Yes contact person, address, telephone, FAX, e-mail, web address, etc.

(2) Kinds of surveys and related information High High - List of agricultural surveys

(3) Information of the statistical organization, background High High Yes(It's not sodetailed)

(4) Country Profile High High Yes Summary of country data, annual report, etc.

*1: "Heavy Users" mean that the people who analyze the data from indivisual questionnair, such as re-calcurate, etc.

*2: "Normal Users" mean that the people who only analyze the data from the results, such as monitoring, classification, etc.

*3: It means that it would be accompanied the metadata when each survey would be planned

Table. Metadata of RDES

Importance by User's point of view Metadata onRDES NoteAttribution of Metadata


- When it would be planned/implemented the survey, the metadata, which is name, objectives, period, etc., also would be automatically accompanied.

- On the other hand, although it is needed for the “Heavy Users”, the “Normal Users” do not need whole the fundamental metadata.


1. Fundamental Metadata of each survey (*3)Name of the Survey (Statistics) High High Yes e.g. Rice Production, Agricultural Census, etc.

Objectives/Purpose of the collection Middle Middle - to caluculate the government price, To monitor the trend, etc

Questionnaire High Low -Survey's object and number High Low - Object: farmer, agro-industry, agricultural cooperatives, etc.


Geographical area, location guidance High High Yes name of city, province, etc.

Reporting period High High Yes daily, monthly, quarterly, yearly, etc.

Definition of data item, unit, High High Yes Item: FAO definition, International clasification, national definition, etc.Unit: MT, kg (weight); ha, Rye (area), kg/ha, bushels (yield), national currency(price), etc.

Sampling process High Low - Random Sampling, Significance sampling, Stratification Sample, etc.

Accuracy High Middle - standard error, standard deviation, variance, etc.

Methodology of data collection High Low - interview by enumerator, mail, actual mesurement by enumerator, etc.

Methodology of totaling High Low - To show/explain the process of calculation, etc.

Table Metadata of RDES



- All the users would require the periphery information of the data such as the reason of data lacking/missing when they analyze the data.

- Date of Publication show the freshness of each data.


2. Metadata which was added when it wouldissue/make publicData table format N.A. N.A. YesInformation of Data file format High High Yes paper (book), electric file (CSV, MS-Excel, PDF, etc.)

Other information High High Yes the reason of missing, lacking the data, merge/divide the range of region, level,etc.

Date of Publication High High Yes(as a upload

date)




- To refer the contact, users can get more profound information from the donor of data.

- Country Profile helps to deepen the knowledge of background in each country.


3. Metadata as a portal website of Food andAgricultural StatisticsContact High High Yes contact person, address, telephone, FAX, e-mail, web address, etc.

Kinds of surveys and related information High High - List of agricultural surveys

Information of the statistical organization, background High High Yes(It's not sodetailed)

Country Profile High High Yes Summary of country data, annual report, etc.


Importance by User's point of view Metadata onRDES NoteBasic Metadata


Present Metadata on RDES is targeted for “Normal Users”, however, it is not enough for “Heavy Users”


1. Fundamental Metadata of each survey (*3)Name of the Survey (Statistics) High High Yes e.g. Rice Production, Agricultural Census, etc.

Objectives/Purpose of the collection Middle Middle - to caluculate the government price, To monitor the trend, etc

Questionnaire High Low -Survey's object and number High Low - Object: farmer, agro-industry, agricultural cooperatives, etc.


Geographical area, location guidance High High Yes name of city, province, etc.

Reporting period High High Yes daily, monthly, quarterly, yearly, etc.

Definition of data item, unit, High High Yes Item: FAO definition, International clasification, national definition, etc.Unit: MT, kg (weight); ha, Rye (area), kg/ha, bushels (yield), national currency(price), etc.

Sampling process High Low - Random Sampling, Significance sampling, Stratification Sample, etc.

Accuracy High Middle - standard error, standard deviation, variance, etc.

Methodology of data collection High Low - interview by enumerator, mail, actual mesurement by enumerator, etc.

Methodology of totaling High Low - To show/explain the process of calculation, etc.

2. Metadata which was added when it wouldissue/make publicData table format N.A. N.A. YesInformation of Data file format High High Yes paper (book), electric file (CSV, MS-Excel, PDF, etc.)

Other information High High Yes the reason of missing, lacking the data, merge/divide the range of region, level,etc.

Date of Publication High High Yes(as a upload

date)

3. Metadata as a portal website of Food andAgricultural StatisticsContact High High Yes contact person, address, telephone, FAX, e-mail, web address, etc.

Kinds of surveys and related information High High - List of agricultural surveys

Information of the statistical organization, background High High Yes(It's not sodetailed)

Country Profile High High Yes Summary of country data, annual report, etc.




1. Fundamental Metadata of each survey (*3)(1) Name of the Survey (Title of Statistics) High High Yes Yes(2) Objectives/Purpose of the collection Middle Middle - -(3) Questionnaire High Low - -(4) Survey's object and number High Low - Yes

(5) Geographical area, location guidance High High Yes Yes(6) Reporting period High High Yes Yes(7) Definition of data item and unit High High Yes Yes

(8) Sampling process High Low - Yes(9) Accuracy High Middle - Yes(10) Methodology of data collection High Low - Yes(11) Methodology of totaling High Low - Yes

2. Metadata which was added when it would beissued/made public(1) Data table format N.A. N.A. Yes Yes(2) Information of Data file format High High Yes Yes(3) Other information (footnote and reference) High High Yes Yes

(4) Date of Publication High High Yes(as a upload date)

Yes(as a upload date)

3. Metadata as a portal website of Food andAgricultural Statistics(1) Contact High High Yes Yes(2) Kinds of surveys and related information High High - Yes(3) Information of the statistical organization, background High High Yes

(It's not so detailed)Yes

(It w ould be moredetaild)

(4) Country Profile High High Yes(It's not so detailed)

Yes(It w ould be more

detaild)

*1: "Heavy Users" mean that the people who analyze the data from indivisual questionnair, such as re-calcurate, etc.

*2: "Normal Users" mean that the people who only analyze the data from the results, such as monitoring, classification, etc.

*3: It means that it would be accompanied the metadata when each survey would be planned

Table. Metadata of RDES

Importance by User's point of view Present Metadataon RDESAttribution of Metadata

Future Metadataon RDES

Country Report helps to develop the Metadata of RDES which target for “Heavy Users”

Development of Metadata of RDESDevelopment of Metadata of RDES

Thank you !!Thank you !!

function and mechanism of new and present rdes rdes with countrystat - function and mechanism of new...

Documents

country database

new rdes

page of website

participating country

country profiles

country pagescountry

countrystat function

main data