Data and Information for UPSC ISS: Data Processing Explained

Data and Information for UPSC ISS is the shortest article in this series, and it earns its place on the strength of the section’s own name.

Quick answer. The section you are preparing is called Computer Application and Data Processing. This article covers the second half of that title: what data is, what information is, what happens in between, and how data is organised before a database ever enters the picture. It is worth one direct question in ten years, but the syllabus names it in plain words and everything in the next article rests on it.

Statistics Paper I, Section IV. Syllabus item: Data, Information, Database. Three nouns, listed in that order, which is exactly the order in which they should be learned.

Table of Contents

Why a short article still earns its place

Be clear about the return here. One question in ten papers. In pure marks, this is the lightest article in the series.

Three reasons to read it anyway, and they are honest reasons rather than padding.

It is a named syllabus item. The commission wrote “Data, Information, Database” into the syllabus deliberately, and a topic that has produced one question can produce two.

It is fifteen minutes long. The return per minute is perfectly reasonable even at one question.

Everything in the DBMS article assumes it. You cannot properly understand why a database management system exists without knowing what problems ordinary files caused, and that is what this article explains.

Data against information

	Data	Information
What it is	Raw, unorganised facts	Processed data that carries meaning
Useful on its own	No	Yes
Example	14, 09, 2003	A date of birth of 14 September 2003
Example	A list of 500 marks	The average mark and the pass rate
Depends on	Nothing	Context and the user’s need

Information is data that has been processed into something a person can act on. The same numbers can be data in one context and information in another, which is why the definition turns on processing rather than on the numbers themselves.

Data processing

Collecting data and converting it into information is called data processing. That is the definition, and it is the one question this topic has produced.

The cycle has three stages, and a fourth that makes it a cycle.

Stage	What happens
1. Input	Data is collected and entered into the system
2. Processing	Data is sorted, classified, calculated, summarised
3. Output	The result is presented as information
4. Storage	The result is kept, and often becomes input for the next cycle

Types of data processing

Type	How it works	Example
Batch processing	Data is collected over a period and processed together	Payroll at month end
Real time processing	Each transaction is processed immediately	An ATM withdrawal
Online processing	The user interacts directly with the system as data is entered	Railway reservation
Distributed processing	The work is spread across several connected machines	A banking network

Batch and real time are opposites, and both appear again in Operating Systems. A batch operating system runs grouped jobs with no user interaction. A real time operating system responds within a guaranteed time. The vocabulary is shared across the two topics, which is worth knowing because it halves the learning.

The data hierarchy

Data is organised in nested levels, each built from the one below it. This is the structure that makes files and databases possible.

Level	What it is	Example
Bit	A single binary digit, 0 or 1	1
Byte or character	8 bits, holding one character	The letter S
Field	A single item of data about something	A roll number
Record	All the fields about one entity	One candidate’s full entry
File	All the records of the same type	The full candidate list
Database	A collection of related files	The whole examination system

Read that table upward and it explains the whole topic. Bits make characters, characters make fields, fields make records, records make files, and related files make a database.

The connection to Computer Memory. The bottom two rows of this table are the same bits and bytes that the memory article measures in kilobytes and gigabytes. One article counts them, this one gives them meaning.

File organisation

Before databases existed, data lived in files, and how those files were arranged decided how quickly a record could be found.

Method	Records stored	To find one record	Best for
Sequential	One after another in order	Read from the start until you reach it	Reading everything in order, like payroll
Direct or random	At a position calculated from a key	Jump straight to it	Fast lookup of single records
Indexed sequential	In order, with an index kept separately	Look up the index, then jump	Both bulk reading and single lookups

Indexed sequential is the compromise, which is why it was the workhorse of commercial data processing for decades and why the idea survives inside modern databases as the index.

Why files were not enough

The whole reason the next article exists.

Problem with file based systems	What went wrong
Data redundancy	The same fact stored in several files
Data inconsistency	Update it in one file, forget the others, now the copies disagree
Data isolation	Data scattered in different formats, hard to combine
Difficult access	A new question needed a new program written
Poor integrity and security	Rules and permissions had to be coded into every program separately

A database management system exists to solve all five at once. That is the bridge into Database Management Systems for UPSC ISS.

Worked Example 1: Turning data into information

A school holds the marks of 500 students in one subject. Which of these are data and which are information?

Item	Verdict	Why
The list of 500 individual marks	Data	Raw, unorganised, nothing concluded
The average mark	Information	Processed, tells you something
The pass percentage	Information	Processed, supports a decision
A single student’s mark of 67	Data	Raw, until compared with something
The rank of that student in the class	Information	The 67 has been processed against the others

Nothing in the second column is new. Every piece of information came from the same 500 numbers. Processing added the meaning, not the data.

Worked Example 2: Reading the hierarchy in a real record

A UPSC ISS candidate record.

Level	In this example
Bit	One of the 8 binary digits storing the letter S
Character	S, in “Shyam”
Field	Name, or roll number, or date of birth, each on its own
Record	Every field about this one candidate, taken together
File	The records of all candidates who applied this year
Database	That file plus the marks file, the centres file and the results file

The field and record boundary is the one to be sure about. A field is one fact. A record is all the facts about one thing. Roll number is a field. The candidate is a record.

How This Gets Asked

The one question this topic has produced [2017]

Collecting the data and converting it into information is called

Data processing.

That is the whole question. One definition, 2.5 marks, and it carries the name of the syllabus section itself.

Notice what the examiner is doing. Before asking anything about databases, models or SQL, the paper checked whether candidates knew what the section was called and why. It has not repeated the question since, but the definition costs you one minute to learn.

Quick Revision Table

Point	Value
Data	Raw, unorganised facts
Information	Processed data that carries meaning
Collecting data and converting it to information	Data processing
Data processing cycle	Input, processing, output, storage
Batch processing	Collected over a period, processed together
Real time processing	Each transaction processed at once
Data hierarchy, smallest first	Bit, byte, field, record, file, database
A field is	One item of data
A record is	All the fields about one entity
A file is	All records of the same type
Sequential file	Read from the start until found
Direct file	Position calculated from a key
Indexed sequential	Ordered records with a separate index
Problems with file systems	Redundancy, inconsistency, isolation, difficult access, weak integrity

Practice Set

Ten questions. No answer key below.

Write your answers in the comments, all ten in a single comment, in the format 1-b 2-a 3-d and so on. The full answer key is posted in this same thread after seven days.

A year in brackets means the question is from that paper. The rest are written in the same pattern.

Collecting the data and converting it into information is called [2017]
Which one of the following correctly describes the data hierarchy from the smallest unit to the largest?
In the context of data organisation, a collection of related fields describing a single entity is called a
Consider the following statements: I. All information is data. II. All data is information. Which of the statements given above is or are correct?
Which one of the following file organisation methods requires records to be read from the beginning until the required record is found?
Which of the following are problems associated with traditional file based data storage? 1. Data redundancy 2. Data inconsistency 3. Data isolation 4. Reduced storage cost
In which type of data processing is each transaction processed immediately as it occurs?
Consider the following statements regarding indexed sequential file organisation: I. Records are stored in a sequential order. II. A separate index is maintained to locate records directly. Which of the statements given above is or are correct?
Which one of the following is the correct sequence of the data processing cycle?
A single item of data such as a roll number or a date of birth is known as a

Question 4 is the one to think about. It looks like a trick and it is not. Work out which direction of the relationship actually holds before you answer.

Frequently Asked Questions

What is the difference between data and information?

Data is raw, unorganised facts that mean nothing on their own. Information is data that has been processed into a form a person can understand and act on. The average of 500 marks is information, the 500 marks themselves are data.

What is data processing?

Collecting data and converting it into information. The cycle runs input, processing, output and storage, and the stored result often becomes the input for the next cycle.

What is the data hierarchy?

Bit, byte or character, field, record, file, database, in that order from smallest to largest. Each level is built from the level below it.

What is the difference between a field and a record?

A field is one item of data, such as a roll number. A record is all the fields describing one entity, such as everything stored about one candidate.

What is indexed sequential file organisation?

Records are stored in sequential order and a separate index is maintained so that any single record can also be reached directly. It combines the strengths of sequential and direct access.

Why were databases created?

Because file based systems caused redundancy, inconsistency, isolation, difficult access and weak integrity. A database management system addresses all of these at once.

How many questions come from this topic in UPSC ISS?

One in the last ten papers. It is the lightest topic in the section by weight, but it is a named syllabus item and it takes about fifteen minutes to learn properly.