Introduction to Data Science

What is Data Science?

Data Science as the name suggests is a field of science that deals with data. It combines the power of computers and mathematics for analyzing data, extracting important information from it and process this information for getting a useful output.

Learn about the providers of online masters in data science by clicking here

How can we use Data Science?

There are two ways in which we can use data science:

1. Finding a solution to a problem by analyzing the data.
2. Analyzing the data and come up with new ideas that can be implemented or come up with new problems that can be solved with it.

Classifications of Data Science

Data Science can be classified into the following:

1. Data Collection
2. Data Analysis
3. Data Visualization

We will take a brief look at each of these three…

Data Collection

In philosophy, we call the things that are known or are assumed as facts which makes the basics of reasoning and calculation as DATA. Collecting data has been one of the most common things that humans have been doing for ages.

Our ancestors used to collect data in rocks and stones for remembering the number of their cattle or to create memories about their life or the knowledge they have gained which they wanted to pass on to the next generation.

In the modern world, the basic purpose of collecting data is for using it to find solutions to existing problems.

We collect data mainly in these different forms like:

• Sound data 
• Visual data
• Text data

Types of data

The two main types of data are:

Structured data

Structured data is information that is organized. For example, a data set which contains names and roll numbers in two different column.

Unstructured data

These are a collection of information that is not processed. Examples are IoT sensor data, emails, chats, etc.

Data Analysis

Now that we have collected the data, for finding the solution to the problem that we have, we need to analyse the data.

The process of analyzing data using different tools like R, Python, MATLAB, etc. (We can use the libraries available in these programming languages for analyzing data by plotting graphs or charts) is called data analysis.                                     

For example, consider the problem of housing price prediction. Imagine we have a dataset containing the prices of houses over the past 10 years. We would like to predict the price of the house in the coming year using this data.

One way we could do this is by plotting a graph where on the x-axis we give the years and, on the y-axis, we give the price of houses. When we plot the data like that, we would be able to see a pattern in which the prices of the house are increasing or decreasing over time.

And now by using this trend we would be able to predict the possible increase in price for a house in the coming years.

Data Visualization

Data visualization is a tool that is used to explain the data using graphical representations of the data. It helps the data analyst to understand different patterns in data and outliers and trends in data.

Also, the data analyst can use the visualization techniques to present his findings to the customer in the form of graphs, charts and maps.

Some of the different libraries in python for data visualization are:

1. Plotly
2. Seaborn
3. Ggplot
4. Altair
5. Matplotlib
6. Bokeh
7. Folium

If we are not using a programming language for visualization, we can use below tools:

1. Google charts
2. Tableau
3. Xplenty
4. Hubspot
5. Whatagraph

Data visualization example

We shall see an example of data visualization of data about three machines A, B, C, D and E for the period 01-10-2020 to 07-10-2020, done in python programming language using Plotly library.

Subsets of Data Science

Artificial Intelligence

AI – Artificial Intelligence is the intelligence that enables machines to think like a human and find solutions to problems with little or no human intervention. There are mainly 3 types of AI:

Artificial Narrow Intelligence (ANI)

Narrow AI is the most common form of AI that machines have these days. ANI allows machines to be automated and do a particular task or a small set of tasks all on its own, with very little or no human intervention.

It doesn’t have emotions or feelings of consciousness. It cannot do a wide variety of tasks if it isn’t programmed for it.

Examples:

• Self-driving cars
• Auto – Pilot
• Spam Filters
• Chatbots

Artificial General Intelligence (AGI)

This type of AI can only be seen in sci-fi movies and can exhibit human-level intelligence. This type of AI would be hard to distinguish from normal humans and would be able to show emotional intelligence.

They can think like human beings and would be able to solve problems based on situations rather than just system needs. In other words, if there is a situation where a particular solution to a problem might be harmful to someone else, at this situation the machine might choose another solution.

Artificial Super Intelligence (ASI)

This type of AI will have an intelligence level that would be far superior to humans and would be able to think much faster than us. They would have greater problem-solving skills and updates themselves which would be more brilliant than the one before, all in just a matter of days.

They would have the ability to evolve quickly and become the better versions of themselves. This type of intelligence can even be a threat to our existence.

Machine Learning

Machine learning is the process of teaching a machine to accept inputs and do calculations based on algorithms build upon statistics and probability, to come up with an output, that is closer or equal to the expected output.

We can see the use of machine learning in our day to day life, for example, the recommendation system in YouTube or Instagram ads is all based on machine learning where the data of what the user clicks the most and likes the most is fed into a system and the system learns about the user’s interests and it suggests the contents that the user is most interested in.

Machine learning is classified mainly into 3 types of learning:

1.Supervised Learning

Let’s say we want our machine to classify images of apple from a set of other images. In supervised learning, we will initially provide the ML-model input images and labels according to the name of the fruit in the image.

An ML-Model is a set of algorithms that learn different features from input data and gives an output.

The model would compare the image and label and learn the features that map a particular image to a particular label.

And now when we give the model a new image it would be able to identify the same features that it had seen in the data, that we had used to train it and would map the image to the particular label.

Common supervised learning problems:

• Classification: Classification group’s the output to categories that are previously given to it as labels. For example 0,1, cat, mouse, apple, mango, etc.
• Regression: Regression is used to predict a continuous quantity. For example predicting live temperature in room. Stock market price prediction is also an example.

2.Unsupervised Learning

In unsupervised learning, the model is provided with input data without any labels. The model would categorize the data into different groups based on similar features. Unsupervised learning is mainly used for two types of problems:

• Clustering: Clustering identifies features that are similar between data and classifies according to these similarities. The model itself classifies input data according to similar features in data. For example, clustering peoples to different groups based on the spread of COVID-19 in their area.
• Association: For example, associating a particular product to a buyer based on another product he brought recently (mapping).

3.Reinforcement Learning

Its like teaching a baby what’s right and wrong. If he does right we will appreciate him, by giving him some chocolates, gifts, etc.. and we will give him a feedback if he does something wrong. So next time if he does something he would know that it is good or bad based on feedbacks or rewards he got before while doing the same.

So, reinforcement learning is a reward-based system in which an agent interacts with an environment by performing some actions and learn from rewards (either negative or positive) obtained from interpreter . There is no predefined data and no supervision. Follows a trial-and-error method for learning. It should identify an output by itself and we would just say if its right or wrong.

Examples:

Self driving cars where the environment is road and the interpreter (error signal generator) is a human in the driving seat. The human sends a signal based on the direction the car automatically takes or maybe the lane changes the car makes or maybe while parking if it follows the rules.

An automated machine that is used for categorizing products into different groups based on its weight. The person who monitors the task would generate an error signal which is negative if the machine classify the product wrongly and it would give positive response if the machine does it correctly

In addition to these, there is another type of learning called semi-supervised in which some data is labelled and others are unlabelled.

4.Deep Learning

Deep learning is a subset of machine learning where we use artificial neural networks for doing the supervised, unsupervised, and reinforcement learning tasks.

Artificial Neural Networks (ANNs) are inspired by the neurons in the human brain. In deep learning, we use multiple layers of neurons connected in which one layer of the neuron will learn a particular feature from the input and the output is passed through a function, which mostly uses some probabilistic equations to identify the useful features and pass it as an input to the next layer and so on, until it reaches the final layer where we get an output.

Benefits of using neural networks

Neural network can have lots of layer’s, each having number of neurons. So even if one neuron isn’t performing well the model would identify it and won’t affect the performance. Also the data (input data and the features identified from data) is stored in the neurons itself in form of numbers. So we don’t have to use a separate database for storing these data.

Also neural networks, can be manipulated to whichever way we want for different tasks. it can be used for solving multiple problems, basically like our brain can do lots of things by firing different sets of neurons.

The two main areas in which Deep Learning is used the most are:

Computer vision

Computer vision is a field of artificial intelligence that uses deep learning to learn about the visual world. We know that an image is a collection of pixel values. In the computer, we represent these values as numbers in the matrix.

These numbers are fed into the neural networks which would then learn the features of the image and would be able to either classify an image or to detect an object in the image.

A type of neural network called Convolutional Neural Networks (CNNs) is used commonly for this. Some of the most common applications of computer vision are:

• Defect detection in manufacturing
• Self-driving cars
• Intruder detection

Natural Language Processing

NLP is a field of artificial intelligence that uses the power of neural networks to understand human language in a useful way. NLP can be used to read, understand, and create natural language. Some of the applications of NLP are:

• Google Translate
• MS Word, Grammarly – for grammar check or spellcheck
• Siri, Alexa – Personal Voice Assistant

If you have decided to go ahead with data science, you can refer out next article on data science.

Thank you

If you know any subject that can be related to manufacturing industry or industrial engineering, you can earn some income by becoming article contributor of this website. For knowing more about it, please visit Join us page.

You don’t need to have any experience in article writing, just knowledge on the subject is needed.

Also you can know more about our team of article contributors by visiting the about us page.

About the Author

Deepak Jose is a B-Tech CS student with a passion for Data Science. Loves learning about Data Science, coding, and science in general. Does data analysis and visualization as a hobby. Even though I’m in the Computer Science path I always find time to learn about space, automobiles, geography, energy, architecture, arts, etc. Loves solving problems and learning about new inventions.

LATEST ARTICLES FROM KNOW INDUSTRIAL ENGINEERING

• Revisiting my Production Engineering subjects: SCT College, 2006–2010
  By Melvin Vincent In 2006, I joined Sree Chitra Thirunal College of Engineering, Trivandrum, to pursue B.Tech in Mechanical Engineering, Production Engineering stream, under the University of Kerala. I graduated in 2010. Advertisement Years later, I feel like opening those books again. Some lessons have stayed with me; others need a little refreshing. I am… Read more: Revisiting my Production Engineering subjects: SCT College, 2006–2010
• Elon Musk Says Money Won’t Matter in the Future. Is It Already Happening?
  Elon Musk has repeatedly discussed a future where AI and robotics could create such enormous productivity that many goods and services become extremely abundant. It sounds difficult to imagine. Advertisement But look at the past. We may already have experienced smaller versions of the same transformation. Things That Once Cost Money but Are Now Almost… Read more: Elon Musk Says Money Won’t Matter in the Future. Is It Already Happening?
• What leads to recent 4.3 Million EVs Recall – An analysis
  In August 2026, nine vehicle manufacturers announced recalls covering approximately 4.276 million electric vehicles in China. The recalls centred on a safety mechanism that was already present in the affected vehicles: the mechanical emergency door release. This was not simply a case of millions of defective door latches. The concern arose from what could happen… Read more: What leads to recent 4.3 Million EVs Recall – An analysis
• Understand how money works through This story of Adam and Ben
  Imagine Earth thousands of years ago. There is only one man. Let’s call him Adam. Advertisement Adam wakes up hungry. He catches a fish. He eats it. Later, he wants shelter. So he cuts some wood and builds a small hut. He wants water. He walks to the river and collects it. There is no… Read more: Understand how money works through This story of Adam and Ben
• Mukesh Ambani’s Three Success Rules Every Manufacturing Professional Should Follow
  Manufacturing professionals are trained to solve problems. A machine stops, we restore it. A line misses its target, we rebalance it. Rejection increases, we search for the root cause. Yet one important problem often remains unattended: Are we building only a successful process, or are we also building a successful career? Many capable engineers spend… Read more: Mukesh Ambani’s Three Success Rules Every Manufacturing Professional Should Follow
• Neuralink Blindsight: When the Brain Becomes the Display
  For most of human history, vision has followed one path: light enters the eyes, the eyes convert it into signals, and the brain interprets those signals. Neuralink’s Blindsight is exploring a radically different possibility: What if visual information could reach the brain without depending on the eyes? Advertisement That idea makes Blindsight much more than… Read more: Neuralink Blindsight: When the Brain Becomes the Display
• Factories are going to change anyway – Before that change yourself
  Walk into a factory today and you may see operators filling production sheets, supervisors updating Excel files, engineers conducting time studies with stopwatches, planners manually changing schedules, quality teams maintaining separate records, and managers waiting until the next morning to understand what actually happened on the shop floor. Much of this may still look normal.… Read more: Factories are going to change anyway – Before that change yourself
• Edge AI in Manufacturing: How Factories Make Intelligent Decisions Without Depending on the Cloud
  Edge AI brings artificial intelligence closer to factory machines, cameras, sensors and production processes. Explore how it works, where it can be used and what manufacturers should evaluate before implementation.
• What Is Culture Actually? A Simple Explanation With Real Workplace Examples
  Many people think culture means company values, motivational posters, annual day celebrations, team photos, or a statement written on the office wall. But culture is much deeper than that. Advertisement Culture is not what a company says. Culture is what people actually do every day. In simple words: Culture is the repeated behavior of people… Read more: What Is Culture Actually? A Simple Explanation With Real Workplace Examples
• Self Respect – You May Be Forgotten, But Do Not Forget Yourself
  There is a powerful meaning behind the line: “You will be forgotten either way. So live in such a manner that, while you remain, you belong to yourself.” Advertisement At first, it may sound negative. But actually, it is a very practical reminder for life and career. Do Not Live Only for Recognition Most people… Read more: Self Respect – You May Be Forgotten, But Do Not Forget Yourself
• Intralogistics
  In manufacturing, people often talk about production, quality, maintenance, automation and supply chain. But there is one area that quietly decides the speed of the entire factory: intralogistics. A factory may have good machines, skilled operators and proper planning. Still, if materials are not available at the right place, in the right quantity and at… Read more: Intralogistics
• 3PL Ecommerce in Manufacturing
  Manufacturing is no longer only about producing goods and sending them to distributors. Today, many manufacturers are also selling directly to customers, dealers, retailers, and online buyers through ecommerce platforms. This shift has created a new challenge: how can a manufacturer manage storage, order picking, packing, shipping, and returns without disturbing core production activities? This… Read more: 3PL Ecommerce in Manufacturing
• Manufacturing Resource Planning
  Manufacturing Resource Planning is one of the most important activities in any factory. A factory may have machines, manpower, materials, tools, space and orders, but if these resources are not planned properly, production will still suffer. Many factories face the same problems every day. Advertisement Material is not available when production needs it.Machines are overloaded… Read more: Manufacturing Resource Planning
• AI and Lean six sigma
  This article is written by Shivani Kadam. She is experienced in Project Management. Walk into any manufacturing plant today and you will find two parallel conversations happening, related to AI and Lean six sigma. Advertisement The first is familiar. Teams are discussing scrap reduction, line balancing, cycle time improvements, OEE losses, and corrective actions. Whiteboards… Read more: AI and Lean six sigma
• Manufacturing Execution System: Meaning, Benefits, and Why Factories Need It
  In manufacturing, every minute matters. A machine waiting for material, an operator waiting for instruction, a supervisor searching for production status, or a planner working with outdated data can silently reduce factory performance. Many factories invest in machines, manpower, and materials, but still struggle because the information flow inside the factory is not clear. Advertisement… Read more: Manufacturing Execution System: Meaning, Benefits, and Why Factories Need It
• When Roles Are Clear, a Factory Feels Like Heaven to Work In
  A factory is not just a building filled with machines, materials, tools, and people. It is a living system. Advertisement Every person, every department, every process, and every decision is connected. When one part is unclear, the whole system starts feeling heavy. But when roles and responsibilities are clearly defined, something beautiful happens. Work becomes… Read more: When Roles Are Clear, a Factory Feels Like Heaven to Work In
• How to Calculate the Number of Observations Required for Time Study
  Time study is one of the most important activities in industrial engineering. It is the foundation for manpower calculation, capacity planning, line balancing, costing, incentive calculation, and productivity improvement. But in many factories, time study is misunderstood. Advertisement Some people take 3 readings and decide the cycle time.Some people take 5 readings and calculate manpower.Some… Read more: How to Calculate the Number of Observations Required for Time Study
• Manpower Calculation Software for Manufacturing
  Manpower Calculation Software for Manufacturing: Why Factories Need a Smarter Way to Plan People In manufacturing, manpower is not just a number. It directly affects production output, delivery performance, overtime cost, machine utilization, line efficiency, and customer satisfaction. Advertisement Many factories still calculate manpower requirements manually using Excel sheets, assumptions, old standard times, or last… Read more: Manpower Calculation Software for Manufacturing
• Manpower Planning Sample
  Manpower planning is one of the most important activities in manufacturing. If manpower is planned wrongly, the factory may face production delays, excess labour cost, poor line balance, overtime, or underutilization of people. Many companies still plan manpower based on experience or rough assumptions. But for better productivity, manpower should be planned using proper data… Read more: Manpower Planning Sample
• Factory Productivity Improvement Tools: The Smarter Way to Improve Manufacturing Performance
  In modern manufacturing, productivity is no longer improved by effort alone. It improves when factories use the right systems, tools, and data to make faster and better decisions. This is why factory productivity improvement tools are becoming essential for manufacturers that want to reduce inefficiencies, improve output, and stay competitive. Looking for factory productivity improvement… Read more: Factory Productivity Improvement Tools: The Smarter Way to Improve Manufacturing Performance
• Industrial Engineering Is Entering Its Golden Hour – Here’s What’s Really Changing
  This article is written by Shivani Kadam. She is experienced in Project Management. For years, Industrial Engineering was seen as the field that kept factories running smoothly, cuts waste and made workflows cleaner. Important work, yes but honestly, it often stayed behind the scenes. In this article lets discuss how Industrial Engineering is entering its… Read more: Industrial Engineering Is Entering Its Golden Hour – Here’s What’s Really Changing
• How AI is quietly reshaping Industrial Engineering
  This article is written by Shreya Desai. She is experienced in Process improvement. Let’s discuss about Artificial Intelligence and Industrial Engineering. Advertisement Over the past few years, I’ve noticed something interesting on the shopfloors….It’s not loud.It’s not flashy.It’s not even obvious at first glance. But you can feel it. AI is slipping into industrial engineering,… Read more: How AI is quietly reshaping Industrial Engineering
• Career transition from automotive to solar module manufacturing
  This article is written by Ashish Gaurav Chaturvedi. Ashish is Operations & Production professional. Here we will be discussing Career transition from automotive to solar module manufacturing. I started my professional journey in the automotive industry. My role involved working on production lines, quality control, design for manufacturing, and taking part in continuous improvement efforts.… Read more: Career transition from automotive to solar module manufacturing
• Adaptive Project Management in an Uncertain Economy
  This article is written by Shivani Kadam. She is experienced in Project Management. Adaptive project management is, moving towards the right or desired outcome, even if the path turned into something completely different from the original plan. Advertisement I once ran a project that looked flawless from the outside, the kind you’d happily showcase in… Read more: Adaptive Project Management in an Uncertain Economy
• How Value Stream Mapping Uncovered a Hidden Defect on the Line
  This article is written by Shreya Desai. She is experienced in Process improvement. In a manufacturing plant, not all problems make noise. Some hide in plain sight. Idle operators, partially filled racks, or a batch of components waiting for someone to notice them. These quiet signs are symptoms of process inefficiencies that cost time, money,… Read more: How Value Stream Mapping Uncovered a Hidden Defect on the Line
• Machine Hour Rate (MHR)
  The Machine Hour Rate refers to the total expense associated with operating a particular machine for one hour. It includes both fixed and variable costs associated with operating the machine. By calculating this rate, factories can accurately determine how much it costs to produce a part or complete a job, especially when machine time is… Read more: Machine Hour Rate (MHR)
• Predetermined Motion Time System (PMTS)
  This article is contributed by Umang Kumar Singh. Predetermined motion time system (PMTS) is a method of arriving Standard time of a work, that comprises predetermined time values corresponding to each and every work element. Advertisement When we talk about Industrial engineering, work measurement plays a crucial role for measuring productivity and reducing operational costs.… Read more: Predetermined Motion Time System (PMTS)
• Karakuri in Manufacturing
  This article is written by Shreya Desai. She is experienced in Process improvement. Karakuri in manufacturing refers to smart, mechanical solutions that harness basic physical principles like gravity, levers, springs, pulleys, and counterweights to support operators and streamline tasks—without relying on electricity, motors, or automated systems. Advertisement What’s the coolest automation you’ve seen? Maybe a… Read more: Karakuri in Manufacturing
• Role of Industrial Engineer in unionized manufacturing
  This article is written by Umang Kumar Singh. The role of an Industrial Engineer in a unionized manufacturing environment is unavoidable, as it clear misunderstandings among workers, align both workers and management with company goals, and strengthens the relationship between them. Advertisement Everyone knows Industrial engineering as Resource Allocation Optimizer, Waste Reducer and Process Efficiency… Read more: Role of Industrial Engineer in unionized manufacturing
• Digital twins in manufacturing
  This article is written by Shreya Desai. She is experienced in Process improvement. What If Your Assembly Line Had a Mind of Its Own? A system on your shop floor that not only sees—but senses. One that learns your bottlenecks before your planners do. That catches torque drift before QA flags it. That knows what’s… Read more: Digital twins in manufacturing