TensorFlow Sessions and Graphs

TensorFlow is an open-source deep learning library that has gained tremendous popularity among developers and researchers for building and deploying machine learning models. One of the key concepts in TensorFlow is sessions and graphs, which play a crucial role in executing TensorFlow operations.

What are TensorFlow Sessions?

A TensorFlow session is responsible for running TensorFlow operations and evaluating tensors. It encapsulates the control and state of the TensorFlow runtime. When a session is created, a new computation graph is also created, which defines the operations and data flow. Sessions enable the actual computation to take place on devices like CPUs or GPUs.

Building the Computation Graph

In TensorFlow, computations are represented using a dataflow graph. A graph is a series of TensorFlow operations connected to one another. Each operation represents a mathematical function that manipulates the tensors flowing through it. A graph can have both constants and variables, with variables allowing the model to learn and adapt through training.

The computation graph is constructed using TensorFlow's Python API, where each operation is defined as a node. Nodes are connected to one another by tensors, which flow between them. These tensors carry the method call's inputs and outputs. The graph represents the entire model, including its structure and the mathematical operations it performs.

Running TensorFlow Operations

To execute TensorFlow operations, you need to create and run a session. A session allocates resources (such as GPU memory) and holds the actual values of variables. The session is in charge of the memory allocation and the execution of the graph operations.

Once the session is created, you can use the run() method to execute operations and evaluate tensors. You pass the desired nodes to evaluate as a list, and TensorFlow automatically determines the order in which operations need to be executed based on their dependencies.

Fetching Results from a Session

When running sessions, you can fetch the results of specific operations or tensors by passing them as arguments to the run() method. TensorFlow will evaluate the graph and return the requested values. For example, if you have a tensor representing the accuracy of a model, you can fetch and display its value during training or testing.

You can also use the feed mechanism to replace tensor values with specific inputs. This is commonly used for supplying training examples or data during model evaluation. By feeding data through placeholders in the graph, you can dynamically change the input data while reusing the same computation graph.

Dealing with Multiple Sessions

In TensorFlow, it is possible to run multiple sessions concurrently. However, each session maintains its own values for variables and other resources. It is essential to understand that sessions do not share any state with each other. Each session is independent and operates on its own graph.


TensorFlow sessions and graphs form the backbone of running computations and evaluating tensors within the TensorFlow framework. Sessions provide the environment in which TensorFlow operations are executed, while graphs define the structure and mathematical operations of the model. Understanding how to create and interact with sessions and graphs is crucial for effectively utilizing TensorFlow's capabilities in building and deploying machine learning models.

noob to master © copyleft