Btukfyl

What if we take a cylindrical vessel with inside surface completely reflecting and attach a piston such that it is also reflecting , what will happen to light if we compress it like this ?

Suppose there is an amount of light (electromagnetic radiation) inside the cylinder. Note that electromagnetic radiation is composed of particles called photons, and if we consider that there is a very large number of photons inside the cylinder, we may use statistical mechanics to create a model of a photon gas. Yes, the system you describe will act like a gas, and its properties may be derived from statistics and from the properties of photons.

Wikipedia has article on photon gases.

If a photon's frequency is $f$, its energy is $E_p = hf$, where $h$ is Planck's constant. It is also important to remember that photons have linear momentum $p = frac{E_p}{c} = frac{hf}{c}$

But the fact that photons have nonzero linear momentum implies that they will exert pressure against the cylinder's walls. Once the photon reflects on the wall, its momentum will have changed direction, and this imples that the wall has exerted a force on the photon to make it change directions. Therefore, the photon gas exerts pressure against the walls.

It can be shown that if the total energy of the photon gas is $U$, then the relationship between the pressure $P$ and the volume $V$ of the gas is $U = 3PV$.

If you push the piston, you'll do positive work and therefore give energy to the system. It can also be shown that if you push the piston very slowly (reversible process) while keeping the system isolated (adiabatic transformation), the relationship between pressure and volume will be:

$$PV^{4/3} = constant$$

In other words, yes, light can be compressed and will act just like any other gas inside of a cylinder. Once you push the piston, you will fell an increase in pressure (the pressure of the photon gas increases)!

This photon gas can be used to make simple model of stars, as is discussed in The Feynman Lectures on Physics, vol.1. The derivation of the other results presented before can also be found in this same book.

As pointed out in Yly's answer, the increase in energy as you push the piston will cause an increase in the frequency of the radiation, essentially causing a blueshift.

Ideally, this is essentially the same as compressing a quantum gas of any other boson. Macroscopically, there is a pressure exerted by the photon gas on the walls of the chamber, so compressing the piston will take work and thus will increase the internal energy of the photon gas. Microscopically, by compressing the chamber, we are making the wavelengths of the supported modes shorter, and thus the frequency and energy of the photons in the chamber will increase. So either way, the internal energy of the photon gas will go up.

The exact amount by which the internal energy increases depends on how the piston is compressed, e.g. adiabatically vs. diabatically.

In the specific case where the piston is compressed adiabatically, the occupation of each mode of the chamber remains unchanged. So the light in the chamber gets "blue-shifted", but the number of photons in a given mode does not change. Summarily, the light gets bluer (higher frequency).