Quickly find the template files that render each blocks in Magento

1. Turn on the template hints for front end.
In Magento Admin Panel
->System
->Configuration
->Developer
->Select a store in the current configuration scope dropdown (located on the top of the left menu)
->Expand Debug
->uncheck use websites for Template Path hints->Select Yes
->Save Config
->reload the any page on the front end
->See the surprise

2. Turn on the template hints for Magento admin panel.
Connect to the Magento database and run the query below to insert two rows in the core_config_data table.

INSERT INTO core_config_data (scope, scope_id, path, value)
VALUES ('default', 0, 'dev/debug/template_hints', 1),
('default', 0, 'dev/debug/template_hints_blocks', 1);

To turn it off, just set the value of these two rows to 0.