Directory page when search engine is SEO priority or user experience first?

SEO and user experience can be said to each other, but sometimes they will inevitably have conflicts, and how to find a balance between them, this is the current stage seoer pursuit. Just contact SEO soon, experience is not much, but still want to put their own problems, write out to share with the discussion. Recently in the Golden Rice Financial Insurance Network (I am currently working in the company website) to do site optimization, encountered a problem, is about the Directory page optimization.

In general, the traditional catalog pages are "title + link" form, and some sites in order to better user experience, in addition to the title will be added to the content of the introduction, so that users can select the first time to choose their own gan interest of the article to read. For example: Insurance blog (a two-level domain name Sub channel under the Company's website), this channel is to allow users to have a better experience, in the directory page for each article attached a brief, the original thought that the user experience is done, search engines will also be included in the good, but a bit wrong. After a period of time found that the channel's few visitors, included is not much, and found almost all of the contents of the page, why? Later, by looking at the server log only to find that the number of spiders, but almost all climbed to the Directory page stopped, and occasionally will enter the article inside the page.

Then I went to study the contents of the major sites page to see how they set. The discovery of several major portal sites in the catalog pages is almost always the comparison of the traditional "title + link" form. And NetEase also has two types of catalogs, but they are included in the situation is not the same. The traditional "title + Link" Catalog page and its inner pages are all good, at least I look at the pages are included in the page, but with the introduction of the table of contents is not the same, itself is included, but it is linked to the page, almost no how to be included, at least I extracted dozens of different dates published articles are not included. Reasonably speaking netease such a big site, the article's click Rate should be not low ah, why is it included? And the same problem, I found in the webmaster Network, with a summary of the contents of the page above the article pages are almost not included.

So I took the idea and tried it, and transformed the catalogue page of the insurance case into another level two channel of the company's website. Make more traditional "title + link Form", the first day after the modification, included unchanged, view the server log, spider crawl number to a single digit, and only climbed the directory page to go. At that time did not know how to be good, thought to wait a few days to see. The next day, the third day .... Finally included up, although the current channel only about 100 articles, but the number of records reached about 90, and has been hovering in the range of 30-40. And compared to the insurance blog This channel although the number of articles reached more than 400, but included only about 100, and almost half of the directory page. It seems that the transformation of the channel without further ado.

Through this matter, my personal summary is: sometimes too much to pursue the user experience is not a good thing, if you can find a good balance point to combine site optimization and user experience is of course the best. As I said above the directory page problem, in the absence of a better binding point, may wish to adopt a traditional way, as the book directory does not have each section of the introduction, are still popular (of course, the premise is a good book).

Finally, tell me what you think of this thing. Webmaster tools through the spider simulation crawl, found with the introduction of the directory page incredibly there are more than 2000 words (of course, this to see the length of the introduction, as well as the number of articles set the title, our company's website is 10), than the general article still longer. From this I have such an idea, is not the spider mistakenly think with introduction of the table of Contents page is an article page, those headings as an anchor text link to see, no further to crawl it? I hope someone can answer the question of me as a novice. Thank you!