Yog browser qhib tau ib nplooj WordPress tiam sis Yandex tsis pom nplooj ntawd, tsis txhob maj hloov tag nrho robots.txt lossis tshem tag nrho cov lus qhia SEO. Xaiv ib qho URL qhib rau pej xeem tiag thiab kuaj plaub txheej raws kab: robots.txt, HTML code, HTTP header thiab WordPress lossis SEO plugin settings.
Tom qab kawm zaj no, koj yuav muaj ib daim ntawv kuaj rau qhov URL piv txwv, paub tias txheej twg tab tom txwv bot lossis thov kom tsis txhob txheeb npe, thiab muaj txoj kev kho thiab kuaj dua uas tseem khaws tau txoj kev thim rov qab. SaibABC.Com tsuas yog lub ntsiab lus ua piv txwv xwb; zaj no tsis lees tias lub website no twb txuas, txheeb xyuas tiav lossis muaj xwm txheej tiag tiag hauv Yandex.
Kev txwv: kev tshem tawm cov lus qhia thaiv tsis lav tias URL yuav raug txheeb npe lossis tshwm tam sim hauv cov txiaj ntsig tshawb. Zaj no tsuas pab txheeb xyuas thiab daws cov txheej txheem technical directives hauv ib qho URL xwb.
Txheeb qhov sib txawv ntawm raug txwv tsis pub sau ntaub ntawv thiab raug thov kom tsis txhob txheeb npe
| Txheej tswj | Yam qhia | Qhov cuam tshuam tseem ceeb |
|---|---|---|
| robots.txt | Disallow | Qhia kom bot tsis txhob sau ntaub ntawv ntawm ib txoj kev txuas lossis ib cheeb tsam. |
| HTML | <meta name="robots" content="noindex"> | Thov kom search engine tsis txhob muab nplooj ntawv tso rau hauv index. |
| HTTP header | X-Robots-Tag: noindex | Teeb indexing directive hauv server response, suav nrog cov ntaub ntawv uas tsis yog HTML. |
| WordPress lossis SEO plugin | Setting kom tsis txhob txheeb npe lossis tsis pub search engine txheeb npe | Tej zaum yuav tsim meta robots lossis hloov robots.txt. |
robots.txt tsis yog ib txoj kev tiv thaiv cov ntaub ntawv ntiag tug. Cov ntsiab lus uas yuav tsum txwv kom neeg saib tau yuav tsum siv kev nkag mus rau hauv tus account, kev faib cai lossis lwm txoj kev tswj kev nkag mus uas tsim nyog; tsis txhob vam khom bot directives ib leeg. Yandex kuj ceeb toom tias nplooj ntawv raug thaiv hauv robots.txt tseem yuav raug paub txog lossis tshwm hauv qee kis (raws li yandex.com).
Npaj URL thiab daim ntawv teev tseg kev kuaj
Qhov chaw ua haujlwm: browser thiab website admin panel. Koj yuav tsum muaj ib tsab xov xwm lossis nplooj ntawv qhib rau pej xeem tiag, xws li [URL bài viết công khai]. Tsis txhob hloov lub cim no ua SaibABC.Com URL yog tseem tsis tau kuaj qhov chaw nyob raug cai.
- Qhib URL hauv private window thiab tsis txhob nkag mus ua tus thawj tswj hwm.
- Sau qhov chaw nyob kawg tom qab redirect, suav nrog
http/httpsthiab seb puas muaj lossis tsis muajwww. - Sau hnub kuaj, cov cuab yeej siv thiab cov pov thawj tau txais.
- Yog npaj yuav kho, luam tseg tus nqi lossis configuration qub ua ntej hloov.
URL kiểm tra: [URL bài viết công khai]
Ngày kiểm tra: [YYYY-MM-DD]
robots.txt: [Cho phép / Bị chặn / Chưa xác định]
meta robots: [Không có noindex / Có noindex / Chưa xác định]
X-Robots-Tag: [Không có noindex / Có noindex / Chưa xác định]
WordPress/plugin: [Đã kiểm tra / Chưa kiểm tra]
Kết luận và hành động tiếp theo: [...]Kuaj robots.txt
Qhib kom raug lub website cov ntaub ntawv
Qhov chaw ua haujlwm: browser address bar. Hloov tus qauv domain ua tus official version uas twb kuaj lawm:
https://ten-mien-cua-ban.example/robots.txtCov ntaub ntawv no feem ntau nyob hauv root directory. Yog URL redirect, thov kom nkag mus, xa error rov qab lossis qhia cov ntsiab lus txawv ntawm configuration uas koj paub, sau tseg qhov xwm txheej tam sim no es tsis txhob kho kiag li.
Nrhiav cov pawg xws li:
User-agent: *
Disallow: /Disallow: / hauv pawg uas siv rau txhua bot yog ib yam qhia tias website tab tom txwv tsis pub sau ntaub ntawv ntawm txhua txoj kev txuas. Txawm li cas los, kuaj kom raug pawg User-agent, txoj kev txuas thiab qhov chaw uas tsim cov ntaub ntawv ua ntej txiav txim. Plugin, CDN lossis server tej zaum yuav tsim robots.txt dynamically.
Siv Yandex Robots.txt analysis
Qhov yuav tsum muaj: website yuav tsum twb ntxiv thiab txheeb xyuas tiav hauv Yandex Webmaster. Qhov chaw ua haujlwm: Yandex Webmaster, hauv thaj chaw uas muaj npe zoo ib yam li Tools → Robots.txt analysis; lub npe ntawm ntu yuav txawv raws hom lus lossis version.
- Xaiv lub website kom raug, kom phim protocol thiab prefix
www. - Nyeem cov ntsiab lus robots.txt uas lub cuab yeej tau txais.
- Ntaus tus URL piv txwv rau hauv lub npov kuaj URL.
- Sau tseg qhov txiaj ntsig ntawm tus URL ntawd raws nraim li tau qhia.
Qhov txiaj ntsig “tsis tso cai” yog pov thawj tias tus URL phim ib qho lus qhia txwv hauv cov ntaub ntawv uas lub cuab yeej tab tom txheeb xyuas. Khaws ib daim duab tshuaj ntsuam ntawm lub vijtsam tiag yog tias koj muaj cai siv; tsis txhob siv daim duab AI cuav los ua pov thawj. Tsis txhob hloov tag nrho robots.txt nrog ib qho qauv hauv Is Taws Nem, vim qhov ntawd yuav rho tawm kab Sitemap lossis rov qhib ib cheeb tsam uas tau txhob txwm cais tawm ntawm kev khaws ntaub ntawv (raws li yandex.com).
Kuaj noindex hauv HTML
Qhov chaw ua: hauv browser uas tsis tau kos npe nkag.
- Qhib tus URL piv txwv hauv lub qhov rais ntiag tug.
- Nias txoj nyem, xaiv Saib qhov chaws ntawm nplooj ntawv lossis View page source.
- Nrhiav
noindex,nofollowthiabrobots. - Kuaj lub cim hauv ntu
<head>.
<meta name="robots" content="noindex">
<meta name="robots" content="noindex, nofollow">
<meta name="yandex" content="noindex">nofollow tsis txhais tias yog noindex. Sau tseg tus nqi uas pom tiag. Yog lub cim tsuas tshwm thaum nkag mus rau hauv tus thawj tswj hwm, tab sis tsis muaj nyob hauv qhov chaws pej xeem, qhov ntawd tseem tsis yog pov thawj tias cov bot sab nraud tau txais lub lus qhia ntawd.
Kuaj X-Robots-Tag hauv HTTP header
Qhov chaw ua: hauv browser DevTools. Qhib tus URL pej xeem, nias F12 lossis Inspect, xaiv Network, rov thauj nplooj ntawv, xaiv qhov kev thov rau daim ntawv tseem ceeb uas muaj hom Document, ces qhib Headers.
Nrhiav X-Robots-Tag. Yog pom noindex lossis none, sau tseg tag nrho tus nqi thiab tus URL ntawm cov lus teb. Tsis txhob xaiv yuam kev rau qhov kev thov CSS, JavaScript lossis duab. Rau PDF thiab cov ntaub ntawv uas tsis muaj ntu <head>, HTTP header yuav yog qhov chaw tso lus qhia txog kev sau npe rau hauv index.
Yog koj tsis paub meej txog kev kuaj header, thov tus thawj tswj hosting, CDN lossis server pab. Tsis txhob kho theme los daws ib qho lus qhia uas tau ntxiv rau ntawm server txheej.
Kuaj WordPress thiab SEO plugin
Kev teeb tsa thoob plaws lub website
Qhov chaw ua: WordPress → Settings → Reading. Nrhiav qhov kev xaiv uas muaj lub ntsiab lus sib npaug li Discourage search engines from indexing this site. Yog qhov kev xaiv qhib rau ntawm lub website pej xeem, sau tseg ua ntej kho. WordPress yuav tsim noindex,nofollow thaum qhov kev xaiv no qhib; lees paub los ntawm qhov chaws HTML pej xeem, tsis yog saib lub npov teeb tsa xwb (raws li WordPress.org).
Tsis txhob xaus lus tias txhua tus URL qhib tsuas yog vim lub npov no raug kaw lawm. Theme, SEO plugin, staging plugin, CDN lossis cov chaws kho tus kheej yuav tso ib qho lus qhia cais.
Kev teeb tsa rau tus ncej lossis nplooj ntawv
Qhov chaw ua: ntawm nplooj hloov kho tus URL piv txwv thiab hauv ntu ntawm SEO plugin uas tab tom siv. Nrhiav cov khoom uas muaj lub ntsiab lus xws li “tso cai rau kev sau npe rau hauv index”, “qhia hauv cov txiaj ntsig tshawb nrhiav”, “Robots meta” lossis “Advanced robots”. Lub npe ntawm cov ntawv qhia zaub mov yuav txawv raws plugin thiab version.
Hloov pauv tsuas yog thaum koj tau txheeb xyuas tus URL raug thiab nkag siab tus nqi qub. Tom qab khaws tseg, rov kho lossis tshem cache raws li tus txheej txheem ntawm lub website, ces rov kuaj qhov chaws pej xeem thiab HTTP header. Yog plugin muaj qhov saib ua ntej, qhov ntawd tsuas yog lus qhia; HTML thiab header tiag tiag xwb yog qhov txiaj ntsig uas yuav tsum tau lees paub.
Yog xav rov nyeem seb Yandex qhia cov lus ceeb toom li cas thiab xaiv thaj chaw kuaj nyob qhov twg, saib ntu hais txog kev nyeem Yandex Webmaster dashboard hauv series no.
Tshawb nrhiav teeb meem ua ntej kho
| Yam qhia | Qhov chaw yuav tsum kuaj | Kev ua yam nyab xeeb |
|---|---|---|
| Robots.txt txwv URL | Disallow uas phim txoj kev URL lossis pawg bot. | Khaws daim file tam sim no, txheeb xyuas qhov chaw uas tsim daim file, mam li kho kab kom raug. |
HTML muaj noindex | WordPress, SEO plugin, theme lossis code uas tau kho ntxiv. | Kuaj cov teeb tsa thoob plaws lub website thiab URL ntawd ib leeg. |
Header muaj X-Robots-Tag: noindex | Server, CDN, security layer lossis kev teeb tsa rau hom file ntawd. | Xa rau tus neeg tswj hwm kuaj kom raug layer. |
| Tsis pom muaj lus qhia txwv | URL tsis yog, muaj kev redirect, HTTP yuam kev, cache lossis Yandex cov ntaub ntawv tseem tsis tau hloov tshiab. | Kuaj URL kawg, server qhov kev teb thiab qhov xwm txheej hauv Webmaster. |
| Website tseem nyob hauv ib puag ncig sim | Muaj staging lossis qhov kev xaiv tsis pub index tseem tshuav. | Sib piv ib puag ncig kom meej ua ntej qhib cov lus qhia. |
Qhov browser qhib tau nplooj ntawv tsis yog pov thawj tias bot yuav tau txais tib qho kev teb: CAPTCHA, kev nkag mus rau hauv tus account, IP txwv, server yuam kev lossis redirect txawv yuav ua rau tau qhov txiaj ntsig txawv.
Kho, txheeb xyuas thiab thim rov qab
- Sau tseg qhov xwm txheej tam sim no: khaws robots.txt, meta robots, header, URL, lub sijhawm thiab tus neeg ua.
- Kho ntawm qhov chaw tsim nyog: WordPress Reading, SEO plugin, file uas tsim robots.txt lossis server configuration uas cuam tshuam.
- Hloov ib layer xwb ib zaug: yog koj kho ntau qhov chaw tib lub sijhawm, koj yuav tsis paub tias qhov twg tau hloov qhov txiaj ntsig.
- Refresh cache raws li tus txheej txheem: tsis txhob rho security plugin lossis CDN ntau yam tsuas yog vim ib zaug kuaj tsis tiav.
- Kuaj los ntawm sab nraud: qhib robots.txt dua, khiav URL dua hauv Robots.txt analysis, saib cov HTML source uas tsis yog tus tswj hwm tus kheej thiab kuaj cov header ntawm daim ntawv tseem ceeb.
- Sau tseg qhov xwm txheej: sau “kho lawm tab sis Yandex tseem tsis tau rov ntsuam xyuas” yog nyuam qhuav tshem cov lus qhia xwb. Tsis txhob sau “tau index lawm” tsuas yog vim twb tshem qhov txwv.
Txoj kev thim rov qab: rov qab muab tus nqi qub ntawm robots meta, file lossis qhov kev xaiv uas tau khaws tseg. Tsis txhob rho DNS records, security plugin lossis server configuration ntau yam los daws ib qho lus ceeb toom uas tseem tsis tau txheeb xyuas.
Yog ntsib teeb meem nkag mus, redirect lossis qhov kev teb sib txawv ntawm browser thiab bot, saib txheej txheem nrhiav qhov chaw teeb meem thaum txheeb xyuas Yandex es tsis txhob tua tag nrho cov kev ruaj ntseg.
Kev xyaum kuaj ib qho URL uas sawv daws nkag tau
Xaiv ib tsab xov xwm tiag ntawm lub website uas koj tswj hwm. Yog tseem tsis muaj URL uas tau txheeb xyuas lawm, cia [URL bài viết công khai] nyob hauv daim ntawv teev tseg thiab nres ntawm theem npaj.
- Sau URL kawg tom qab qhib hauv lub qhov rai private.
- Qhib robots.txt thiab khiav URL hauv Robots.txt analysis yog lub website twb npaj txhij hauv Yandex Webmaster lawm.
- Nrhiav
noindexthiabnonehauv HTML source. - Kuaj
X-Robots-Tagntawm qhov kev teb HTML tseem ceeb. - Qhib Settings → Reading thiab kuaj robots meta ntawm SEO plugin uas tab tom siv.
- Sau tseg txhua layer sib cais: “tso cai”, “raug txwv”, “muaj noindex”, “tsis muaj pov thawj” lossis “tseem tsis tau kuaj”.
Qhov kev xyaum no suav tias ua tiav thaum koj teb tau tias: bot puas raug tso cai sau URL, HTML puas muaj noindex, header puas muaj lus qhia txwv thiab qhov kev teeb tsa twg tau tsim qhov txiaj ntsig ntawd. Yog tsis muaj pov thawj txaus, sau “tseem tsis tau txheeb xyuas” es tsis txhob kwv yees.
Tej kev nkag siab yuam kev uas yuav tsum zam
- Nplooj ntawv qhib tau rau kuv ces bot yeej nkag tau thiab: tsis tas li ntawd, vim bot yuav tau txais yuam kev, CAPTCHA, lus thov kom nkag mus rau hauv tus account lossis redirect txawv.
- robots.txt thiab noindex yog tib yam: tsis yog; ib qho cuam tshuam txog kev sau cov ntaub ntawv, hos lwm qhov feem ntau cuam tshuam txog kev muab nplooj ntawv tso rau hauv index.
- Tshem noindex ces nplooj ntawv yuav tshwm sim tam sim: tsis muaj kev lav paub li ntawd; Yandex tseem yuav tsum nkag mus, ua tiav thiab ntsuam xyuas URL.
- Daim ntawv tshaj tawm khoob txhais tias raug txwv: tej zaum tsuas yog tsis tau muaj ntaub ntawv, xaiv lub website tsis raug, URL tsis raug lossis lub lim tsis haum.
- robots.txt tiv thaiv ntaub ntawv ntiag tug: tsis muaj kev nyab xeeb; ntaub ntawv ntiag tug yuav tsum muaj kev tswj hwm kev nkag mus.
Yog robots.txt tsis thaiv tab sis URL tseem muaj teeb meem, tshuaj xyuas server response thiab URL status hauv Yandex lub cuab yeej uas tsim nyog, tsis yog tsuas rov kho cov ntaub ntawv ntawd dua xwb (raws li yandex.com).
Kauj ruam tom ntej
Qhov txiaj ntsig ntawm qhov kev kawm no yog ib daim ntawv tshuaj xyuas rau ib qho URL xwb, tsis yog pov thawj tias URL ntawd twb raug index lawm. Khaws URL, hnub tshuaj xyuas, xwm txheej ntawm txhua txheej, cov pov thawj thiab cov kev teeb tsa qub cia. Kauj ruam tom ntej yog siv daim ntawv no los nyeem qhov xwm txheej tshwj xeeb ntawm URL hauv Yandex Webmaster:
Yuav tshuaj xyuas li cas seb Yandex twb index koj tsab xov xwm lawm los tsis tauCov ntaub ntawv siv
- Using robots.txt — Yandex Webmaster.
- Robots.txt analysis — Yandex Webmaster.
- How do I prohibit indexing of a site or pages? — Yandex Webmaster.
- How do I check if a site is accessible to users and indexing robots? — Yandex Webmaster.
- Settings Reading screen — WordPress.org Documentation.
- wp_robots_noindex() — WordPress Developer Resources.
