Robots.txt Basic Syntax

-
Allowing all web crawlers access to all content

User-agent: *
Disallow:

Using this syntax in a robots.txt file tells web crawlers to crawl all pages on www.example.com, including the homepage.
       


Comments

Post a Comment

Popular posts from this blog

How to make Grid in React Native

-
Image
 App.js: import React from 'react' ; import { StyleSheet , Text , View } from 'react-native' ; const App = () => {     const users = [         {             id : 1 ,             name : "Kavita"         },         {             id : 2 ,             name : "Kavita"         },         {             id : 3 ,             name : "Kavita"         },         {             id : 4 ,             name : "Kavita"         },         {             id : 5 ,             name : "Kavita"   ...
Read more

Style in React Native | Style Type

-
Image
  App.js: -  import React , { useState } from 'react' ; import { Text , Button , View , StyleSheet } from 'react-native' ; import Exstyles from './exStyles' ; const App = () => {     return (         < View >             < Text style = { { fontSize : 30 , backgroundColor : 'green' } } > Style in             react native </ Text >             < Text style = { styles . textBox } > Style in             react native </ Text >             < Text style = { styles . textBox } > Style in             react native </ Text >                         < Text style = { Exstyles . textBox } > Style in             react native ...
Read more

React Native | Section List with example

-
Image
 App.js: import React from 'react' ; import { SectionList , Text , View } from 'react-native' ; const App =() => {     users =[         {             id : 1 ,             name : "Krishan" ,             data : [ "Angular" , "HTML" , "CSS" , "JavaScript" ]         },         {             id : 1 ,             name : "Krishan" ,             data : [ "HTML" , "Angular" ,   "CSS" , "JavaScript" ]         },         {             id : 1 ,             name : "Krishan" ,             data : [ "CSS" , "Angular" , "HTML" ,   "JavaScript" ]         }     ]     r...
Read more