Managing robots.txt¶
Every command should be ran as the pleroma user from it's home directory. For example if you are superuser, you would have to wrap the command in su pleroma -s $SHELL -lc "$COMMAND".
From source note about MIX_ENV
The mix command should be prefixed with the name of environment your Pleroma server is running in, usually it's MIX_ENV=prod
Generate a new robots.txt file and add it to the static directory¶
The robots.txt that ships by default is permissive. It allows well-behaved search engines to index all of your instance's URIs.
If you want to generate a restrictive robots.txt, you can run the following mix task. The generated robots.txt will be written in your instance static directory.
./bin/pleroma_ctl robots_txt disallow_all
mix pleroma.robots_txt disallow_all