D
D
dark_sage2016-06-06 10:05:22
Joomla
dark_sage, 2016-06-06 10:05:22

Netpeak sees only the main page, nofollow tags, noindex tags, robots.txt is empty, what could be the problem?

Site on joomla, any scanning services show only the main page. Netpeak only crawls the main page with a 200 OK response.
htaccess:
##
# @package Joomla
# @copyright Copyright (C) 2005 - 2015 Open Source Matters. All rights reserved.
# @license GNU General Public License version 2 or later; see LICENSE.txt
##
##
# READ THIS COMPLETELY IF YOU CHOOSE TO USE THIS FILE!
#
# The line just below this section: 'Options +FollowSymLinks' may cause problems
# with some server configurations. It is required for use of mod_rewrite, but may already
# be set by your server administrator in a way that disallows changing it in
# your .htaccess file. If using it causes your server to error out, comment it out (add # to
# beginning of line), reload your site in your browser and test your sef url's. If they work,
# it has been set by your server administrator and you do not need it set here.
##
## No directory listings
IndexIgnore *
## Can be commented out if causes errors, see notes above.
Options +FollowSymlinks
Options -Indexes
## Mod_rewrite in use.
RewriteEngine On
## Begin - Rewrite rules to block out some common exploits.
# If you experience problems on your site block out the operations listed below
# This attempts to block the most common type of exploit `attempts` to Joomla!
#
# Block out any script trying to base64_encode data within the URL.
RewriteCond %{QUERY_STRING} base64_encode[^(]*\([^)]*\) [OR]
# Block out any script that includes a

Answer the question

In order to leave comments, you need to log in

1 answer(s)
V
Viktor Taran, 2016-06-06
@shambler81

So, can you give me a website?

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question