Content scraping
Goto page 1, 2, 3, 4  Next

Post new topic   Reply to topic    CPU-World.com forums Forum Index -> Off Topic
View previous topic :: View next topic  
Author Message
D.8080



Joined: 03 Apr 2006
Posts: 1474
Location: Italy

PostPosted: Sun Jan 28, 2024 5:40 am    Post subject: Content scraping Reply with quote

Hello everybody!

I get a message that a stop to the cpu spcs have been put in place to deter content scraping.

Is it that huge?

Thanks for any feedback on the issue. Must be bandwidth deadly.
Back to top
View user's profile Send private message  
D.8080



Joined: 03 Apr 2006
Posts: 1474
Location: Italy

PostPosted: Sun Jan 28, 2024 7:05 am    Post subject: Reply with quote

I just noticed that with on incognito mode I don't get the message.

Is there anything wrong I'm doing with my browser?

Edit: it does it at random in incognito mode...
Back to top
View user's profile Send private message  
admin
Site Admin


Joined: 31 Dec 1969
Posts: 121
Location: Fairfax, VA USA

PostPosted: Sun Jan 28, 2024 9:51 pm    Post subject: Re: Content scraping Reply with quote

D.8080 wrote:
Hello everybody!

I get a message that a stop to the cpu spcs have been put in place to deter content scraping.

Is it that huge?


It's not that huge, but it's very annoying. I configured web server to block only some requests, that look like scraper's requests. Blocking algorithm is not very accurate and it blocks some legitimate requests, therefore I turn it off when I'm near the computer.

Gennadiy
Back to top
View user's profile Send private message   Visit poster's website
D.8080



Joined: 03 Apr 2006
Posts: 1474
Location: Italy

PostPosted: Tue Jan 30, 2024 7:17 pm    Post subject: Re: Content scraping Reply with quote

admin wrote:
D.8080 wrote:
Hello everybody!

I get a message that a stop to the cpu spcs have been put in place to deter content scraping.

Is it that huge?


It's not that huge, but it's very annoying. I configured web server to block only some requests, that look like scraper's requests. Blocking algorithm is not very accurate and it blocks some legitimate requests, therefore I turn it off when I'm near the computer.

Gennadiy


Hello Gennadiy! It's nice to hear from you Smile

It's an old thing, coupled with the stolen data for ads... I thought I had something with my browser.

Again, thanks for keeping this alive and well!
Very Happy
Back to top
View user's profile Send private message  
admin
Site Admin


Joined: 31 Dec 1969
Posts: 121
Location: Fairfax, VA USA

PostPosted: Fri Feb 02, 2024 9:27 pm    Post subject: Reply with quote

I modified anti-scraping algorithm not to block logged-in forum users. If anybody still sees this message while being logged in please post here.

Gennadiy
Back to top
View user's profile Send private message   Visit poster's website
Mr.Scott



Joined: 15 Jul 2014
Posts: 267
Location: Upstate NY USA

PostPosted: Sat Feb 10, 2024 1:31 pm    Post subject: Reply with quote

Logged in and still getting the message.
All specs pages are blocked for me. Sad
Back to top
View user's profile Send private message   Visit poster's website
D.8080



Joined: 03 Apr 2006
Posts: 1474
Location: Italy

PostPosted: Sun Feb 11, 2024 6:15 pm    Post subject: Reply with quote

Mr.Scott wrote:
Logged in and still getting the message.
All specs pages are blocked for me. Sad


Do you say "energize" when clicking on the links? Cool

I don't have this issue anymore. Could it be due to antitrack and co. tech in browser?
Back to top
View user's profile Send private message  
CPUShack



Joined: 16 Jun 2003
Posts: 34259
Location: State of Jefferson, USA

PostPosted: Mon Feb 12, 2024 12:17 am    Post subject: Reply with quote

Mr.Scott wrote:
Logged in and still getting the message.
All specs pages are blocked for me. Sad


Or clear your cache?

_________________
New for 2025! The CPU Shack has a co-processor!

Visit The CPU Shack of microprocessor history and information.
Back to top
View user's profile Send private message   Visit poster's website AIM Address MSN Messenger
Mr.Scott



Joined: 15 Jul 2014
Posts: 267
Location: Upstate NY USA

PostPosted: Wed Feb 14, 2024 9:33 am    Post subject: Reply with quote

Cache cleared, still blocked.
Back to top
View user's profile Send private message   Visit poster's website
admin
Site Admin


Joined: 31 Dec 1969
Posts: 121
Location: Fairfax, VA USA

PostPosted: Wed Feb 14, 2024 9:21 pm    Post subject: Reply with quote

Please see if it works now. You may need to log out of the forum and log back in. Please post here if CPU pages are still blocked for you.

Gennadiy
Back to top
View user's profile Send private message   Visit poster's website
Mr.Scott



Joined: 15 Jul 2014
Posts: 267
Location: Upstate NY USA

PostPosted: Thu Feb 15, 2024 9:34 am    Post subject: Reply with quote

All fixed.
Thank you. Smile
Back to top
View user's profile Send private message   Visit poster's website
D.8080



Joined: 03 Apr 2006
Posts: 1474
Location: Italy

PostPosted: Fri Feb 16, 2024 8:30 am    Post subject: Reply with quote

admin wrote:
Please see if it works now. You may need to log out of the forum and log back in. Please post here if CPU pages are still blocked for you.

Gennadiy


I have this:

on homepage appears "LOG IN" on the top right corner.
But in Forum I am logged in.

I logged in on the home page.

Are there 2 different log in sections? One for the site and one for the forum?
Back to top
View user's profile Send private message  
debs3759



Joined: 18 Jan 2006
Posts: 9477
Location: Northampton, Divided Kingdom

PostPosted: Fri Feb 16, 2024 7:19 pm    Post subject: Reply with quote

I'm permanently logged in to the forums, and on the main site page I'm automatically logged in.
_________________
My graphics card database can be found at http://www.gpuzoo.com.

I can resist anything except temptation.

Debs
Back to top
View user's profile Send private message  
admin
Site Admin


Joined: 31 Dec 1969
Posts: 121
Location: Fairfax, VA USA

PostPosted: Sat Feb 17, 2024 9:16 pm    Post subject: Reply with quote

Quote:

I have this:

on homepage appears "LOG IN" on the top right corner.
But in Forum I am logged in.

I logged in on the home page.

Are there 2 different log in sections? One for the site and one for the forum?


Yes, there are two different login pages. They both use your forum username and password, but there are some differences in how they work:

Site's login page linked from the CPU-World home page:
- It logs you in to the site and hides all (most) ads. Small number of old pages may still show ads. Previously visited pages may also show ads if your browser cached these pages. When you encounter a page with ads you can press F5 or Control-F5 to get rid of them.
- It does not log you in to the forum.
- You stay logged in for about a week.

Forum login page:
- It logs you in to the forum.
- It logs you in to the site as well.
- If I'm not mistaken, you stay logged in in the forum for 1 year if you have Autologin feature enabled.
- You stay logged in for about a week on the site. However, every time you "autologin" in the forum, you will also get logged in to the site.

Gennadiy
Back to top
View user's profile Send private message   Visit poster's website
Wandering_Smoke



Joined: 18 Apr 2024
Posts: 1

PostPosted: Thu Apr 18, 2024 9:02 pm    Post subject: Reply with quote

I got blocked for content scraping after looking at 2 pages. First one loaded. Second one blocked. So I searched to find out WTH this content scraping thing was about, read this thread and then made an account. ...I'm logged in but I'm still blocked.
Back to top
View user's profile Send private message  
Display posts from previous:   
Post new topic   Reply to topic    CPU-World.com forums Forum Index -> Off Topic All times are GMT - 5 Hours
Goto page 1, 2, 3, 4  Next
Page 1 of 4
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum

Powered by phpBB © 2001 phpBB Group