forums.rs

Forums

Forum Scraping Changes Thread is locked

Quick find code: 278-279-819-66190437

of 4
Happi Ending
Jul Member 2022

Happi Ending

Posts: 62,216 Emerald Posts by user Forum Profile RuneMetrics Profile
¸†¸

¸††¸

¸†
.....
†¸

˜•¸
....................
-««
**˜˜˜
...............
˜˜˜**
»»-
....................
¸•˜

˜•¸˜•¸
.......................................................................
¸•˜¸•˜

.
˜•¸
....................................................................................................................
¸•˜

.
††
††˜•¸˜•¸
...........
The B
UM
P
Ma
chine
...........
¸•˜¸•˜††
††
†
`*»
#
#
˜•¸˜•¸
...........
Pv
E Hit S
quad
.........
¸•˜¸•˜
#
#
«*`

`
..
`*»
#
#
†
˜•¸˜•¸
..................................
¸•˜¸•˜
†
#
#
«*`
..
`

`
`*»
•„•
»*'’˜
˜•¸˜•¸
......
M
.
A
.
X
......
¸•˜¸•˜
˜’*«
•„•
«*'`
`
.
.
.
.
*
'’˜
˜•
¸˜
•¸
.....................
¸•
˜¸
•˜
˜’
*

†
†
...................
†
†

†
.................
†
¸‚•‡
¥
‡•‚¸
‡
¥
‡
Join Clan-->PvE Hit Squad <--
‡
¥
‡
¸‚•‡
¥
‡•‚¸

03-Mar-2021 06:52:09

Mexk
Aug
fmod Member
2006

Mexk

Forum Moderator Posts: 19,605 Opal Posts by user Forum Profile RuneMetrics Profile
Hi there

In light of Jagex' continued insistence of employing various CAPTCHA services, some specifically designed to detect and stop automated requests, I consider it quite unlikely that your scraper can be whitelisted or otherwise approved.

This is not to say you cannot scrape the site; in fact it remains very easy to do so (further calling into question the current usage of CAPTCHA services...), provided you are a bit clever about how you approach it. One approach, for instance, is to proxy and rotate your traffic, while another is to employ frameworks like selenium, puppeteer, or similar and persist cookies.

That said, the ideal solution, obviously, would be for Jagex to expose a developer friendly API.

One can dream.
¸,.•
Mexk
•.,¸

Stand up for what is right, even if you stand alone
¨`'°«„¸¸„»°'
.............................
'°«„¸¸„»°'´¨

03-Mar-2021 19:28:22 - Last edited on 03-Mar-2021 19:30:24 by Mexk

Ms Toxicity
Jul
fmod Member
2004

Ms Toxicity

Forum Moderator Posts: 78,314 Emerald Posts by user Forum Profile RuneMetrics Profile
Gabrillezena, welcome to the forums. :)

If you wish to advertise that you are seeking to be recruited by a clan, please post a thread in the Recruitment - Looking for a Clan forum. There, clans will be able to read your request and send an invitation.

Because it appears that Mexk has answered the question asked about scraping data to the satisfaction of the OP, this thread is now closed.
•
Forum Help
•

25-Apr-2021 13:05:43

Quick find code: 278-279-819-66190437 Back to Top