PK Bots - Self learning

[neilg 8]

Hello,

Years ago i created bots. The bots were built on a server from around 2011.
Because i decided to work on a base from all those years ago, i was faced with horrific code, dupes and all kinds of problems. Not only was the server not stable at all, but my bot code wasn't particularly optimized either.
100% cpu usage after 30 minutes of run-time and the server would simply lag itself to death if i dared to run 200 bots. I worked on the base for a few months and then scrapped all my bot code and started again.

This is my second generation of rsps bots.
They're a lot smarter, way more optimized and have much more believable behaviors. If you're not sitting there studying them, it would be incredibly difficult to tell they're bots at times.

Features:

[*]PvP
[*]PvM and bossing
[*]Skilling around the gameworld
[*]Afking
[*]Duelarena Staking
[*]Clanwars/ safepking/ joining in minigames/ Tournaments
[*]Looting players they kill
[*]Ability to make friends and enemies
[*]All combat styles supported
[*]PvM bots in the wilderness will attempt to run away while underattack or fight back if it has no choice
[*]Bots will break the rules and will lure/scam players
[*]Conversations / small talk
 

More information:

When bots are first spawned, they will instantly set their stats to maxed, or randomized. Maxed accounts will begin preperations to start pking while other bots will train until they're able to pk.
Bots will "access" banks and shops before spawning items as to appear like they're not spawning them from thin air. Once a bot has used a bank and has selected some gear, it will choose an activity to crack on with.
Bots will prioritize populating the wilderness before anything else. Once the wilderness has reached its goal (player count set in its config file), bots will begin to populate other areas of the gameworld at random.

Bot gear is currently determined by a global tier system. If the bots have been running for a specific amount of time, the tier will increase and all bots will gain access to a rarer item spawn table.
At tier 3 (the highest tier), you can expect infernal capes, bandos, armadyl etc. The tier system also affects the combo's and spec weapons used in the wilderness. The higher the tier, the more deadly the pvp combo's become.

By default, bots are "friendly" and you can approach and attempt to start a conversation with any bot you wish. This may appear to be counter productive when it comes to trying to appear as real players, but this isn't in production
and will most likely be a work in progress forever with all the fine details that keep coming up.

Duel arena bots currently support tent/whip fights only. They will stake a randomized amount of cash based on the tier system. (Higher tier means more default risk). Bots will continue to stake for up to 45 minutes before deciding to call it a day.
This can be ended abruptly if a bot is completly cleaned. Bots who lose fights will run to the bank and attempt to double up to rebuild the losses. I have worked on PID which i posted on a previous thread to ensure duel arena has more or less
the same feel as runescape.

Hybrid/Tribrid pking bots are the rarest bots to spawn (this can be changed in their config file) and the most complicated to design. They can fight against all types of combat styles including other bots who are hybridding.
The giveaway would be watching 2 hybrid bots fight as they tend to lean more towards reactive behaviors. Hybrids on occasion will scout the rev caves for peoples and other bots to kill.

Issues:

This is not specific to bots, but the audio is still a WIP. Some npc's default to certain sounds when its correct sounds aren't specified.

Bot conversations are incredibly difficult to master. It wouldn't take long to figure out you're talking to a bot if you were skeptical from the start.
To this day i haven't had a conversation with ANY AI that's believable, but i did the best i could with this. I still have a few tricks up my sleeve with how to improve this.
Sometimes bots simply bug out and behave weirdly. While filming clips for this thread, the luring bot forgot to barrage me and kept hitting me with a staff.
When i enabled bots starting conversations with other bots, they were stuck in an endless loop of greeting eachother for hours on end.
Theres a few rare instances of bots standing still in the wilderness and becoming completely docile.
Sometimes bots face a direction at random and i'm still not sure why.
Probably a mountain more of issues.

Media:


 

I've recently been getting asked alot of questions on discord about the bots and people have told me that one of the cool features they have isn't mentioned once in the thread, so i'll explain it in this post and add these additional details to the bottom of the thread.

The bots config file has a readAndWrite option meaning instead of launching and playing, they can save data over time and adjust their pking styles a lot.
This includes hardcoded combinations to choose from when they wish to K0 a player but with an element of learning the "sweet spots" to initiate that combo.
Additionally, they learn when its the best time to eat, switch weapons and gear and escape.
I think this is a great approach because if anyone were to purchase this at some point, their servers may have different weapons, combat or pkers from mine.
An adaptable system would simply learn the habbits of the playerbase (for example, if the majority were to safe above 90hp continously, the bots would eventually mimic that or better yet, figure out how to counter it).

It was suggested that i write an AI that learns EVERYTHING from scratch but even i don't fully know how to go about that as well as the learning time would be insanely long in comparison to how ive currently done it.

To show just how this works, i wrote a basic little training system.

Be aware that parts of what the bots have already learned were reset for this video

The bots must learn to eat, when to combo, the most effective equipment to use and attack style over a few hours

[*]Bots have infinite food and infinite special attack
[*]Bots that spawn will set their stats to maxed and instantly appear in the Wilderness
[*]Bots will engage a closeby player until one of them die
[*]The winner will save bits and pieces of data each win
[*]After a few saves, it selects the best solution found from all the data and uses that as the base for the next generation bots

Bugs:

There were really rare occurances of bots using wind bolt for some reason.
Occasionally bots randomly face a direction again.
Perhaps its a visual bug, but i saw a few bolts flying into the bank from edgeville.

Additional information

In the video below i have sped up lots of the clips and cut out footage BUT if anyone wishes to for a 5-6 hour training video, i can do that i guess but it'd be quite boring.

The bots equipment thats initially spawned before combat is not learned. I use a TIER system from 1 - 3. 1 being welfare and 3 being high cost equipment ids.
The bots track which Tier the equipment is spawned from and the most successful Tier will be continued by the next generation.

Media:

 

Edited May 24, 2023 by neilg
Typo's.

[jim12127 0]

nice

[neilg 8]

On 1/4/2022 at 8:23 PM, jim12127 said:

nice

[xdnothanks 0]

This looks really cool, when the bots are pking are they hardcoded to spec/veng at certain times or does it randomly choose what to do?

[neilg 8]

2 hours ago, xdnothanks said:

This looks really cool, when the bots are pking are they hardcoded to spec/veng at certain times or does it randomly choose what to do?

Bots have a simple .txt file that stores data for a every fight occuring at once and logs data for different fighting styles.
On server startup you can choose if you want it to read only or read/write.

The .txt files stores information like "sweet spots" for when to use a special attack, when to eat, when to run etc.
They simply learn how to become better pkers over time.

[neilg 8]

I've recently been getting asked alot of questions on discord about the bots and people have told me that one of the cool features they have isn't mentioned once in the thread, so i'll explain it in this post and add these additional details to the bottom of the thread.

The bots config file has a readAndWrite option meaning instead of launching and playing, they can save data over time and adjust their pking styles a lot.
This includes hardcoded combinations to choose from when they wish to K0 a player but with an element of learning the "sweet spots" to initiate that combo.
Additionally, they learn when its the best time to eat, switch weapons and gear and escape.
I think this is a great approach because if anyone were to purchase this at some point, their servers may have different weapons, combat or pkers from mine.
An adaptable system would simply learn the habbits of the playerbase (for example, if the majority were to safe above 90hp continously, the bots would eventually mimic that or better yet, figure out how to counter it).

It was suggested that i write an AI that learns EVERYTHING from scratch but even i don't fully know how to go about that as well as the learning time would be insanely long in comparison to how ive currently done it.

To show just how this works, i wrote a basic little training system.

Be aware that parts of what the bots have already learned were reset for this video

The bots must learn to eat, when to combo, the most effective equipment to use and attack style over a few hours

[*]Bots have infinite food and infinite special attack
[*]Bots that spawn will set their stats to maxed and instantly appear in the Wilderness
[*]Bots will engage a closeby player until one of them die
[*]The winner will save bits and pieces of data each win
[*]After a few saves, it selects the best solution found from all the data and uses that as the base for the next generation bots

Bugs:

There were really rare occurances of bots using wind bolt for some reason.
Occasionally bots randomly face a direction again.
Perhaps its a visual bug, but i saw a few bolts flying into the bank from edgeville.

Additional information

In the video below i have sped up lots of the clips and cut out footage BUT if anyone wishes to for a 5-6 hour training video, i can do that i guess but it'd be quite boring.

The bots equipment thats initially spawned before combat is not learned. I use a TIER system from 1 - 3. 1 being welfare and 3 being high cost equipment ids.
The bots track which Tier the equipment is spawned from and the most successful Tier will be continued by the next generation.

Media:

This is the hidden content, please

• Sign In
• or
• Sign Up

Edited January 11, 2022 by neilg

[xx501xx 0]

very very nice man

 

[u fail77 0]

Very cool looking to add pk bots to my hobby server... maybe not though waste of time?

 

[neilg 8]

On 1/13/2022 at 3:00 PM, u fail77 said:

Very cool looking to add pk bots to my hobby server... maybe not though waste of time?

 

I don't see why it would be a waste of time if it was done properly.
Nobody wants to log into a server with no players but unless you spend money on advertising, your start will be rough. Pk bots can ease that initial emptiness alittle bit.

[Wiz Khalifa 0]

very nice

[u fail77 0]

On 1/14/2022 at 10:44 PM, neilg said:

I don't see why it would be a waste of time if it was done properly.
Nobody wants to log into a server with no players but unless you spend money on advertising, your start will be rough. Pk bots can ease that initial emptiness alittle bit.

I ment me coding would be waste of time as I don't really want to code rsps anymore... I just want to move on with my life, hell I'm almost 25 years old... Coding is like an addiction to me and its a very very bad habit.... Especially when 90% of the rsps community is so toxic... this shit stresses me out to the max... 

[06 Prod 0]

This looks really dope- GL!

[daniMilio 0]

LOL!

Looks damn cool, GJ!

[vypur 0]

this is pretty sick work

[alkaline3030 0]

thats sick wtf