The Cache: Technology Expert's Forum
 
*
Welcome, Guest. Please login or register. September 21, 2019, 12:14:59 PM

Login with username, password and session length


Pages: [1]
  Print  
Author Topic: Sometimes, Im a real tard  (Read 2281 times)
nutballs
Administrator
Lifer
*****
Offline Offline

Posts: 5627


Back in my day we had 9 planets


View Profile
« on: December 05, 2008, 09:05:02 PM »

So. I have the uber huge network of sites right.
They all run off a single code base right.
They clean up, cache, uncache, build, grow, all on their own right?

Yea, well... the were building alright...

When you look at your core server and you see a server load of 3.0 or higher, consistently, you kinda gotta wonder what the hell is going on, especially when it really should be around .1

So what do you do? You shut off all the "extras" like content scraper, generator, linker, etc etc etc.
server load still at 3.0 ish.
wtf you may ask?

Ah well you see, it is helpful to not delete 2.8 million pages EVERY HOUR.

D'oh!

took me 3 days to figure that out. My fucking clean up routine went haywire, and as a result, it was telling all my nodes to delete EVERYTHING, every hour. That in itself is not a big deal, except, the minute a spider hits, that new file is generated and my core gets queried.
Now that I actually looked at my service logger which tracks internal coms from the nodes...
i had up to 30 requests a second coming in, for a pretty hefty DB query.
OOPS.  ROFLMAO
Logged

I could eat a bowl of Alphabet Soup and shit a better argument than that.
perkiset
Olde World Hacker
Administrator
Lifer
*****
Offline Offline

Posts: 10096



View Profile
« Reply #1 on: December 05, 2008, 09:18:50 PM »

Definition: thrash     [thrash]
–verb (used with object)
1.   to beat soundly in punishment; flog. See "Nutballs"  ROFLMAO
Logged

It is now believed, that after having lived in one compound with 3 wives and never leaving the house for 5 years, Bin Laden called the U.S. Navy Seals himself.
nutballs
Administrator
Lifer
*****
Offline Offline

Posts: 5627


Back in my day we had 9 planets


View Profile
« Reply #2 on: December 05, 2008, 09:37:24 PM »

I laugh every time when i watch office space when mike says he must have misplaced a comma. I HATE WHEN I DO THAT. its always the mundane that gets you.
Logged

I could eat a bowl of Alphabet Soup and shit a better argument than that.
jairez
Expert
****
Offline Offline

Posts: 164


JTFC


View Profile
« Reply #3 on: December 05, 2008, 10:22:26 PM »

Quote
delete 2.8 million pages EVERY HOUR
Fuck me running!  Ssssooooooo ... this begs to question, how many pages per hour are you creating? Huh?

Wow ... I'm a TOTAL piker in comparison.  Wait a minute ... who am I kidding?  There is no comparison.  Seriously.

Very, very impressive NB. 

How do you back that stuff up? 

You must be an server vendor's wet dream AND a router vendor's nightmare  Praise

Logged

Spontaneity has it's time and place.  [Sluggo, 1990-ish]
nutballs
Administrator
Lifer
*****
Offline Offline

Posts: 5627


Back in my day we had 9 planets


View Profile
« Reply #4 on: December 05, 2008, 11:19:43 PM »

heh. currently my system is reporting 28 new pages a minute. Thats not counting all the other coms that take place. Im not even really up to speed yet. I just got the final piece of automation in place, so i now am making reseller club alot of money... lol

I don't back it up. if I lose it, it will just rebuild, so no biggy. Its distro'd across 8 hosts currently, with more on the way. some elements are stored in a database on the core server, but that is only for in case of loss, so that i can maintain the same links and such. I originally had no core server, and all sites ran autonomously. but some secret sauce was needed, so a core got added.

actually i am pissing off the cheap hosts I am using, lol.

and just to make your head hurt, that aint nothing... my goal is to multply by at least a factor of 10. And im nothing compared to a few other folks...
Logged

I could eat a bowl of Alphabet Soup and shit a better argument than that.
jairez
Expert
****
Offline Offline

Posts: 164


JTFC


View Profile
« Reply #5 on: December 06, 2008, 09:49:42 AM »

Quote
distro'd across 8 hosts
Wow ... nice trick!  At least in my realm ...
Logged

Spontaneity has it's time and place.  [Sluggo, 1990-ish]
Pages: [1]
  Print  
 
Jump to:  

Perkiset's Place Home   Best of The Cache   phpMyIDE: MySQL Stored Procedures, Functions & Triggers
Politics @ Perkiset's   Pinkhat's Perspective   
cache
mart
coder
programmers
ajax
php
javascript
Powered by MySQL Powered by PHP Powered by SMF 1.1.2 | SMF © 2006-2007, Simple Machines LLC
Seo4Smf v0.2 © Webmaster's Talks


Valid XHTML 1.0! Valid CSS!