Académique Documents
Professionnel Documents
Culture Documents
LoginJoin
Community
Categories
Resources
Learn
Tools
Ask
Answer
Cookies help us deliver our services. By using our services you agree to our use of cookies.
Ok
Best Practices
31
Join the Community! Creating your account only takes a few minutes.
Join Now
Photo credit: Asterio Fiora
Hi Spiceheads,
I'm wondering how you all manage your daily or morning checks and how you begin to
report on it. I'm looking to use the checks I'm being asked to do to not only log them, but be
able to report and escalate issues where needsbe.
These checks will include hardware and software based - therefore checking if servers are
running, their temperature and whether the software/remote services are working. I currently
have a rubbish little C# application I'm building to automate some of the checks etc.
I could do an excel spreadsheet with pass and fail requirements but was wondering if anyone
knew of any different options or how you manage it.
Thanks!
Reply Subscribe
18 Replies
Habanero
For instance we have a runbook (web -based) which we fill out every morning and then
submit for approval. This checks space in exchange, AV is downloading newest dats, if
backups failed critical systems are running (via alerts from SolarWinds and VMware alerts,
tec...... Anything that pops up we raise a request and assign it to to our queue, fix and
document the fix
So depending on how you want to proceed you could implement something that will do all
the grunt work for you i.e. Solarwinds, NAGIOS, PRTG for checking servers and sending
alerts when something isn't right with services, memory disks. Have your Backup system
send job results which highlight failures or warnings.
You can get pretty granular with what you want to achieve, so the above is just an overview.
Others can add this, as different environments have different ways of reporting and
documenting
Nagios(84)
VMware396,506 FollowersFollow
SolarWinds2,170 FollowersFollow
Spice
Reply
Pure Capsaicin
we have a separate gmail account with daily tasks listed as events with the helpdesk invited
so 10 mins before they are due helpdesk will get a reminder email which converts into a
ticket
Spice
Reply
Habanero
stables2511 Oct 14, 2015 at 11:03 AM
We have a display screen here running various pieces of software showing allocated &
outstanding jobs (bespoke), client network health (naggios), system backups etc etc. That way
everyone in the office can see whats outstanding or been allocated and as a manager i can see
if stuff is being done without having to ask.
Spice
Reply
Mace
If you have your data center all or partly in Azure, you can use Azure Automation -
PowerShell workflows that you can schedule. One client kicks off the automation script every
morning at 06:00. The script looks at all manner of things (disk space, services, best practics,
etc, etc) against all the servers in their organisation. The script then sends email to people
(depending on what is found) so that when they get in at 08:00, the mail is sitting there
waiting for them.
You could, of course, do exactaly the same thing if your infrastrcture is locally virtualised -
just run the script say on a domain controller, and let it reach out to find out things using
PowerShell remoting.
Spice
Reply
Ghost Chili
I use PRTG to automate such stuff - it monitors backup mailboxes, checks for disk space etc,
checks that services are running and available, and alerts the appropriate person if there's an
error.
1. It's automated.
Spice
Reply
Cayenne
For years we had a VBScript and later Powershell checking things like drive space and event
logs, dumping the output to a spreadsheet. Our management were somewhat insistant on
having a manual and human aspect to these checks, but refused to believe that what was
being checked was mostly redundant data and was a very ineffective use of our time, they
'didnt trust' automated solutions because they 'could fail', just like the systems they
monitored.
Then 2 full-time IT people left and they refused to replace them, so I decreed that there was
just no way IT could waste over an hour a day of now severely limited resources doing 'busy
work', manually checking things which would not indicate impending failure, much less
prevent it.
Don't get me wrong it took me about a solid month to get it running exactly the way we
wanted and there were many hours of writing special host definitions and all the rest of it, but
the end result was well worth the effort. I thoroughly recommend it, theres not much it can't
monitor and you can script it to within an inch of its life.
Spice
Reply
Cayenne
JoeWilliams wrote:
Exactly.
That's the key, and the thing I argued tooth and nail with management about. It's wonderful
seeing that all your Exchange databases are nicely mounted and working when the 'moment
in time' daily check is run at 7:30, but if they're on fire by 7:33 you're not going to know a
damn thing about it until either the next morning, or when users start phoning up anyway.
Spice
Reply
Habanero
I just want to put in my 2 cents - Daily Check of your IT infrastructure configuration changes
can be done via free Netwrix Change Notifier Widget for Spiceworks, it reports all changes
made to your AD, Exchange, Group Policy by sending alerts to your e-mail daily, and also
has hourly updated dashboard inside Spiceworks.
Netwrix3,320 FollowersFollow
Spice
Reply
4
Tabasco
We started with PowerShell scripts to start automating things like checking disk
space\backups. Pretty much just started picking off manual tasks and making PowerShell
scripts for them (spice works has great ones, also learned a lot about PS). So if you normally
go and check the free disk space on 4 servers, make a PowerShell script to do it for you and
give you a nice report (which also doubles as some historical data so you can spot trends).
It is not the prettiest way to do it (I have several scripts that run every morning), but it cut
about an hour out of my day, and now I have the report waiting for me when I get in.
I have just started playing with PRTG for some of the more mission critical processes that I
check several times a day, and this looks like it will save some more time!
Best advise I have is start small. While it would be nice to do it all at once, you will drive
yourself crazy. Break it out in chunks, get it providing the information you need\when you
need it, then move on to the next chunk.
Spice
Reply
Serrano
I keep all mine on my Spiceworks Dashboard and the PRTG. With just those 2 things i keep
my task for the day and all alerts up-to-date with no issues.
Spice
Reply
Datil
Awesome !
Sounds like, you do have now some great resources to manage your tedious tasks in different
ways. Spiceworks has also some good stuffs to help you and manage the routine jobs in an
secure way.
And, to get notified of critical events into real time, you can also look into Lepide 2020 suite
that provides an automated solution to get total visibility of crucial changes and complete
control over your Active Directory, Group Policy, File Server, SQL Servers, Exchange
servers, SharePoint server and much more in order to enhance the IT environment in more
appropriate way.
Lepide1,211 FollowersFollow
Spice
Reply
Cayenne
I've since extended the system monitoring screen to include server temperature checks, with
resultant colour changes in the display if temp goes over certain thresholds I've set. Crossing
the thresholds also generates an email feeding my Spiceworks helpdesk.
I'll update the monitoring screen How To in a bit to add the temp monitor.
Spice
Reply
Cayenne
Right, I've made the changes to that How To, so the temperature monitor scripts are in there
now.
Spice
Reply
Jalapeno
Powershell
Function Send-SpiceMail {
send-mailmessage `
-To $To `
-Subject $Subject `
-From $From `
-Body $Body `
-SMTPServer $smtpserver `
-BodyAsHTML
}
$To = "helpdesk@contoso.com"
$From = "me@contoso.com"
$SMTPServer = "mailserver.contoso.com"
#TASK 1
$Subject = "Scheduled - Server Room Walkthrough"
$Body = "Walk through the server room, performing physical check of
equipment
<br>`#assign to Tech1
<br>`#priority high"
Send-SpiceMail
Spice
Reply
Jalapeno
BSOD'D - You said you use a web based runbook... which providor?
Thanks!
Spice
Reply
Cayenne
Well, you've explicitly stated you want something for daily/morning checks. We used to have
a script ("wot I wrote") which we'd run when the early shift came in, and again about 30
minutes before the late shift left. This script would create an email detailing issues found that
went out to a distribution group.
The problem with this approcah is that it only gives you a snapshot of what's happening at the
moment you run the script. Which is fine if all you're interested in is the state of things in
your environment at (script) runtime, but surely you're interested in the state of things ALL
the time?
So, what you really want is something that runs all the time and send alerts when it detects
any kind of outage. i.e. something dynamic.
We used to used Servers Alive for this (nice and cheap, but a bit dumb so you have to define
each and every alert condition and notification(s)), but now we use Microsoft SCOM (with a
LiveMaps add-on) which at least automatically sets its own alerts based on its knowledge of
each system you make it aware of,
But then, there's always, oh what's it called, ChiliFactory? No, PepperJobs? um...Got it!
SpiceWorks!
Spice
Reply
Chipotle
One of the techs gets in early and works through the 1st checklist which only covers any
hardware or software required for normal trading operations. This check is performed early
enough before the stores open so that any problems can be sorted out before the customers
walk in. The 2nd checklist goes through overnight processes, backups, daily maintenance
tasks etc that are important but do not influence retail operations. Almost all of the check
items are already monitored by various tools but we get better levels of thoroughness from
the support staff when they have to record the various statuses (such as server room
temperature) and sign-off on the checklist. This process does not take very long as the
monitoring tools and scripts provide almost all the info required for the checklists.
(These tickets are automatically generated in Spiceworks using gmail calendar notifications)
Spice
Reply
Poblano
Spice
Reply
You may get a better answer to your question by starting a new discussion.
IN THE COMMUNITY
VMware
396506 Followers Follow
Netwrix
3320 Followers Follow
SolarWinds
2170 Followers Follow
Lepide
1211 Followers Follow
Nagios