Final Project of Using Python to Interact with the Operating System

 

What we'll do in Brief

Use regex to parse a log file for keyword INFO and ERROR

  • Append and modify values in a dictionary| Two separate dictionaries for INFO and ERROR

  • Write to a file in CSV format |, Two CSV files

  • Move files to the appropriate directory for use with the CSV->HTML converter| The conversion program is already provided. We have not to create/develope conversion utility.

#ticky_check written by Me and with My own Login without using import csv utility only in 31 lines a in very simple way
#!/usr/bin/env python
import re
import operator
users={}
errors={}
with open('syslog.log') as logfile:
    for line in logfile:
        line=line.strip() # to trim \n
        user = re.search(r'\((.+)\)$',line)
        if user[1] not in users:
            users[user[1]]=(0,0) #(info,error)
        if 'INFO' in line:
            #sers['ac']=(users['ac'][0]+1,users['ac'][1])
            users[user[1]]=(users[user[1]][0]+1,users[user[1]][1])
        if 'ERROR' in line:
            users[user[1]]=(users[user[1]][0],users[user[1]][1]+1)
            line = re.search(r'ERROR (.*) \(',line)
            if line[1] not in errors:
                errors[line[1]]=0
            errors[line[1]] += 1
userscsv=open('user_statistics.csv','w')
print('Username','INFO','ERRORS',sep=',',file=userscsv)
for row in sorted(users.items()):
        print(row[0],row[1][0],row[1][1],sep=',',file=userscsv)
userscsv.close()
errorscsv = open('error_message.csv','w')
print('Error','Count',sep=',',file=errorscsv)
rows= sorted(errors.items(),key=operator.itemgetter(1),reverse=True)
for row in rows:
        print(row[0],row[1],sep=',',file=errorscsv)
errorscsv.close()

------------------------------------------------syslog.log is as under----------------------------

Jan 32 00:09:39 ubuntu.local ticky: INFO Created ticket [#4217] (mdouglas) Jan 31 00:16:25 ubuntu.local ticky: INFO Closed ticket [#1754] (noel) Jan 31 00:21:30 ubuntu.local ticky: ERROR The ticket was modified while updating (breee) Jan 31 00:44:34 ubuntu.local ticky: ERROR Permission denied while closing ticket (ac) Jan 31 01:00:50 ubuntu.local ticky: INFO Commented on ticket [#4709] (blossom) Jan 31 01:29:16 ubuntu.local ticky: INFO Commented on ticket [#6518] (rr.robinson) Jan 31 01:33:12 ubuntu.local ticky: ERROR Tried to add information to closed ticket (mcintosh) Jan 31 01:43:10 ubuntu.local ticky: ERROR Tried to add information to closed ticket (jackowens) Jan 31 01:49:29 ubuntu.local ticky: ERROR Tried to add information to closed ticket (mdouglas) Jan 31 02:30:04 ubuntu.local ticky: ERROR Timeout while retrieving information (oren) Jan 31 02:55:31 ubuntu.local ticky: ERROR Ticket doesn't exist (xlg) Jan 31 03:05:35 ubuntu.local ticky: ERROR Timeout while retrieving information (ahmed.miller) Jan 31 03:08:55 ubuntu.local ticky: ERROR Ticket doesn't exist (blossom) Jan 31 03:39:27 ubuntu.local ticky: ERROR The ticket was modified while updating (bpacheco) Jan 31 03:47:24 ubuntu.local ticky: ERROR Ticket doesn't exist (enim.non) Jan 31 04:30:04 ubuntu.local ticky: ERROR Permission denied while closing ticket (rr.robinson) Jan 31 04:31:49 ubuntu.local ticky: ERROR Tried to add information to closed ticket (oren) Jan 31 04:32:49 ubuntu.local ticky: ERROR Timeout while retrieving information (mcintosh) Jan 31 04:44:23 ubuntu.local ticky: ERROR Timeout while retrieving information (ahmed.miller) Jan 31 04:44:46 ubuntu.local ticky: ERROR Connection to DB failed (jackowens) Jan 31 04:49:28 ubuntu.local ticky: ERROR Permission denied while closing ticket (flavia) Jan 31 05:12:39 ubuntu.local ticky: ERROR Tried to add information to closed ticket (oren) Jan 31 05:18:45 ubuntu.local ticky: ERROR Tried to add information to closed ticket (sri) Jan 31 05:23:14 ubuntu.local ticky: INFO Commented on ticket [#1097] (breee) Jan 31 05:35:00 ubuntu.local ticky: ERROR Connection to DB failed (nonummy) Jan 31 05:45:30 ubuntu.local ticky: INFO Created ticket [#7115] (noel) Jan 31 05:51:30 ubuntu.local ticky: ERROR The ticket was modified while updating (flavia) Jan 31 05:57:46 ubuntu.local ticky: INFO Commented on ticket [#2253] (nonummy) Jan 31 06:12:02 ubuntu.local ticky: ERROR Connection to DB failed (oren) Jan 31 06:26:38 ubuntu.local ticky: ERROR Timeout while retrieving information (xlg) Jan 31 06:32:26 ubuntu.local ticky: INFO Created ticket [#7298] (ahmed.miller) Jan 31 06:36:25 ubuntu.local ticky: ERROR Timeout while retrieving information (flavia) Jan 31 06:57:00 ubuntu.local ticky: ERROR Connection to DB failed (jackowens) Jan 31 06:59:57 ubuntu.local ticky: INFO Commented on ticket [#7255] (oren) Jan 31 07:59:56 ubuntu.local ticky: ERROR Ticket doesn't exist (flavia) Jan 31 08:01:40 ubuntu.local ticky: ERROR Tried to add information to closed ticket (jackowens) Jan 31 08:03:19 ubuntu.local ticky: INFO Closed ticket [#1712] (britanni) Jan 31 08:22:37 ubuntu.local ticky: INFO Created ticket [#2860] (mcintosh) Jan 31 08:28:07 ubuntu.local ticky: ERROR Timeout while retrieving information (montanap) Jan 31 08:49:15 ubuntu.local ticky: ERROR Permission denied while closing ticket (britanni) Jan 31 08:50:50 ubuntu.local ticky: ERROR Permission denied while closing ticket (montanap) Jan 31 09:04:27 ubuntu.local ticky: ERROR Tried to add information to closed ticket (noel) Jan 31 09:15:41 ubuntu.local ticky: ERROR Timeout while retrieving information (oren) Jan 31 09:18:47 ubuntu.local ticky: INFO Commented on ticket [#8385] (mdouglas) Jan 31 09:28:18 ubuntu.local ticky: INFO Closed ticket [#2452] (jackowens) Jan 31 09:41:16 ubuntu.local ticky: ERROR Connection to DB failed (ac) Jan 31 10:11:35 ubuntu.local ticky: ERROR Timeout while retrieving information (blossom) Jan 31 10:21:36 ubuntu.local ticky: ERROR Permission denied while closing ticket (montanap) Jan 31 11:04:02 ubuntu.local ticky: ERROR Tried to add information to closed ticket (breee) Jan 31 11:19:37 ubuntu.local ticky: ERROR Connection to DB failed (sri) Jan 31 11:22:06 ubuntu.local ticky: ERROR Timeout while retrieving information (montanap) Jan 31 11:31:34 ubuntu.local ticky: ERROR Permission denied while closing ticket (ahmed.miller) Jan 31 11:40:25 ubuntu.local ticky: ERROR Connection to DB failed (mai.hendrix) Jan 31 11:47:07 ubuntu.local ticky: INFO Commented on ticket [#4562] (ac) Jan 31 11:58:33 ubuntu.local ticky: ERROR Tried to add information to closed ticket (ahmed.miller) Jan 31 12:00:17 ubuntu.local ticky: INFO Created ticket [#7897] (kirknixon) Jan 31 12:02:49 ubuntu.local ticky: ERROR Permission denied while closing ticket (mai.hendrix) Jan 31 12:20:23 ubuntu.local ticky: ERROR Connection to DB failed (kirknixon) Jan 31 12:20:40 ubuntu.local ticky: ERROR Ticket doesn't exist (flavia) Jan 31 12:24:32 ubuntu.local ticky: INFO Created ticket [#5784] (sri) Jan 31 12:50:10 ubuntu.local ticky: ERROR Permission denied while closing ticket (blossom) Jan 31 12:58:16 ubuntu.local ticky: ERROR Tried to add information to closed ticket (nonummy) Jan 31 13:08:10 ubuntu.local ticky: INFO Closed ticket [#8685] (rr.robinson) Jan 31 13:48:45 ubuntu.local ticky: ERROR The ticket was modified while updating (breee) Jan 31 14:13:00 ubuntu.local ticky: INFO Commented on ticket [#4225] (noel) Jan 31 14:38:50 ubuntu.local ticky: ERROR The ticket was modified while updating (enim.non) Jan 31 14:41:18 ubuntu.local ticky: ERROR Timeout while retrieving information (xlg) Jan 31 14:45:55 ubuntu.local ticky: INFO Closed ticket [#7948] (noel) Jan 31 14:50:41 ubuntu.local ticky: INFO Commented on ticket [#8628] (noel) Jan 31 14:56:35 ubuntu.local ticky: ERROR Tried to add information to closed ticket (noel) Jan 31 15:27:53 ubuntu.local ticky: ERROR Ticket doesn't exist (blossom) Jan 31 15:28:15 ubuntu.local ticky: ERROR Permission denied while closing ticket (enim.non) Jan 31 15:44:25 ubuntu.local ticky: INFO Closed ticket [#7333] (enim.non) Jan 31 16:17:20 ubuntu.local ticky: INFO Commented on ticket [#1653] (noel) Jan 31 16:19:40 ubuntu.local ticky: ERROR The ticket was modified while updating (mdouglas) Jan 31 16:24:31 ubuntu.local ticky: INFO Created ticket [#5455] (ac) Jan 31 16:35:46 ubuntu.local ticky: ERROR Timeout while retrieving information (oren) Jan 31 16:53:54 ubuntu.local ticky: INFO Commented on ticket [#3813] (mcintosh) Jan 31 16:54:18 ubuntu.local ticky: ERROR Connection to DB failed (bpacheco) Jan 31 17:15:47 ubuntu.local ticky: ERROR The ticket was modified while updating (mcintosh) Jan 31 17:29:11 ubuntu.local ticky: ERROR Connection to DB failed (oren) Jan 31 17:51:52 ubuntu.local ticky: INFO Closed ticket [#8604] (mcintosh) Jan 31 18:09:17 ubuntu.local ticky: ERROR The ticket was modified while updating (noel) Jan 31 18:43:01 ubuntu.local ticky: ERROR Ticket doesn't exist (nonummy) Jan 31 19:00:23 ubuntu.local ticky: ERROR Timeout while retrieving information (blossom) Jan 31 19:20:22 ubuntu.local ticky: ERROR Timeout while retrieving information (mai.hendrix) Jan 31 19:59:06 ubuntu.local ticky: INFO Created ticket [#6361] (enim.non) Jan 31 20:02:41 ubuntu.local ticky: ERROR Timeout while retrieving information (xlg) Jan 31 20:21:55 ubuntu.local ticky: INFO Commented on ticket [#7159] (ahmed.miller) Jan 31 20:28:26 ubuntu.local ticky: ERROR Connection to DB failed (breee) Jan 31 20:35:17 ubuntu.local ticky: INFO Created ticket [#7737] (nonummy) Jan 31 20:48:02 ubuntu.local ticky: ERROR Connection to DB failed (mdouglas) Jan 31 20:56:58 ubuntu.local ticky: INFO Closed ticket [#4372] (oren) Jan 31 21:00:23 ubuntu.local ticky: INFO Commented on ticket [#2389] (sri) Jan 31 21:02:06 ubuntu.local ticky: ERROR Connection to DB failed (breee) Jan 31 21:20:33 ubuntu.local ticky: INFO Closed ticket [#3297] (kirknixon) Jan 31 21:29:24 ubuntu.local ticky: ERROR The ticket was modified while updating (blossom) Jan 31 22:58:55 ubuntu.local ticky: INFO Created ticket [#2461] (jackowens) Jan 31 23:25:18 ubuntu.local ticky: INFO Closed ticket [#9876] (blossom) Jan 31 23:35:40 ubuntu.local ticky: INFO Created ticket [#5896] (mcintosh)

Comments

Post a Comment

Popular posts from this blog

PANDAS micro course by www.Kaggle.com https://www.kaggle.com/learn/pandas

Image
  Creating, Reading and Writing $ pip install pandas $ python3 >>> import pandas as pd >>> pd.DataFrame({'BOB':['Ist column of BOB','IInd col of BoB'],'SUSE':['Ist col suse','II col suse']})                  BOB          SUSE 0  Ist column of BOB  Ist col suse 1    IInd col of BoB   II col suse >>>pd.DataFrame({..same as above---},index=['Prouct a ',' Product b'])   >>> pd.Series([30, 35, 40], index=['2015 Sales', '2016 Sales', '2017 Sales'], name='Product A') 2015 Sales    30 2016 Sales    35 2017 Sales    40 Name: Product A, dtype: int64 >>> reviews=pd.read_csv('/mnt/d/wine.csv') >>> reviews show the contents of file wine.csv >>> reviews.country >>> reviews['country']   to see only country column >>> reviews.iloc[0] return only one row >>> review.il...
Read more

Course No 2 Using Python to Interact with the Operating System Rough Notes

Image
MAIN COURSE  Google IT Automation with Python Professional Certificate Having 6 crouse 1st course was Python Crash which I have DONE got certificate . My friend say 'bati bana kar gand meen dalo' Course No 2 Using Python to Interact with the Operating System ------------------------------ course 2 week 5 added  By inputting emp name the program will return its email address By inputing   Blossom Gill program will return his email aress blossom@abc.edu Our job is to  1. add a test means  test cases like basic_test Edge_test see  the bugs,  2. make the necessary corrections in  email.py Python file to correct the bugs   3. verify that all the tests pass to make sure the script works!  4.  This is The End Lab . Best of luck! and Congrautulations Once again, in other words, same matter/problem as mentioned above What you'll do In this lab, you will: Write a simple test (basic test )to check for basic functionality Write a test...
Read more

Introduction to Git and GitHub https://www.coursera.org/learn/introduction-git-github/

Image
Introduction to Git and GitHub https://www.coursera.org/learn/introduction-git-github/ On top of search results, here are some great Git resources available online: Pro Git : This book (available online and in print) covers all the fundamentals of how Git works and how to use it. Refer to it if you want to learn more about the subjects that we cover throughout the course. Git tutorial : This tutorial includes a very brief reference of all Git commands available. You can use it to quickly review the commands that you need to use. WEEK NO 1  Intro to Module 1: Version Control First I have to install Git in each computer???????????!!!!!!!!!!!! https://git-scm.com/download/win Instead of new coding we must use the previous codes and extend/add  functions/codes because previous codes are alrady tested from bugs and are debugged .  in VCS/Git there are two main utilities  DIFFand PATCH After installatin of GIT we can track the changes in codes. Week 1 What is version cont...
Read more