Project 2
There is 2 options for the project. You can select only one to do. Each is worth 100 points. Option 1 is more command driven and option 2 is with docker. option 1 is in blue and option 2 is in green.
Option 1:
project2hints.txt
Create user accounts Sally, John and Patty. Give them each a password of test.
Create a general and accounting group.
Add Sally and John to the accounting group.
Add Sally, John, and Patty to the general group.
Who are you currently logged in as?
Go to your home folder.
Create the folder testfolder1 and a folder inside called testfolder2
Change your current folder to testfolder1
Create a new file called sallyfile inside testfolder1. Type sallyfile as the contents, and then save and close it.
Create a new file called testfile2 inside testfolder1. Type testfile2 as the contents, and then save and close it.
Change your current folder to testfolder2.
Create a new file called proga.sh inside testfolder2. It should have this as its contents:
#/bin/sh
echo “hello world”
Change the owner of testfolder1 and its contents, so sally is the owner.
Change the group of testfolder1 and its contents to accounting.
Change the permissions of sallyfile, so the group and other levels cannot do anything to it .
Change the permissions of testfile2, so the group can read/write to it and other can read it.
Change the permissions of testfolder2, so the group has execute permission, and other has no permissions.
Change the permissions of proga.sh, so the group can execute the program.
Backup testfolder2 with the tar command and use gzip compression. Name the archive testfolder2.tgz.
Backup up testfolder1 with the tar command. Name the archive simple_1.tar
Please do these commands so as to collect all of your work for grading.
echo company data > ~/yourname
ls –Ral /testfolder1 >> ~/yourname
echo /etc/passwd >> ~/yourname
cat /etc/passwd >> ~/yourname
echo /etc/group >> ~/yourname
cat /etc/group >>~/yourname
history >> ~/yourname
Grading for option 1
As a deliverable, please submit a pdf or word doc with your command history and output from step # 21. I need to see the complete command history as well as a see the complete directory listing of your testfolder1 and its subcontents. Screenshots of your command history and directory listing of testfolder1 complete contents are acceptable but not required.
Each step is worth 5 points (20 graded steps altogether). For each step that is wrong, 5 points is subtracted.
OPTION 2 – SET UP A DOCKER CONTAINER
For this option we would set up a docker container with the following parameters
The docker container should run Linux
It must have the following packages installed:
Python and pip
Install the ssh package paramiko for Python
an editor like vim, nano, and/or emacs
SSH
curl and wget
cron
Your docker container should connect to a volume
Create a hello world shell script hello.sh that is executable. All it does is the following:
print out the “Hello world” and output to the volume you created in file called hello_datehere.txt. For instance, your docker volume could be called /usr/share/dockervolume and the file would be named /usr/share/dockervolume/hello_20230327
Create dockerfile that builds this image for the container so matches all the above parameters. The hello world script hello.sh should be copied into your image using the dockerfile and the dockerfile should include all the packages specified above.
Bonus (not required): make your container run on the hello.sh script every day and output to your dockervolume
Grading for option 2
50 points: Provide the dockerfile
10 points: Provide the hello.sh
10 points: Screenshot of your working container
30 points: write up explaining your whole process
When uploading your deliverable please provide the contents as a pdf or word doc.
OPTION 3 – WEB SCRAPING
For this option we will put our scripting knowledge to test. You will scrape a website and collect the data points into a csv.
Here are the parameters of this project:
Try to scrape this fake ecommerce page of cars: https://mrlabsllc.com/tuxcars/.
Your scraper should collect at least 3 data points such as name of product, price of product and product number or rating
Only one page of store data is necessary but it should be around 20 items though. No need to have your scraper page through the website inventory.
It’s ok if your script is being blocked by the website, you can just download HTML source of page instead.
If you are having trouble because the site is blocking you, I can help you on how to download the source of a website so you can move forward with your scraping project.
Setting up a webdriver with selenium or a similar tool is not required for this project.
Your script should output the data points into a csv
Suggested programs/tools to use for your scripting:
cut
sed
grep
regular expressions
curl/wget
awk
variables
if statements, while loops, for loops, and other control structures
Here is a basic flow for your webscraping
Have your script download 1 page of store items. If you cannot have your script do this. It’s ok to download it manually the HTML source of a website.
Parse the outputted HTML source from the data to recognize the 3 data points you identified for each store item such as price, name of product and item id or rating
Output a csv of the parsed data. A csv is a comma separated spreadsheet
Grading for option 3
80 points: script that parses the HTML source of a website’s store inventory to generate a csv of its product data with at least 3 data points.
20 points: write up explaining your process