Develop a web links scraper program in Python that extracts all of the unique web links that point out to other web pages

INSTRUCTIONS TO CANDIDATES

ANSWER ALL QUESTIONS

Develop a web links scraper program in Python that extracts all of the unique web links that point out to other web pages from the HTML code of the “Current Estimates” web link, both from the “US Census Bureau” website (see web link below) and outside that domain, and that populates them in a comma-separated values (CSV) file as absolute uniform resource indicators (URIs).

 

A.    Explain how the Python program extracts the web links from the HTML code of the “Current Estimates,” found in web links section.

B.    Explain the criteria you used to determine if a link is a locator to another HTML page. Identify the code segment that executes this action as part of your explanation.

C.    Explain how the program ensures that relative links are saved as absolute URIs in the output file. Identify the code segment that executes this action as part of your explanation.

D.    Explain how the program ensures that there are no duplicated links in the output file. Identify the code that executes this action as part of your explanation.

Note: Please consider weblinks that point to the same web pages as identical  (e.g., www.commerce.gov and www.commerce.gov/).

E.    Provide the Python code you wrote to extract all the unique web links from the HTML code of the “Current Estimates” (in the web links section), that point out to other HTML pages.

F.    Provide the HTML code of the “Current Estimates” web page scrapped at the time when the scraper was run and the CSV file was generated.

G.    Provide the CSV file that your script created.

H.    Run your script and provide a screenshot of the successfully executed results.

I.     Acknowledge sources, using in-text citations and references, for content that is quoted, paraphrased, or summarized.

J.    Demonstrate professional communication in the content and presentation of your submission.

Related Questions

. The fundamental operations of create, read, update, and delete (CRUD) in either Python or Java

CS 340 Milestone One Guidelines and Rubric  Overview: For this assignment, you will implement the fundamental operations of create, read, update,

. Develop a program to emulate a purchase transaction at a retail store. This  program will have two classes, a LineItem class and a Transaction class

Retail Transaction Programming Project  Project Requirements:  Develop a program to emulate a purchase transaction at a retail store. This

. The following program contains five errors. Identify the errors and fix them

7COM1028   Secure Systems Programming   Referral Coursework: Secure

. Accepts the following from a user: Item Name Item Quantity Item Price Allows the user to create a file to store the sales receipt contents

Create a GUI program that:Accepts the following from a user:Item NameItem QuantityItem PriceAllows the user to create a file to store the sales receip

. The final project will encompass developing a web service using a software stack and implementing an industry-standard interface. Regardless of whether you choose to pursue application development goals as a pure developer or as a software engineer

CS 340 Final Project Guidelines and Rubric  Overview The final project will encompass developing a web service using a software stack and impleme