1. [40 points, inverted index] Write a Python script ”index.py” that takes books.xml as the input
and outputs the index in an XML file: index.xml.
You are free to choose a desirable structure for the index file. But the index should store
keywords in the author, title, genre, and description attributes of books, and for each keyword,
stores id’s of books which contains the keyword, and for each book, indicates where (that is, in
which attribute) the keyword appears in the book.
You can assume that keywords are obtained from the content of attribute after removing white
spaces and punctuation characters (except for apostrophe ‘ )
2. [60 points, search] Write a Python script ”search.py” that takes the data file (books.xml) index
file (index.xml) and a string of keywords, and outputs the search result in an XML file:
results.xml, which lists the documents having all the keywords in at least one of the attributes
and also the complete content of the attributes. For example,
python search.py books.xml index.xml ”xml xslt” results.xml
The Microsoft MSXML3 parser is covered in detail, with
attention to XML DOM interfaces, XSLT processing, SAX and
Note that only the description attribute of book ”bk111” is displayed, since the book has both
keywords but only in its description.
You may use library lxml for the homework. Please make sure your script compiles and runs in Python 3.
INF 551 – Fall 2019
1. Python Environment : Python3.6
2. Packages : The Python Standard Library and lxml
3. Submission : __index.py and __search.py
4. Command to Execute Your Code :
5. Output Format :
– For question 1, you can design your own xml structure.
But use as tag for keywords and output a valid xml document, referring to index.xml in 4.
e.g. (you do not need to design exactly like this but use tag for your inverted index)
– For question 2, please strictly follow the output xml format, referring to results.xml in 4.
if searching for ”xml xslt”,
if searching for ”xml”,
if nothing found,
6. Execution Time : suppose to be no more than 1 minute for both questions.
1. If your programs can not be executed with the command specified above, there will be 40% penalty.
2. If your programs can not be executed with the required Python version, there will be 30% penalty.
3. If you use non-standard python packages (except for lxml package), there will be 30% penalty.
4. If not able to find a specified tag, such as , then will be no point for the question.
5. If your .py takes more than 5 minutes for each to complete, there will be 20% penalty.
6. Please do not keep any ”print” statements, they will lead to 10% penalty.
7. Please do not hard-code file names, else 10% penalty. Take all inputs from command line as shown.
8. Late homework will be deducted by 10% for every 24 hours that it is late. (no credit after 72 hours)