Project-Treasure-island

Software Development tool concepts:

1. Named Entities Extraction:

Input: .pdf document

Output: Rendering of the document text with Named entities extracted

This is Jupyter notebook for processing .pdf documents and html webpages and extracting names entities

Backend database is SQL

All data processing is done in python

Required Libraries:

1. Spacy
  Displacy renders the text into the named entity format
2. Collections
3. en_core_web_sm
4. pprint
  Print the outputs as aesthetically pleasing (not required)
5. tkinter
  Prompt the user to select the disired PDF
6. PyPDF2
  Parse the pdf
7. requests
  To get the infomation from the provided url
8. re
9. BeautifulSoup

2. Image extraction:

Input: Directory of .pdf documents

Output:Gallery of all the images extracted from the .pdfs

This is a web-based application developed in Django that extracts all the images from .pdf documents, stores them in a local media folder

Backend database is SQL

All data processing is done in python

Required Libraries:

1. Django: Full stack web development framework 
  Install with: pip install django
2. PyMuPDF (fitz) 
  - https://pypi.org/project/PyMuPDF/#files
  - install with: pip install PyMuPDF
  - import fitz
3. io
  - from io import BytesIO 
4. PIL 
  - form PIL import Image
5. filetype
  - Install with: pip install filetype
  - import filetype
6. os
  - import os
  
  What does PyMuPDF do?
  processes .pdfs and allows user to extract text and images, search for text, render pages, etc.

3. Mathematical Language Processing:

Input: .pdf document Output: ...