Updated: November 1, 2020
For use ONLY with Ubuntu 18.04
For Ubuntu 20.04, use https://inteltechniques.com/osintbook/linux.20.txt
This is the text file with a summary of all REQUIRED steps present in Chapter Five.
These will assist with the creation of your custom machine and will be updated as things change
This file should be downloaded and opened in a text viewer, not viewed in a browser
Full usage details are available in the book: https://inteltechniques.com/book1.html
Slight variations may be present for Windows/Mac users (such as 'Next' vs. 'Continue')
Please send any issues to errors@inteltechniques.com

INSTRUCTIONS:

Install, configure, and launch VirtualBox according to the directions within the book
Download Ubuntu 18.04 from https://releases.ubuntu.com/18.04.4/ubuntu-18.04.4-desktop-amd64.iso
Within VirtualBox, click on the button labeled 'New'
Provide a name of 'OSINT Master'
Choose your desired location to save the machine on your host
Select 'Linux' as the type, and 'Debian 64-bit' as the version
Click Continue
In the Memory size window, move the slider to select 50% of your system memory
Click Continue
Click Create
Leave the hard disk file type as VDI and click Continue
Select the default option of 'Dynamically allocated' and click Continue
Choose the desired size of your virtual hard drive (20GB+)
Click Create
Click the Settings icon
Click the Storage icon
Click the CD icon which displays 'Empty' in the left menu
Click the small blue circle to the far right in the 'Optical Drive' option
Select 'Choose Virtual Optical Disk File'
Select the Ubuntu 18.04 ISO downloaded previously
Click 'OK'
If prompted, Select the Ubuntu iso again
Click 'Start' in menu
Select 'Install Ubuntu'
Select your desired language and location, then click 'Continue'
Select 'Normal Installation', 'Download Updates', and 'Install third party'
Click 'Continue'
Select 'Erase disk and install Ubuntu', then 'Install Now'. Confirm with 'Continue'
Choose your desired time zone and click 'Continue'
Choose a name, user name, computer name, and password of 'osint' for each
Select 'Log in automatically'
Allow Ubuntu to complete the installation, and choose 'Restart Now'
Click 'Enter' or click on 'Restart Now' until reboot
Click 'Next' twice
Select 'No' and then 'Next' when asked to help improve Ubuntu
Click 'Done' to remove the welcome screen
If prompted to install updates, click 'Remind me later'
In the VirtualBox Menu, select Devices > 'Insert Guest Additions CD Image'
Click 'Run' when the dialogue box pops up, provide your password when prompted
Once the process is complete, press enter, and shut down the VM (Upper right)
In VirtualBox, select your VM and click 'Settings
In the 'General' icon, click on the 'Advanced' tab
Change 'Shared clipboard' and Drag n’ Drop' to 'Bidirectional'
In the 'Display' icon, change the Video Memory to the maximum
In the 'Shared Folders' icon, click the green '+'
Click the dropdown menu under 'Folder Path'
Select 'Other'
Choose a desired folder on your host to share data back and forth
Select the 'Auto-mount' option and then 'OK'
Click 'OK' to close the settings window
Click on Start to restart your Ubuntu VM
Right-click and eject the CD on the Desktop
In Terminal, type sudo adduser osint vboxsf
Right-click on the Desktop and select 'Change Background'
Click the 'Background' image and then 'Colors'
Choose a solid color of preference
Repeat the process with the 'Lock Screen' image
Back in the 'Settings' menu, click 'Notifications' and disable both options
Click the 'Privacy' option, then click 'Screen Lock' and disable the option
Close the window and click 'Usage and History', then disable the option
Close the window and click 'Problem Reporting', then disable the option
Close the window and click Power, changing 'Blank Screen' to 'Never'
Click 'Automatic Suspend' and disable the feature
Close all open windows
Right-click any undesired icons from the dock and select 'Remove from Favorites'
Click the nine small dots in the lower left to launch the Applications menu
Type Terminal in the search field and click on the application
Type: sudo apt purge ubuntu-web-launchers, click 'Y' when prompted
Click the nine dots to launch the Applications option
Type Terminal into the search field
Right-click on the application and select 'Add to Favorites'
Type Software into the search field and right-click on 'Software Updater'
Select 'Add to Favorites'
Press escape until all windows are gone
Launch the Software Updater icon from the Dock
Click 'Install Now' and allow the updates to complete
Open Firefox
Click on the menu in the upper right and select 'Preferences'
In the General options, uncheck 'Recommend extensions as you browse'
In the General options, if present, uncheck 'Recommend features as you browse'
In the Home options, change 'Homepage and new windows' and 'New tabs' to 'Blank page'
In the Privacy & Security options, select the Strict option under Content Blocking
Check the box titled 'Delete cookies and site data when Firefox is closed'
Uncheck the box titled 'Ask to save logins and passwords for websites'
Change the History setting to 'Firefox will use custom settings for history'
Uncheck the boxes 'Remember browsing and download history' and 'Remember search and form history'
Check the box titled 'Clear history when Firefox closes'
Uncheck 'Browsing history' from the 'Address Bar' menu
In the Permissions menu, click 'Settings' next to 'Location, Camera, Microphone'
Check the box titled 'Block new requests' on each of these options
Uncheck all options under 'Firefox Data Collection and Use'
Uncheck all options under 'Deceptive Content and Dangerous Software Protection'
Close all menus and return to Firefox
Enter 'about:config' into the address field and hit enter
Search and change geo.enabled to FALSE
Search and change browser.safebrowsing.phishing.enabled to FALSE
Search and change browser.safebrowsing.malware.enabled to FALSE
Search and change media.navigator.enabled to FALSE
Search and change dom.battery.enabled to FALSE
Search and change extensions.pocket.enabled to FALSE
Search and change network.trr.mode from 0 to 2
Search and change network.security.esni.enabled from False to True
Search and change media.peerconnection.enabled to FALSE
Search and change media.peerconnection.turn.disable to TRUE
Search and change media.peerconnection.use_document_iceservers to FALSE
Search and change media.peerconnection.video.enabled to FALSE
Search and change devtools.jsonview.enabled to FALSE (If using MJSONViewer below)
Click the Firefox menu and choose 'Addons'
Search and Install Add-on titled Multi-Account Containers
Search and Install Add-on titled uBlock Origin
Search and Install Add-on titled DownThemAll
Search and Install Add-on titled VideoDownloadHelper
Search and Install Add-on titled Full Web Page Screenshots
Search and Install Add-on titled Nimbus
Search and Install Add-on titled HTTPS Everywhere
Search and Install Add-on titled MJSONViewer
Search and Install Add-on titled User-Agent Switcher
Search and Install Add-on titled OneTab
Search and Install Add-on titled Image Search Options
Search and Install Add-on titled Resurrect Pages
Search and Install Add-on titled Copy Selected Links
Search and Install Add-on titled KeePassXC Browser
Close Firefox and open Terminal
sudo snap install vlc
sudo apt-get install ffmpeg (press Y)
sudo apt-get install python-pip (press Y)
sudo apt-get install python3-pip (press Y)
sudo -H pip install --upgrade youtube_dl (press Y)
Download https://inteltechniques.com/osintbooksecure/vm-files.zip to VM Desktop
Right-click file and choose 'Extract here'
mkdir ~/Documents/scripts
mkdir ~/Documents/icons
cd ~/Desktop/vm-files/scripts
sudo mv * ~/Documents/scripts
cd ~/Desktop/vm-files/icons
sudo mv * ~/Documents/icons
cd ~/Desktop/vm-files/shortcuts
sudo mv * /usr/share/applications/
Delete vm-files file and folder from Desktop
Open Applications menu
Right-click Domains, EyeWitness, Instagram, Twitter, and Video Utilities/Download
Choose 'Add to Favorites'
cd ~/Downloads
mkdir Programs
cd Programs
sudo -H pip install Instalooter
sudo -H pip3 install Instaloader
sudo -H apt install git (press Y)
git clone https://github.com/twintproject/twint.git
cd twint
sudo python3 setup.py install
cd ~/Downloads/Programs
git clone https://github.com/ChrisTruncer/EyeWitness.git
cd EyeWitness/Python/setup
sudo -H ./setup.sh
cd ~/Documents/scripts
sed -i "s/Programs\/EyeWitness/Programs\/EyeWitness\/Python/g" eyewitness.sh
sudo apt-get install xvfb
cd ~/Downloads/Programs
sudo snap install amass
git clone https://github.com/aboul3la/Sublist3r.git
cd Sublist3r && sudo -H pip install -r requirements.txt
sudo apt-get install python-argparse
cd ~/Downloads/Programs
git clone https://github.com/s0md3v/Photon.git
cd Photon && sudo -H pip3 install -r requirements.txt
cd ~/Downloads/Programs
git clone https://github.com/laramies/theHarvester.git
cd theHarvester
git checkout 8b88a66
sudo -H pip3 install -r requirements.txt
sudo apt-get install mediainfo-gui (press Y)
sudo apt install libimage-exiftool-perl (press Y)
sudo apt-get install webhttrack (press Y)
sudo wget -O google-earth64.deb http://dl.google.com/dl/earth/client/current/google-earth-stable_current_amd64.deb
sudo dpkg -i google-earth64.deb
sudo apt-get -f install; sudo rm google-earth64.deb
sudo snap install keepassxc
sudo apt install kazam (press Y)
Shut down the VM from the menu in the upper right of the Desktop.

Apply Updates:

sudo apt-get update
sudo apt-get upgrade
sudo -H pip install --upgrade youtube-dl
sudo -H pip install instalooter -U
sudo -H pip3 install Instaloader -U
sudo -H pip3 install Twint -U
cd ~/Downloads/Programs/EyeWitness
git pull https://github.com/ChrisTruncer/EyeWitness.git
cd Python/setup && sudo -H ./setup.sh
cd ~/Downloads/Programs/Sublist3r
git pull https://github.com/aboul3la/Sublist3r.git
sudo -H python3 -m pip install -r requirements.txt
cd ~/Downloads/Programs/Photon
git pull https://github.com/s0md3v/Photon.git
sudo sudo -H python3 -m pip install -r requirements.txt
sudo snap refresh

Metagoofil:

cd ~/Downloads/Programs
git clone https://github.com/opsdisk/metagoofil.git
cd metagoofil
sudo -H pip3 install -r requirements.txt

Update Metagoofil :

cd ~/Downloads/Programs/metagoofil
git pull https://github.com/opsdisk/metagoofil.git
sudo -H pip3 install -r requirements.txt

RipMe:

sudo apt install default-jre
Download 'ripme.jar' from github.com/ripmeapp/ripme/releases to 'Downloads'
Right-click this file and choose 'Properties'
In the Permissions tab, select 'Allow executing file'

Recon-ng:

cd ~/Downloads/Programs
git clone https://github.com/lanmaster53/recon-ng.git
cd recon-ng
sudo -H pip3 install -r REQUIREMENTS
./recon-ng
Press Ctrl-C to exit Recon-ng

Update Recon-ng:

cd ~/Downloads/Programs/recon-ng
git pull https://github.com/lanmaster53/recon-ng.git
sudo -H pip3 install -r REQUIREMENTS

Skiptracer

cd ~/Downloads/Programs
git clone https://github.com/xillwillx/skiptracer.git
cd skiptracer
sudo -H pip install -r requirements.txt

Update Skiptracer

cd ~/Downloads/Programs/skiptracer
git pull https://github.com/xillwillx/skiptracer.git
sudo -H pip install -r requirements.txt

Sherlock:

cd ~/Downloads/Programs
git clone https://github.com/sherlock-project/sherlock.git
cd sherlock
python3 -m pip install -r requirements.txt

Update Sherlock:

cd ~/Downloads/Programs/sherlock
git pull https://github.com/sherlock-project/sherlock.git
python3 -m pip install -r requirements.txt

Spiderfoot:

cd ~/Downloads/Programs
git clone https://github.com/smicallef/spiderfoot.git
cd spiderfoot
sudo -H pip3 install -r requirements.txt
cd ~/Documents/scripts
sed -i '/^sudo/ d' spiderfoot.sh
sed -i '/^firefox/ d' spiderfoot.sh
echo "cd ~/Downloads/Programs/spiderfoot" >> spiderfoot.sh
echo "python3 sf.py -l 127.0.0.1:5001 &" >> spiderfoot.sh
echo "sleep 5" >> spiderfoot.sh
echo "firefox http://127.0.0.1:5001" >> spiderfoot.sh

Update Spiderfoot:

cd ~/Downloads/Programs/spiderfoot
git pull https://github.com/smicallef/spiderfoot.git
sudo -H pip3 install -r requirements.txt

Elasticsearch Crawler:

cd ~/Downloads/Programs
git clone https://github.com/AmIJesse/Elasticsearch-Crawler.git
cd Elasticsearch-Crawler
sudo -H pip install nested-lookup

Update Elasticsearch Crawler :
cd ~/Downloads/Programs/Elasticsearch-Crawler
git pull https://github.com/AmIJesse/Elasticsearch-Crawler.git

InternetArchive:

sudo -H pip install internetarchive

Update InternetArchive:

sudo -H pip install internetarchive -U

Update Pip:

pip install --upgrade pip
pip3 install --upgrade pip

Update Script:

#!/usr/bin/env bash
##Updates Script

sudo apt update
sudo apt -y upgrade
sudo snap refresh
sudo apt update --fix-missing
sudo apt --fix-broken install
sudo -H python3 -m pip install pip -U
sudo -H python3 -m pip install youtube-dl -U
sudo -H python3 -m pip install instalooter -U
sudo -H python3 -m pip install Instaloader -U
sudo -H python3 -m pip install nested-lookup -U
sudo -H python3 -m pip install pipenv -U
sudo -H python3 -m pip install internetarchive -U
sudo -H python3 -m pip install waybackpy -U
cd ~/Downloads/Programs/EyeWitness
git pull https://github.com/ChrisTruncer/EyeWitness.git
cd Python/setup && sudo -H ./setup.sh
cd ~/Downloads/Programs/Sublist3r
git pull https://github.com/aboul3la/Sublist3r.git
sudo -H python3 -m pip install -r requirements.txt
cd ~/Downloads/Programs/Photon
git pull https://github.com/s0md3v/Photon.git
sudo sudo -H python3 -m pip install -r requirements.txt
cd ~/Downloads/Programs/theHarvester
git pull https://github.com/laramies/theHarvester.git
sudo -H python3 -m pip install -r requirements.txt
cd ~/Downloads/Programs/sherlock
git pull https://github.com/sherlock-project/sherlock.git
sudo -H python3 -m pip install -r requirements.txt
cd ~/Downloads/Programs/metagoofil
git pull https://github.com/opsdisk/metagoofil.git
sudo -H python3 -m pip install -r requirements.txt
cd ~/Downloads/Programs/recon-ng
git pull https://github.com/lanmaster53/recon-ng.git
sudo -H python3 -m pip install -r REQUIREMENTS
cd ~/Downloads/Programs/spiderfoot
git pull https://github.com/smicallef/spiderfoot.git
sudo -H python3 -m pip install -r requirements.txt
cd ~/Downloads/Programs/Elasticsearch-Crawler
git pull https://github.com/AmIJesse/Elasticsearch-Crawler.git
sudo apt autoremove -y