Updated: November 1, 2020 For use ONLY with Ubuntu 20.04 For Ubuntu 18.04, use https://inteltechniques.com/osintbook/linux.txt This is the text file with a summary of all REQUIRED steps present in Chapter Five These will assist with the creation of your custom machine and will be updated as things change This file should be downloaded and opened in a text viewer, not viewed in a browser Full usage details are available in the book: https://inteltechniques.com/book1.html Slight variations may be present for Windows/Mac users (such as 'Next' vs. 'Continue') Please send any issues to errors@inteltechniques.com INSTRUCTIONS: Install, configure, and launch VirtualBox Download Ubuntu 20.04 Desktop from https://releases.ubuntu.com/20.04/ Within VirtualBox, click on the button labeled 'New' Provide a name of 'OSINT Master 20 Custom' Choose your desired location to save the machine on your host Select 'Linux' as the type, and 'Ubuntu 64-bit' as the version Click Continue In the Memory size window, move the slider to select 50% of your system memory Click Continue Click Create Leave the hard disk file type as VDI and click Continue Select the default option of 'Dynamically allocated' and click Continue Choose the desired size of your virtual hard drive (20GB+) Click Create Click the Settings icon Click the Storage icon Click the CD icon which displays 'Empty' in the left menu Click the small blue circle to the far right in the 'Optical Drive' option Select 'Choose a Disk File' Select the Ubuntu 20.04 ISO downloaded previously Click 'Open' or Choose' if prompted Click 'OK' If prompted, Select the Ubuntu iso again Click 'Start' in menu Select 'Install Ubuntu' Select your desired language and location, then click 'Continue' Select 'Normal Installation', 'Download Updates', and 'Install third party' Click 'Continue' Select 'Erase disk and install Ubuntu', then 'Install Now'. Confirm with 'Continue' Choose your desired time zone and click 'Continue' Choose a name, user name, computer name, and password of 'osint' for each Select 'Log in automatically' then 'Continue' Allow Ubuntu to complete the installation, and choose 'Restart Now' Click 'Enter' or click on 'Restart Now' until reboot Click 'Skip' then 'Next' Select 'No' and then 'Next' when asked to help improve Ubuntu Click 'Next' then 'Done' to remove the welcome screen If prompted to install updates, click 'Remind me later' In the VirtualBox Menu, select Devices > 'Insert Guest Additions CD Image' Click 'Run' when the dialogue box pops up, provide your password when prompted, then 'Authenticate' Once the process is complete, press enter, and shut down the VM (Upper right) In VirtualBox, select your VM and click 'Settings' In the 'General' icon, click on the 'Advanced' tab Change 'Shared clipboard' and Drag n Drop' to 'Bidirectional' In the 'Display' icon, change the Video Memory to the maximum In the 'Shared Folders' icon, click the green '+' Click the dropdown menu under 'Folder Path' Select 'Other' Choose a desired folder on your host to share data back and forth Select the 'Auto-mount' option and then 'OK' Click 'OK' to close the settings window Click on Start to restart your Ubuntu VM In the left dock, right-click and eject the CD Click the 9 dots (Applications Menu) in the lower left and launch Settings Click 'Notifications' and disable both options Click the 'Privacy' option, then click 'Screen Lock' and disable all options Click 'File History & Trash', then disable the option Click 'Diagnostics', then change to 'Never' Click the back arrow and click Power, changing 'Blank Screen' to 'Never' Click 'Automatic Suspend' and disable the feature Close all Settings windows Open Firefox Click on the menu in the upper right and select 'Preferences' In the General options, uncheck 'Recommend extensions as you browse' In the General options, if present, uncheck 'Recommend features as you browse' In the Home options, change 'Homepage and new windows' and 'New tabs' to 'Blank page' In the Privacy & Security options, select the Strict option under Content Blocking Check the box titled 'Delete cookies and site data when Firefox is closed' Uncheck the box titled 'Ask to save logins and passwords for websites' Change the History setting to 'Firefox will use custom settings for history' Uncheck the boxes 'Remember browsing and download history' and 'Remember search and form history' Check the box titled 'Clear history when Firefox closes' Uncheck 'Browsing history' from the 'Address Bar' menu In the Permissions menu, click 'Settings' next to 'Location, Camera, Microphone' Check the box titled 'Block new requests' on each of these options Uncheck all options under 'Firefox Data Collection and Use' Uncheck all options under 'Deceptive Content and Dangerous Software Protection' Close all menus and return to Firefox Enter 'about:config' into the address field and hit enter Search and change geo.enabled to FALSE Search and change browser.safebrowsing.phishing.enabled to FALSE Search and change browser.safebrowsing.malware.enabled to FALSE Search and change media.navigator.enabled to FALSE Search and change dom.battery.enabled to FALSE Search and change extensions.pocket.enabled to FALSE Search and change network.trr.mode from 0 to 2 Search and change network.security.esni.enabled from False to True Search and change media.peerconnection.enabled to FALSE Search and change media.peerconnection.turn.disable to TRUE Search and change media.peerconnection.use_document_iceservers to FALSE Search and change media.peerconnection.video.enabled to FALSE Search and change devtools.jsonview.enabled to FALSE (If using MJSONViewer below) Click the Firefox menu and choose 'Addons' Search and Install Add-on titled Multi-Account Containers Search and Install Add-on titled uBlock Origin Search and Install Add-on titled DownThemAll Search and Install Add-on titled VideoDownloadHelper Search and Install Add-on titled Full Web Page Screenshots Search and Install Add-on titled Nimbus Search and Install Add-on titled HTTPS Everywhere Search and Install Add-on titled MJSONViewer Search and Install Add-on titled User-Agent Switcher Search and Install Add-on titled OneTab Search and Install Add-on titled Image Search Options Search and Install Add-on titled Resurrect Pages Search and Install Add-on titled Copy Selected Links Search and Install Add-on titled KeePassXC Browser Close Firefox Click the 9 dots (Applications Menu) in the lower left and launch Terminal Execute the following commands sudo adduser osint vboxsf gsettings set org.gnome.desktop.background picture-uri '' sudo snap install vlc sudo apt-get install -y ffmpeg sudo apt-get install -y python3-pip sudo -H pip3 install --upgrade youtube_dl sudo apt install -y curl cd ~/Desktop && curl -u osint:thought -O https://inteltechniques.com/osintbooksecure/vm-files.zip unzip vm-files.zip -d /home/osint/Desktop/ mkdir ~/Documents/scripts mkdir ~/Documents/icons cd ~/Desktop/vm-files/scripts sudo cp * ~/Documents/scripts cd ~/Desktop/vm-files/icons cp * ~/Documents/icons cd ~/Desktop/vm-files/shortcuts sudo cp * /usr/share/applications/ Delete the 'vm-files' file and folder from Desktop if desired cd ~/Downloads mkdir Programs cd Programs sudo -H pip3 install Instalooter sudo -H pip3 install Instaloader sudo apt install -y git git clone https://github.com/twintproject/twint.git cd twint sudo -H pip3 install twint sudo -H pip3 install -r requirements.txt cd ~/Downloads/Programs git clone https://github.com/ChrisTruncer/EyeWitness.git cd EyeWitness/Python/setup sudo -H ./setup.sh cd ~/Documents/scripts sed -i "s/Programs\/EyeWitness/Programs\/EyeWitness\/Python/g" eyewitness.sh cd ~/Downloads/Programs sudo snap install amass git clone https://github.com/aboul3la/Sublist3r.git cd Sublist3r && sudo -H pip3 install -r requirements.txt cd ~/Downloads/Programs git clone https://github.com/s0md3v/Photon.git cd Photon && sudo -H pip3 install -r requirements.txt cd ~/Downloads/Programs git clone https://github.com/laramies/theHarvester.git cd theHarvester git checkout 8b88a66 sudo -H pip3 install -r requirements.txt cd ~/Downloads/Programs sudo python3 -m pip install pipenv sudo apt-get install -y mediainfo-gui sudo apt install -y libimage-exiftool-perl sudo apt-get install -y webhttrack sudo wget -O google-earth64.deb http://dl.google.com/dl/earth/client/current/google-earth-stable_current_amd64.deb sudo dpkg -i google-earth64.deb sudo apt-get -f install; sudo rm google-earth64.deb sudo snap install keepassxc sudo apt install -y kazam cd ~/Documents/scripts/ sed -i "s/python3\.6/python3/g" domains.sh sed -i "s/python\ sublist3r/python3\ sublist3r/g" domains.sh sed -i "s/pip\ install/pip3\ install/g" updates.sh sed -i "s/sudo\ pip3/sudo\ \-H\ pip3/g" updates.sh pip3 install --upgrade pip cd ~/Downloads/Programs git clone https://github.com/opsdisk/metagoofil.git cd metagoofil sudo -H pip3 install -r requirements.txt cd ~/Downloads/Programs git clone https://github.com/lanmaster53/recon-ng.git cd recon-ng sudo -H pip3 install -r REQUIREMENTS cd ~/Downloads/Programs git clone https://github.com/sherlock-project/sherlock.git cd sherlock python3 -m pip install -r requirements.txt cd ~/Documents/scripts/ sed -i 's/Programs\/sherlock/Programs\/sherlock\/sherlock/g' sherlock.sh cd ~/Downloads/Programs git clone https://github.com/smicallef/spiderfoot.git cd spiderfoot sudo -H pip3 install -r requirements.txt cd ~/Documents/scripts sed -i '/^sudo/ d' spiderfoot.sh sed -i '/^firefox/ d' spiderfoot.sh echo "cd ~/Downloads/Programs/spiderfoot" >> spiderfoot.sh echo "python3 sf.py -l 127.0.0.1:5001 &" >> spiderfoot.sh echo "sleep 5" >> spiderfoot.sh echo "firefox http://127.0.0.1:5001" >> spiderfoot.sh cd ~/Downloads/Programs git clone https://github.com/AmIJesse/Elasticsearch-Crawler.git cd Elasticsearch-Crawler sudo -H pip3 install nested-lookup sudo -H pip3 install internetarchive Right-click any undesired icons from the dock and select 'Remove from Favorites' Click the '9 dots', and right-click any desired applications to 'add to favorites' (dock) Shut down the VM and create a snapshot or clone if desired Apply Application Updates: Launch the Software Updater application Click 'Install Now' and allow the updates to complete In Terminal, enter the following: sudo apt update sudo apt -y upgrade sudo snap refresh sudo apt update --fix-missing sudo apt --fix-broken install sudo -H python3 -m pip install pip -U sudo -H python3 -m pip install youtube-dl -U sudo -H python3 -m pip install instalooter -U sudo -H python3 -m pip install Instaloader -U sudo -H python3 -m pip install nested-lookup -U sudo -H python3 -m pip install pipenv -U sudo -H python3 -m pip install internetarchive -U sudo -H python3 -m pip install waybackpy -U cd ~/Downloads/Programs/EyeWitness git pull https://github.com/ChrisTruncer/EyeWitness.git cd Python/setup && sudo -H ./setup.sh cd ~/Downloads/Programs/Sublist3r git pull https://github.com/aboul3la/Sublist3r.git sudo -H python3 -m pip install -r requirements.txt cd ~/Downloads/Programs/Photon git pull https://github.com/s0md3v/Photon.git sudo sudo -H python3 -m pip install -r requirements.txt cd ~/Downloads/Programs/theHarvester git pull https://github.com/laramies/theHarvester.git sudo -H python3 -m pip install -r requirements.txt cd ~/Downloads/Programs/sherlock git pull https://github.com/sherlock-project/sherlock.git sudo -H python3 -m pip install -r requirements.txt cd ~/Downloads/Programs/metagoofil git pull https://github.com/opsdisk/metagoofil.git sudo -H python3 -m pip install -r requirements.txt cd ~/Downloads/Programs/recon-ng git pull https://github.com/lanmaster53/recon-ng.git sudo -H python3 -m pip install -r REQUIREMENTS cd ~/Downloads/Programs/spiderfoot git pull https://github.com/smicallef/spiderfoot.git sudo -H python3 -m pip install -r requirements.txt cd ~/Downloads/Programs/Elasticsearch-Crawler git pull https://github.com/AmIJesse/Elasticsearch-Crawler.git sudo apt autoremove -y