Skip to content

You will find a wealth of resources to help with your Website investigations.

Notifications You must be signed in to change notification settings

The-Osint-Toolbox/Website-OSINT

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 

Repository files navigation

Website-OSINT



Welcome to my website Osint repository. Some of the resources, require you to sign up for an account but they will offer a free amount of monthly searches and an API key. Some will offer free searches without the need to sign up however they may not provide you with the full result of your request. Some resources will offer you everything they find on a website.

If you are thinking of using an OSINT tool such as Spiderfoot, it is worth obtaining API keys so that Spiderfoot can automate your website research for you.

ICANN
  • ARIN
  • American Registry for Internet Numbers.

  • ICANN Lookup
  • Anytime you register a domain on the Internet, you go through a domain name registrar, who pays a small fee to ICANN to register your domain.

  • Nominet
  • Nominet UK is currently delegated by IANA to be the manager of the .uk domain name.



Archive Resources
  • 12ft
  • Will attempt to show content from a paywalled site by using the cached, unpaywalled version of the page.

  • Archive Today
  • You can use this site to view saved snapshots of a website or manually save a snapchat.

  • Aware-Online
  • A tool to create targeted searches for archived texts, videos, audio, software and images from the internet.

  • Cached Pages
  • Get the cached page of any URL.

  • Cached View
  • Enter your URL here to get its current status and view any cached/archived results.

  • Cached Views
  • Cached view of any page on Internet through multiple cached sources.

  • Cipher 387
  • Quick cache and archive multi search resource.

  • Distill
  • Tracking website updates, automated and simplified.

  • Follow That Page
  • Follow That Page is a change detection and notification service that sends you an email when your favourite web pages have change.

  • Ghost Archive
  • Ghostarchive is a free-to-use archiving website designed to be fast and easy to use.

  • HTTrack
  • HTTrack is a free (GPL, libre/free software) and easy-to-use offline browser utility. It allows you to download a World Wide Web site.

  • PDF a URL
  • Quickly and easily convert any URL or raw HTML into a high-quality PDF

  • Quick Viewer
  • Quick archive.org viewer.

  • UK Web Archive
  • Use this site to discover old or obsolete versions of UK websites.

  • Waymore
  • The idea behind waymore is to find even more links from the Wayback Machine than other existing tools.

  • Wayback Machine
  • Internet Archive is a non-profit library of millions of free books, movies, software, music, websites, and more.



Similar Site Resources


Website Investigation Resources
  • AI Scraper
  • Easily scrape and summarize web content using advanced AI model

  • Awesome Tech Stack
  • Awesome Tech Stack's offers in-depth technology analysis of a website.

  • Blacklight
  • Blacklight will scan a website and reveal the specific user-tracking technologies on the site.

  • Built With
  • Find out what websites are Built With.

  • Carbon 14
  • OSINT dating tool for web pages.

  • Censys
  • Helps information security practitioners discover, monitor, and analyze devices that are accessible from the Internet.

  • Central Ops
  • Investigate domains and IP addresses. Get registrant information, DNS records, and more—all in one report.

  • Check Host
  • Check-Host.net is an online tool for checking availability of websites, servers, hosts and IP addresses. It provides domain and IP address location data from a few geolocation IP databases and whois as well.

  • Chiasmodon
  • Chiasmodon is an OSINT tool designed to assist in the process of gathering information about a target domain.

  • Cmlabs
  • Cmlabs, lets you find out what technologies websites have.

  • Crt.sh
  • Certificate search engine.

  • Cybernews Website Security Checker
  • This free website vulnerability scanner tests a website for potential security flaws.

  • Cyber X-Ray
  • Classifies the domains on the Internet according to their “historical and relational data.”

  • DNS Dumpster
  • Dns recon & research, find & lookup dns records.

  • DNS Lytics
  • See detailed information about every IP Address, Domain Name and Provider.

  • DNS Spy
  • Monitor, validate and verify your DNS configurations.

  • DNS Twister
  • The anti-phishing domain name search engine and DNS monitoring service.

  • Domain Digger
  • Get details about any Domain.

  • DownDetector
  • Real-time problem & outage monitoring.

  • Down For Everyone
  • This site checks if a website is down for everyone or just you.

  • Fredirect
  • Follow URLs redirects.

  • GlimpseHQ
  • Get a glimpse of the marketing activity of your competitors.

  • Google Admin Toolbox
  • Google Admin Toolbox has a suite of tools to help you analyse a website.

  • Google Search Console
  • Google Search Console (formerly Google Webmaster Tools) is a web service by Google which allows webmasters to check indexing status, search queries, crawling errors and optimize visibility of their websites.

  • Information Laundromat
  • Tool used to determine if and how websites share architecture and content.

  • IPVoid
  • Popular toolkit resources for researching websites.

  • Larger
  • Larger uncovers the technologies used on websites.

  • Lookyloo
  • Website forensic tool for analysing links and redirects on a website. You can also search for previous website analyse.

  • Mobile Freindly
  • Google's mobile friendly test, see how a website renders on a mobile.

  • MX Toolbox
  • MX Toolbox has a another suite of tools to help you analyse a website.

  • PageXray
  • Analyse a website for links, ads, trackers, download results and save a screenshot of the webpage.

  • Phish Stats
  • Gathering, enhancing and sharing phishing information with the infosec community.

  • Phish Tank.
  • PhishTank is a collaborative clearing house for data and information about phishing on the Internet.

  • Phonebook
  • Phonebook lists all domains, email addresses, or URLs for the given input domain.

  • Photon
  • Website crawler designed for OSINT.

  • Publicwww
  • Source code search engine.

  • Shimon
  • URL fingerprinting made easy.

  • Site 24x7
  • Free tools for network, DevOps and site reliability engineers

  • Spy On Web
  • Spy On Web is a free online service that allows you to identify all websites that might belong to the same owner.

  • Synapslnnt
  • The unified OSINT research tool.

  • URL DNA
  • Web analysis tool designed to provide in-depth insights into websites.

  • Urlscan
  • Urlscan.io is a free service to scan and analyse websites.

  • Uscrapper
  • Extract valuable insights with ease and efficiency, from both surface and deep web sources.

  • Validin
  • Validin offers cutting-edge DNS, certificate, and crawling data services to empower threat researchers and corporate security teams.

  • View DNS
  • ViewDNS.info allow users to gather a large amount of data about a given website or IP address./p>

  • VirusTotal
  • Analyse suspicious files, domains, IPs and URLs to detect malware and other breaches, automatically share them with the security community.

  • Visual Ping
  • Monitors website for any changes and notifies you by email.

  • Visual Site Mapper.
  • Visual Site Mapper is a free service that can quickly show a map of a website.

  • Wappalyzer
  • Find out the technology stack of any website. Create lists of websites that use certain technologies.

  • Web Check
  • Analyse a website, server location, crawl rules, DNS record, SSL info etc.

  • Website Down
  • Website Down status checker tool to test any site's reachability in real-time.

  • Website Informer
  • Get a quick aggregated view of everything the Web can promptly tell you about a website.



       
Favicon Resources
  • Favicon Hasher
  • Fav Icon Hasher can search various search engines to locate additional assets that might be associated with the target web application.

  • Favicorn
  • All-sources tool to search websites by favicons.

  • Fav-Up
  • Favicon lookup using Shodan.



Whois & IP Resources
  • BigDomainData
  • Reverse Whois lookup.

  • Cloudcheck
  • A simple Python utility to check whether an IP address belongs to a cloud provider.

  • Domain Tools
  • Find all the domains hosted on a given IP address.Track the domains that come and go.

  • DREWS
  • Ability to identify unauthorised domain registrations.

  • I Know What You Download
  • Monitors torrent IP traffic around the clock and makes everything public.

  • IP.me
  • Proton's IP & Whois lookup site.

  • Host io
  • A powerful and fast domain name data API.

  • Maxmind
  • This link will take you to Maxmind's GeoIP2 search where you can enter upto 25 IP addresses.

  • My IP
  • Find Hosting Company On Any Website / Owner on Any IP Address

  • RDAP
  • The Registration Data Access Protocol (RDAP) is the successor to WHOIS. Like WHOIS, RDAP provides access to information about Internet resources.

  • Registration Data Request Service
  • This service connects requestors seeking nonpublic registration data with the relevant ICANN-accredited registrars.

  • Robtex
  • Robtex is used for various kinds of research of IP numbers, Domain names, etc.

  • Seon
  • Seon is a fraud prevention tool that allows you to check an emails, IP or telephone number.

  • Synapsint
  • Synapsint is a tool that allows you to collect information from different open sources on the Internet about a target such as a domain, an IP address, an email, a phone number and a Bitcoin wallet.

  • Tor Whois
  • TorWhois Onion Search.

  • Whoisology
  • Deep connections between domain names & their owners.

  • WhoisXML Domain Suite
  • This link will take you to the login page, where you can create a free account. The links below offer WhoisXML limited data without the need to log in.

  • WhoisXML DNS
  • A complete DNS records lookup product line to check the NS, MX, SPF, A, SOA, TXT, etc.

  • WhoisXML IP Geolocation
  • IP geolocation tools to find someone’s exact IP address location.

  • WhoisXML IP Range
  • Gather details about the IP range of a specific IP address such as its netblock borders, last update, organization name, country code, abuse contact information.

  • WhoisXML Whois Overview
  • WHOIS data domain name, IP address, or email account

  • WhoisXML Whois History
  • WHOIS History Lookup: Access domain name ownership history.

  • Whoxy
  • Search by domain, keyword, email address, company name.



URL Shortener Resources


About

You will find a wealth of resources to help with your Website investigations.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published