Skip to content

asabayxx/mylinks

BranchesTags
 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
README.md
README.md
 
 

Repository files navigation

My Links

Table of Contents

Tools by Category

General IT News

Linux News and Articles

Linux Message Boards and Forums

Asset Management

  • Asset Inventory and Job Tracking (IRMA) - Asset tracking and trouble ticketing system with barcode and LDAP/AD interface capabilities
  • Clusto - Inventory tracking and "cluster management" system
  • Collins - Infrastructure source of truth, created by Tumblr
  • Fusion Inventory - Mulit-lingual
  • Genesis - Hardware discovery, by Tumblr, can report to Collins
  • GestioIP - IP address management (IPAM), web based, supports discovery
  • GLPI - Also provides license management, software auditing, and ticketing
  • HostDB - New tool to help manage data center inventory
  • IP Plan - IPAM written in PHP
  • IT ITems DataBase (ITDB) - Includes purchase order management, floor plans, and ISO20000-like features
  • Network UPS Tools - Manage power devices from over 100 manufacturers using a single web interface
  • OCS Inventory NG (OCS-NG) - Automated inventory, deployment system, can sync with GLPI
  • openDCIM - Data center infrastructure management
  • phpIPAM - Written in perl. No, Ruby. No, Perl. Probably PHP
  • RackMonkey - No longer under development as of 2013
  • RackTables - Data center asset management, highly recommended
  • racktables-contribs - RackTables user-contributed plugins
  • Ralph - DCIM and CMDB, supports auto-discovery
  • rho - Scans for and gathers information about Linux and Unix servers
  • Snipe IT - Uses Bootstrap, web based, supports mobile
  • Tracmor - Web-based inventory and asset tracking system written in PHP 5 utilizing the Qcodo Framework

AWS Tools

  • awstools - Some handy AWS tools and scripts that use boto3 and troposphere
  • boto3 - Python library for interfacing with AWS, aka AWS SDK for Python
  • CASTER - Chrome extension that automatically re-logs into AWS via ADFS before credentials expire
  • CloudBerry Explorer - Windows client for accessing AWS S3 buckets -- freeware, closed source
  • Developer Tools - 3rd party tools for AWS - not screened or supported by Amazon
  • ec2dns - CLI tools to display public host names of instances and SSH into them via their tag
  • ElasticWolf - Client-side GUI for managing AWS, has versions for Windows/Mac/Linux/Firefox
  • haproxy-autoscale - Wrapper for haproxy that handles auto-scaling EC2 instances
  • JAWS Stack - Javascript + AWS stack, the entire backend is Lambda functions, server-free
  • kappa - CLI tool that makes it easier to deploy, update, and test Lambda functions
  • s3cmd - Backup to AWS via the command line
  • Sneaker - Store secrets on S3 using Amazon KMS
  • StarCluster - Toolkit for using AWS for high performance computing (HPC)
  • Tools for Amazon Web Services - Amazon's portal for their official tools
  • troposphere - Python library to create CloudFormation descriptions

Backups

  • Amanda - The classic
  • Attimatic - Wrapper for attic to make it easier and more reliable
  • Attic - Written in Python
  • Backupninja - Centralize way to configure and schedule many different backup utilities
  • BackUp and Restore Program (BURP) - Reduces network traffic and the amount of space required by using librsync
  • BackupPC - Dedupe and a web GUI for restores
  • Backup - RubyGem for backup and restore, supports tons of platforms and notifiers (RDBMS, S3, Dropbox, rsync, Hipchat, Zabbix)
  • Bacula - Open source backup tool, lots of downloads so I guess it's good I don't know
  • Back in Time - Similar to TimeMachine, simple GUI backup program
  • bup - Uses the git packfile format, supports global dedupe, can use "par2" redundancy
  • Deja Dup - GUI for duplicity
  • Disk ARchive (DAR) - Better than tar, focuses on disks instead of tapes
  • Duplicati - Supports encryption and dedupe
  • Duplicity - Encrypted bandwidth-efficient backup using the rsync algorithm
  • Fpart - Packs file systems into "partitions" so you can do multi-threaded or multi-node rsyncs
  • FSArchiver - Save the contents of a file system to a compressed archive, if one of the checksums doesn't match the file is lost, not the whole backup
  • Grsync - GUI for rsync
  • lsyncd - Watches a local directory trees event monitor interface (inotify or fsevents) and kicks off an rsync when things change
  • Mondo Rescue - Disaster recovery, supports tapes, disks, network and CD/DVD as backup media, multiple filesystems, LVM, software and hardware RAID
  • Obnam - Snapshots, dedupe, encryption
  • rdiff-backup - Combines the best features of a mirror and an incremental backup in a bandwidth efficient manner
  • Redo Backup and Recovery - Simple bare metal backup and restore
  • Relax and Recover (REAR) - BMR, simple
  • rsnapshot - Uses rsync and hard links, can keep multiple full backups available while using very little disk space
  • SafeKeep - Superb project, uses LVM snapshots
  • SnapRAID - Backup program that also stores RAID parity information
  • UrBackup - Supports Windows, has a web interface
  • wal-e - Simple continuous archiving for Postgres
  • zpaq - Free incremental and journaling command-line archiver, supports Windows

Bootable USB Tools

Configuration Management and Orchestration

  • Ansible - CM and orchestration, also can do provisioning
  • Ansible Galaxy - Community site for finding, reusing, and sharing Ansible content
  • Archipel - Push notifications to virtualization orchestration using XMPP
  • Awesome Chef - A curated list of amazingly awesome Chef resources
  • Batou - Define and perform automated service deployments
  • Berkshelf - Like Bundler for Chef cookbooks, manages dependencies
  • Blueprint - Reverse engineer a server configuration
  • BOSH - Cloud orchestration, supports Docker containers too
  • Boxen - Focused on Mac / OS X
  • Capistrano - Run scripts/commands and push software using SSH, a RubyGem, uses a Rake DSL
  • Chef - Well known configuration management tool
  • chef-handlers - Log failures to IRC and send metrics to Graphite (including deploys)
  • chef-relevant-test - Runs Test Kitchen tests only on the parts of your code that changed (rather than the full suite)
  • ChefScripts - Quickly parse the Chef run log to get the resources updated recently, in chronological order
  • Chef Development Kit (ChefDK) - Includes Berkshelf, Test Kitchen, ChefSpec, Foodcritic, Knife, Chef Zero, Ohai, and more
  • Chef Supermarket (community) - Massive collection of cookbooks
  • Chef Supermarket (private) - Community cookbook repository for Chef, can be hosted internally
  • ElasticBox - Create your own catalog of applications and infrastructure components then build, deploy, and go
  • Fabric - Python library, uses SSH
  • grocery-delivery - Utility for managing cookbook uploads to distributed Chef backends, by Facebook
  • hiera-eyaml - Backend for Hiera that provides per-value encryption of sensitive data within Puppet yaml files
  • Juju - Ubuntu focused but works on RHEL / CentOS now
  • kitchen-puppet - Test Kitchen provisioner for Puppet
  • knife-backup - Knife plugin to help backup and restore a Chef server
  • knife-sharp - Adds features such as data bag/environment/role sync & backup
  • Knife Community Plugins - List of community written plugins for Knife
  • librarian-puppet - Bundler for Puppet, manages dependencies
  • mcollective - Orchestration, can be used independently of Puppet
  • motherbrain - Use knife to spin up one node? Nah, use this to create a whole environment
  • omnibus - Create full-stack installers for your project, Chef
  • Open Linux Management Infrastructure (OpenLMI) - Manage, monitor, and configure servers via API calls (instead of SSH), included in RHEL 7
  • Opscode - Chef on Github, tons of great tools
  • Opskeleton - Great for test environments
  • Puppet - Well known CM tool
  • puppet-lint - Check that your Puppet manifest conform to the style guide
  • puppet-profiler - Find out what's making your Puppet runs so slow
  • Puppet Dashboard - Web based dashboard for Puppet
  • Puppet Forge - Community repository of Puppet modules
  • puppet-module-skeleton - Skeleton modules for Puppet
  • r10k - General purpose toolset for deploying Puppet environments and modules
  • Really Awesome New Cisco config Differ (RANCID) - Designed to monitor network hardware
  • Rex - Agentless server orchestration, written in perl
  • Rudder - Automation and compliance, uses CFengine
  • Rundeck - Easy automation
  • Saltstack - Orchestration, server provisioning, and configuration management
  • ServerSpec - RSpec tests for your servers configured by Puppet, Chef or anything else
  • Slaughter - Centralized system-administration & configuration tool
  • Sovereign - Set of Ansible playbooks to deploy your own private cloud, very feature-rich
  • spiceweasel - Quickly automates the creation of whole Chef environments (batch loading)
  • ssl-vault - Chef cookbook to manage SSL keys, certificates & chains using chef-vault
  • tarball - Ruby-based resource provider to manage tarballs in Chef
  • Test Kitchen - Automated testing for configuration management tools (mostly Chef)
  • VirtKick - Simple panel for orchestrating VMs and containers
  • zero-user - Zero hassle Linux user management, requires Ansible

Containers

  • Bocker - Docker written in 100 lines of shell
  • boot2docker - Lightweight Linux distribution running Docker, packaged as an VM for OS X and Windows
  • cadvisor - Analyzes resource usage and performance characteristics of running containers
  • crane - Docker orchestration
  • Distribution - Docker Registry 2.0, supersedes docker-registry
  • Docker - Designed to applications in a container, but not a whole OS instance
  • dockerfiles - Great little collection of pre-made Docker files
  • DockerUI - Web interface for Docker
  • Docker Compose - Define and run multi-container apps with Docker, previously known as fig
  • Docker Hub - Official Docker images for many projects
  • Dokku - Docker powered mini-Heroku (PaaS) in around 100 lines of Bash
  • Dokku Alternative - Dokku fork, supports plugins
  • Ferry - Launch, run, and manage big data clusters without worry about infrastructure
  • Fleet - Treat your CoreOS cluster as if it shared a single init system
  • Flocker - Docker data management for stateful services such as DBs
  • Flynn - PaaS built on top of Docker, can run stateful services
  • geard - CLI tool for installing Docker images as containers onto a systemd-enabled Linux system
  • Hyper - Hypervisor-agnostic Docker engine
  • Kitematic - Mac app for managing Docker containers
  • libcontainer - Used by Docker 1.0+ so it doesn't have to use LXC/libvirt/systemd-nspawn
  • Linux Containers (LXC) - Runs an OS instance (sshd, cron, daemons, init, etc) within a container
  • Nomad - A distributed, highly available, data-center aware scheduler
  • Panamax - Containerized app creator with an open-source app marketplace hosted in GitHub
  • pipework - SDN for Linux Containers
  • Rancher - Provides a complete platform for operating Docker in production
  • Registrator - Service registry bridge for Docker, supports Consult, etcd
  • rkt (Rocket) - New container system by the CoreOS guys
  • Shipyard - Composable Docker management toolkit
  • ShutIt - Manage your build process in a way that is both structured and flexible
  • SmartDataCenter (SDC) - Containers and SmartOS, by Joyent
  • Swarm - Docker-native clustering system
  • Ventriloquist - Combines Vagrant and Docker to give developers the ability to configure portable and disposable dev environments
  • Weave - Virtual network that connects Docker containers deployed across multiple hosts
  • Zenoss Control Center - PaaS framework for deploying enterprise applications using Docker

Dashboards and Visualization

  • Awesome Dashboard - A collection of dashboards
  • Bigdesk - Live charts and statistics for Elasticsearch cluster
  • blockdiag - Generate simple block/sequence/activity/network diagrams from text files
  • Cachet - Create beautiful, responsive status pages. Written in PHP
  • Cacti - Web-based network monitoring and graphing tool designed as a front-end to RRDtool
  • collectd3 - Beautiful D3JS visualizations of system performance statistics
  • Dashing - Dashboard framework written in Ruby
  • Dashing Widgets - Massive collection of widgets for Dashing
  • draw.io - Free online flow chart maker / Visio alternative
  • Freeboard - Ridiculously simple dashboards for your devices
  • FreeMind - OSS mind mapping software, great for brainstorming
  • GoAccess - Real-time web log analyzer and interactive viewer that runs in a terminal and/or dashboard
  • Graphite-Sankey - Turns Graphite targets into a D3.js Sankey visualization
  • Inkscape - Open source vector image editor
  • Kibana - Visualization component of the ELK stack
  • ksar - Creates pretty graphs from sar output
  • LICEcap - Capture an area of your desktop (eg: a terminal) and save it to a GIF
  • linux-dash - A simple web dashboard to monitor your Linux server
  • logstalgia - Web site access log visualization tool, aka Apache Pong
  • Grafana - Modern dashboard for Graphite
  • Graphviz - Graph visualization and flow chart software
  • Gravit - Web-based vector image editor / design tool, source code is available on GitHub
  • maim - The most powerful and flexible Linux desktop screenshot tool
  • Nagdash - Dashboard / NOC screen for Nagios
  • NagVis - Visualization suite for Nagios
  • Nagiosgraph - Another visualization tool for Nagios data
  • Network Weathermap - Network visualization tool, create a "weather map" just like big ISPs use
  • php-weathermap-graphite - Allows Network Weathermap to source data from Graphite
  • PNP4Nagios - Nagios visualization tool
  • ScreenCloud - Take a screenshot and either upload it to their site to share, or save it locally
  • Seyren - Alerting dashboard for Graphite
  • Skitch - Feature-rich screenshot editing, sharing, and annotation tool -- closed source
  • TermRecord - Record and playback terminal sessions
  • Thruk - Web interface for Nagios, Icinga, Shinken and Naemon, can create SLA reports, has a mobile client
  • Uchiwa - Dashboard for Sensu
  • Varnish Dashboard - Realtime dashboard for Varnish cache servers
  • vnstati - Creates PNG images using vnStat data

Distributed Systems Tools

  • Aurora - Mesos scheduler for long running services and cron jobs, similar to Marathon
  • Bamboo - HAProxy auto configuration and auto service discovery for Marathon
  • Chronos - Distributed, fault tolerant cron scheduler that runs on top of Apache Mesos
  • Cisco Cloud Microservices Infrastructure - Complete suite of OSS tools
  • crypt - Store and retrieve encrypted configs from etcd or Consul
  • consul - Service discovery and configuration via DNS or HTTP, great for auto-scaling
  • Curator - ZooKeeper client wrapper and rich ZooKeeper framework, by Netflix
  • etcd - Distributed, consistent key-value store for shared configuration and service discovery
  • eureka - AWS Service registry for resilient mid-tier load balancing and failover, by Netflix
  • FileUtils - File utilities for distributed computing
  • git2consul - Mirror git repos to Consult K/V stores
  • Herd - A single-command bittorrent distribution system, based on Twitter's Murder
  • Hystrix - Library to stop cascading failures
  • jespen - Call Me Maybe: simulating network partitions in DBs
  • Kong - Microservice / API management layer
  • kubernetes - Open source orchestration system for Docker containers by Google
  • Marathon - Mesos scheduler for "always on" jobs (eg: web services)
  • marathon-consul - Take information provided by the Marathon event bus and forward it to Consul's KV tree
  • Mesos - Cluster manager and scheduler, similar to Google's Borg and Omega projects
  • mesos-consul - Automatically registers/deregisters services run as Mesos tasks
  • Mesosphere - Apache Mesos schedulers for almost anything
  • Myriad - YARN framework/scheduler for Mesos
  • nsq - Realtime distributed messaging platform / message queue
  • parallel - Execute jobs in parallel using one or more computers
  • Serf - Decentralized solution for service discovery and orchestration
  • SmartStack - Automated service discovery and registration framework, by Airbnb
  • vulcand - Programmatic extendable proxy for microservices and API management
  • Webjob - Downloads a program or script from a remote WebJob server, executes it, and sends back output to a server
  • xCAT - Complete management solution for distributed systems
  • Zookeeper - Distributed configuration service, synchronization service, and naming registry

File Sync and Sharing

  • BitTorrent Sync (btsync) - Sync on the local network or over the internet -- closed source
  • Cloud Explorer - GUI to access storage on multiple clouds, for Windows -- freeware, closed source
  • Heartbeat - Uses an ID rather than an IP address, share your ID with friends and go. Formerly Syncthing, formerly Pulse
  • ownCloud - The most popular file sync and share program
  • Pydio - Formerly AjaXplorer, AGPL license
  • Seafile - Also offers a paid professional edition with more features
  • SparkleShare - Uses git under the hood
  • Syncany - Supports tons of different protocols for the transfer
  • Tahoe-LAFS - Free and open decentralized cloud storage system
  • Unison - Multiplatform, feature-rich file sync

High Availability Clustering Tools

  • AN! Cluster Tutorial 2 - Building clusters with OSS software, very detailed, highly recommended
  • Corosync - HA framework and cluster engine
  • csync2 - Cluster file sync tool
  • Distributed Replicated Block Device (DRBD) - Mirror block devices to a remote system
  • HAproxy - Open source software load balancer
  • haproxyctl - Wrapper to talk to the HAProxy socket, as well as regular init (start stop restart) shit
  • Hipache - Distributed HTTP and websocket proxy, supports load balancing
  • keepalived - Load balancing and high availability
  • huptime - Zero downtime restarts of unmodified programs
  • Linux-HA - Building blocks for high availability systems
  • Pacemaker - HA resource manager
  • Spread - Fault resilient message bus
  • UCARP - VIP management using the CARP protocol
  • Vippy - VIP management, written in node.js

High Performance Computing Tools

HTTP Load Generation Tools

  • Gatling - HTTP, JMS, and WebSocket load generator
  • FunkLoad - Functional and load web tester, written in Python
  • httperf - HTTP load generator, originally created, by HP
  • httping - Simple program that "pings" a URL and shows response time
  • JChav - Visualize JMeter output
  • JMeter - Designed to load test functional behavior and measure performance, written in Java
  • Locust - Written in Python, allows you to define user behavior
  • Siege - CLI based, supports basic authentication, cookies, and HTTPS
  • Tsung - Distributed stress tester, also supports stress testing DBs
  • vegeta - Written in Go
  • Web Performance Today - News site dedicated to web / HTTP performance
  • wrk - Multi-threaded CLI tool
  • wrk2 - Fork of wrk that fixes the coordinated omissions problem

IO Load Generation Tools

Logging and Log Management

  • Adiscon LogAnalyzer - Slick web interface for syslog messages
  • ElasticDump - Import / export tools for Elasticsearch
  • Elasticsearch - Component of the ELK stack, used for super fast searches
  • elasticsearch-river-email - E-mail river plugin for Elasticsearch
  • Elasticsearch Copier (escp) - Tool to copy elasticsearch indexes, great for copying from prod to dev
  • Elasticsearch Exporter - Small script to export data from one Elasticsearch cluster into another
  • Errbit - Tool for collecting and managing errors from other application, Airbrake API compliant
  • FileSystem River (fsriver) - Elasticsearch river plugin helps to index documents from your local file system and using SSH
  • Fluentd - Unified logging layer
  • Flume - Distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data
  • Graylog2 - Log capture and analysis
  • Heka / hekad - Stream processing, can gather logs or performance metrics
  • IRCcat - Send log messages and alerts to an IRC channel, can also use IRC to send commands
  • Log Courier - Enhanced fork of Logstash Forwarder
  • Logplex - Distributed syslog log router, uses Redis
  • logstash - Collect, parse, and store logs. A component of the popular ELK stack
  • logstash-forwarder - Formerly Lumberjack, forwards logs to centralized server(s), very lightweight
  • Logster - Utility for reading log files and generating metrics to configurable outputs by Etsy
  • Logwatch - Monitor logs and send an e-mail when event(s) occur
  • multilog - Reads a sequence of lines from stdin and appends selected lines to any number of logs
  • multitail - Monitor multiple log files in a single terminal window
  • NXLOG - Universal log collector and forwarder, supports many formats/platforms/sources including Windows
  • Piwik - Web analytics platform with a killer UI
  • Sentry - Application exception logging
  • Simple Event Correlator (SEC) - Event correlation tool for advanced event processing
  • swatch - Simple watcher
  • Webalizer - Web and FTP log analyzer

Metric Collection Analaysis and Storage

  • collectd - Collects system performance statistics
  • collectd Related Sites - Great tools that integrate with collectd
  • collectd-openstack - collectd plugin for monitoring OpenStack components
  • collectl - sar on steroids
  • Diamond - Python daemon that collects system metrics and publishes them to Graphite (or similar), has an API
  • dim_STAT - Collects almost everything and stores it in a MySQL database, produces reports too
  • FastForward - Flexible system event and metric forwarding agent by Spotify
  • Graphite - Store numeric time-series data and render graphs of the data on demand
  • Graphite Tools - Tools that work with Graphite
  • Heka / hekad - Stream processing, can gather logs or performance metrics
  • InfluxDB - Distributed time series database with no external dependencies
  • kairosdb - Time series DB written on top of Cassandra
  • Node-Bell - Real-time anomalies detection system for periodic time series
  • OpenTSDB - Store and serve massive amounts of time series data without losing granularity
  • RRDtool - High performance data logging and graphing system for time series data
  • Scales - Metrics collection, written in Python
  • Skyline - Real-time anomaly detection system to enable passive monitoring of metrics without the need to configure thresholds
  • sysinfo_influxdb - Collect system metrics and store them in an InfluxDB server

Monitoring and Alerting

  • Adagios - Web based Nagios configuration interface
  • bluepill - Simple process monitoring, written in Ruby
  • Bosun - Monitoring and alerting system written by Stack Exchange
  • Cabot - Self-hosted, easily-deployable monitoring and alerts service - like a lightweight PagerDuty
  • check_mk - Extensions / plugins for Nagios
  • check_mk Multisite - GUI for check_mk
  • Daemon Tools - Service monitoring and management tools by DJB
  • FastForward - Flexible system event and metric forwarding agent by Spotify
  • Flapjack - Alert routing and rollup so you don't get tons of alerts for large failures
  • Fully Automated Nagios - Easy to install, pre-packaged Nagios that includes the most-used tools and plugins
  • Ganglia - Monitoring software that's focused on HPC / distributed clusters
  • Icinga - Nagios fork, updated frequently
  • Icinga2 - Complete re-write of Icinga
  • jmxtrans - Connector between speaking to a JVM via JMX on one end and whatever logging / monitoring / graphing package
  • Kale - Monitoring stack by Etsy
  • LibreNMS - GPL fork of Observium
  • Monit - Includes tools to automatically take action when certain conditions are met
  • Monitorix - So lightweight that it can be used in mobile devices, aka Mikaku
  • Multi Router Traffic Grapher (MRTG) - Still being updated!
  • Naemon - Modular Nagios fork
  • Nagios - One of the most widely used OSS monitoring programs
  • nagios-herald - Gives context to Nagios alerts, by Etsy
  • NeDi - Network discovery and monitoring
  • OpenNMS - Network monitoring, also supports configuration/asset management
  • Open Monitoring Distribution (OMD) - Nagios bundled with the most popular plugins and tools
  • OpsView Core - GPL version of OpsView, not as feature-rich as the commercial product
  • Packetbeat - Distributed packet monitoring system that can be used for application performance management
  • pmacct - IP and network traffic accounting / monitoring
  • Prometheus - An open-source service monitoring system and time series database
  • Riemann - Aggregates events from your servers and applications with a powerful stream processing language, for distributed systems
  • Sensu - Open source monitoring framework, cloud-focused
  • Shinken - Compatible with Nagios
  • StatsD - Monitoring in node.js bu Etsy
  • Tattle - Self service alerting and dashboard frontend for Graphite and Ganglia
  • Uptime - Remote monitoring application using Node.js, MongoDB, and Twitter Bootstrap
  • Xymon - Fork of Big Brother
  • Zabbix - Stores monitoring data in a DB, has agents for almost every OS
  • Zenoss - Supports Nagios plug-in format

Network Load Generation Tools

  • Flent - Python wrapper to run mutliple netperf/iperf3/ping in parallel, formerly netperf-wrapper
  • Flowgrind - Distributed TCP traffic generator
  • iperf3 - Supports tuning of various parameters related to timing, protocols, and buffers
  • netperf - The web page looks ancient but the software's still being updated!
  • ostinato - Packet crafter/traffic generator and analyzer with a friendly GUI

Networking Tools

  • Audit Record Generation and Utilization System (ARGUS) - Generates network activity reports
  • Augmented Traffic Control (ATC) - A tool to simulate network conditions, by Facebook
  • bbcp - Copies files using multiple TCP streams to greatly increase throughput
  • bbFTP - Uses it's own transfer protocol, optimized for large file transfers
  • BIRD Internet Routing Daemon (BIRD) - (Almost) fully functional IP routing daemon for Linux, supports tons of standard routing protocols
  • Charles Web Debugging Proxy - Highly recommended, includes support for decoding HTTPS traffic and throttling -- commercial software
  • Comcast - Simulate crappy network connections
  • curlish - Improved curl, includes cookie management and OAuth support
  • dummynet - Simulates/enforces queue and bandwidth limitations, delays, packet losses, and multipath effects
  • FaceBook Open Switching System (FBOSS) - FB's software stack for managing and controlling whitebox switches
  • fping - High performance ping (ya, really)
  • ipcalc - CLI tool to calculate subnets, netmasks, IP ranges, broadcast addresses, and more
  • iptstate - A top-like display of IP Tables state table entries
  • GridFTP - Supports parallel streams
  • httpdiff - Perform the same reuqest against two HTTP servers and diff the results
  • httpie - curl replacement with many new features
  • intrace - Enumerate IP hops using existing TCP connections
  • lftp - Supports many protocols (FTPS, HTTPS, SFTP), scheduling, bandwidth throttling, scripting, and more
  • localtunnel - Share a web service on your local development machine without messing with DNS and firewall settings
  • mitmproxy - Intercept, modify, replay and save HTTP/S traffic, edit flows on the fly
  • moloch - Large scale IPv4 full PCAP capturing, indexing and database system
  • mountebank - Stub downstream resources for testing, supports HTTP HTTPS SMTP TCP
  • mtr (My traceroute) - Combines ping and traceroute into a single program
  • multicast remote sync (mrsync) - Transfers from a master to many remote machines using Unix multicast sockets
  • namebench - Hunts down the fastest DNS servers for your computer to use
  • ncat - Improved netcat, written by the Nmap team
  • netbrake - Limit the bandwidth used by a process
  • Netdisco - Web-based network management tool, written in perl, uses SNMP
  • Network Link Conditioner - Simulate bandwidth, latency, and packet loss. For OS X
  • nfdump - Captures network flows
  • NfSen - GUI for nfdump
  • ngrep - Network grep
  • nping - Create custom network packets
  • ntopng - New version of the popular ntop tool
  • OpenResty - Turn nginx into a non-blocking API server
  • Paris Traceroute - Shows proper network topology when load balancers and load-balanced routers are used
  • PageKite - Makes web servers or SSH publicly available on any server
  • POSTman - Create and share HTTP requests, great for testing APIs - Chrome plugin
  • prettyping.sh - bash wrapper for ping to create pretty output
  • Quagga - Routing software suite, supports most routing protocols
  • Repose - REST proxy
  • scapy - Interactive packet manipulation tools written in Python
  • Sloppy - Proxy server that slows down connections for testing
  • socat - netcat on steroids, supports serial devices
  • spiped - Create encrypted pipes between socket addresses using PSKs, similar to ssh -L
  • sslh - Protocol multiplexer, forwards packets based on the first packet
  • Stanford Linear Accelerator Center - Network Monitoring Tools - MASSIVE list of network monitoring tools
  • tc - Built-in Linux kernel traffic control
  • tcpdstat - Get protocol statistics from tcpdump / PCAP files
  • tcpflow - TCP demultiplexer, each flow is stored in it's own file
  • TCPWatch - TCP monitoring and logging tool
  • tengine - A distribution of Nginx with some advanced features, by Alibaba
  • Tracebox - Detect middleboxes (NAT, transparent proxies, etc) in a network path
  • trickle - Userspace bandwidth shaper
  • UDR - UDT wrapper for rsync that improves throughput of large data transfers over long distances
  • Varnish - Caching HTTP accelerator
  • WANem - WAN emulator for testing response over low bandwidth and/or high latency connections
  • WireShark - The classic network analyzer
  • WireShark Tools - Superb list of network tools from the WireShark wiki
  • Yconalyzer - Monitor and analyze TCP connections
  • Your Own URL Shortener (YOURLS) - Lets you run your own URL shortener a'la TinyURL or bit.ly
  • ZeroTier - Cloud / provider-agnostic private network backplanes

Packages and Repositories

  • Aminator - Create application-specific custom AMIs, by Netflix
  • apt-dater - ncurses frontend for package management via SSH, also supports yum
  • aptly - Debian-centric, includes repo support and the ability to take snapshots for easy rollback
  • CentOS Errata for Spacewalk (CEFS) - Import errata information from CentOS-announce into Spacewalk
  • CentOS Repositories - Large list of both official and unofficial CentOS software repositories
  • CentOS Software Collections (SCL) - Use multiple versions of software on a system without disturbing the system default version
  • Copr - Automatic build system providing a package repository as its output
  • cowbuilder - Package builder that uses copy-on-write (COW) to speed up the build process
  • DNF - Package management system that will replace Yum in upcoming Fedora releases
  • Effing Package Management (fpm) - Build packages for multiple platforms (deb, rpm, etc) with great ease and sanity
  • ELRepo - Repo that focuses on hardware related packages, supports RHEL and CentOS
  • Extra Packages for Enterprise Linux (EPEL) - Supports CentOS, RHEL, Scientific Linux, and Oracle Linux
  • Extra Packaging Guidelines and Policies for EPEL - Packaging guidelines, great even if not creating EPEL stuff
  • Fedora Packaging Guidelines - Excellent information that can be applied to CentOS & RHEL
  • fpm-cookery - Tool for building software packages with FPM
  • IUS SafeRepo Initiative - Create "safe" 3rd party repos
  • Koji - Software that builds packages for Fedora, can be used for other stuff too, uses mock
  • Mock - Build packages in a simple chroot so you don't blow up your system
  • mrepo - Yum & APT repository mirroring, formerly Yam
  • OStree - Tool for managing bootable, immutable, versioned filesystem trees (not really a package manager but...)
  • Package Repository Manager (PRM) - OS-independent package repository tool
  • pkgr - Made deb or RPM packages out of any Ruby, NodeJS, or Go app
  • Pulp - Next generation repository management, a component of Red Hat Satellite 6
  • Red Hat Software Collections (SCL) - Use multiple versions of software on a system without disturbing the system default version
  • reposync - Synchronize yum repositories to a local directory
  • rpm-ostree - Take RPM packages and commit them to an OSTree repository
  • RPM Fusion - Provides software that the Fedora Project or Red Hat doesn't want to ship
  • schroot - Allow non-root users to create chroot environments, great for package testing
  • Spacewalk - Provides package management (among other things)
  • yum-presto - yum plugin that provides support for downloading package deltas instead of whole packages
  • yum-security - Plugin to only install security updates

Password and Secret Management

  • 1Password - Password manager for OS X, Windows, iOS, and Android -- closed source
  • blackbox - Safely store secrets in Git
  • ccrypt - Replacement for the standard Unix "crypt" utility
  • Diceware - Neat passphrase generator
  • GNU Privacy Guard (GPG) - The original! Store em in text files and encrypt
  • GRC Password Generator - Generates 63 bit passwords, web based
  • KeePass - Lightweight, easy to use password manager, runs on most OSes, requires MONO for non-Windows systems
  • Keepass2Android - Compatible with KeePass 2.x, requires MONO
  • KeePassDroid - Compatible with KeePass 1.x
  • KeePassX - Alternative to KeePass, requires QT
  • Keywhiz - A system for distributing and managing secrets (API keys, certificates, etc)
  • kpcli - Command line interface for KeePass
  • LastPass - Freemium, can sync to other devices -- closed source
  • lastpass-cli - CLI for LastPass
  • msktutil - Keytab client for a Microsoft Active Directory environment
  • One-Time Secret - Create links that self-destruct after a single viewing, great for sharing passwords
  • pass (passwordstore) - Uses GPG at it's core, supports tracking password changes in git
  • passff - Firefox addon for interacting with the a pass/passwordstore repository
  • Password Gorilla - Written in Tcl/Tk
  • Password Pusher - Links to passwords expire after a certain number of views and/or time has passed, RoR app
  • Password Safe - Designed by Bruce Schneier himself
  • Pleasant Password Server - Multi-user management tool for KeePass, great for businesses -- commercial software
  • pwd.sh - Script to manage passwords in an encrypted file using GPG
  • pwgen - Password generated, included in most Linux distros
  • RatticDB - Web-based password management, includes an API, great for teams or companies
  • scrypt - Super secure against hardware brute-force attacks, is also a part of/module for most programming languages
  • TeamPass - Collaborative password management using the LAMP stack
  • Vault - Tool for storing secrets (API keys, passwords, certs, etc) by Hashicorp
  • webpasswordsafe - Very powerful, designed "for the enterprise"
  • zxcvbn - Password strength estimator, written by Dropbox, operates in a browser window

Performance Monitoring

  • apachetop - top for Apache
  • atop - Supports both real-time and historical erformance monitoring
  • bandwidthd - Monitors and graphs bandwidth usage
  • blktrace - Article on blktrace, includes tldr setup steps in the comments
  • bmon - Console based network monitor
  • bwm-ng - Small and simple console-based live network and disk I/O bandwidth monitor
  • Conky - Lightweight system monitor for X windows
  • dstat - Versatile replacement for vmstat, iostat, netstat and ifstat
  • ESnet Fasterdata Knowledge Base - Provides proven, operationally sound methods for troubleshooting and solving performance issues
  • EtherApe - Graphical network monitor, pretty output
  • findswappers - perl script that identifies swapped processes
  • ftptop - Monitor FTP connections in real time
  • Glances - Real-time performance monitoring, written in curses and Python
  • gt5 - A "du browser", handy for finding large files
  • htop - top replacement, has a few additional features
  • iftop - top for network interfaces
  • ioping - Monitor I/O latency in real time
  • iotop - top for I/O requests, displays information on a per-process basis
  • iptraf - A top'esque program for network traffic, has multiple display modes, written in ncurses
  • Linux Performance Observability Tools - Awesome graphic that shows you which tool to use, by Brendan Gregg
  • mem_logger.sh - Monitor a processes' memory usage over time
  • Munin - Historical performance monitoring to help determine when you server became "slow"
  • nbwmon - Ncurses bandwidth monitor
  • ncdu - ncurses version of "du"
  • netatop - Kernel module for atop to watch and report on network packets
  • NetHogs - Displays per-process bandwidth usage
  • ngxtop - top for nginx
  • nicstat - vmstat for network interfaces
  • nload - Console application that monitors network traffic and bandwidth usage in real time, neat ASCII graphs
  • nmon - Provides both real-time and historical performance metrics
  • PageSpeed Module - Reduce page load time without modify your existing content or workflow
  • perf-tools - By Brendan Gregg, uses perf and ftrace, includes iosnoop, KILLER TOOLS
  • Performance Co-Pilot (PCP) - System performance and analysis framework, included in RHEL 7
  • pidstat - vmstat type output for CPU, disk I/O, page faults, and more on a per-process basis
  • pmap - Shell scripts for tracking memory usage using "pmap"
  • PowerTOP - Real-time power consumption on a per-process & per-thread basis
  • ps_mem - Accurately reports core memory usage for a process
  • ptop - top/ntop-like task monitor written in Python
  • recap - Collects info from various standard utilities (free, sar, vmstat, etc) at specified intervals
  • saidar - ncurses based program for viewing system statistics
  • slabtop - Tutorial on how to use slabtop, useful when you have no idea on how your RAM is being used
  • smem - Reports memory usage based on proportional set size (PSS) instead of the usual resident set size (RSS)
  • ss - Socket statistics, a better netstat
  • sysdig - "Think of it as strace + tcpdump + lsof + awesome sauce.", recommended
  • SmokePing - Network latency visualizer, written by the MRTG and RRDtool guy
  • USE Method - Brendan Gregg's rosetta stone for performance analysis and tuning
  • vnStat - Console based traffic monitor, supports statistic collecting
  • wtop - Another top for Apache

Provisioning and Lifecycle Management

  • Bento - Encapsulates Packer templates for building Vagrant baseboxes, used by Chef
  • Box-Cutter - Templates and tools for creating OS environments using Packer, by Hashicorp
  • cloud-init - Configures settings the first time a system spins up (SSH keys, hostname, etc)
  • Cobbler - Provisioning system used in Red Hat's Satellite
  • Crowbar - Multi-purpose provisioning tool, created by Dell
  • edeploy - Tool to provision and update systems using trees of files instead of packages or VM images
  • Foreman - Provisioning and life cycle management
  • iPXE - GPL'ed version of PXE, replacement for gPXE
  • Jeto - Control multiple VMs on a headless server using Flask and AngularJS
  • Katello - Candlepin + Pulp + Foreman, the core of Red Hat Satellite 6
  • Kickstart - The classic Red Hat tool
  • Metal as a Service (MaaS) - Ubuntu provisioning system
  • Overcast - VM orchestration and provisioning for DigitalOcean, Linode and Amazon, or locally using Vagrant + Virtualbox
  • Packer - Automates VM creation for multiple platforms (VMware, AWS, etc), can use a "golden image" approach
  • Pallet - Aims to solve the problem of providing a consistently configured running image across a range of clouds
  • Razor - Puppet provisioning software that handles bare metal hardware and virtual server provisioning
  • Sandstorm - Download, install, and run apps in a container
  • Terraform - Infrastructure provisioning using existing tools, supports many providers (AWS, Azure, DO, OpenStack, etc)
  • Vagrant - Quickly spin up environments for local testing and development
  • vagrant-cachier - Creates a common cache among all Vagrant boxes to reduce the amount of downloading
  • Vagrant Manager - GUI to manage Vagrant boxes, supports Windows and OS X
  • veewee - Easily (and repeatedly) build custom Vagrant base boxes, KVMs, and VM images
  • veewee-to-packer - RubyGem that will translate Veewee templates to Packer templates
  • VMFest - Turn VirtualBox into a light-weight cloud provider

Python Tools and Resources

  • 2.7 and 3.x Differences - The differences between 2.7 and 3.x with examples, via Hacker News
  • Awesome Python - Very large list of Python resources
  • bpython - Killer interface for the Python interpreter
  • Common Python Mistakes - Link and discussion on Hacker News
  • IPython - Interactive Python, like a shell or environment
  • Jinja2 - Templating language for Python
  • Micro Python - Python for microcontrollers and embedded systems
  • Parallel Python - Provides a mechanism for parallel execution of Python code on SMP and clusters
  • Python Package Index (PyPI) - Software repo for Python packages, like Ruby gems
  • Python Reference - A collection of useful scripts, tutorials, and other Python-related things
  • PyPy - Python alternative with advance features (JIT compiles, sandboxing, etc)
  • Requests - Killer replacement for the urllib2 module
  • virtualenv - Tool to create isolated Python environments
  • xlwings - Replace your Excel VBA code with Python

Python Tutorials

RDBMS Load Generation and Performance Tools

RDBMS Tools

  • Adminer - GUI for database management in a single PHP
  • Flyway - Version control for DB schemas, supports most DBs, highly recommended
  • Galera Cluster - HA clustering for MySQL
  • HeidiSQL - GUI SQL DB browser and editor
  • migrit - Iterative schema migrations for MySQL
  • MariaDB Galera Cluster - HA for MariaDB
  • MySQL Data Dumper (mydumper) - Much better than mysqldump
  • Navicat - GUI for RDBMS administration and development, RECOMMENDED -- commercial software
  • Percona XtraDB Cluster - HA clustering for MySQL / MariaDB, supports active/active
  • pg_shard - PostgreSQL extension to scale out real-time reads and writes
  • pgBadger - PostgreSQL log analyzer
  • pgcli - Postgres CLI with autocomplete and syntax highlighting
  • pgloader - Fast data loader for PostgreSQL
  • Postgres-XL - Scale-out version of PostgresSQL
  • rdbms-subsetter - Generate a random sample of rows from a relational database that preserves referential integrity, great for using production data for testing/dev
  • SQL Fiddle - Write and test SQL
  • WebScaleSQL - Huge scale MySQL with contributions from Facebook, Google, LinkedIn, and Twitter

Regular Expressions

Ruby Tools and Resources

  • Awesome Ruby - A collection of awesome Ruby libraries, tools, frameworks and software
  • Bundler - Manage Gem dependencies
  • did_you_mean - Suggestions for typos in Ruby code
  • fog - Cloud services library for Ruby
  • Omniref - A better search site for Ruby documentation
  • Pry - IRB alternative, very feature-rich
  • Rake - Make / Makefile-like build utility
  • rbenv - Alternative to RVM
  • replicate - Dump and load relational objects between Ruby environments (eg: prod and dev)
  • RSpec - Behavior-driven development (BDD) testing framework
  • RuboCop - Static code analyzer that enforces guidelines
  • Ruby Gems - The Ruby package manager. Gems = libraries
  • Ruby Toolbox - Trillions of Ruby projects, categorized
  • Ruby Version Manager (RVM) - Install, manage, and work with multiple Ruby environments

Ruby Tutorials

Security Tools

Shell Scripting

  • Advanced Bash-Scripting Guide - By the Linux Documentation Project (LDP)
  • Bash Hackers Wiki - Human-readable bash documentation so you don't have to dig through the man page
  • bro pages - Simplifed man pages and examples
  • CommandlineFu - Killer code snippets
  • Explain Shell - Enter a command-line to see the help text that matches each argument
  • Fu - CLI for CommandlineFu.com, allows for easy searches
  • ShellCheck - Checks shell scripts for common mistakes
  • tldr - Simplified and community-driven man pages, cuts out a lot of cruft
  • The Art of Command Line - Master the command line, in one page
  • Unix Rosetta Stone - The one and only resource for a mixed Linux/Unix environment
  • Unix Toolbox - A collection of Unix/Linux/BSD commands and tasks for advanced users

SSH Tools

  • autossh - Automatically restart SSH sessions that stop passing traffic
  • Balancing Load Across Systems (Ballast) - Balance user load across SSH servers based on configured policies
  • Bitvise SSH Client - Feature-rich SSH & SFTP client for Windows, free for individual use -- closed source
  • Byobu - An enhanced version of the "screen" utility
  • cloud-ssh - SSH wrapper that supports hostname tab-completion based on name, tag, or security group
  • ClusterSSH - Make a change on many servers at the same time
  • Corkscrew - Tunnel SSH through HTTP proxies
  • csshX - Cluster SSH for OS X
  • Dancer's Shell (dsh) - Wrapper for executing multiple remote shell (rsh/remsh/ssh) commands
  • FileZilla - The best GUI file transfer client, supports scp -- WARNING saves passwords in plain text
  • Guacamole - Clientless (in-browser) remote desktop gateway, supports VNC, RDP, and SSH
  • HPN-SSH - High performance ssh/scp (auth handshake is encrypted, data transfer is not)
  • KeyBox - Web-based SSH console that executes commands on multiple shells
  • Keychain - frontend to ssh-agent and ssh-add, reduces the number of times you have to type in your passphrase
  • KiTTY - PuTTY fork with additional features
  • Mass Parallel SSH (mpssh) - Simple parallel SSH
  • Match - Creates a conditional block, great for controlling actions on a per-user and/or per-host basis
  • MobaXterm - Tabbed SSH, VNC, and RDP client for Windows, free for personal use -- closed source
  • Mobile Shell (Mosh) - Remote shell that supports roaming (client IP address changes) and intermittent connectivity
  • mRemoteNG - Open source, tabbed, multi-protocol, remote connections manager
  • MTPuTTY (Multi-Tabbed PuTTY) - Multiple PuTTY sessions in a single window
  • MUltihost SSH Wrapper (Mussh) - SSH wrapper
  • NoVNC - Client-less VNC in a web browser, uses HTML5 and WebSockets
  • parallel-ssh (pssh) - Parallel version of OpenSSH tools, comes with prsync too
  • Parallel Distributed Shell (pdsh) - Kick off many SSH sessions in parallel
  • paramiko - SSH2 protocol library for Python, provides both client and server
  • Parcel - High performance scp replacement, WARNING: uses UDP
  • PuTTY - The classic SSH client for Windows
  • rssh - Restricted shell for SSH, only allows scp, sftp, rdist, rsync, and cvs
  • scponly - Shell that only allows incoming SCP, supports chroot
  • SSH Power Tool (sshpt) - Execute commands and upload files to many servers simultaneously via SSH without using pre-shared keys
  • ssh-ldap-helper - Store public keys in LDAP
  • SSHFS - Mount remote file systems using a SSH tunnel
  • sshrc - Sources the ~/.sshrc on your local computer after logging in remotely
  • sshuttle - Transparent proxy server that works as a poor man's VPN, forwards over SSH, supports DNS tunneling
  • SuperPutty - Allows the PuTTY SSH client to be opened in tabs
  • tmux - An alternative to GNU screen
  • tmux-cssh - Cluster SSH for tmux
  • WinSCP - The well-known SCP client for Windows
  • x2go - One of the best remote-desktop-over-SSH clients
  • Xming - Windows Xwindows server, supports PuTTY

SSL TLS HTTPS Tools

  • BoringSSL - Google's fork of OpenSSL, does not guarantee API and ABI compatibility
  • cipherscan - Find out which SSL ciphersuites are supported by a target
  • duraconf - A collection of hardened configuration files for SSL/TLS services by Jacob Appelbaum
  • HTTP Strict Transport Secuirity (HSTS) - Forces browsers to interact with a site by only using HTTPS
  • LibreSSL - OpenBSD's fork of OpenSSL, Linux compatible
  • Mozilla SSL Configuration Generator - Generate SSL configs for Apache, Nginx, ELB, HAproxy and more
  • nogotofail - Spot and fix weak TLS/SSL connections and sensitive cleartext traffic
  • Qualys SSL Server Test - Evaluates and provides recommendations for the SSL settings of any web site
  • Server Name Indication (SNI) - Think vhosts for SSL
  • sslconfig - CloudFlare's Internet facing SSL cipher configuration
  • sslsniff - A tool for automated MITM attacks on SSL connections
  • SSLsplit - Transparent and scalable SSL/TLS interception
  • sslyze - Fast and full-featured SSL scanner, written in Python
  • SSL Decoder - Decodes a SSL connection and displays certificate information

Software Development Tools

  • ack - grep-like tool designed to search source code
  • Artifactory - Probably the best way to store software artifacts and deal with dependency hell
  • Barkeep - Code review tool, kinda sorta like GitHub
  • BFG Repo-Cleaner - Scrub large blobs and sensitive data from git history
  • boar - Stores snapshots of directory trees in a local or remote repository, for BLOBs
  • Buildbot - CI framework
  • Codeine - CD with built in monitoring and automation
  • comm - Display lines that two files have in common (eg: the opposite of diff)
  • Completion - Tab completion for git branches, supports various shells
  • cwrap - Wrappers for creating test scenarios and faking behavior, recommended
  • devcheatsheet.com - Cheat sheets and quick references for almost every programming language
  • drone - CI platform built on Docker
  • Elita - API based CD framework/engine that uses git and Salt
  • Environment Modules - Dynamic modification of your shell environment using modules
  • fig - A way to create "environments" for developers (dependencies, etc)
  • FindBugs - Static code analyser for Java
  • GistBox - Web UI for organizing Gists
  • git-arr - Repo browser that uses static HTML pages for reduced overhead
  • git-fat - Like git-media but without the Ruby dependencies
  • git-media - Use Git with large BLOBs without storing the BLOBs in Git itself
  • GitBucket - GitHub clone written in Scala
  • GitHub Pull Request Builder Plugin (gprbp) - Allows certain comment strings to kick off builds
  • GitLab - Kinda like an open source GitHub
  • GitLab CI - CI that integrates with GitLab
  • Gitorious - Web front end for git, can be deployed as an appliance
  • GitTorrent - A decentralization of GitHub using BitTorrent and Bitcoin/blockchain
  • gitwatch - Automatically commit changes when specified files or directories are modified
  • Git Interfaces, Frontends, and Tools - Massive list on the kernel.org wiki
  • gkv - Use git as a KV key/value store
  • Gource - Software version control visualization tool
  • Hubot - Chat bot that can do deploys, look up images, integrate with Google Maps, and tons of other stuff
  • Imhotep - Comments on commits coming into your repository and checks for syntactic errors and general lint warnings
  • Jenkins - The most popular CI orchestration tool, supports a billion plugins
  • Jenkins JobConfigHistory - Tracks changes to system and job configurations
  • Jenkins Job DSL Plugin (jenkins-job-dsl) - Groovy-based DSL for writing Jenkins jobs
  • JSON Formatter - Automatically format JSON code, 100% client side
  • libgit2 - Library for interfacing with git via Ruby, Python, Go, and others
  • Mergeatron - Kicks off Jenkins a repo gets a PR, gives a thumbs up/down reply
  • myrepos - Flexible tool for managing many repos
  • Ninja - Small build system with a focus on speed
  • PatchELF - Simple utility for modifying existing ELF executables and libraries
  • Phabricator - Suite of web-based software development collaboration tools
  • Phare - Static code analysis
  • PRoot - User-space version of chroot, great for testing and development
  • Pushpin - Proxy server that adds WebSockets to existing request-response APIs
  • Review Board - Code review tool for multiple SCM systems
  • RocksDB - Library that provides an embeddable, persistent key-value store for fast storage - by Facebook
  • Silver Searcher, The (aka ag) - Source code searching tool, similar to "ack" but faster
  • SonarQube - Platform / dashboard for managing code quality
  • Swagger - A JSON format/standard that describes a RESTful API
  • tortilla - Easily wrap web APIs, written in Python
  • tup - Super fast and efficient build system
  • watch-make - Monitor Makefile dependencies and kick off make when one changes
  • watchman - Watch files and take action when they change (eg: kick off the CI system)

Storage Tools

  • ATA Secure Erase - Send a signal to an ATA drive to perform a hardware-based erase
  • CockroachDB - Open source version of Google's Spanner storage system
  • EnhanceIO - SSD caching, in the mainline Linux kernel, a fork of Facebook's Flashcache project
  • fs-cache - NFS client caching
  • IPOS Calculator - Created by Marek Wolynko
  • Linux-IO Target (LIO) - Create and share iSCSI, FC, FCoE, and other storage targets on Linux
  • Linux Journal - Linux Swap Space - Superb article about Linux swap, includes some tuning parameters
  • lsblk - List block devices
  • lvcache - Wrapper to help you create and manage LVM caches
  • OpenDedupe - Open source dedupe software, works on both block storage and file systems
  • Parted Magic - Resize, grow, shrink, clone, recovery, wiping, benchmarking, and more. Supports Linux and Windows file systems.
  • Red Hat LVM RAID Calculator - Login required
  • snapper - CLI tool to manage Btrfs snapshots, snapshot timelines, and more
  • System Storage Manager (SSM) - Generic CLI for managing all types of storage (DM, LVM, multipath), added in RHEL 7

Text Editors IDEs and Related Tools

  • Atom - Superb text editor, created by GitHub
  • Atom Linter - A collection of lint tools for the Atom editor\
  • Eclipse - The well known Java IDE
  • Etherpad - Enter, save, and share text/code in a web browser
  • HasteBin - Open source pastebin alternative for sharing code, can be installed locally / on-site
  • LargeFile - vim plugin that automatically disables certain things so you can edit large files faster
  • Notepad++ - Killer GPL'ed text editor for Windows
  • percol - Interactive grep tool
  • Sticky Notes - On-site / local pastebin
  • Sublime Text - Ok it's closed source and costs money but it's probably the best one out there
  • vim-json - A better JSON plugin for vim

Tracing Debugging Profiling

Two Factor Authentication

  • Authy - Provides both personal and enterprise versions
  • Barada Aint Respecting Any Deceptive Adversaries (BARADA) - PAM module for TFA support
  • Crypto Stick - OTP and more -- commercial products
  • Duo Security - Cloud-based, supports many methods of authentication (hard token, smartphone application, etc) -- commercial product
  • FreeOTP - Open source fork of Google Authenticator for iOS and Android
  • Google Authenticator - Two factor authentication; supports Android, iOS, and even has a PAM module -- closed source
  • Two Factor Auth (2FA) - Massive list of web sites that support and don't support two factor authentication
  • YubiKey - Acts as a USB keyboard to automatically input a strong, one time password -- commercial product
  • Yubico PAM - PAM module for use with YubiKey devices

Virtualization

Misc Tools and Utilities

  • appscale - Open source implementation of Google App Engine
  • AutoHotKey - Automate input (desktop and web forms, data entry, keybinds, etc)
  • autojump - Small database of directories that you visited in the past, used to quickly navigate complex directory structures
  • Awesome - A curated list of awesome lists
  • Bento - Links to tutorials based on subject (programming, sysadmin, protocols, standards, etc)
  • Checkpoint/Restore in Userspace (CRIU) - Freeze a process, save it to disk, then resume it later
  • conserver - Virtual console server with many features
  • Cygwin - GNU shell and tools for Windows
  • Deltacloud - API that abstracts the differences between clouds (AWS, OpenStack, etc)
  • dotfiles - Store your .bashrc and others on GitHub
  • dtrx - Single command to extract almost any type of archive, requires Python 2.4+
  • eatmemory - Allocates X amount of memory, great for testing
  • etckeeper - Stores /etc in version control
  • f.lux - Changes your screen from blue light to yellow light when the sun sets to tell your brain it's night time -- closed source
  • Filewatcher - Written in Ruby, monitors changes in the file system by polling
  • ForgeRock - Enterprise identification management and access (IAM)
  • FreeIPA - Identity, policy, and audit suite, think Active Directory for Linux
  • gcalcli - CLI for Google Calendar
  • Geocities-izer - Make any web page look like a Geocities page
  • grabmem - Allocates memory until the machine runs out or you quit it with ctrl-c
  • incrond - Fires off a job when a file system event happens
  • ISO 8601 - ISO standard for dates, the only way to fly
  • inotify - Watch file(s) for changes, take an action when the change occurs
  • inxi - "a full featured system information script" (hardware info, etc)
  • jq - Command line JSON processor
  • Keybase - Upload your public key and find other people's public key via their social media user name(s)
  • Let's Chat - Self-hosted open source HipChat clone
  • mockaroo - Generate up to 100,000 rows of realistic test data in CSV, JSON, SQL, and Excel formats
  • moreutils - "Collection of the unix tools that nobody thought to write long ago when unix was young"
  • Netflix OSS - Netflix OSS tools on GitHub
  • observr - Monitor a directory and kick off an action when a file in the directory changes
  • pigz - Parallel gzip for multi-processor/core systems
  • pv - Shows the progress of data as it flows through a pipe
  • Rackerlabs - Rackspace's OSS tools, hosted on GitHub
  • rcron - cron redundancy and failover, ensures a job will only run on the "active" machine
  • Request Tracker - Bug tracking, help desk ticketing, customer service, workflow processes, change management and more
  • supervisord - Process control, kinda like an init replacement but not really
  • Synergy - Share a single keyboard and mouse with multiple physical computers
  • sysadmin-util - A collection of small but useful utilities
  • Tools of the Trade - Massive list of SaaS, via Hacker News
  • watchr - Monitor a directory tree and kick off a script when a file changes, written in Ruby

About

No description, website, or topics provided.

Resources

Readme
Activity

Stars

0 stars

Watchers

1 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published